Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-06-17T20:16:39Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-06-17T20:16:39Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260617 20:16:39.881779 28631 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRePpQS/build/asan/bin/kudu
/tmp/dist-test-taskRePpQS/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.254:37301
--webserver_interface=127.27.245.254
--webserver_port=0
--builtin_ntp_servers=127.27.245.212:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260617 20:16:40.209003 28639 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 20:16:40.209328 28639 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 20:16:40.209453 28639 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 20:16:40.217948 28639 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260617 20:16:40.218034 28639 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 20:16:40.218091 28639 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 20:16:40.218138 28639 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 20:16:40.228673 28639 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.245.212:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.254:37301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.245.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 17 Jun 2026 19:49:13 UTC on bdcb31816ec0
build id 12442
ASAN enabled
I20260617 20:16:40.230418 28639 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 20:16:40.232180 28639 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 20:16:40.241096 28645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:40.241515 28644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:40.241569 28647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:40.242282 28639 server_base.cc:1061] running on GCE node
I20260617 20:16:40.243152 28639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 20:16:40.244632 28639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 20:16:40.245860 28639 hybrid_clock.cc:648] HybridClock initialized: now 1781727400245833 us; error 63 us; skew 500 ppm
I20260617 20:16:40.246235 28639 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 20:16:40.248426 28639 webserver.cc:533] Webserver started at http://127.27.245.254:40135/ using document root <none> and password file <none>
I20260617 20:16:40.249225 28639 fs_manager.cc:362] Metadata directory not provided
I20260617 20:16:40.249390 28639 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 20:16:40.249749 28639 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 20:16:40.252235 28639 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data/instance:
uuid: "590225c8ea36448093b77385d238a34a"
format_stamp: "Formatted at 2026-06-17 20:16:40 on dist-test-slave-dvcr"
I20260617 20:16:40.253041 28639 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal/instance:
uuid: "590225c8ea36448093b77385d238a34a"
format_stamp: "Formatted at 2026-06-17 20:16:40 on dist-test-slave-dvcr"
I20260617 20:16:40.258342 28639 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260617 20:16:40.261729 28653 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:40.263119 28639 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260617 20:16:40.263305 28639 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data,/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal
uuid: "590225c8ea36448093b77385d238a34a"
format_stamp: "Formatted at 2026-06-17 20:16:40 on dist-test-slave-dvcr"
I20260617 20:16:40.263515 28639 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 20:16:40.282747 28639 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 20:16:40.283638 28639 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 20:16:40.283963 28639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 20:16:40.303436 28639 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.254:37301
I20260617 20:16:40.303445 28704 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.254:37301 every 8 connection(s)
I20260617 20:16:40.304976 28639 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data/info.pb
I20260617 20:16:40.308360 28631 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRePpQS/build/asan/bin/kudu as pid 28639
I20260617 20:16:40.308674 28631 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal/instance
I20260617 20:16:40.310278 28705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:40.312129 28631 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRePpQS/build/asan/bin/kudu
/tmp/dist-test-taskRePpQS/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.253:38361
--webserver_interface=127.27.245.253
--webserver_port=0
--builtin_ntp_servers=127.27.245.212:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260617 20:16:40.318228 28705 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } has no permanent_uuid. Determining permanent_uuid...
I20260617 20:16:40.337921 28705 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } has no permanent_uuid. Determining permanent_uuid...
W20260617 20:16:40.339107 28657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.245.253:38361: connect: Connection refused (error 111)
W20260617 20:16:40.340689 28705 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.253:38361: Network error: Client connection negotiation failed: client connection to 127.27.245.253:38361: connect: Connection refused (error 111)
I20260617 20:16:40.390066 28705 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } attempt: 1
W20260617 20:16:40.392241 28705 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.253:38361: Network error: Client connection negotiation failed: client connection to 127.27.245.253:38361: connect: Connection refused (error 111)
I20260617 20:16:40.460559 28705 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } attempt: 2
W20260617 20:16:40.462785 28705 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.253:38361: Network error: Client connection negotiation failed: client connection to 127.27.245.253:38361: connect: Connection refused (error 111)
I20260617 20:16:40.554075 28705 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } attempt: 3
W20260617 20:16:40.556162 28705 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.253:38361: Network error: Client connection negotiation failed: client connection to 127.27.245.253:38361: connect: Connection refused (error 111)
W20260617 20:16:40.643288 28707 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 20:16:40.643604 28707 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 20:16:40.643764 28707 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 20:16:40.652601 28707 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260617 20:16:40.652699 28707 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 20:16:40.652791 28707 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 20:16:40.652856 28707 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 20:16:40.663370 28707 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.245.212:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.253:38361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.245.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 17 Jun 2026 19:49:13 UTC on bdcb31816ec0
build id 12442
ASAN enabled
I20260617 20:16:40.665081 28707 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 20:16:40.666990 28707 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 20:16:40.675585 28716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:40.675545 28715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:40.675562 28718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:40.676442 28707 server_base.cc:1061] running on GCE node
I20260617 20:16:40.677232 28707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 20:16:40.678565 28707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 20:16:40.679831 28707 hybrid_clock.cc:648] HybridClock initialized: now 1781727400679790 us; error 53 us; skew 500 ppm
I20260617 20:16:40.680222 28707 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 20:16:40.682337 28707 webserver.cc:533] Webserver started at http://127.27.245.253:44941/ using document root <none> and password file <none>
I20260617 20:16:40.683084 28707 fs_manager.cc:362] Metadata directory not provided
I20260617 20:16:40.683215 28707 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 20:16:40.683566 28707 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 20:16:40.685868 28707 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data/instance:
uuid: "87437cd320a4470fa0dedd43aa7ea3eb"
format_stamp: "Formatted at 2026-06-17 20:16:40 on dist-test-slave-dvcr"
I20260617 20:16:40.686606 28707 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal/instance:
uuid: "87437cd320a4470fa0dedd43aa7ea3eb"
format_stamp: "Formatted at 2026-06-17 20:16:40 on dist-test-slave-dvcr"
I20260617 20:16:40.691596 28707 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260617 20:16:40.694816 28724 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:40.696117 28707 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260617 20:16:40.696296 28707 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data,/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal
uuid: "87437cd320a4470fa0dedd43aa7ea3eb"
format_stamp: "Formatted at 2026-06-17 20:16:40 on dist-test-slave-dvcr"
I20260617 20:16:40.696501 28707 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 20:16:40.699427 28705 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } attempt: 4
W20260617 20:16:40.701364 28705 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.253:38361: Network error: Client connection negotiation failed: client connection to 127.27.245.253:38361: connect: Connection refused (error 111)
I20260617 20:16:40.714293 28707 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 20:16:40.715090 28707 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 20:16:40.715318 28707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 20:16:40.734761 28707 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.253:38361
I20260617 20:16:40.734786 28775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.253:38361 every 8 connection(s)
I20260617 20:16:40.736253 28707 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data/info.pb
I20260617 20:16:40.740289 28776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:40.741567 28631 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRePpQS/build/asan/bin/kudu as pid 28707
I20260617 20:16:40.741772 28631 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal/instance
I20260617 20:16:40.743144 28631 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRePpQS/build/asan/bin/kudu
/tmp/dist-test-taskRePpQS/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.252:46059
--webserver_interface=127.27.245.252
--webserver_port=0
--builtin_ntp_servers=127.27.245.212:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260617 20:16:40.748226 28776 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } has no permanent_uuid. Determining permanent_uuid...
I20260617 20:16:40.764492 28776 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } has no permanent_uuid. Determining permanent_uuid...
I20260617 20:16:40.773789 28776 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } has no permanent_uuid. Determining permanent_uuid...
W20260617 20:16:40.774968 28728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
W20260617 20:16:40.776593 28776 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.252:46059: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
I20260617 20:16:40.825906 28776 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } attempt: 1
W20260617 20:16:40.828038 28776 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.252:46059: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
I20260617 20:16:40.896250 28776 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } attempt: 2
W20260617 20:16:40.898280 28776 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.252:46059: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
I20260617 20:16:40.989503 28776 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } attempt: 3
W20260617 20:16:40.991988 28776 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.252:46059: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
I20260617 20:16:41.000636 28705 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } attempt: 5
I20260617 20:16:41.008421 28705 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } has no permanent_uuid. Determining permanent_uuid...
W20260617 20:16:41.010327 28705 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.252:46059: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
I20260617 20:16:41.061542 28705 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } attempt: 1
W20260617 20:16:41.064038 28705 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.252:46059: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
W20260617 20:16:41.089442 28778 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 20:16:41.089771 28778 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 20:16:41.089905 28778 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 20:16:41.098315 28778 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260617 20:16:41.098404 28778 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 20:16:41.098491 28778 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 20:16:41.098589 28778 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 20:16:41.108779 28778 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.245.212:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.252:46059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.245.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 17 Jun 2026 19:49:13 UTC on bdcb31816ec0
build id 12442
ASAN enabled
I20260617 20:16:41.110411 28778 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 20:16:41.112282 28778 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 20:16:41.120144 28786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:41.120180 28787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:41.120877 28789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:41.121433 28778 server_base.cc:1061] running on GCE node
I20260617 20:16:41.122160 28778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 20:16:41.123584 28778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 20:16:41.124810 28778 hybrid_clock.cc:648] HybridClock initialized: now 1781727401124770 us; error 33 us; skew 500 ppm
I20260617 20:16:41.125155 28778 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 20:16:41.127324 28778 webserver.cc:533] Webserver started at http://127.27.245.252:42219/ using document root <none> and password file <none>
I20260617 20:16:41.128074 28778 fs_manager.cc:362] Metadata directory not provided
I20260617 20:16:41.128209 28778 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 20:16:41.128579 28778 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 20:16:41.130980 28778 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data/instance:
uuid: "f5ea3f9265d84474ab3bced8dd5aecc5"
format_stamp: "Formatted at 2026-06-17 20:16:41 on dist-test-slave-dvcr"
I20260617 20:16:41.131831 28778 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal/instance:
uuid: "f5ea3f9265d84474ab3bced8dd5aecc5"
format_stamp: "Formatted at 2026-06-17 20:16:41 on dist-test-slave-dvcr"
I20260617 20:16:41.132277 28705 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } attempt: 2
W20260617 20:16:41.134174 28705 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.252:46059: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
I20260617 20:16:41.135217 28776 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } attempt: 4
W20260617 20:16:41.136925 28776 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.27.245.252:46059: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
I20260617 20:16:41.137933 28778 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260617 20:16:41.141438 28795 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:41.142807 28778 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260617 20:16:41.143030 28778 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data,/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal
uuid: "f5ea3f9265d84474ab3bced8dd5aecc5"
format_stamp: "Formatted at 2026-06-17 20:16:41 on dist-test-slave-dvcr"
I20260617 20:16:41.143249 28778 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 20:16:41.162259 28778 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 20:16:41.163123 28778 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 20:16:41.163414 28778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 20:16:41.183984 28778 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.252:46059
I20260617 20:16:41.184005 28846 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.252:46059 every 8 connection(s)
I20260617 20:16:41.185626 28778 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data/info.pb
I20260617 20:16:41.187611 28631 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRePpQS/build/asan/bin/kudu as pid 28778
I20260617 20:16:41.187786 28631 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal/instance
I20260617 20:16:41.191010 28847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:41.198910 28847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } has no permanent_uuid. Determining permanent_uuid...
I20260617 20:16:41.211717 28847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } has no permanent_uuid. Determining permanent_uuid...
I20260617 20:16:41.219540 28847 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } has no permanent_uuid. Determining permanent_uuid...
I20260617 20:16:41.231228 28847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Bootstrap starting.
I20260617 20:16:41.234576 28847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:41.235595 28847 log.cc:826] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Log is configured to *not* fsync() on all Append() calls
I20260617 20:16:41.238077 28847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: No bootstrap required, opened a new log
I20260617 20:16:41.240386 28705 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } attempt: 3
I20260617 20:16:41.244056 28847 raft_consensus.cc:359] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:41.244388 28847 raft_consensus.cc:385] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:41.244532 28847 raft_consensus.cc:740] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ea3f9265d84474ab3bced8dd5aecc5, State: Initialized, Role: FOLLOWER
I20260617 20:16:41.245218 28847 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:41.246281 28856 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:41.246628 28856 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:16:41.247361 28847 sys_catalog.cc:565] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260617 20:16:41.250674 28705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Bootstrap starting.
I20260617 20:16:41.254040 28705 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:41.255427 28705 log.cc:826] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Log is configured to *not* fsync() on all Append() calls
I20260617 20:16:41.258288 28705 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: No bootstrap required, opened a new log
W20260617 20:16:41.260016 28867 catalog_manager.cc:1593] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260617 20:16:41.260133 28867 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260617 20:16:41.256286 28778 master_runner.cc:187] Error getting master registration for 127.27.245.254:37301: OK, instance_id { permanent_uuid: "590225c8ea36448093b77385d238a34a" instance_seqno: 1781727400298383 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260617 20:16:41.262133 28778 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260617 20:16:41.265887 28705 raft_consensus.cc:359] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:41.266218 28705 raft_consensus.cc:385] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:41.266327 28705 raft_consensus.cc:740] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590225c8ea36448093b77385d238a34a, State: Initialized, Role: FOLLOWER
I20260617 20:16:41.267073 28705 consensus_queue.cc:260] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:41.268028 28870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:41.268322 28870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:16:41.269428 28705 sys_catalog.cc:565] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: configured and running, proceeding with master startup.
W20260617 20:16:41.280652 28881 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260617 20:16:41.280779 28881 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260617 20:16:41.280061 28639 master_runner.cc:187] Error getting master registration for 127.27.245.253:38361: OK, instance_id { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" instance_seqno: 1781727400729520 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
W20260617 20:16:41.286597 28659 tablet.cc:2406] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 20:16:41.286680 28639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260617 20:16:41.415836 28801 tablet.cc:2406] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 20:16:41.436157 28776 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } attempt: 5
I20260617 20:16:41.448418 28776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Bootstrap starting.
I20260617 20:16:41.452805 28776 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:41.454173 28776 log.cc:826] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Log is configured to *not* fsync() on all Append() calls
I20260617 20:16:41.458750 28776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: No bootstrap required, opened a new log
I20260617 20:16:41.466267 28776 raft_consensus.cc:359] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:41.466652 28776 raft_consensus.cc:385] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:41.466779 28776 raft_consensus.cc:740] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87437cd320a4470fa0dedd43aa7ea3eb, State: Initialized, Role: FOLLOWER
I20260617 20:16:41.467545 28776 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:41.468667 28884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:41.469055 28884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:16:41.470016 28776 sys_catalog.cc:565] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: configured and running, proceeding with master startup.
I20260617 20:16:41.486976 28707 master_runner.cc:264] No leader master found from master 87437cd320a4470fa0dedd43aa7ea3eb
I20260617 20:16:41.487113 28707 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
W20260617 20:16:41.492059 28895 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260617 20:16:41.492189 28895 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260617 20:16:41.551733 28870 raft_consensus.cc:493] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:41.552088 28870 raft_consensus.cc:515] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:41.554380 28870 leader_election.cc:290] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87437cd320a4470fa0dedd43aa7ea3eb (127.27.245.253:38361), f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059)
I20260617 20:16:41.555960 28822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "590225c8ea36448093b77385d238a34a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" is_pre_election: true
I20260617 20:16:41.555961 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "590225c8ea36448093b77385d238a34a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" is_pre_election: true
I20260617 20:16:41.556468 28822 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590225c8ea36448093b77385d238a34a in term 0.
I20260617 20:16:41.556492 28751 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590225c8ea36448093b77385d238a34a in term 0.
I20260617 20:16:41.557263 28657 leader_election.cc:304] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590225c8ea36448093b77385d238a34a, f5ea3f9265d84474ab3bced8dd5aecc5; no voters:
I20260617 20:16:41.558467 28870 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:41.558632 28870 raft_consensus.cc:493] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:41.558740 28870 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:41.561983 28870 raft_consensus.cc:515] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:41.563153 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "590225c8ea36448093b77385d238a34a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87437cd320a4470fa0dedd43aa7ea3eb"
I20260617 20:16:41.563375 28751 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:41.563546 28822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "590225c8ea36448093b77385d238a34a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5"
I20260617 20:16:41.563753 28822 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:41.566746 28751 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590225c8ea36448093b77385d238a34a in term 1.
I20260617 20:16:41.566993 28822 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590225c8ea36448093b77385d238a34a in term 1.
I20260617 20:16:41.567417 28657 leader_election.cc:304] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590225c8ea36448093b77385d238a34a, 87437cd320a4470fa0dedd43aa7ea3eb; no voters:
I20260617 20:16:41.569053 28870 leader_election.cc:290] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [CANDIDATE]: Term 1 election: Requested vote from peers 87437cd320a4470fa0dedd43aa7ea3eb (127.27.245.253:38361), f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059)
I20260617 20:16:41.569501 28870 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:41.569950 28870 raft_consensus.cc:697] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [term 1 LEADER]: Becoming Leader. State: Replica: 590225c8ea36448093b77385d238a34a, State: Running, Role: LEADER
I20260617 20:16:41.570796 28870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:41.590935 28897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 590225c8ea36448093b77385d238a34a. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:41.591307 28897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: This master's current role is: LEADER
I20260617 20:16:41.600037 28899 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260617 20:16:41.602886 28899 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260617 20:16:41.624032 28822 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Refusing update from remote peer 590225c8ea36448093b77385d238a34a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:41.625360 28897 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:41.630666 28751 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Refusing update from remote peer 590225c8ea36448093b77385d238a34a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:41.632651 28897 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [LEADER]: Connected to new peer: Peer: permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:41.658419 28884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 590225c8ea36448093b77385d238a34a. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:41.658778 28884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:16:41.662757 28900 mvcc.cc:204] Tried to move back new op lower bound from 7297955437038358528 to 7297955436846309376. Current Snapshot: MvccSnapshot[applied={T|T < 7297955437038358528}]
I20260617 20:16:41.663417 28856 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 590225c8ea36448093b77385d238a34a. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:41.663683 28856 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:16:41.665987 28902 mvcc.cc:204] Tried to move back new op lower bound from 7297955437038358528 to 7297955436846309376. Current Snapshot: MvccSnapshot[applied={T|T < 7297955437038358528}]
I20260617 20:16:41.667623 28901 mvcc.cc:204] Tried to move back new op lower bound from 7297955437038358528 to 7297955436846309376. Current Snapshot: MvccSnapshot[applied={T|T < 7297955437038358528}]
I20260617 20:16:41.671335 28884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:41.671578 28884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:16:41.672951 28856 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:41.673208 28856 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:16:41.681926 28870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:41.682684 28870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: This master's current role is: LEADER
I20260617 20:16:41.683271 28870 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:41.683625 28870 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: This master's current role is: LEADER
I20260617 20:16:41.689851 28899 catalog_manager.cc:1382] Generated new cluster ID: 46a5ac7d37d748d69d2d5bbcb74d8c61
I20260617 20:16:41.690003 28899 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260617 20:16:41.737848 28899 catalog_manager.cc:1405] Generated new certificate authority record
I20260617 20:16:41.739697 28899 catalog_manager.cc:1539] Loading token signing keys...
I20260617 20:16:41.763494 28899 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Generated new TSK 0
I20260617 20:16:41.768146 28899 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260617 20:16:41.801834 28631 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRePpQS/build/asan/bin/kudu
/tmp/dist-test-taskRePpQS/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.245.193:0
--local_ip_for_outbound_sockets=127.27.245.193
--webserver_interface=127.27.245.193
--webserver_port=0
--tserver_master_addrs=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--builtin_ntp_servers=127.27.245.212:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260617 20:16:42.135098 28908 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 20:16:42.135499 28908 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 20:16:42.135658 28908 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 20:16:42.144444 28908 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 20:16:42.144693 28908 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.245.193
I20260617 20:16:42.155303 28908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.245.212:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.245.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.27.245.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.245.193
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 17 Jun 2026 19:49:13 UTC on bdcb31816ec0
build id 12442
ASAN enabled
I20260617 20:16:42.156984 28908 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 20:16:42.158978 28908 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 20:16:42.168324 28913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:42.168419 28914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:42.169637 28908 server_base.cc:1061] running on GCE node
W20260617 20:16:42.169819 28916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:42.170761 28908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 20:16:42.171882 28908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 20:16:42.173143 28908 hybrid_clock.cc:648] HybridClock initialized: now 1781727402173078 us; error 45 us; skew 500 ppm
I20260617 20:16:42.173521 28908 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 20:16:42.175886 28908 webserver.cc:533] Webserver started at http://127.27.245.193:35523/ using document root <none> and password file <none>
I20260617 20:16:42.176652 28908 fs_manager.cc:362] Metadata directory not provided
I20260617 20:16:42.176786 28908 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 20:16:42.177131 28908 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 20:16:42.179553 28908 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/data/instance:
uuid: "5ca3d93189744132bbf55ac01f3a8254"
format_stamp: "Formatted at 2026-06-17 20:16:42 on dist-test-slave-dvcr"
I20260617 20:16:42.180316 28908 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/instance:
uuid: "5ca3d93189744132bbf55ac01f3a8254"
format_stamp: "Formatted at 2026-06-17 20:16:42 on dist-test-slave-dvcr"
I20260617 20:16:42.185843 28908 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260617 20:16:42.189174 28922 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:42.190721 28908 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260617 20:16:42.190939 28908 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/data,/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal
uuid: "5ca3d93189744132bbf55ac01f3a8254"
format_stamp: "Formatted at 2026-06-17 20:16:42 on dist-test-slave-dvcr"
I20260617 20:16:42.191184 28908 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 20:16:42.210525 28908 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 20:16:42.211459 28908 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 20:16:42.211774 28908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 20:16:42.212765 28908 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260617 20:16:42.214749 28908 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260617 20:16:42.214883 28908 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:42.215026 28908 ts_tablet_manager.cc:616] Registered 0 tablets
I20260617 20:16:42.215119 28908 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:42.250782 28908 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.193:38317
I20260617 20:16:42.250921 29034 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.193:38317 every 8 connection(s)
I20260617 20:16:42.252434 28908 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/data/info.pb
I20260617 20:16:42.261057 28631 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRePpQS/build/asan/bin/kudu as pid 28908
I20260617 20:16:42.261334 28631 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/instance
I20260617 20:16:42.262473 28867 catalog_manager.cc:1294] Loaded cluster ID: 46a5ac7d37d748d69d2d5bbcb74d8c61
I20260617 20:16:42.262565 28867 catalog_manager.cc:1587] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: loading cluster ID for follower catalog manager: success
I20260617 20:16:42.266727 28867 catalog_manager.cc:1609] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: acquiring CA information for follower catalog manager: success
I20260617 20:16:42.266811 28631 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRePpQS/build/asan/bin/kudu
/tmp/dist-test-taskRePpQS/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.245.194:0
--local_ip_for_outbound_sockets=127.27.245.194
--webserver_interface=127.27.245.194
--webserver_port=0
--tserver_master_addrs=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--builtin_ntp_servers=127.27.245.212:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260617 20:16:42.269631 28867 catalog_manager.cc:1637] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260617 20:16:42.271379 29037 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:16:42.271730 29045 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590225c8ea36448093b77385d238a34a)
I20260617 20:16:42.271948 29045 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:42.272104 29037 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:42.273248 29037 heartbeater.cc:507] Master 127.27.245.253:38361 requested a full tablet report, sending...
I20260617 20:16:42.273454 29045 leader_election.cc:290] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059)
I20260617 20:16:42.274343 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "590225c8ea36448093b77385d238a34a" is_pre_election: true
I20260617 20:16:42.275728 28741 ts_manager.cc:194] Registered new tserver with Master: 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:42.276361 28822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" is_pre_election: true
I20260617 20:16:42.276993 28728 leader_election.cc:304] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87437cd320a4470fa0dedd43aa7ea3eb; no voters: 590225c8ea36448093b77385d238a34a, f5ea3f9265d84474ab3bced8dd5aecc5
I20260617 20:16:42.278764 29045 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:16:42.279793 29036 heartbeater.cc:344] Connected to a master server at 127.27.245.254:37301
I20260617 20:16:42.279930 29036 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:42.280377 29036 heartbeater.cc:507] Master 127.27.245.254:37301 requested a full tablet report, sending...
I20260617 20:16:42.281764 29035 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:42.281926 29035 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:42.282027 28670 ts_manager.cc:194] Registered new tserver with Master: 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:42.282413 29035 heartbeater.cc:507] Master 127.27.245.252:46059 requested a full tablet report, sending...
I20260617 20:16:42.284025 28670 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.245.193:34505
I20260617 20:16:42.284219 28812 ts_manager.cc:194] Registered new tserver with Master: 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:42.494055 28895 catalog_manager.cc:1294] Loaded cluster ID: 46a5ac7d37d748d69d2d5bbcb74d8c61
I20260617 20:16:42.494148 28895 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: loading cluster ID for follower catalog manager: success
I20260617 20:16:42.496794 28895 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: acquiring CA information for follower catalog manager: success
I20260617 20:16:42.498565 28895 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260617 20:16:42.609587 29046 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 20:16:42.609982 29046 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 20:16:42.610141 29046 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 20:16:42.619045 29046 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 20:16:42.619303 29046 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.245.194
I20260617 20:16:42.629827 29046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.245.212:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.245.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.27.245.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.245.194
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 17 Jun 2026 19:49:13 UTC on bdcb31816ec0
build id 12442
ASAN enabled
I20260617 20:16:42.631556 29046 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 20:16:42.633880 29046 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 20:16:42.644012 29051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:42.644093 29052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:42.645836 29046 server_base.cc:1061] running on GCE node
W20260617 20:16:42.645897 29054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:42.646543 29046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 20:16:42.647509 29046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 20:16:42.648764 29046 hybrid_clock.cc:648] HybridClock initialized: now 1781727402648673 us; error 60 us; skew 500 ppm
I20260617 20:16:42.649230 29046 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 20:16:42.651724 29046 webserver.cc:533] Webserver started at http://127.27.245.194:42475/ using document root <none> and password file <none>
I20260617 20:16:42.652595 29046 fs_manager.cc:362] Metadata directory not provided
I20260617 20:16:42.652691 29046 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 20:16:42.653018 29046 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 20:16:42.655668 29046 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/data/instance:
uuid: "6d4ce30e1fce4591b64c398747f8d37a"
format_stamp: "Formatted at 2026-06-17 20:16:42 on dist-test-slave-dvcr"
I20260617 20:16:42.656533 29046 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/instance:
uuid: "6d4ce30e1fce4591b64c398747f8d37a"
format_stamp: "Formatted at 2026-06-17 20:16:42 on dist-test-slave-dvcr"
I20260617 20:16:42.662220 29046 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260617 20:16:42.665557 29060 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:42.666977 29046 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260617 20:16:42.667171 29046 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/data,/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal
uuid: "6d4ce30e1fce4591b64c398747f8d37a"
format_stamp: "Formatted at 2026-06-17 20:16:42 on dist-test-slave-dvcr"
I20260617 20:16:42.667380 29046 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 20:16:42.691280 29046 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 20:16:42.692134 29046 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 20:16:42.692396 29046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 20:16:42.693365 29046 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260617 20:16:42.695073 29046 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260617 20:16:42.695158 29046 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:42.695284 29046 ts_tablet_manager.cc:616] Registered 0 tablets
I20260617 20:16:42.695379 29046 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:42.729537 29046 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.194:41833
I20260617 20:16:42.729620 29172 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.194:41833 every 8 connection(s)
I20260617 20:16:42.731137 29046 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/data/info.pb
I20260617 20:16:42.740587 28631 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRePpQS/build/asan/bin/kudu as pid 29046
I20260617 20:16:42.740782 28631 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/instance
I20260617 20:16:42.746780 28631 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRePpQS/build/asan/bin/kudu
/tmp/dist-test-taskRePpQS/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.27.245.195:0
--local_ip_for_outbound_sockets=127.27.245.195
--webserver_interface=127.27.245.195
--webserver_port=0
--tserver_master_addrs=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--builtin_ntp_servers=127.27.245.212:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260617 20:16:42.750897 29175 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:16:42.751259 29175 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:42.752331 29175 heartbeater.cc:507] Master 127.27.245.253:38361 requested a full tablet report, sending...
I20260617 20:16:42.754352 28741 ts_manager.cc:194] Registered new tserver with Master: 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:42.755192 29174 heartbeater.cc:344] Connected to a master server at 127.27.245.254:37301
I20260617 20:16:42.755313 29174 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:42.755821 29174 heartbeater.cc:507] Master 127.27.245.254:37301 requested a full tablet report, sending...
I20260617 20:16:42.756855 28670 ts_manager.cc:194] Registered new tserver with Master: 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:42.757943 28670 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.245.194:51601
I20260617 20:16:42.758601 29173 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:42.758701 29173 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:42.759140 29173 heartbeater.cc:507] Master 127.27.245.252:46059 requested a full tablet report, sending...
I20260617 20:16:42.760318 28812 ts_manager.cc:194] Registered new tserver with Master: 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:42.786643 29036 heartbeater.cc:499] Master 127.27.245.254:37301 was elected leader, sending a full tablet report...
I20260617 20:16:42.829704 29181 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590225c8ea36448093b77385d238a34a)
I20260617 20:16:42.829952 29181 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:42.830613 29181 leader_election.cc:290] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059)
I20260617 20:16:42.831248 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "590225c8ea36448093b77385d238a34a" is_pre_election: true
I20260617 20:16:42.831290 28822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" is_pre_election: true
I20260617 20:16:42.831935 28728 leader_election.cc:304] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87437cd320a4470fa0dedd43aa7ea3eb; no voters: 590225c8ea36448093b77385d238a34a, f5ea3f9265d84474ab3bced8dd5aecc5
I20260617 20:16:42.832216 29181 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260617 20:16:43.086170 29180 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 20:16:43.086484 29180 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 20:16:43.086567 29180 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 20:16:43.095166 29180 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 20:16:43.095343 29180 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.27.245.195
I20260617 20:16:43.105743 29180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.245.212:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.27.245.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.27.245.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.27.245.195
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 17 Jun 2026 19:49:13 UTC on bdcb31816ec0
build id 12442
ASAN enabled
I20260617 20:16:43.107306 29180 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 20:16:43.109321 29180 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260617 20:16:43.118577 29186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:43.118748 29187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:43.118777 29189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:43.120227 29180 server_base.cc:1061] running on GCE node
I20260617 20:16:43.120832 29180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 20:16:43.121909 29180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 20:16:43.123176 29180 hybrid_clock.cc:648] HybridClock initialized: now 1781727403123120 us; error 45 us; skew 500 ppm
I20260617 20:16:43.123510 29180 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 20:16:43.125770 29180 webserver.cc:533] Webserver started at http://127.27.245.195:36299/ using document root <none> and password file <none>
I20260617 20:16:43.126541 29180 fs_manager.cc:362] Metadata directory not provided
I20260617 20:16:43.126677 29180 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 20:16:43.127029 29180 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260617 20:16:43.129495 29180 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/data/instance:
uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
format_stamp: "Formatted at 2026-06-17 20:16:43 on dist-test-slave-dvcr"
I20260617 20:16:43.130293 29180 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/instance:
uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
format_stamp: "Formatted at 2026-06-17 20:16:43 on dist-test-slave-dvcr"
I20260617 20:16:43.135557 29180 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260617 20:16:43.139070 29195 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:43.140501 29180 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260617 20:16:43.140707 29180 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/data,/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal
uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
format_stamp: "Formatted at 2026-06-17 20:16:43 on dist-test-slave-dvcr"
I20260617 20:16:43.140964 29180 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 20:16:43.165920 29180 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 20:16:43.166926 29180 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 20:16:43.167464 29180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 20:16:43.168625 29180 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260617 20:16:43.170547 29180 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260617 20:16:43.170670 29180 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:43.170805 29180 ts_tablet_manager.cc:616] Registered 0 tablets
I20260617 20:16:43.170948 29180 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:43.210165 29180 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.195:45189
I20260617 20:16:43.210253 29307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.195:45189 every 8 connection(s)
I20260617 20:16:43.211639 29180 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/data/info.pb
I20260617 20:16:43.220584 28631 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRePpQS/build/asan/bin/kudu as pid 29180
I20260617 20:16:43.220795 28631 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/instance
I20260617 20:16:43.227924 29310 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:16:43.228035 29309 heartbeater.cc:344] Connected to a master server at 127.27.245.254:37301
I20260617 20:16:43.228070 29308 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:43.228416 29309 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:43.228410 29310 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:43.228410 29308 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:43.229701 29309 heartbeater.cc:507] Master 127.27.245.254:37301 requested a full tablet report, sending...
I20260617 20:16:43.229763 29310 heartbeater.cc:507] Master 127.27.245.253:38361 requested a full tablet report, sending...
I20260617 20:16:43.229876 29308 heartbeater.cc:507] Master 127.27.245.252:46059 requested a full tablet report, sending...
I20260617 20:16:43.231560 28812 ts_manager.cc:194] Registered new tserver with Master: a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:43.231585 28741 ts_manager.cc:194] Registered new tserver with Master: a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:43.232126 28670 ts_manager.cc:194] Registered new tserver with Master: a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:43.232966 28670 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.27.245.195:55493
I20260617 20:16:43.247591 28631 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260617 20:16:43.261454 29174 heartbeater.cc:499] Master 127.27.245.254:37301 was elected leader, sending a full tablet report...
I20260617 20:16:43.279441 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0fe0f22560934821b3f63f9385793c57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.279434 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f54293907a8e4f93a0d2dc015eda4376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.281128 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fe0f22560934821b3f63f9385793c57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:43.281172 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f54293907a8e4f93a0d2dc015eda4376 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.282492 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c3d305689680416bad8847dd921e1a94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.283113 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3d305689680416bad8847dd921e1a94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.286980 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_bd049c0ed3fa40e99bfcdceff6842be6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.287776 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd049c0ed3fa40e99bfcdceff6842be6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.291574 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ae2c57ccdbb24219a781cf46489485d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.292303 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae2c57ccdbb24219a781cf46489485d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.292588 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_87c4fdebf4f24b5aabd1a274ecd1d005"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.293762 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87c4fdebf4f24b5aabd1a274ecd1d005 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.294948 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2aff49df5853489380e2e98e4b4e3136"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.295641 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2aff49df5853489380e2e98e4b4e3136 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.295439 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e294d2f29d224d2d91c1d64901ccb8db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.295642 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b67aea11857c4eac91427f845b772571"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.296241 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e294d2f29d224d2d91c1d64901ccb8db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:43.296458 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b67aea11857c4eac91427f845b772571 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.297123 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_421f6bf3dab14ec58437bc887fb7b191"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.298516 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_421f6bf3dab14ec58437bc887fb7b191 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.357111 28631 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRePpQS/build/asan/bin/kudu pid 28778
I20260617 20:16:43.358537 28842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260617 20:16:43.383437 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f54293907a8e4f93a0d2dc015eda4376" } new_table_name: "default.Table_f2c395a0432b4290a5b96c05ac1587c1" modify_external_catalogs: true
I20260617 20:16:43.383637 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e294d2f29d224d2d91c1d64901ccb8db" } modify_external_catalogs: true
I20260617 20:16:43.383857 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e294d2f29d224d2d91c1d64901ccb8db" } modify_external_catalogs: true
I20260617 20:16:43.383463 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0fe0f22560934821b3f63f9385793c57" } new_table_name: "default.Table_c7b7e3bd549f44f897eb7364a000c40e" modify_external_catalogs: true
I20260617 20:16:43.384079 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bd049c0ed3fa40e99bfcdceff6842be6" } new_table_name: "default.Table_790a35cc325041b987a0185f1f3044a6" modify_external_catalogs: true
I20260617 20:16:43.385051 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2aff49df5853489380e2e98e4b4e3136" } modify_external_catalogs: true
I20260617 20:16:43.385319 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2aff49df5853489380e2e98e4b4e3136" } modify_external_catalogs: true
I20260617 20:16:43.387980 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_87c4fdebf4f24b5aabd1a274ecd1d005" } modify_external_catalogs: true
I20260617 20:16:43.388154 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c3d305689680416bad8847dd921e1a94" } new_table_name: "default.Table_bc35f27ad56b4a8fbed488c27162dcd1" modify_external_catalogs: true
I20260617 20:16:43.388198 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_87c4fdebf4f24b5aabd1a274ecd1d005" } modify_external_catalogs: true
I20260617 20:16:43.389003 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_421f6bf3dab14ec58437bc887fb7b191" } modify_external_catalogs: true
I20260617 20:16:43.389209 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_421f6bf3dab14ec58437bc887fb7b191" } modify_external_catalogs: true
I20260617 20:16:43.389583 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ae2c57ccdbb24219a781cf46489485d9" } new_table_name: "default.Table_735760b562bd4aa59a5b6512879b2b6c" modify_external_catalogs: true
I20260617 20:16:43.388774 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b67aea11857c4eac91427f845b772571" } modify_external_catalogs: true
I20260617 20:16:43.390686 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b67aea11857c4eac91427f845b772571" } modify_external_catalogs: true
W20260617 20:16:43.403119 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d6af4b98fcb4161b7432280605224d9 has no consensus state
W20260617 20:16:43.403618 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ae50375e5934acbb213379fb7c87989 has no consensus state
W20260617 20:16:43.404331 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52d25188917845a28a926274976cbaf4 has no consensus state
W20260617 20:16:43.404708 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b5ddb72dae9345febe2a9a53bc2d89f6 has no consensus state
W20260617 20:16:43.407902 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 02cea5d29e8b4c209515bc05be7a6324 consensus state has no leader
W20260617 20:16:43.430536 28657 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 3ae50375e5934acbb213379fb7c87989 (table default.Table_735760b562bd4aa59a5b6512879b2b6c [id=d70c3654e0c4417e9ff68be4309793ba], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3ae50375e5934acbb213379fb7c87989 consensus state has no leader
I20260617 20:16:43.443832 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 0ba4e3bc4a2e40319e4da6ee04807bf6
I20260617 20:16:43.445353 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3bff8e928b534201bac3c1d27878535f
I20260617 20:16:43.445443 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 42aeede5da974652898bccc8e0a38bce
I20260617 20:16:43.446101 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 45399615180643949e95189457f6b923
I20260617 20:16:43.447116 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet ba383035d6f94f1686f6f1dfd10a974d
I20260617 20:16:43.472711 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae50375e5934acbb213379fb7c87989 (DEFAULT_TABLE table=default.Table_735760b562bd4aa59a5b6512879b2b6c [id=d70c3654e0c4417e9ff68be4309793ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.473474 29103 tablet_service.cc:1511] Processing CreateTablet for tablet 45399615180643949e95189457f6b923 (DEFAULT_TABLE table=default.Table_2aff49df5853489380e2e98e4b4e3136 [id=5cbd1fda6d4a4150a1bb9d05f74c7d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.472837 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6af4b98fcb4161b7432280605224d9 (DEFAULT_TABLE table=default.Table_790a35cc325041b987a0185f1f3044a6 [id=c4b8f5740cdf4cc7912c732a21e3b13d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.474289 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 42aeede5da974652898bccc8e0a38bce (DEFAULT_TABLE table=default.Table_421f6bf3dab14ec58437bc887fb7b191 [id=eb811592c47c4ad695a19baf0cc91349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.474342 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 (DEFAULT_TABLE table=default.Table_e294d2f29d224d2d91c1d64901ccb8db [id=aec20b3f1911426694e0588bfd2ac962]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.475126 29105 tablet_service.cc:1511] Processing CreateTablet for tablet b5ddb72dae9345febe2a9a53bc2d89f6 (DEFAULT_TABLE table=default.Table_c7b7e3bd549f44f897eb7364a000c40e [id=83c5102e80914ce69636ef845c3bad3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.476397 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 02cea5d29e8b4c209515bc05be7a6324 (DEFAULT_TABLE table=default.Table_f2c395a0432b4290a5b96c05ac1587c1 [id=727864a195db4e4585240fb48a508df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.475590 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bff8e928b534201bac3c1d27878535f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.477084 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45399615180643949e95189457f6b923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.476995 28966 tablet_service.cc:1511] Processing CreateTablet for tablet ba383035d6f94f1686f6f1dfd10a974d (DEFAULT_TABLE table=default.Table_b67aea11857c4eac91427f845b772571 [id=291a4589243443078220d3cd9940a63d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.477481 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 3bff8e928b534201bac3c1d27878535f (DEFAULT_TABLE table=default.Table_87c4fdebf4f24b5aabd1a274ecd1d005 [id=7e09804e39894310ba5f841e3921d0c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.477931 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6af4b98fcb4161b7432280605224d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.479249 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 42aeede5da974652898bccc8e0a38bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.479586 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 02cea5d29e8b4c209515bc05be7a6324 (DEFAULT_TABLE table=default.Table_f2c395a0432b4290a5b96c05ac1587c1 [id=727864a195db4e4585240fb48a508df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.480019 29104 tablet_service.cc:1511] Processing CreateTablet for tablet ba383035d6f94f1686f6f1dfd10a974d (DEFAULT_TABLE table=default.Table_b67aea11857c4eac91427f845b772571 [id=291a4589243443078220d3cd9940a63d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.480441 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 52d25188917845a28a926274976cbaf4 (DEFAULT_TABLE table=default.Table_bc35f27ad56b4a8fbed488c27162dcd1 [id=9439537fd882414f94ec8dd957bbd86e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.480870 29098 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.481089 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 45399615180643949e95189457f6b923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.481319 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet ba383035d6f94f1686f6f1dfd10a974d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.481452 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bff8e928b534201bac3c1d27878535f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.483331 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42aeede5da974652898bccc8e0a38bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.483320 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 42aeede5da974652898bccc8e0a38bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.485186 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.485447 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d25188917845a28a926274976cbaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.486048 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet ba383035d6f94f1686f6f1dfd10a974d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.486079 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 (DEFAULT_TABLE table=default.Table_e294d2f29d224d2d91c1d64901ccb8db [id=aec20b3f1911426694e0588bfd2ac962]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.486761 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02cea5d29e8b4c209515bc05be7a6324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.487385 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.487838 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba383035d6f94f1686f6f1dfd10a974d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.487430 29243 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 (DEFAULT_TABLE table=default.Table_e294d2f29d224d2d91c1d64901ccb8db [id=aec20b3f1911426694e0588bfd2ac962]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.489531 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 45399615180643949e95189457f6b923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.489872 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 52d25188917845a28a926274976cbaf4 (DEFAULT_TABLE table=default.Table_bc35f27ad56b4a8fbed488c27162dcd1 [id=9439537fd882414f94ec8dd957bbd86e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.490567 29239 tablet_service.cc:1511] Processing CreateTablet for tablet ba383035d6f94f1686f6f1dfd10a974d (DEFAULT_TABLE table=default.Table_b67aea11857c4eac91427f845b772571 [id=291a4589243443078220d3cd9940a63d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.491168 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 3bff8e928b534201bac3c1d27878535f (DEFAULT_TABLE table=default.Table_87c4fdebf4f24b5aabd1a274ecd1d005 [id=7e09804e39894310ba5f841e3921d0c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.491775 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6af4b98fcb4161b7432280605224d9 (DEFAULT_TABLE table=default.Table_790a35cc325041b987a0185f1f3044a6 [id=c4b8f5740cdf4cc7912c732a21e3b13d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.492408 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae50375e5934acbb213379fb7c87989 (DEFAULT_TABLE table=default.Table_735760b562bd4aa59a5b6512879b2b6c [id=d70c3654e0c4417e9ff68be4309793ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.493021 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 42aeede5da974652898bccc8e0a38bce (DEFAULT_TABLE table=default.Table_421f6bf3dab14ec58437bc887fb7b191 [id=eb811592c47c4ad695a19baf0cc91349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.493652 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 45399615180643949e95189457f6b923 (DEFAULT_TABLE table=default.Table_2aff49df5853489380e2e98e4b4e3136 [id=5cbd1fda6d4a4150a1bb9d05f74c7d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.494234 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 02cea5d29e8b4c209515bc05be7a6324 (DEFAULT_TABLE table=default.Table_f2c395a0432b4290a5b96c05ac1587c1 [id=727864a195db4e4585240fb48a508df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.494843 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bff8e928b534201bac3c1d27878535f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.495260 29240 tablet_service.cc:1511] Processing CreateTablet for tablet b5ddb72dae9345febe2a9a53bc2d89f6 (DEFAULT_TABLE table=default.Table_c7b7e3bd549f44f897eb7364a000c40e [id=83c5102e80914ce69636ef845c3bad3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.495779 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae50375e5934acbb213379fb7c87989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.498945 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.499125 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:43.500183 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 42aeede5da974652898bccc8e0a38bce because the tablet was not found. No further retry: Not found: Tablet not found: 42aeede5da974652898bccc8e0a38bce
W20260617 20:16:43.501013 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 because the tablet was not found. No further retry: Not found: Tablet not found: 0ba4e3bc4a2e40319e4da6ee04807bf6
W20260617 20:16:43.501588 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet ba383035d6f94f1686f6f1dfd10a974d because the tablet was not found. No further retry: Not found: Tablet not found: ba383035d6f94f1686f6f1dfd10a974d
W20260617 20:16:43.502096 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 45399615180643949e95189457f6b923 because the tablet was not found. No further retry: Not found: Tablet not found: 45399615180643949e95189457f6b923
W20260617 20:16:43.502640 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3bff8e928b534201bac3c1d27878535f because the tablet was not found. No further retry: Not found: Tablet not found: 3bff8e928b534201bac3c1d27878535f
I20260617 20:16:43.497975 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 42aeede5da974652898bccc8e0a38bce (DEFAULT_TABLE table=default.Table_421f6bf3dab14ec58437bc887fb7b191 [id=eb811592c47c4ad695a19baf0cc91349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.503161 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bff8e928b534201bac3c1d27878535f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.503501 28964 tablet_service.cc:1511] Processing CreateTablet for tablet 52d25188917845a28a926274976cbaf4 (DEFAULT_TABLE table=default.Table_bc35f27ad56b4a8fbed488c27162dcd1 [id=9439537fd882414f94ec8dd957bbd86e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.504053 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02cea5d29e8b4c209515bc05be7a6324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.504396 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42aeede5da974652898bccc8e0a38bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.504437 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 45399615180643949e95189457f6b923 (DEFAULT_TABLE table=default.Table_2aff49df5853489380e2e98e4b4e3136 [id=5cbd1fda6d4a4150a1bb9d05f74c7d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.504678 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d25188917845a28a926274976cbaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.504930 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45399615180643949e95189457f6b923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.505505 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45399615180643949e95189457f6b923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.506062 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6af4b98fcb4161b7432280605224d9 (DEFAULT_TABLE table=default.Table_790a35cc325041b987a0185f1f3044a6 [id=c4b8f5740cdf4cc7912c732a21e3b13d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.506171 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6af4b98fcb4161b7432280605224d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.506567 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6af4b98fcb4161b7432280605224d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.506839 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae50375e5934acbb213379fb7c87989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.507418 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba383035d6f94f1686f6f1dfd10a974d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.507659 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba383035d6f94f1686f6f1dfd10a974d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.507987 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02cea5d29e8b4c209515bc05be7a6324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.508551 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42aeede5da974652898bccc8e0a38bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.508534 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 3bff8e928b534201bac3c1d27878535f (DEFAULT_TABLE table=default.Table_87c4fdebf4f24b5aabd1a274ecd1d005 [id=7e09804e39894310ba5f841e3921d0c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.509087 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bff8e928b534201bac3c1d27878535f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.509193 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d25188917845a28a926274976cbaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.509784 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ddb72dae9345febe2a9a53bc2d89f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.509938 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 42aeede5da974652898bccc8e0a38bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.510645 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.510928 28959 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bff8e928b534201bac3c1d27878535f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.511157 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 45399615180643949e95189457f6b923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.511387 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet ba383035d6f94f1686f6f1dfd10a974d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.512252 28967 tablet_service.cc:1511] Processing CreateTablet for tablet b5ddb72dae9345febe2a9a53bc2d89f6 (DEFAULT_TABLE table=default.Table_c7b7e3bd549f44f897eb7364a000c40e [id=83c5102e80914ce69636ef845c3bad3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.512790 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ddb72dae9345febe2a9a53bc2d89f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.517736 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 3ae50375e5934acbb213379fb7c87989 (DEFAULT_TABLE table=default.Table_735760b562bd4aa59a5b6512879b2b6c [id=d70c3654e0c4417e9ff68be4309793ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.518318 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ae50375e5934acbb213379fb7c87989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.538059 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ddb72dae9345febe2a9a53bc2d89f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.543838 28631 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRePpQS/build/asan/bin/kudu with pid 28778
W20260617 20:16:43.551528 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3bff8e928b534201bac3c1d27878535f because the tablet was not found. No further retry: Not found: Tablet not found: 3bff8e928b534201bac3c1d27878535f
W20260617 20:16:43.551841 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 42aeede5da974652898bccc8e0a38bce because the tablet was not found. No further retry: Not found: Tablet not found: 42aeede5da974652898bccc8e0a38bce
W20260617 20:16:43.553949 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 because the tablet was not found. No further retry: Not found: Tablet not found: 0ba4e3bc4a2e40319e4da6ee04807bf6
W20260617 20:16:43.554253 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 45399615180643949e95189457f6b923 because the tablet was not found. No further retry: Not found: Tablet not found: 45399615180643949e95189457f6b923
W20260617 20:16:43.554445 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet ba383035d6f94f1686f6f1dfd10a974d because the tablet was not found. No further retry: Not found: Tablet not found: ba383035d6f94f1686f6f1dfd10a974d
I20260617 20:16:43.567618 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c0b49bddc6014a769317c2ecc24f9bfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.567819 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d17e64a2c92e46a8b0a7f133253239bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.568296 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0b49bddc6014a769317c2ecc24f9bfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:43.568388 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d17e64a2c92e46a8b0a7f133253239bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.569581 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3f3b8288030e40df8c1ea401e3a60e49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.570096 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f3b8288030e40df8c1ea401e3a60e49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.579171 29379 tablet_bootstrap.cc:492] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:43.590601 29379 tablet_bootstrap.cc:654] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.592084 29379 log.cc:826] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: Log is configured to *not* fsync() on all Append() calls
I20260617 20:16:43.598174 28968 tablet_service.cc:1511] Processing CreateTablet for tablet df72757ce3cd4651987bfb29dd8be77d (DEFAULT_TABLE table=default.Table_d17e64a2c92e46a8b0a7f133253239bd [id=44e40556c20646558eb58acec6ad5f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.598678 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df72757ce3cd4651987bfb29dd8be77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.598600 29232 tablet_service.cc:1511] Processing CreateTablet for tablet df72757ce3cd4651987bfb29dd8be77d (DEFAULT_TABLE table=default.Table_d17e64a2c92e46a8b0a7f133253239bd [id=44e40556c20646558eb58acec6ad5f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.600906 29100 tablet_service.cc:1511] Processing CreateTablet for tablet df72757ce3cd4651987bfb29dd8be77d (DEFAULT_TABLE table=default.Table_d17e64a2c92e46a8b0a7f133253239bd [id=44e40556c20646558eb58acec6ad5f05]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.601346 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df72757ce3cd4651987bfb29dd8be77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.602890 29378 tablet_bootstrap.cc:492] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:43.607020 29378 tablet_bootstrap.cc:654] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:43.618851 28657 consensus_peers.cc:597] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a -> Peer f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059): Couldn't send request to peer f5ea3f9265d84474ab3bced8dd5aecc5. Status: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:43.619345 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df72757ce3cd4651987bfb29dd8be77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.630115 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d3e77c86faef4354bde8ee10e5ec573e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.630358 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f2c395a0432b4290a5b96c05ac1587c1" } new_table_name: "default.Table_d8de4b07f59243b79391d97fdec2323f" modify_external_catalogs: true
W20260617 20:16:43.630800 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3e77c86faef4354bde8ee10e5ec573e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.631953 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_afc19b5045e2429a8e30a23563fbb900"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.632051 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5b1993d0c19d4c9a9d266ba632d99c39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.632498 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b1993d0c19d4c9a9d266ba632d99c39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:43.632642 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afc19b5045e2429a8e30a23563fbb900 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.635774 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1f83bbace5d34129ae25257812cd9df9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.636284 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d17e64a2c92e46a8b0a7f133253239bd" } new_table_name: "default.Table_13dc7de987b143f8b177239c1488c2ad" modify_external_catalogs: true
W20260617 20:16:43.636484 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f83bbace5d34129ae25257812cd9df9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.639065 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_61a0915707aa43228ddd3cf87f4c1d80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.639467 29378 log.cc:826] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: Log is configured to *not* fsync() on all Append() calls
W20260617 20:16:43.639729 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61a0915707aa43228ddd3cf87f4c1d80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.641930 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bc35f27ad56b4a8fbed488c27162dcd1" } new_table_name: "default.Table_8eceb8f19afd47f2bf478ee57537dd7b" modify_external_catalogs: true
I20260617 20:16:43.641950 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_389a4632b173428984db63f12fbe631f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.642479 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_389a4632b173428984db63f12fbe631f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:43.643221 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 42aeede5da974652898bccc8e0a38bce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42aeede5da974652898bccc8e0a38bce already in progress: creating tablet
I20260617 20:16:43.643505 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d0963241dd0f4d5f9be5d2bd34871072"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.644011 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0963241dd0f4d5f9be5d2bd34871072 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.645406 29378 tablet_bootstrap.cc:492] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:43.645704 29378 ts_tablet_manager.cc:1403] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.002s
I20260617 20:16:43.648548 29383 tablet_bootstrap.cc:492] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:43.654829 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_735760b562bd4aa59a5b6512879b2b6c" } new_table_name: "default.Table_4d5105d9785547e587bf29e7bca97216" modify_external_catalogs: true
W20260617 20:16:43.655503 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 already in progress: creating tablet
W20260617 20:16:43.656196 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3bff8e928b534201bac3c1d27878535f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bff8e928b534201bac3c1d27878535f already in progress: creating tablet
W20260617 20:16:43.656752 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 45399615180643949e95189457f6b923 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45399615180643949e95189457f6b923 already in progress: creating tablet
W20260617 20:16:43.657384 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet ba383035d6f94f1686f6f1dfd10a974d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba383035d6f94f1686f6f1dfd10a974d already in progress: creating tablet
W20260617 20:16:43.659332 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df72757ce3cd4651987bfb29dd8be77d consensus state has no leader
I20260617 20:16:43.657279 29383 tablet_bootstrap.cc:654] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.659705 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet 3bff8e928b534201bac3c1d27878535f from {username='slave'} at 127.0.0.1:60552
W20260617 20:16:43.659825 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 02cea5d29e8b4c209515bc05be7a6324 consensus state has no leader
I20260617 20:16:43.660102 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet 02cea5d29e8b4c209515bc05be7a6324 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:43.660660 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 52d25188917845a28a926274976cbaf4 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:43.660744 29383 log.cc:826] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: Log is configured to *not* fsync() on all Append() calls
I20260617 20:16:43.661167 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet ba383035d6f94f1686f6f1dfd10a974d from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:43.661314 29379 tablet_bootstrap.cc:492] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:43.661615 29379 ts_tablet_manager.cc:1403] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.083s user 0.020s sys 0.031s
I20260617 20:16:43.662592 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd2621fc81a46c4945260a85a8d6aa2 (DEFAULT_TABLE table=default.Table_c0b49bddc6014a769317c2ecc24f9bfe [id=f447de1e65a64027ae9c8983d72195e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.663163 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd2621fc81a46c4945260a85a8d6aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.663729 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet 3ae50375e5934acbb213379fb7c87989 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:43.665426 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd2621fc81a46c4945260a85a8d6aa2 (DEFAULT_TABLE table=default.Table_c0b49bddc6014a769317c2ecc24f9bfe [id=f447de1e65a64027ae9c8983d72195e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.665892 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd2621fc81a46c4945260a85a8d6aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.665938 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (DEFAULT_TABLE table=default.Table_3f3b8288030e40df8c1ea401e3a60e49 [id=3a41dd53c3974256877f193219240234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.666317 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.669044 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (DEFAULT_TABLE table=default.Table_3f3b8288030e40df8c1ea401e3a60e49 [id=3a41dd53c3974256877f193219240234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.669436 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.669560 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (DEFAULT_TABLE table=default.Table_3f3b8288030e40df8c1ea401e3a60e49 [id=3a41dd53c3974256877f193219240234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.669983 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.669716 29379 raft_consensus.cc:359] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.670120 29379 raft_consensus.cc:385] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.670235 29379 raft_consensus.cc:740] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.671149 29379 consensus_queue.cc:260] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.675498 29383 tablet_bootstrap.cc:492] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:43.675806 29383 ts_tablet_manager.cc:1403] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.003s
I20260617 20:16:43.677925 29378 raft_consensus.cc:359] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:43.678429 29378 raft_consensus.cc:385] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.678530 29378 raft_consensus.cc:740] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.679612 29378 consensus_queue.cc:260] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:43.680200 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd2621fc81a46c4945260a85a8d6aa2 (DEFAULT_TABLE table=default.Table_c0b49bddc6014a769317c2ecc24f9bfe [id=f447de1e65a64027ae9c8983d72195e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.680604 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd2621fc81a46c4945260a85a8d6aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.687409 29383 raft_consensus.cc:359] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.687840 29383 raft_consensus.cc:385] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.687954 29383 raft_consensus.cc:740] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.688446 29378 ts_tablet_manager.cc:1434] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.043s user 0.006s sys 0.009s
I20260617 20:16:43.688679 29383 consensus_queue.cc:260] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:43.691676 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52d25188917845a28a926274976cbaf4 consensus state has no leader
I20260617 20:16:43.692153 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d3e77c86faef4354bde8ee10e5ec573e" } modify_external_catalogs: true
I20260617 20:16:43.692296 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c7b7e3bd549f44f897eb7364a000c40e" } modify_external_catalogs: true
I20260617 20:16:43.692343 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d3e77c86faef4354bde8ee10e5ec573e" } modify_external_catalogs: true
I20260617 20:16:43.692512 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c7b7e3bd549f44f897eb7364a000c40e" } modify_external_catalogs: true
I20260617 20:16:43.692690 29379 ts_tablet_manager.cc:1434] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.031s user 0.012s sys 0.000s
I20260617 20:16:43.693182 29379 tablet_bootstrap.cc:492] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:43.693883 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3f3b8288030e40df8c1ea401e3a60e49" } new_table_name: "default.Table_49f5d2834cac44a498320d7ed4c3b040" modify_external_catalogs: true
I20260617 20:16:43.694998 29379 tablet_bootstrap.cc:654] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.695979 29378 tablet_bootstrap.cc:492] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:43.695879 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_13dc7de987b143f8b177239c1488c2ad" } modify_external_catalogs: true
I20260617 20:16:43.696012 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_afc19b5045e2429a8e30a23563fbb900" } modify_external_catalogs: true
I20260617 20:16:43.696135 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_13dc7de987b143f8b177239c1488c2ad" } modify_external_catalogs: true
I20260617 20:16:43.696198 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_afc19b5045e2429a8e30a23563fbb900" } modify_external_catalogs: true
I20260617 20:16:43.699097 29378 tablet_bootstrap.cc:654] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:43.704864 29173 heartbeater.cc:646] Failed to heartbeat to 127.27.245.252:46059 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
I20260617 20:16:43.706969 29378 tablet_bootstrap.cc:492] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:43.707126 29378 ts_tablet_manager.cc:1403] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.005s
I20260617 20:16:43.708173 29378 raft_consensus.cc:359] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.708416 29378 raft_consensus.cc:385] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.708561 29378 raft_consensus.cc:740] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:16:43.711347 29035 heartbeater.cc:646] Failed to heartbeat to 127.27.245.252:46059 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
I20260617 20:16:43.712922 29378 consensus_queue.cc:260] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:43.715399 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ae50375e5934acbb213379fb7c87989 consensus state has no leader
I20260617 20:16:43.715714 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.716012 29377 tablet_replica.cc:333] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:43.715404 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_790a35cc325041b987a0185f1f3044a6" } modify_external_catalogs: true
I20260617 20:16:43.716351 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_790a35cc325041b987a0185f1f3044a6" } modify_external_catalogs: true
I20260617 20:16:43.716462 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 52d25188917845a28a926274976cbaf4
I20260617 20:16:43.716512 29377 raft_consensus.cc:2243] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.716873 29377 raft_consensus.cc:2272] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.716970 28663 catalog_manager.cc:6784] ReplaceTablet: tablet 52d25188917845a28a926274976cbaf4 deleted and replaced by tablet 680fe7bf06bf4dcdab15c7c95cb00daf
I20260617 20:16:43.717545 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d25188917845a28a926274976cbaf4 with delete_type TABLET_DATA_DELETED (replaced by tablet 680fe7bf06bf4dcdab15c7c95cb00daf) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.717684 28666 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet e9605d6927874f6686e0d44a45effead
I20260617 20:16:43.718516 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d25188917845a28a926274976cbaf4 with delete_type TABLET_DATA_DELETED (replaced by tablet 680fe7bf06bf4dcdab15c7c95cb00daf) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.720239 29377 ts_tablet_manager.cc:1916] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:43.720597 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 52d25188917845a28a926274976cbaf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52d25188917845a28a926274976cbaf4 already in progress: creating tablet
I20260617 20:16:43.722103 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bff8e928b534201bac3c1d27878535f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.722445 29375 tablet_replica.cc:333] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:43.722555 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d25188917845a28a926274976cbaf4 with delete_type TABLET_DATA_DELETED (replaced by tablet 680fe7bf06bf4dcdab15c7c95cb00daf) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.722944 29375 raft_consensus.cc:2243] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.723345 29375 raft_consensus.cc:2272] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.725045 29375 ts_tablet_manager.cc:1916] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.728751 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet ba383035d6f94f1686f6f1dfd10a974d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.731112 29377 ts_tablet_manager.cc:1929] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.731256 29377 log.cc:1199] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/0ba4e3bc4a2e40319e4da6ee04807bf6
I20260617 20:16:43.731715 29377 ts_tablet_manager.cc:1950] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:43.732390 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b5ddb72dae9345febe2a9a53bc2d89f6
I20260617 20:16:43.734771 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ddb72dae9345febe2a9a53bc2d89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.735033 29309 heartbeater.cc:499] Master 127.27.245.254:37301 was elected leader, sending a full tablet report...
W20260617 20:16:43.737799 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac consensus state has no leader
I20260617 20:16:43.741410 29378 ts_tablet_manager.cc:1434] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.034s user 0.001s sys 0.002s
I20260617 20:16:43.744249 29375 ts_tablet_manager.cc:1929] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.744467 29375 log.cc:1199] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/3bff8e928b534201bac3c1d27878535f
I20260617 20:16:43.744536 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ddb72dae9345febe2a9a53bc2d89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.745044 29375 ts_tablet_manager.cc:1950] T 3bff8e928b534201bac3c1d27878535f P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:43.745272 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ddb72dae9345febe2a9a53bc2d89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.746615 29378 tablet_bootstrap.cc:492] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:43.747148 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 3bff8e928b534201bac3c1d27878535f (table default.Table_87c4fdebf4f24b5aabd1a274ecd1d005 [id=7e09804e39894310ba5f841e3921d0c2]) successfully deleted
I20260617 20:16:43.747449 29383 ts_tablet_manager.cc:1434] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.072s user 0.009s sys 0.016s
W20260617 20:16:43.747695 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 52d25188917845a28a926274976cbaf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52d25188917845a28a926274976cbaf4 already in progress: creating tablet
I20260617 20:16:43.747922 29383 tablet_bootstrap.cc:492] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:43.748003 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet b5ddb72dae9345febe2a9a53bc2d89f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ddb72dae9345febe2a9a53bc2d89f6 already in progress: creating tablet
I20260617 20:16:43.748988 29378 tablet_bootstrap.cc:654] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.749688 29383 tablet_bootstrap.cc:654] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.750190 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet df72757ce3cd4651987bfb29dd8be77d
I20260617 20:16:43.751021 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet df72757ce3cd4651987bfb29dd8be77d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.751467 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet df72757ce3cd4651987bfb29dd8be77d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.751922 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 (table default.Table_e294d2f29d224d2d91c1d64901ccb8db [id=aec20b3f1911426694e0588bfd2ac962]) successfully deleted
I20260617 20:16:43.752221 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet df72757ce3cd4651987bfb29dd8be77d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:43.752274 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet df72757ce3cd4651987bfb29dd8be77d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df72757ce3cd4651987bfb29dd8be77d already in progress: creating tablet
W20260617 20:16:43.752910 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet df72757ce3cd4651987bfb29dd8be77d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df72757ce3cd4651987bfb29dd8be77d already in progress: creating tablet
W20260617 20:16:43.753350 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 52d25188917845a28a926274976cbaf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52d25188917845a28a926274976cbaf4 already in progress: creating tablet
W20260617 20:16:43.753373 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet b5ddb72dae9345febe2a9a53bc2d89f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ddb72dae9345febe2a9a53bc2d89f6 already in progress: creating tablet
I20260617 20:16:43.753957 29377 tablet_replica.cc:333] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:43.754146 29377 raft_consensus.cc:2243] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.754312 29377 raft_consensus.cc:2272] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:43.755995 29308 heartbeater.cc:646] Failed to heartbeat to 127.27.245.252:46059 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111)
I20260617 20:16:43.759358 29377 ts_tablet_manager.cc:1916] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.763522 29383 tablet_bootstrap.cc:492] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:43.763684 29383 ts_tablet_manager.cc:1403] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.002s
I20260617 20:16:43.765676 29378 tablet_bootstrap.cc:492] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:43.765870 29378 ts_tablet_manager.cc:1403] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20260617 20:16:43.766505 29383 raft_consensus.cc:359] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.766587 29378 raft_consensus.cc:359] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.766705 29383 raft_consensus.cc:385] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.766793 29378 raft_consensus.cc:385] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.766805 29383 raft_consensus.cc:740] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.766891 29378 raft_consensus.cc:740] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.767251 29378 consensus_queue.cc:260] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.769178 29378 ts_tablet_manager.cc:1434] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:43.769809 28968 tablet_service.cc:1511] Processing CreateTablet for tablet a9a54cc7eccb4227be5fded7cc6e2a8b (DEFAULT_TABLE table=default.Table_61a0915707aa43228ddd3cf87f4c1d80 [id=da4afdf3f60e48e78eb52d454fa4142c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.770202 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a54cc7eccb4227be5fded7cc6e2a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.770449 29236 tablet_service.cc:1511] Processing CreateTablet for tablet a9a54cc7eccb4227be5fded7cc6e2a8b (DEFAULT_TABLE table=default.Table_61a0915707aa43228ddd3cf87f4c1d80 [id=da4afdf3f60e48e78eb52d454fa4142c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.771070 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 02cea5d29e8b4c209515bc05be7a6324
I20260617 20:16:43.771536 28661 catalog_manager.cc:6784] ReplaceTablet: tablet 02cea5d29e8b4c209515bc05be7a6324 deleted and replaced by tablet 95bf5d8704614db68c8ce7c272c2fb13
I20260617 20:16:43.770862 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a54cc7eccb4227be5fded7cc6e2a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.773353 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 02cea5d29e8b4c209515bc05be7a6324 with delete_type TABLET_DATA_DELETED (replaced by tablet 95bf5d8704614db68c8ce7c272c2fb13) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.773536 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 02cea5d29e8b4c209515bc05be7a6324 with delete_type TABLET_DATA_DELETED (replaced by tablet 95bf5d8704614db68c8ce7c272c2fb13) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.771631 29383 consensus_queue.cc:260] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.774214 29383 ts_tablet_manager.cc:1434] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
W20260617 20:16:43.774361 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 02cea5d29e8b4c209515bc05be7a6324 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02cea5d29e8b4c209515bc05be7a6324 already in progress: creating tablet
I20260617 20:16:43.774538 29383 tablet_bootstrap.cc:492] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:43.776350 29383 tablet_bootstrap.cc:654] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.780472 29378 tablet_bootstrap.cc:492] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:43.781348 29107 tablet_service.cc:1511] Processing CreateTablet for tablet a9a54cc7eccb4227be5fded7cc6e2a8b (DEFAULT_TABLE table=default.Table_61a0915707aa43228ddd3cf87f4c1d80 [id=da4afdf3f60e48e78eb52d454fa4142c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.781765 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9a54cc7eccb4227be5fded7cc6e2a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.782166 29378 tablet_bootstrap.cc:654] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.782127 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 3f550e50674e43b785d23c37ab28b956 (DEFAULT_TABLE table=default.Table_afc19b5045e2429a8e30a23563fbb900 [id=d1ef628fd67d49d3bd9bd960b9a54465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.782612 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f550e50674e43b785d23c37ab28b956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.783584 29377 ts_tablet_manager.cc:1929] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.783738 29377 log.cc:1199] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/ba383035d6f94f1686f6f1dfd10a974d
I20260617 20:16:43.784070 29377 ts_tablet_manager.cc:1950] T ba383035d6f94f1686f6f1dfd10a974d P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:43.785090 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet ba383035d6f94f1686f6f1dfd10a974d (table default.Table_b67aea11857c4eac91427f845b772571 [id=291a4589243443078220d3cd9940a63d]) successfully deleted
I20260617 20:16:43.785238 29383 tablet_bootstrap.cc:492] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:43.785451 29383 ts_tablet_manager.cc:1403] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
W20260617 20:16:43.785820 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet b5ddb72dae9345febe2a9a53bc2d89f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ddb72dae9345febe2a9a53bc2d89f6 already in progress: creating tablet
I20260617 20:16:43.786332 29383 raft_consensus.cc:359] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:43.786409 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet df72757ce3cd4651987bfb29dd8be77d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df72757ce3cd4651987bfb29dd8be77d already in progress: creating tablet
I20260617 20:16:43.786567 29383 raft_consensus.cc:385] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.786707 29377 tablet_replica.cc:333] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:43.786689 29383 raft_consensus.cc:740] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.786872 29377 raft_consensus.cc:2243] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.787056 29377 raft_consensus.cc:2272] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.787072 29383 consensus_queue.cc:260] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.787812 29383 ts_tablet_manager.cc:1434] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:16:43.787817 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 3f550e50674e43b785d23c37ab28b956 (DEFAULT_TABLE table=default.Table_afc19b5045e2429a8e30a23563fbb900 [id=d1ef628fd67d49d3bd9bd960b9a54465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.788170 29383 tablet_bootstrap.cc:492] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:43.788254 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f550e50674e43b785d23c37ab28b956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.790756 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 02cea5d29e8b4c209515bc05be7a6324 with delete_type TABLET_DATA_DELETED (replaced by tablet 95bf5d8704614db68c8ce7c272c2fb13) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.791594 29378 tablet_bootstrap.cc:492] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:43.791740 29378 ts_tablet_manager.cc:1403] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.003s
I20260617 20:16:43.792276 29383 tablet_bootstrap.cc:654] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.792851 29378 raft_consensus.cc:359] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.793053 29378 raft_consensus.cc:385] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.793148 29378 raft_consensus.cc:740] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.793397 29378 consensus_queue.cc:260] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:43.793807 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 02cea5d29e8b4c209515bc05be7a6324 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 02cea5d29e8b4c209515bc05be7a6324 already in progress: creating tablet
I20260617 20:16:43.793975 29378 ts_tablet_manager.cc:1434] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:43.794229 29378 tablet_bootstrap.cc:492] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:43.795871 29378 tablet_bootstrap.cc:654] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.796950 29377 ts_tablet_manager.cc:1916] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.797168 29379 tablet_bootstrap.cc:492] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:43.797327 29379 ts_tablet_manager.cc:1403] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.104s user 0.013s sys 0.011s
I20260617 20:16:43.797801 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3f550e50674e43b785d23c37ab28b956
I20260617 20:16:43.798080 29379 raft_consensus.cc:359] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.798257 29379 raft_consensus.cc:385] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.798342 29379 raft_consensus.cc:740] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.798662 29379 consensus_queue.cc:260] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.798864 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f550e50674e43b785d23c37ab28b956 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.799129 29379 ts_tablet_manager.cc:1434] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:16:43.799619 29379 tablet_bootstrap.cc:492] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:43.799665 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f550e50674e43b785d23c37ab28b956 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.801970 29379 tablet_bootstrap.cc:654] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.802903 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_68a04d47b12e4085a79f0e2fd7b388ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.803035 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0ec2cf7d7dc84aaa942f063bbcb984b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.803468 29377 ts_tablet_manager.cc:1929] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:16:43.803503 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68a04d47b12e4085a79f0e2fd7b388ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.803580 29377 log.cc:1199] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/02cea5d29e8b4c209515bc05be7a6324
W20260617 20:16:43.803629 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3f550e50674e43b785d23c37ab28b956 because the tablet was not found. No further retry: Not found: Tablet not found: 3f550e50674e43b785d23c37ab28b956
I20260617 20:16:43.803949 29377 ts_tablet_manager.cc:1950] T 02cea5d29e8b4c209515bc05be7a6324 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:43.804936 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 02cea5d29e8b4c209515bc05be7a6324 (table default.Table_d8de4b07f59243b79391d97fdec2323f [id=727864a195db4e4585240fb48a508df7]) successfully deleted
W20260617 20:16:43.803511 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ec2cf7d7dc84aaa942f063bbcb984b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.806305 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet ba383035d6f94f1686f6f1dfd10a974d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.806563 29375 tablet_replica.cc:333] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:43.806749 29375 raft_consensus.cc:2243] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.806914 29375 raft_consensus.cc:2272] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.807478 29375 ts_tablet_manager.cc:1916] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:43.808034 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3f550e50674e43b785d23c37ab28b956 because the tablet was not found. No further retry: Not found: Tablet not found: 3f550e50674e43b785d23c37ab28b956
I20260617 20:16:43.808318 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f550e50674e43b785d23c37ab28b956 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.809919 29378 tablet_bootstrap.cc:492] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:43.810122 29378 ts_tablet_manager.cc:1403] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.005s
I20260617 20:16:43.810241 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3ae50375e5934acbb213379fb7c87989
I20260617 20:16:43.810714 28670 catalog_manager.cc:6784] ReplaceTablet: tablet 3ae50375e5934acbb213379fb7c87989 deleted and replaced by tablet f23960607f8a4efcb56cd5f306dc3a85
I20260617 20:16:43.810978 29378 raft_consensus.cc:359] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.811196 29378 raft_consensus.cc:385] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.811292 29378 raft_consensus.cc:740] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.811592 29378 consensus_queue.cc:260] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.812211 29378 ts_tablet_manager.cc:1434] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:43.812338 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (table default.Table_49f5d2834cac44a498320d7ed4c3b040 [id=3a41dd53c3974256877f193219240234]). Expected version 1 got 0
I20260617 20:16:43.812575 29378 tablet_bootstrap.cc:492] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:43.812666 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 6d6af4b98fcb4161b7432280605224d9
I20260617 20:16:43.813818 29375 ts_tablet_manager.cc:1929] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.813958 29375 log.cc:1199] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/ba383035d6f94f1686f6f1dfd10a974d
I20260617 20:16:43.814117 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae50375e5934acbb213379fb7c87989 with delete_type TABLET_DATA_DELETED (replaced by tablet f23960607f8a4efcb56cd5f306dc3a85) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.814255 28970 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d6af4b98fcb4161b7432280605224d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.814323 29375 ts_tablet_manager.cc:1950] T ba383035d6f94f1686f6f1dfd10a974d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:43.814512 29378 tablet_bootstrap.cc:654] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.815629 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae50375e5934acbb213379fb7c87989 with delete_type TABLET_DATA_DELETED (replaced by tablet f23960607f8a4efcb56cd5f306dc3a85) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.815711 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d6af4b98fcb4161b7432280605224d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.816359 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d6af4b98fcb4161b7432280605224d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.816573 29376 tablet_replica.cc:333] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:43.817162 29376 raft_consensus.cc:2243] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.817627 29376 raft_consensus.cc:2272] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.819257 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet ba383035d6f94f1686f6f1dfd10a974d (table default.Table_b67aea11857c4eac91427f845b772571 [id=291a4589243443078220d3cd9940a63d]) successfully deleted
W20260617 20:16:43.819547 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3f550e50674e43b785d23c37ab28b956 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f550e50674e43b785d23c37ab28b956 already in progress: creating tablet
W20260617 20:16:43.819813 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 6d6af4b98fcb4161b7432280605224d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d6af4b98fcb4161b7432280605224d9 already in progress: creating tablet
I20260617 20:16:43.819908 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet ba383035d6f94f1686f6f1dfd10a974d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:43.820078 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3ae50375e5934acbb213379fb7c87989 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae50375e5934acbb213379fb7c87989 already in progress: creating tablet
I20260617 20:16:43.820308 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d25188917845a28a926274976cbaf4 with delete_type TABLET_DATA_DELETED (replaced by tablet 680fe7bf06bf4dcdab15c7c95cb00daf) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.820343 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet 45399615180643949e95189457f6b923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.820416 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae50375e5934acbb213379fb7c87989 with delete_type TABLET_DATA_DELETED (replaced by tablet f23960607f8a4efcb56cd5f306dc3a85) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.820524 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet 02cea5d29e8b4c209515bc05be7a6324 with delete_type TABLET_DATA_DELETED (replaced by tablet 95bf5d8704614db68c8ce7c272c2fb13) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.820712 29240 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ddb72dae9345febe2a9a53bc2d89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.820919 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bff8e928b534201bac3c1d27878535f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.821107 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet df72757ce3cd4651987bfb29dd8be77d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.821290 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.821892 28970 tablet_service.cc:1511] Processing CreateTablet for tablet cd628a25f3a14b64a5f9a70d104b3dcf (DEFAULT_TABLE table=default.Table_d0963241dd0f4d5f9be5d2bd34871072 [id=b5d358e515734a51b4a25fb7c90b2a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.821986 29379 tablet_bootstrap.cc:492] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:43.822139 29379 ts_tablet_manager.cc:1403] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.005s
I20260617 20:16:43.822335 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd628a25f3a14b64a5f9a70d104b3dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.822508 28958 tablet_service.cc:1511] Processing CreateTablet for tablet a42074d6374a4682a4948970720134e4 (DEFAULT_TABLE table=default.Table_389a4632b173428984db63f12fbe631f [id=22252c6160d540879efa900a2d3584c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.822834 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42074d6374a4682a4948970720134e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.822873 29379 raft_consensus.cc:359] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:43.823067 29379 raft_consensus.cc:385] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.823151 29379 raft_consensus.cc:740] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.823501 29379 consensus_queue.cc:260] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:43.824023 29379 ts_tablet_manager.cc:1434] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:16:43.825582 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet 42aeede5da974652898bccc8e0a38bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:43.825924 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 511179f9875241128390708b55dba05e (DEFAULT_TABLE table=default.Table_5b1993d0c19d4c9a9d266ba632d99c39 [id=ac46308147954a68bc53d1b6684d1b62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.826253 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 511179f9875241128390708b55dba05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.826354 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 3f550e50674e43b785d23c37ab28b956 (DEFAULT_TABLE table=default.Table_afc19b5045e2429a8e30a23563fbb900 [id=d1ef628fd67d49d3bd9bd960b9a54465]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.826735 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f550e50674e43b785d23c37ab28b956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.826802 29107 tablet_service.cc:1511] Processing CreateTablet for tablet a42074d6374a4682a4948970720134e4 (DEFAULT_TABLE table=default.Table_389a4632b173428984db63f12fbe631f [id=22252c6160d540879efa900a2d3584c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.827134 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42074d6374a4682a4948970720134e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.827696 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 511179f9875241128390708b55dba05e (DEFAULT_TABLE table=default.Table_5b1993d0c19d4c9a9d266ba632d99c39 [id=ac46308147954a68bc53d1b6684d1b62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.828015 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 511179f9875241128390708b55dba05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.833459 29376 ts_tablet_manager.cc:1916] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.834323 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 511179f9875241128390708b55dba05e (DEFAULT_TABLE table=default.Table_5b1993d0c19d4c9a9d266ba632d99c39 [id=ac46308147954a68bc53d1b6684d1b62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.836247 29377 tablet_replica.cc:333] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:43.836439 29377 raft_consensus.cc:2243] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.836537 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 511179f9875241128390708b55dba05e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.836586 29377 raft_consensus.cc:2272] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.840327 29101 tablet_service.cc:1511] Processing CreateTablet for tablet cd628a25f3a14b64a5f9a70d104b3dcf (DEFAULT_TABLE table=default.Table_d0963241dd0f4d5f9be5d2bd34871072 [id=b5d358e515734a51b4a25fb7c90b2a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.840730 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd628a25f3a14b64a5f9a70d104b3dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.834684 29239 tablet_service.cc:1511] Processing CreateTablet for tablet a42074d6374a4682a4948970720134e4 (DEFAULT_TABLE table=default.Table_389a4632b173428984db63f12fbe631f [id=22252c6160d540879efa900a2d3584c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.841658 29379 tablet_bootstrap.cc:492] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:43.841946 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42074d6374a4682a4948970720134e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.843436 29379 tablet_bootstrap.cc:654] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.844828 29378 tablet_bootstrap.cc:492] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:43.844959 29378 ts_tablet_manager.cc:1403] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.000s
I20260617 20:16:43.835017 29235 tablet_service.cc:1511] Processing CreateTablet for tablet cd628a25f3a14b64a5f9a70d104b3dcf (DEFAULT_TABLE table=default.Table_d0963241dd0f4d5f9be5d2bd34871072 [id=b5d358e515734a51b4a25fb7c90b2a66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.846352 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd628a25f3a14b64a5f9a70d104b3dcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.847100 29378 raft_consensus.cc:359] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.847309 29378 raft_consensus.cc:385] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.847409 29378 raft_consensus.cc:740] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.848531 29378 consensus_queue.cc:260] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.852036 29378 ts_tablet_manager.cc:1434] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 20:16:43.853264 29378 tablet_bootstrap.cc:492] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:43.855041 29378 tablet_bootstrap.cc:654] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:43.857973 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3ae50375e5934acbb213379fb7c87989 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae50375e5934acbb213379fb7c87989 already in progress: creating tablet
I20260617 20:16:43.859066 29379 tablet_bootstrap.cc:492] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:43.859228 29379 ts_tablet_manager.cc:1403] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.006s
I20260617 20:16:43.859827 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.860098 29375 tablet_replica.cc:333] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:43.860275 29375 raft_consensus.cc:2243] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.860199 29379 raft_consensus.cc:359] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.860396 29379 raft_consensus.cc:385] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.860478 29375 raft_consensus.cc:2272] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.861200 29375 ts_tablet_manager.cc:1916] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.864714 29377 ts_tablet_manager.cc:1916] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.867254 29375 ts_tablet_manager.cc:1929] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.867386 29375 log.cc:1199] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/0ba4e3bc4a2e40319e4da6ee04807bf6
I20260617 20:16:43.867771 29375 ts_tablet_manager.cc:1950] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:43.867882 29378 tablet_bootstrap.cc:492] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:43.868218 29378 ts_tablet_manager.cc:1403] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.003s
I20260617 20:16:43.869004 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d8de4b07f59243b79391d97fdec2323f" } new_table_name: "default.Table_a34b5cc6e9f2434488cc50d41fb64a03" modify_external_catalogs: true
I20260617 20:16:43.860502 29379 raft_consensus.cc:740] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.870527 29379 consensus_queue.cc:260] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.871052 29379 ts_tablet_manager.cc:1434] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260617 20:16:43.871054 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1f83bbace5d34129ae25257812cd9df9" } new_table_name: "default.Table_c0b0e14daadf4b44b74c58729d340367" modify_external_catalogs: true
I20260617 20:16:43.872373 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0a57fb26789b4826858b2755f0f85b86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.872918 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a57fb26789b4826858b2755f0f85b86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.874069 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8768bdfdc4af4740898b1018fd51e808"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.874312 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_315b909d8d1c411f89063fecb8be5b84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.874265 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_24eb651bcbec4bafbac0b0612438512f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.874588 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8768bdfdc4af4740898b1018fd51e808 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:43.874729 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_315b909d8d1c411f89063fecb8be5b84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:43.874966 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24eb651bcbec4bafbac0b0612438512f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.876356 29379 tablet_bootstrap.cc:492] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:43.878141 29379 tablet_bootstrap.cc:654] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.879393 29378 raft_consensus.cc:359] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.879655 29378 raft_consensus.cc:385] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.879732 29378 raft_consensus.cc:740] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.880201 29378 consensus_queue.cc:260] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.882525 29377 ts_tablet_manager.cc:1929] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.882683 29377 log.cc:1199] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/3ae50375e5934acbb213379fb7c87989
I20260617 20:16:43.883116 29377 ts_tablet_manager.cc:1950] T 3ae50375e5934acbb213379fb7c87989 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:43.883250 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bff8e928b534201bac3c1d27878535f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.869040 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 (table default.Table_e294d2f29d224d2d91c1d64901ccb8db [id=aec20b3f1911426694e0588bfd2ac962]) successfully deleted
I20260617 20:16:43.887246 29376 ts_tablet_manager.cc:1929] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.887429 29376 log.cc:1199] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/6d6af4b98fcb4161b7432280605224d9
I20260617 20:16:43.887936 29376 ts_tablet_manager.cc:1950] T 6d6af4b98fcb4161b7432280605224d9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:43.888032 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d25188917845a28a926274976cbaf4 with delete_type TABLET_DATA_DELETED (replaced by tablet 680fe7bf06bf4dcdab15c7c95cb00daf) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.888598 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9d14a80a9dfb4132a326a22fffbe8152"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:43.889213 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d14a80a9dfb4132a326a22fffbe8152 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.889926 29376 tablet_replica.cc:333] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:43.890133 29376 raft_consensus.cc:2243] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.890326 29376 raft_consensus.cc:2272] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.890493 28970 tablet_service.cc:1558] Processing DeleteTablet for tablet 45399615180643949e95189457f6b923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.890784 29375 tablet_replica.cc:333] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:43.890986 29375 raft_consensus.cc:2243] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.891367 29375 raft_consensus.cc:2272] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.891489 29376 ts_tablet_manager.cc:1916] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.891950 29383 tablet_bootstrap.cc:492] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:43.892483 29375 ts_tablet_manager.cc:1916] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.892719 29383 ts_tablet_manager.cc:1403] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.105s user 0.015s sys 0.025s
I20260617 20:16:43.893702 29383 raft_consensus.cc:359] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.894102 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 6d6af4b98fcb4161b7432280605224d9 (table default.Table_790a35cc325041b987a0185f1f3044a6 [id=c4b8f5740cdf4cc7912c732a21e3b13d]) successfully deleted
I20260617 20:16:43.893791 29379 tablet_bootstrap.cc:492] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
W20260617 20:16:43.894358 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet ba383035d6f94f1686f6f1dfd10a974d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba383035d6f94f1686f6f1dfd10a974d already in progress: creating tablet
I20260617 20:16:43.894416 29379 ts_tablet_manager.cc:1403] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20260617 20:16:43.894861 29378 ts_tablet_manager.cc:1434] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.026s user 0.000s sys 0.002s
I20260617 20:16:43.897779 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d25188917845a28a926274976cbaf4 with delete_type TABLET_DATA_DELETED (replaced by tablet 680fe7bf06bf4dcdab15c7c95cb00daf) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:43.897933 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 680fe7bf06bf4dcdab15c7c95cb00daf (DEFAULT_TABLE table=default.Table_8eceb8f19afd47f2bf478ee57537dd7b [id=9439537fd882414f94ec8dd957bbd86e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.898039 29383 raft_consensus.cc:385] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.898155 29383 raft_consensus.cc:740] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.898217 28970 tablet_service.cc:1511] Processing CreateTablet for tablet dd7079ea860149f19227264b8507685b (DEFAULT_TABLE table=default.Table_1f83bbace5d34129ae25257812cd9df9 [id=b4613adf2f5b40a780f81d91421a689a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.898326 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680fe7bf06bf4dcdab15c7c95cb00daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.898407 29379 raft_consensus.cc:359] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.898551 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd7079ea860149f19227264b8507685b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.897357 29376 ts_tablet_manager.cc:1929] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.898602 29379 raft_consensus.cc:385] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.898674 29379 raft_consensus.cc:740] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.898952 29383 consensus_queue.cc:260] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.899277 29379 consensus_queue.cc:260] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.899777 29379 ts_tablet_manager.cc:1434] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260617 20:16:43.900054 29379 tablet_bootstrap.cc:492] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:43.901731 29379 tablet_bootstrap.cc:654] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.902705 28966 tablet_service.cc:1511] Processing CreateTablet for tablet f23960607f8a4efcb56cd5f306dc3a85 (DEFAULT_TABLE table=default.Table_4d5105d9785547e587bf29e7bca97216 [id=d70c3654e0c4417e9ff68be4309793ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.903110 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f23960607f8a4efcb56cd5f306dc3a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.905568 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 95bf5d8704614db68c8ce7c272c2fb13 (DEFAULT_TABLE table=default.Table_d8de4b07f59243b79391d97fdec2323f [id=727864a195db4e4585240fb48a508df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.905938 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95bf5d8704614db68c8ce7c272c2fb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.908196 29383 ts_tablet_manager.cc:1434] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.015s user 0.000s sys 0.002s
I20260617 20:16:43.909195 29376 log.cc:1199] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/45399615180643949e95189457f6b923
I20260617 20:16:43.909967 29377 tablet_replica.cc:333] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:43.910147 29377 raft_consensus.cc:2243] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.910332 29377 raft_consensus.cc:2272] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.910818 29378 tablet_bootstrap.cc:492] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:43.911049 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 3ae50375e5934acbb213379fb7c87989 (table default.Table_4d5105d9785547e587bf29e7bca97216 [id=d70c3654e0c4417e9ff68be4309793ba]) successfully deleted
W20260617 20:16:43.911281 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 6d6af4b98fcb4161b7432280605224d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d6af4b98fcb4161b7432280605224d9 already in progress: creating tablet
I20260617 20:16:43.911931 29377 ts_tablet_manager.cc:1916] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.912675 29378 tablet_bootstrap.cc:654] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.914738 29375 ts_tablet_manager.cc:1929] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.914889 29375 log.cc:1199] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/52d25188917845a28a926274976cbaf4
I20260617 20:16:43.915242 29375 ts_tablet_manager.cc:1950] T 52d25188917845a28a926274976cbaf4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:43.916360 29383 tablet_bootstrap.cc:492] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:43.919466 29376 ts_tablet_manager.cc:1950] T 45399615180643949e95189457f6b923 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:43.920696 29379 tablet_bootstrap.cc:492] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:43.920850 29379 ts_tablet_manager.cc:1403] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260617 20:16:43.921761 29379 raft_consensus.cc:359] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.921950 29379 raft_consensus.cc:385] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.922048 29379 raft_consensus.cc:740] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.922258 29379 consensus_queue.cc:260] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.923491 29379 ts_tablet_manager.cc:1434] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:43.923756 29379 tablet_bootstrap.cc:492] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:43.924836 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd7079ea860149f19227264b8507685b consensus state has no leader
I20260617 20:16:43.925329 29379 tablet_bootstrap.cc:654] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.925726 29383 tablet_bootstrap.cc:654] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:43.925956 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95bf5d8704614db68c8ce7c272c2fb13 consensus state has no leader
I20260617 20:16:43.927610 29376 tablet_replica.cc:333] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:43.927829 29376 raft_consensus.cc:2243] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.927918 29377 ts_tablet_manager.cc:1929] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.928041 29377 log.cc:1199] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/3bff8e928b534201bac3c1d27878535f
I20260617 20:16:43.928062 29376 raft_consensus.cc:2272] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.928447 29377 ts_tablet_manager.cc:1950] T 3bff8e928b534201bac3c1d27878535f P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:43.928897 29376 ts_tablet_manager.cc:1916] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.929823 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 3bff8e928b534201bac3c1d27878535f (table default.Table_87c4fdebf4f24b5aabd1a274ecd1d005 [id=7e09804e39894310ba5f841e3921d0c2]) successfully deleted
I20260617 20:16:43.930239 29377 tablet_replica.cc:333] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:43.930445 29377 raft_consensus.cc:2243] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.930613 29377 raft_consensus.cc:2272] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.931367 29377 ts_tablet_manager.cc:1916] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.938898 29379 tablet_bootstrap.cc:492] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:43.939073 29379 ts_tablet_manager.cc:1403] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20260617 20:16:43.940001 29379 raft_consensus.cc:359] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.940207 29379 raft_consensus.cc:385] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.940356 29379 raft_consensus.cc:740] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.940640 29379 consensus_queue.cc:260] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.941826 29383 tablet_bootstrap.cc:492] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:43.942366 29379 ts_tablet_manager.cc:1434] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:43.942052 29383 ts_tablet_manager.cc:1403] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.007s
I20260617 20:16:43.942663 29379 tablet_bootstrap.cc:492] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:43.943614 29383 raft_consensus.cc:359] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.943856 29383 raft_consensus.cc:385] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.943974 29383 raft_consensus.cc:740] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.944327 29379 tablet_bootstrap.cc:654] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.944332 29383 consensus_queue.cc:260] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.948741 29383 ts_tablet_manager.cc:1434] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260617 20:16:43.950569 29377 ts_tablet_manager.cc:1929] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.950788 29377 log.cc:1199] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/45399615180643949e95189457f6b923
I20260617 20:16:43.951221 29377 ts_tablet_manager.cc:1950] T 45399615180643949e95189457f6b923 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:43.952239 29239 tablet_service.cc:1511] Processing CreateTablet for tablet dd7079ea860149f19227264b8507685b (DEFAULT_TABLE table=default.Table_1f83bbace5d34129ae25257812cd9df9 [id=b4613adf2f5b40a780f81d91421a689a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.952550 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 45399615180643949e95189457f6b923 (table default.Table_2aff49df5853489380e2e98e4b4e3136 [id=5cbd1fda6d4a4150a1bb9d05f74c7d3e]) successfully deleted
I20260617 20:16:43.952620 29383 tablet_bootstrap.cc:492] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:43.952699 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd7079ea860149f19227264b8507685b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.953647 29379 tablet_bootstrap.cc:492] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:43.953781 29379 ts_tablet_manager.cc:1403] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20260617 20:16:43.954559 29379 raft_consensus.cc:359] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.954737 29379 raft_consensus.cc:385] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.954813 29379 raft_consensus.cc:740] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.955118 29379 consensus_queue.cc:260] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.955760 29379 ts_tablet_manager.cc:1434] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:43.955852 29376 ts_tablet_manager.cc:1929] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.956008 29376 log.cc:1199] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/02cea5d29e8b4c209515bc05be7a6324
I20260617 20:16:43.956161 29388 raft_consensus.cc:493] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:43.956489 29376 ts_tablet_manager.cc:1950] T 02cea5d29e8b4c209515bc05be7a6324 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:43.956413 29388 raft_consensus.cc:515] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.958607 29388 leader_election.cc:290] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:43.959558 29383 tablet_bootstrap.cc:654] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.959918 29101 tablet_service.cc:1511] Processing CreateTablet for tablet dd7079ea860149f19227264b8507685b (DEFAULT_TABLE table=default.Table_1f83bbace5d34129ae25257812cd9df9 [id=b4613adf2f5b40a780f81d91421a689a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.960307 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd7079ea860149f19227264b8507685b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.961159 29376 tablet_replica.cc:333] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:43.961378 29376 raft_consensus.cc:2243] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.961544 29376 raft_consensus.cc:2272] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.963346 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 680fe7bf06bf4dcdab15c7c95cb00daf (DEFAULT_TABLE table=default.Table_8eceb8f19afd47f2bf478ee57537dd7b [id=9439537fd882414f94ec8dd957bbd86e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.963764 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680fe7bf06bf4dcdab15c7c95cb00daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.963739 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 95bf5d8704614db68c8ce7c272c2fb13 (DEFAULT_TABLE table=default.Table_d8de4b07f59243b79391d97fdec2323f [id=727864a195db4e4585240fb48a508df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.964141 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95bf5d8704614db68c8ce7c272c2fb13. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:43.964390 29311 tablet.cc:2406] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 20:16:43.963016 29376 ts_tablet_manager.cc:1916] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:43.971370 29063 leader_election.cc:343] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 02cea5d29e8b4c209515bc05be7a6324
I20260617 20:16:43.972954 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 95bf5d8704614db68c8ce7c272c2fb13 (DEFAULT_TABLE table=default.Table_d8de4b07f59243b79391d97fdec2323f [id=727864a195db4e4585240fb48a508df7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.973417 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95bf5d8704614db68c8ce7c272c2fb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.974540 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 52d25188917845a28a926274976cbaf4 (table default.Table_8eceb8f19afd47f2bf478ee57537dd7b [id=9439537fd882414f94ec8dd957bbd86e]) successfully deleted
I20260617 20:16:43.974907 29242 tablet_service.cc:1511] Processing CreateTablet for tablet f23960607f8a4efcb56cd5f306dc3a85 (DEFAULT_TABLE table=default.Table_4d5105d9785547e587bf29e7bca97216 [id=d70c3654e0c4417e9ff68be4309793ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.975311 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f23960607f8a4efcb56cd5f306dc3a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.979101 29379 tablet_bootstrap.cc:492] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:43.980823 29379 tablet_bootstrap.cc:654] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:43.981853 29377 tablet_replica.cc:333] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:43.982043 29377 raft_consensus.cc:2243] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.982993 29107 tablet_service.cc:1511] Processing CreateTablet for tablet f23960607f8a4efcb56cd5f306dc3a85 (DEFAULT_TABLE table=default.Table_4d5105d9785547e587bf29e7bca97216 [id=d70c3654e0c4417e9ff68be4309793ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.974921 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 45399615180643949e95189457f6b923 (table default.Table_2aff49df5853489380e2e98e4b4e3136 [id=5cbd1fda6d4a4150a1bb9d05f74c7d3e]) successfully deleted
I20260617 20:16:43.983383 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f23960607f8a4efcb56cd5f306dc3a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.984026 29377 raft_consensus.cc:2272] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:43.984562 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 52d25188917845a28a926274976cbaf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52d25188917845a28a926274976cbaf4 already in progress: creating tablet
I20260617 20:16:43.984683 29377 ts_tablet_manager.cc:1916] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:43.984978 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 02cea5d29e8b4c209515bc05be7a6324 (table default.Table_a34b5cc6e9f2434488cc50d41fb64a03 [id=727864a195db4e4585240fb48a508df7]) successfully deleted
I20260617 20:16:43.985424 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 02cea5d29e8b4c209515bc05be7a6324 with delete_type TABLET_DATA_DELETED (replaced by tablet 95bf5d8704614db68c8ce7c272c2fb13) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.985661 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 45399615180643949e95189457f6b923 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.986088 29375 tablet_replica.cc:333] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:43.986289 29375 raft_consensus.cc:2243] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:43.986472 29375 raft_consensus.cc:2272] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:43.986655 29103 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae50375e5934acbb213379fb7c87989 with delete_type TABLET_DATA_DELETED (replaced by tablet f23960607f8a4efcb56cd5f306dc3a85) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:43.987202 29375 ts_tablet_manager.cc:1916] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:43.987416 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet b5ddb72dae9345febe2a9a53bc2d89f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b5ddb72dae9345febe2a9a53bc2d89f6 already in progress: creating tablet
I20260617 20:16:43.985229 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet ba383035d6f94f1686f6f1dfd10a974d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:43.987828 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3bff8e928b534201bac3c1d27878535f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3bff8e928b534201bac3c1d27878535f already in progress: creating tablet
W20260617 20:16:43.988109 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet df72757ce3cd4651987bfb29dd8be77d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df72757ce3cd4651987bfb29dd8be77d already in progress: creating tablet
W20260617 20:16:43.988353 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 already in progress: creating tablet
I20260617 20:16:43.989424 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_49f5d2834cac44a498320d7ed4c3b040" } new_table_name: "default.Table_fe67ad77f1ce49b5937264b0a78665f5" modify_external_catalogs: true
W20260617 20:16:43.989657 29176 tablet.cc:2406] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 20:16:43.990289 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 680fe7bf06bf4dcdab15c7c95cb00daf (DEFAULT_TABLE table=default.Table_8eceb8f19afd47f2bf478ee57537dd7b [id=9439537fd882414f94ec8dd957bbd86e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:43.990648 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680fe7bf06bf4dcdab15c7c95cb00daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:43.990761 29377 ts_tablet_manager.cc:1929] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.990872 29377 log.cc:1199] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/52d25188917845a28a926274976cbaf4
I20260617 20:16:43.991230 29377 ts_tablet_manager.cc:1950] T 52d25188917845a28a926274976cbaf4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:43.992234 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 52d25188917845a28a926274976cbaf4 (table default.Table_8eceb8f19afd47f2bf478ee57537dd7b [id=9439537fd882414f94ec8dd957bbd86e]) successfully deleted
I20260617 20:16:43.994499 29379 tablet_bootstrap.cc:492] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:43.994666 29379 ts_tablet_manager.cc:1403] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.004s
I20260617 20:16:43.995481 29379 raft_consensus.cc:359] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:43.995702 29379 raft_consensus.cc:385] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:43.995790 29379 raft_consensus.cc:740] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:43.996017 29379 consensus_queue.cc:260] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:43.997009 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac consensus state has no leader
I20260617 20:16:43.997753 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b9ea9adf3f7143cba867bf439590a359"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:43.997952 29379 ts_tablet_manager.cc:1434] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:16:43.998307 29379 tablet_bootstrap.cc:492] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:43.998574 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9ea9adf3f7143cba867bf439590a359 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:43.999616 29375 ts_tablet_manager.cc:1929] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:43.999745 29375 log.cc:1199] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/02cea5d29e8b4c209515bc05be7a6324
I20260617 20:16:44.000182 29375 ts_tablet_manager.cc:1950] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.000705 29375 tablet_replica.cc:333] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.001510 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_bc9d14d4c6734ab380f6fd753c50567d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.002024 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc9d14d4c6734ab380f6fd753c50567d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.002262 29375 raft_consensus.cc:2243] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.002456 29375 raft_consensus.cc:2272] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.000187 29379 tablet_bootstrap.cc:654] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.006047 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet a9a54cc7eccb4227be5fded7cc6e2a8b from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.009094 29375 ts_tablet_manager.cc:1916] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.010067 29379 tablet_bootstrap.cc:492] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.010205 29379 ts_tablet_manager.cc:1403] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260617 20:16:44.010354 29383 tablet_bootstrap.cc:492] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.010495 29383 ts_tablet_manager.cc:1403] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.058s user 0.000s sys 0.007s
I20260617 20:16:44.011008 29379 raft_consensus.cc:359] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.011189 29379 raft_consensus.cc:385] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.011294 29379 raft_consensus.cc:740] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.011237 29383 raft_consensus.cc:359] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.011436 29383 raft_consensus.cc:385] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.011530 29383 raft_consensus.cc:740] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.011514 29379 consensus_queue.cc:260] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.011765 29383 consensus_queue.cc:260] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.012003 29379 ts_tablet_manager.cc:1434] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:44.012264 29379 tablet_bootstrap.cc:492] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.012610 29383 ts_tablet_manager.cc:1434] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:44.012872 29383 tablet_bootstrap.cc:492] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.014815 29383 tablet_bootstrap.cc:654] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.017966 29376 ts_tablet_manager.cc:1929] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.018132 29376 log.cc:1199] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/42aeede5da974652898bccc8e0a38bce
I20260617 20:16:44.018512 29376 ts_tablet_manager.cc:1950] T 42aeede5da974652898bccc8e0a38bce P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:44.020551 29383 tablet_bootstrap.cc:492] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.020732 29383 ts_tablet_manager.cc:1403] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s
I20260617 20:16:44.021703 29383 raft_consensus.cc:359] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.021896 29383 raft_consensus.cc:385] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.021974 29383 raft_consensus.cc:740] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.022234 29383 consensus_queue.cc:260] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.023416 29383 ts_tablet_manager.cc:1434] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:44.023703 29383 tablet_bootstrap.cc:492] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.023958 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a9a54cc7eccb4227be5fded7cc6e2a8b
I20260617 20:16:44.024437 28665 catalog_manager.cc:6784] ReplaceTablet: tablet a9a54cc7eccb4227be5fded7cc6e2a8b deleted and replaced by tablet d723526a83174898a71a835b7cdbc467
I20260617 20:16:44.025852 29383 tablet_bootstrap.cc:654] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.027468 29376 tablet_replica.cc:333] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:16:44.027431 29062 leader_election.cc:343] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 02cea5d29e8b4c209515bc05be7a6324
I20260617 20:16:44.027643 29376 raft_consensus.cc:2243] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.027832 29376 raft_consensus.cc:2272] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.027582 29062 leader_election.cc:304] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:44.028421 29379 tablet_bootstrap.cc:654] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.028576 29376 ts_tablet_manager.cc:1916] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:44.028733 29062 raft_consensus.cc:2686] T 02cea5d29e8b4c209515bc05be7a6324 P 6d4ce30e1fce4591b64c398747f8d37a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:16:44.031319 29375 ts_tablet_manager.cc:1929] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.031545 29375 log.cc:1199] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/45399615180643949e95189457f6b923
I20260617 20:16:44.031936 29375 ts_tablet_manager.cc:1950] T 45399615180643949e95189457f6b923 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.032994 29375 tablet_replica.cc:333] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.033237 29375 raft_consensus.cc:2243] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.033502 29375 raft_consensus.cc:2272] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.034565 29375 ts_tablet_manager.cc:1916] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.034950 29376 ts_tablet_manager.cc:1929] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.035079 29376 log.cc:1199] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/ba383035d6f94f1686f6f1dfd10a974d
I20260617 20:16:44.035442 29376 ts_tablet_manager.cc:1950] T ba383035d6f94f1686f6f1dfd10a974d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:44.038141 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet a9a54cc7eccb4227be5fded7cc6e2a8b with delete_type TABLET_DATA_DELETED (replaced by tablet d723526a83174898a71a835b7cdbc467) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:44.039019 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet a9a54cc7eccb4227be5fded7cc6e2a8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9a54cc7eccb4227be5fded7cc6e2a8b already in progress: creating tablet
I20260617 20:16:44.039270 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 4bd2621fc81a46c4945260a85a8d6aa2 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.041771 29383 tablet_bootstrap.cc:492] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.041654 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3074bd171fd54a10948acd223e1c6da7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.041951 29383 ts_tablet_manager.cc:1403] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.002s
W20260617 20:16:44.042433 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3074bd171fd54a10948acd223e1c6da7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.042861 29383 raft_consensus.cc:359] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.043105 29383 raft_consensus.cc:385] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.043205 29383 raft_consensus.cc:740] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.043569 29383 consensus_queue.cc:260] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.045238 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2010232aed489ba61ec1ac423b2f2d (DEFAULT_TABLE table=default.Table_9d14a80a9dfb4132a326a22fffbe8152 [id=225c167b50aa4f898139245b0935968b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.045876 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2010232aed489ba61ec1ac423b2f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.047151 29375 ts_tablet_manager.cc:1929] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.047293 29375 log.cc:1199] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/3ae50375e5934acbb213379fb7c87989
I20260617 20:16:44.047713 29375 ts_tablet_manager.cc:1950] T 3ae50375e5934acbb213379fb7c87989 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.048446 29383 ts_tablet_manager.cc:1434] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260617 20:16:44.050462 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_68a04d47b12e4085a79f0e2fd7b388ce" } new_table_name: "default.Table_5fa8145179ed4e05903ddbb2e8dfa82d" modify_external_catalogs: true
I20260617 20:16:44.054440 29383 tablet_bootstrap.cc:492] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.054510 28966 tablet_service.cc:1511] Processing CreateTablet for tablet f3d06c0618db45689428b0c1125bd193 (DEFAULT_TABLE table=default.Table_315b909d8d1c411f89063fecb8be5b84 [id=aca59faae56b44f5ae502160c7b43e4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.055243 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d06c0618db45689428b0c1125bd193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.056770 29383 tablet_bootstrap.cc:654] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.061023 29383 tablet_bootstrap.cc:492] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.061190 29383 ts_tablet_manager.cc:1403] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260617 20:16:44.061342 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 3ae50375e5934acbb213379fb7c87989 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.061983 29383 raft_consensus.cc:359] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.062197 29383 raft_consensus.cc:385] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.062188 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5b1993d0c19d4c9a9d266ba632d99c39" } modify_external_catalogs: true
I20260617 20:16:44.062275 29383 raft_consensus.cc:740] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.062351 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d0963241dd0f4d5f9be5d2bd34871072" } modify_external_catalogs: true
I20260617 20:16:44.062384 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5b1993d0c19d4c9a9d266ba632d99c39" } modify_external_catalogs: true
I20260617 20:16:44.062565 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d0963241dd0f4d5f9be5d2bd34871072" } modify_external_catalogs: true
I20260617 20:16:44.062582 29383 consensus_queue.cc:260] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.064275 29391 raft_consensus.cc:493] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:44.064517 29391 raft_consensus.cc:515] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.065533 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet 511179f9875241128390708b55dba05e from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.066536 29391 leader_election.cc:290] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:44.066821 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0ec2cf7d7dc84aaa942f063bbcb984b9" } modify_external_catalogs: true
I20260617 20:16:44.066936 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8768bdfdc4af4740898b1018fd51e808" } modify_external_catalogs: true
I20260617 20:16:44.067025 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0ec2cf7d7dc84aaa942f063bbcb984b9" } modify_external_catalogs: true
I20260617 20:16:44.067117 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8768bdfdc4af4740898b1018fd51e808" } modify_external_catalogs: true
I20260617 20:16:44.067852 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 02cea5d29e8b4c209515bc05be7a6324 (table default.Table_a34b5cc6e9f2434488cc50d41fb64a03 [id=727864a195db4e4585240fb48a508df7]) successfully deleted
I20260617 20:16:44.068163 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 45399615180643949e95189457f6b923 (table default.Table_2aff49df5853489380e2e98e4b4e3136 [id=5cbd1fda6d4a4150a1bb9d05f74c7d3e]) successfully deleted
I20260617 20:16:44.068351 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 3ae50375e5934acbb213379fb7c87989 (table default.Table_4d5105d9785547e587bf29e7bca97216 [id=d70c3654e0c4417e9ff68be4309793ba]) successfully deleted
I20260617 20:16:44.068521 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 42aeede5da974652898bccc8e0a38bce (table default.Table_421f6bf3dab14ec58437bc887fb7b191 [id=eb811592c47c4ad695a19baf0cc91349]) successfully deleted
I20260617 20:16:44.068711 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet ba383035d6f94f1686f6f1dfd10a974d (table default.Table_b67aea11857c4eac91427f845b772571 [id=291a4589243443078220d3cd9940a63d]) successfully deleted
I20260617 20:16:44.068802 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_61a0915707aa43228ddd3cf87f4c1d80" } new_table_name: "default.Table_dd6ce0bb614b47a8a449e4b75ec58dce" modify_external_catalogs: true
I20260617 20:16:44.070204 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_389a4632b173428984db63f12fbe631f" } modify_external_catalogs: true
I20260617 20:16:44.070408 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_389a4632b173428984db63f12fbe631f" } modify_external_catalogs: true
I20260617 20:16:44.071125 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet df72757ce3cd4651987bfb29dd8be77d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.071406 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ddb72dae9345febe2a9a53bc2d89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.071592 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 42aeede5da974652898bccc8e0a38bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.071767 29103 tablet_service.cc:1558] Processing DeleteTablet for tablet a9a54cc7eccb4227be5fded7cc6e2a8b with delete_type TABLET_DATA_DELETED (replaced by tablet d723526a83174898a71a835b7cdbc467) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.072144 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2010232aed489ba61ec1ac423b2f2d (DEFAULT_TABLE table=default.Table_9d14a80a9dfb4132a326a22fffbe8152 [id=225c167b50aa4f898139245b0935968b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.072605 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2010232aed489ba61ec1ac423b2f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.073172 29237 tablet_service.cc:1511] Processing CreateTablet for tablet f3d06c0618db45689428b0c1125bd193 (DEFAULT_TABLE table=default.Table_315b909d8d1c411f89063fecb8be5b84 [id=aca59faae56b44f5ae502160c7b43e4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.073664 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d06c0618db45689428b0c1125bd193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.077353 29240 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ae50375e5934acbb213379fb7c87989 with delete_type TABLET_DATA_DELETED (replaced by tablet f23960607f8a4efcb56cd5f306dc3a85) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.077464 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ddb72dae9345febe2a9a53bc2d89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.077818 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2010232aed489ba61ec1ac423b2f2d (DEFAULT_TABLE table=default.Table_9d14a80a9dfb4132a326a22fffbe8152 [id=225c167b50aa4f898139245b0935968b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.078209 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2010232aed489ba61ec1ac423b2f2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.080438 28897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:44.080688 28897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: This master's current role is: LEADER
I20260617 20:16:44.082475 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bff8e928b534201bac3c1d27878535f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.084167 28969 tablet_service.cc:1511] Processing CreateTablet for tablet adcd4689680e43b19318336fb5a3edb3 (DEFAULT_TABLE table=default.Table_24eb651bcbec4bafbac0b0612438512f [id=704477b29a8548ed9d8fd39b7e9e89a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.084606 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcd4689680e43b19318336fb5a3edb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.084712 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 5c047f3fab644c50aef4adfff153a85b (DEFAULT_TABLE table=default.Table_0ec2cf7d7dc84aaa942f063bbcb984b9 [id=fb1fb1a6dbdd4b258aa91bb9e4f06ae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.085176 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c047f3fab644c50aef4adfff153a85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.088686 29379 tablet_bootstrap.cc:492] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.088843 29103 tablet_service.cc:1511] Processing CreateTablet for tablet f3d06c0618db45689428b0c1125bd193 (DEFAULT_TABLE table=default.Table_315b909d8d1c411f89063fecb8be5b84 [id=aca59faae56b44f5ae502160c7b43e4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.089257 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d06c0618db45689428b0c1125bd193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.090248 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4bd2621fc81a46c4945260a85a8d6aa2
I20260617 20:16:44.090760 28663 catalog_manager.cc:6784] ReplaceTablet: tablet 4bd2621fc81a46c4945260a85a8d6aa2 deleted and replaced by tablet f74494a3230448c983d8af0e553247bf
I20260617 20:16:44.091006 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet a42074d6374a4682a4948970720134e4 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.091496 29234 tablet_service.cc:1511] Processing CreateTablet for tablet adcd4689680e43b19318336fb5a3edb3 (DEFAULT_TABLE table=default.Table_24eb651bcbec4bafbac0b0612438512f [id=704477b29a8548ed9d8fd39b7e9e89a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.091907 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcd4689680e43b19318336fb5a3edb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.088920 29379 ts_tablet_manager.cc:1403] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.077s user 0.024s sys 0.028s
I20260617 20:16:44.093588 29243 tablet_service.cc:1511] Processing CreateTablet for tablet a340551ee95c4b6685213a4dbd21f6c1 (DEFAULT_TABLE table=default.Table_8768bdfdc4af4740898b1018fd51e808 [id=772f52014ca7448ba492233fd74402e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.093824 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 61b9f6bff7b546ad94411325cc770d52 (DEFAULT_TABLE table=default.Table_0a57fb26789b4826858b2755f0f85b86 [id=d6d4c2a3dc5e41669e992a16ce5f16c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.093952 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a340551ee95c4b6685213a4dbd21f6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.093976 29379 raft_consensus.cc:359] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.094127 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b9f6bff7b546ad94411325cc770d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.094163 29379 raft_consensus.cc:385] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.094236 29379 raft_consensus.cc:740] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.089514 29106 tablet_service.cc:1511] Processing CreateTablet for tablet a340551ee95c4b6685213a4dbd21f6c1 (DEFAULT_TABLE table=default.Table_8768bdfdc4af4740898b1018fd51e808 [id=772f52014ca7448ba492233fd74402e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.094511 29240 tablet_service.cc:1511] Processing CreateTablet for tablet b89b44c6cb2c41409a15708feec0c29b (DEFAULT_TABLE table=default.Table_68a04d47b12e4085a79f0e2fd7b388ce [id=8272ea6276314a28bca235431f8f3986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.094496 29379 consensus_queue.cc:260] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.094627 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a340551ee95c4b6685213a4dbd21f6c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.094818 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b89b44c6cb2c41409a15708feec0c29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.096225 29379 ts_tablet_manager.cc:1434] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:44.096613 29379 tablet_bootstrap.cc:492] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.089406 29100 tablet_service.cc:1511] Processing CreateTablet for tablet adcd4689680e43b19318336fb5a3edb3 (DEFAULT_TABLE table=default.Table_24eb651bcbec4bafbac0b0612438512f [id=704477b29a8548ed9d8fd39b7e9e89a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.089592 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 61b9f6bff7b546ad94411325cc770d52 (DEFAULT_TABLE table=default.Table_0a57fb26789b4826858b2755f0f85b86 [id=d6d4c2a3dc5e41669e992a16ce5f16c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.097818 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcd4689680e43b19318336fb5a3edb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.098119 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b9f6bff7b546ad94411325cc770d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.098387 29379 tablet_bootstrap.cc:654] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.089906 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 5c047f3fab644c50aef4adfff153a85b (DEFAULT_TABLE table=default.Table_0ec2cf7d7dc84aaa942f063bbcb984b9 [id=fb1fb1a6dbdd4b258aa91bb9e4f06ae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.099967 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c047f3fab644c50aef4adfff153a85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.093590 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 5c047f3fab644c50aef4adfff153a85b (DEFAULT_TABLE table=default.Table_0ec2cf7d7dc84aaa942f063bbcb984b9 [id=fb1fb1a6dbdd4b258aa91bb9e4f06ae2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.105746 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c047f3fab644c50aef4adfff153a85b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.105754 29375 tablet_replica.cc:333] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.105954 29375 raft_consensus.cc:2243] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.106127 29375 raft_consensus.cc:2272] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.106896 29375 ts_tablet_manager.cc:1916] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.090224 29101 tablet_service.cc:1511] Processing CreateTablet for tablet b89b44c6cb2c41409a15708feec0c29b (DEFAULT_TABLE table=default.Table_68a04d47b12e4085a79f0e2fd7b388ce [id=8272ea6276314a28bca235431f8f3986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.108590 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b89b44c6cb2c41409a15708feec0c29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.114903 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 511179f9875241128390708b55dba05e
I20260617 20:16:44.116080 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a340551ee95c4b6685213a4dbd21f6c1
I20260617 20:16:44.116833 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_81c4de22d335419abd4b3910e9025510"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.117448 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81c4de22d335419abd4b3910e9025510 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:44.117826 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d723526a83174898a71a835b7cdbc467 has no consensus state
I20260617 20:16:44.118404 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet cd628a25f3a14b64a5f9a70d104b3dcf
I20260617 20:16:44.118490 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a42074d6374a4682a4948970720134e4
I20260617 20:16:44.122284 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd2621fc81a46c4945260a85a8d6aa2 with delete_type TABLET_DATA_DELETED (replaced by tablet f74494a3230448c983d8af0e553247bf) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.124075 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet 52d25188917845a28a926274976cbaf4 with delete_type TABLET_DATA_DELETED (replaced by tablet 680fe7bf06bf4dcdab15c7c95cb00daf) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.126641 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet a9a54cc7eccb4227be5fded7cc6e2a8b with delete_type TABLET_DATA_DELETED (replaced by tablet d723526a83174898a71a835b7cdbc467) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.126843 29376 tablet_replica.cc:333] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:44.127280 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet 511179f9875241128390708b55dba05e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.130144 29383 ts_tablet_manager.cc:1434] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.069s user 0.002s sys 0.000s
I20260617 20:16:44.132557 29376 raft_consensus.cc:2243] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.132573 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ceb8ef16219d4297985dadd23cf17cea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.132748 29376 raft_consensus.cc:2272] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:44.133320 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceb8ef16219d4297985dadd23cf17cea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.134586 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd2621fc81a46c4945260a85a8d6aa2 with delete_type TABLET_DATA_DELETED (replaced by tablet f74494a3230448c983d8af0e553247bf) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.134670 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 511179f9875241128390708b55dba05e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.134790 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet a340551ee95c4b6685213a4dbd21f6c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.134945 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet cd628a25f3a14b64a5f9a70d104b3dcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.135108 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet a42074d6374a4682a4948970720134e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.135365 28970 tablet_service.cc:1511] Processing CreateTablet for tablet b89b44c6cb2c41409a15708feec0c29b (DEFAULT_TABLE table=default.Table_68a04d47b12e4085a79f0e2fd7b388ce [id=8272ea6276314a28bca235431f8f3986]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.135845 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b89b44c6cb2c41409a15708feec0c29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.135990 29378 tablet_bootstrap.cc:492] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.136126 29378 ts_tablet_manager.cc:1403] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.225s user 0.035s sys 0.045s
W20260617 20:16:44.137002 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b89b44c6cb2c41409a15708feec0c29b consensus state has no leader
I20260617 20:16:44.137009 29378 raft_consensus.cc:359] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.137216 29378 raft_consensus.cc:385] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.137322 29378 raft_consensus.cc:740] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.137586 29378 consensus_queue.cc:260] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.138680 28963 tablet_service.cc:1511] Processing CreateTablet for tablet a340551ee95c4b6685213a4dbd21f6c1 (DEFAULT_TABLE table=default.Table_8768bdfdc4af4740898b1018fd51e808 [id=772f52014ca7448ba492233fd74402e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.139072 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a340551ee95c4b6685213a4dbd21f6c1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:44.140224 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3ae50375e5934acbb213379fb7c87989 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3ae50375e5934acbb213379fb7c87989 already in progress: creating tablet
I20260617 20:16:44.140908 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5c047f3fab644c50aef4adfff153a85b
I20260617 20:16:44.141970 29378 ts_tablet_manager.cc:1434] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260617 20:16:44.142247 29378 tablet_bootstrap.cc:492] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.144111 29378 tablet_bootstrap.cc:654] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:44.151443 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 4bd2621fc81a46c4945260a85a8d6aa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bd2621fc81a46c4945260a85a8d6aa2 already in progress: creating tablet
W20260617 20:16:44.151767 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet a340551ee95c4b6685213a4dbd21f6c1 because the tablet was not found. No further retry: Not found: Tablet not found: a340551ee95c4b6685213a4dbd21f6c1
W20260617 20:16:44.152029 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet cd628a25f3a14b64a5f9a70d104b3dcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd628a25f3a14b64a5f9a70d104b3dcf already in progress: creating tablet
W20260617 20:16:44.152249 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet a42074d6374a4682a4948970720134e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a42074d6374a4682a4948970720134e4 already in progress: creating tablet
W20260617 20:16:44.152495 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 511179f9875241128390708b55dba05e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 511179f9875241128390708b55dba05e already in progress: creating tablet
I20260617 20:16:44.153260 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c047f3fab644c50aef4adfff153a85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:44.161875 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5c047f3fab644c50aef4adfff153a85b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c047f3fab644c50aef4adfff153a85b already in progress: creating tablet
I20260617 20:16:44.162794 28631 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRePpQS/build/asan/bin/kudu
/tmp/dist-test-taskRePpQS/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.252:46059
--webserver_interface=127.27.245.252
--webserver_port=42219
--builtin_ntp_servers=127.27.245.212:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260617 20:16:44.165627 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet b5ddb72dae9345febe2a9a53bc2d89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.165942 29377 tablet_replica.cc:333] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.166169 29377 raft_consensus.cc:2243] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.166350 29377 raft_consensus.cc:2272] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.170871 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd2621fc81a46c4945260a85a8d6aa2 with delete_type TABLET_DATA_DELETED (replaced by tablet f74494a3230448c983d8af0e553247bf) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:44.175143 29197 leader_election.cc:343] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 52d25188917845a28a926274976cbaf4
I20260617 20:16:44.176321 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet a42074d6374a4682a4948970720134e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.178959 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c047f3fab644c50aef4adfff153a85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.181747 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 55e4ef1f493c4f1289cfa192ce38161d (DEFAULT_TABLE table=default.Table_b9ea9adf3f7143cba867bf439590a359 [id=904de84620c746dd8bc86909459d3506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.182318 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e4ef1f493c4f1289cfa192ce38161d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.182555 28964 tablet_service.cc:1511] Processing CreateTablet for tablet d723526a83174898a71a835b7cdbc467 (DEFAULT_TABLE table=default.Table_dd6ce0bb614b47a8a449e4b75ec58dce [id=da4afdf3f60e48e78eb52d454fa4142c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.182950 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d723526a83174898a71a835b7cdbc467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.186528 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 46d7fa99c35646c59898738de38c88ed (DEFAULT_TABLE table=default.Table_bc9d14d4c6734ab380f6fd753c50567d [id=c654a7154f724dd8ac916d398c662cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.186830 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet a340551ee95c4b6685213a4dbd21f6c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.186904 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d7fa99c35646c59898738de38c88ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.187045 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d6af4b98fcb4161b7432280605224d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.187489 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 511179f9875241128390708b55dba05e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.188340 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet a42074d6374a4682a4948970720134e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.189585 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 55e4ef1f493c4f1289cfa192ce38161d (DEFAULT_TABLE table=default.Table_b9ea9adf3f7143cba867bf439590a359 [id=904de84620c746dd8bc86909459d3506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.189961 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e4ef1f493c4f1289cfa192ce38161d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.190392 29108 tablet_service.cc:1511] Processing CreateTablet for tablet d723526a83174898a71a835b7cdbc467 (DEFAULT_TABLE table=default.Table_dd6ce0bb614b47a8a449e4b75ec58dce [id=da4afdf3f60e48e78eb52d454fa4142c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.190745 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d723526a83174898a71a835b7cdbc467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.190210 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c047f3fab644c50aef4adfff153a85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.191704 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet cd628a25f3a14b64a5f9a70d104b3dcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.192144 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 55e4ef1f493c4f1289cfa192ce38161d (DEFAULT_TABLE table=default.Table_b9ea9adf3f7143cba867bf439590a359 [id=904de84620c746dd8bc86909459d3506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.192569 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e4ef1f493c4f1289cfa192ce38161d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.194166 29242 tablet_service.cc:1511] Processing CreateTablet for tablet d723526a83174898a71a835b7cdbc467 (DEFAULT_TABLE table=default.Table_dd6ce0bb614b47a8a449e4b75ec58dce [id=da4afdf3f60e48e78eb52d454fa4142c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.194485 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d723526a83174898a71a835b7cdbc467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.200453 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cd1fcbb5998c47d3a94203871e26a5a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.200769 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5fa8145179ed4e05903ddbb2e8dfa82d" } new_table_name: "default.Table_675165a5585146af86731c73080a0f3f" modify_external_catalogs: true
W20260617 20:16:44.201043 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd1fcbb5998c47d3a94203871e26a5a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.201900 29103 tablet_service.cc:1511] Processing CreateTablet for tablet 46d7fa99c35646c59898738de38c88ed (DEFAULT_TABLE table=default.Table_bc9d14d4c6734ab380f6fd753c50567d [id=c654a7154f724dd8ac916d398c662cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.202175 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a03f11705bbf4b679523c33e9fb71474"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.202311 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d7fa99c35646c59898738de38c88ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.202306 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e2bac1887f9c48fe8410e3d11b967c6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.202659 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a03f11705bbf4b679523c33e9fb71474 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:44.202741 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e2bac1887f9c48fe8410e3d11b967c6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.203832 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_28cf82e4eadf4486803f82c018ee9df6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.203886 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a5c3b69aae404d2291e8273318f4db21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.204259 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28cf82e4eadf4486803f82c018ee9df6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:44.204339 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5c3b69aae404d2291e8273318f4db21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.205415 29379 tablet_bootstrap.cc:492] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.205564 29379 ts_tablet_manager.cc:1403] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.109s user 0.025s sys 0.048s
I20260617 20:16:44.206589 29379 raft_consensus.cc:359] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.206780 29379 raft_consensus.cc:385] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.207206 29379 raft_consensus.cc:740] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.208246 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 46d7fa99c35646c59898738de38c88ed (DEFAULT_TABLE table=default.Table_bc9d14d4c6734ab380f6fd753c50567d [id=c654a7154f724dd8ac916d398c662cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.208460 29379 consensus_queue.cc:260] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.208683 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46d7fa99c35646c59898738de38c88ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.209515 29379 ts_tablet_manager.cc:1434] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20260617 20:16:44.218961 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b89b44c6cb2c41409a15708feec0c29b consensus state has no leader
I20260617 20:16:44.219164 29379 tablet_bootstrap.cc:492] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.221211 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet cd628a25f3a14b64a5f9a70d104b3dcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.223852 29376 ts_tablet_manager.cc:1916] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.222411 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 61b9f6bff7b546ad94411325cc770d52 (DEFAULT_TABLE table=default.Table_0a57fb26789b4826858b2755f0f85b86 [id=d6d4c2a3dc5e41669e992a16ce5f16c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.224116 29379 tablet_bootstrap.cc:654] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.230559 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61b9f6bff7b546ad94411325cc770d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.232086 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c0b0e14daadf4b44b74c58729d340367" } new_table_name: "default.Table_fb677487243a423f83473bfcd261bbf4" modify_external_catalogs: true
I20260617 20:16:44.234675 29377 ts_tablet_manager.cc:1916] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.235250 29240 tablet_service.cc:1558] Processing DeleteTablet for tablet a340551ee95c4b6685213a4dbd21f6c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.236037 28964 tablet_service.cc:1511] Processing CreateTablet for tablet cd312e8817ee4c8fb7377825a7e6122a (DEFAULT_TABLE table=default.Table_3074bd171fd54a10948acd223e1c6da7 [id=1d46529c95a44c2c91c54e5b16a5f7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.236181 29383 tablet_bootstrap.cc:492] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.236477 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd312e8817ee4c8fb7377825a7e6122a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.241705 29377 ts_tablet_manager.cc:1929] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.241999 29377 log.cc:1199] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/b5ddb72dae9345febe2a9a53bc2d89f6
I20260617 20:16:44.242511 29377 ts_tablet_manager.cc:1950] T b5ddb72dae9345febe2a9a53bc2d89f6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:44.244009 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet b5ddb72dae9345febe2a9a53bc2d89f6 (table default.Table_c7b7e3bd549f44f897eb7364a000c40e [id=83c5102e80914ce69636ef845c3bad3f]) successfully deleted
I20260617 20:16:44.249068 29383 tablet_bootstrap.cc:654] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.254436 29242 tablet_service.cc:1511] Processing CreateTablet for tablet cd312e8817ee4c8fb7377825a7e6122a (DEFAULT_TABLE table=default.Table_3074bd171fd54a10948acd223e1c6da7 [id=1d46529c95a44c2c91c54e5b16a5f7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.254918 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd312e8817ee4c8fb7377825a7e6122a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.259091 29378 tablet_bootstrap.cc:492] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.259855 29378 ts_tablet_manager.cc:1403] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.118s user 0.009s sys 0.015s
I20260617 20:16:44.259842 29376 ts_tablet_manager.cc:1929] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.260283 29376 log.cc:1199] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/b5ddb72dae9345febe2a9a53bc2d89f6
I20260617 20:16:44.260669 29376 ts_tablet_manager.cc:1950] T b5ddb72dae9345febe2a9a53bc2d89f6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:44.261536 29378 raft_consensus.cc:359] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.261801 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet b5ddb72dae9345febe2a9a53bc2d89f6 (table default.Table_c7b7e3bd549f44f897eb7364a000c40e [id=83c5102e80914ce69636ef845c3bad3f]) successfully deleted
I20260617 20:16:44.262565 29378 raft_consensus.cc:385] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.262854 29378 raft_consensus.cc:740] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.263499 29378 consensus_queue.cc:260] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.266146 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 137cbb87d11c450995b63f7a8a7dece5 (DEFAULT_TABLE table=default.Table_81c4de22d335419abd4b3910e9025510 [id=0466c781ca0e4145b9f25b606c0edc5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.266685 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137cbb87d11c450995b63f7a8a7dece5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.270047 29108 tablet_service.cc:1511] Processing CreateTablet for tablet cd312e8817ee4c8fb7377825a7e6122a (DEFAULT_TABLE table=default.Table_3074bd171fd54a10948acd223e1c6da7 [id=1d46529c95a44c2c91c54e5b16a5f7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.270500 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd312e8817ee4c8fb7377825a7e6122a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.272290 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e2bac1887f9c48fe8410e3d11b967c6e" } new_table_name: "default.Table_e48bc2c0d35c428da4dd3a65681b7c15" modify_external_catalogs: true
I20260617 20:16:44.273625 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f07486abff7b4958baba24d98d53df0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.274127 29198 leader_election.cc:343] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 52d25188917845a28a926274976cbaf4
W20260617 20:16:44.274170 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f07486abff7b4958baba24d98d53df0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.274272 29198 leader_election.cc:304] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:44.275271 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a945d2c9fc4e4ebf92224c1a32bec9be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.275380 29391 raft_consensus.cc:2749] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:44.275717 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a945d2c9fc4e4ebf92224c1a32bec9be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.276614 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 137cbb87d11c450995b63f7a8a7dece5 (DEFAULT_TABLE table=default.Table_81c4de22d335419abd4b3910e9025510 [id=0466c781ca0e4145b9f25b606c0edc5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.279016 29375 ts_tablet_manager.cc:1929] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.279152 29375 log.cc:1199] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/df72757ce3cd4651987bfb29dd8be77d
I20260617 20:16:44.279496 29375 ts_tablet_manager.cc:1950] T df72757ce3cd4651987bfb29dd8be77d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.285997 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet 42aeede5da974652898bccc8e0a38bce from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.286298 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet 61b9f6bff7b546ad94411325cc770d52 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.286371 28962 tablet_service.cc:1511] Processing CreateTablet for tablet f74494a3230448c983d8af0e553247bf (DEFAULT_TABLE table=default.Table_c0b49bddc6014a769317c2ecc24f9bfe [id=f447de1e65a64027ae9c8983d72195e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.286478 29103 tablet_service.cc:1511] Processing CreateTablet for tablet 5f2ec59ac5864da5a13965ca0724c387 (DEFAULT_TABLE table=default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.286914 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 5f2ec59ac5864da5a13965ca0724c387 (DEFAULT_TABLE table=default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.287200 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74494a3230448c983d8af0e553247bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.287335 29240 tablet_service.cc:1511] Processing CreateTablet for tablet f74494a3230448c983d8af0e553247bf (DEFAULT_TABLE table=default.Table_c0b49bddc6014a769317c2ecc24f9bfe [id=f447de1e65a64027ae9c8983d72195e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.287331 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f2ec59ac5864da5a13965ca0724c387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.287873 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137cbb87d11c450995b63f7a8a7dece5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.290110 29379 tablet_bootstrap.cc:492] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.290333 29379 ts_tablet_manager.cc:1403] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.081s user 0.005s sys 0.013s
I20260617 20:16:44.291198 29379 raft_consensus.cc:359] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.291476 29379 raft_consensus.cc:385] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.291597 29379 raft_consensus.cc:740] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.291765 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74494a3230448c983d8af0e553247bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.291988 29379 consensus_queue.cc:260] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.294142 29379 ts_tablet_manager.cc:1434] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:16:44.294473 29379 tablet_bootstrap.cc:492] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.295305 29378 ts_tablet_manager.cc:1434] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.029s user 0.002s sys 0.000s
I20260617 20:16:44.296424 29375 tablet_replica.cc:333] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.296654 29375 raft_consensus.cc:2243] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.296948 29375 raft_consensus.cc:2272] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.297132 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 5f2ec59ac5864da5a13965ca0724c387 (DEFAULT_TABLE table=default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.297533 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f2ec59ac5864da5a13965ca0724c387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.298624 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f2ec59ac5864da5a13965ca0724c387. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.299930 28664 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (table default.Table_fe67ad77f1ce49b5937264b0a78665f5 [id=3a41dd53c3974256877f193219240234]). Expected version 2 got 0
I20260617 20:16:44.301086 29375 ts_tablet_manager.cc:1916] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.303087 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d6af4b98fcb4161b7432280605224d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.303432 29377 tablet_replica.cc:333] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.303608 29377 raft_consensus.cc:2243] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.303786 29377 raft_consensus.cc:2272] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:44.303995 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd7079ea860149f19227264b8507685b consensus state has no leader
I20260617 20:16:44.304497 29377 ts_tablet_manager.cc:1916] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.305426 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet df72757ce3cd4651987bfb29dd8be77d (table default.Table_13dc7de987b143f8b177239c1488c2ad [id=44e40556c20646558eb58acec6ad5f05]) successfully deleted
I20260617 20:16:44.306636 29101 tablet_service.cc:1511] Processing CreateTablet for tablet f74494a3230448c983d8af0e553247bf (DEFAULT_TABLE table=default.Table_c0b49bddc6014a769317c2ecc24f9bfe [id=f447de1e65a64027ae9c8983d72195e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.307013 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74494a3230448c983d8af0e553247bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.313287 29376 tablet_replica.cc:333] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:44.314270 28670 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (table default.Table_fe67ad77f1ce49b5937264b0a78665f5 [id=3a41dd53c3974256877f193219240234]). Expected version 2 got 0
I20260617 20:16:44.315567 29377 ts_tablet_manager.cc:1929] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.315866 29378 tablet_bootstrap.cc:492] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.315905 29377 log.cc:1199] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/6d6af4b98fcb4161b7432280605224d9
I20260617 20:16:44.316453 29377 ts_tablet_manager.cc:1950] T 6d6af4b98fcb4161b7432280605224d9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:44.317559 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 6d6af4b98fcb4161b7432280605224d9 (table default.Table_790a35cc325041b987a0185f1f3044a6 [id=c4b8f5740cdf4cc7912c732a21e3b13d]) successfully deleted
I20260617 20:16:44.319111 29379 tablet_bootstrap.cc:654] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:44.320012 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a79b56241ac84862868c664cca25654b has no consensus state
I20260617 20:16:44.320063 29378 tablet_bootstrap.cc:654] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.322655 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet adcd4689680e43b19318336fb5a3edb3 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.325493 29375 ts_tablet_manager.cc:1929] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.325668 29375 log.cc:1199] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/b5ddb72dae9345febe2a9a53bc2d89f6
I20260617 20:16:44.326152 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 137cbb87d11c450995b63f7a8a7dece5 (DEFAULT_TABLE table=default.Table_81c4de22d335419abd4b3910e9025510 [id=0466c781ca0e4145b9f25b606c0edc5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.313547 29376 raft_consensus.cc:2243] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.327127 29376 raft_consensus.cc:2272] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.327399 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_24eb651bcbec4bafbac0b0612438512f" } modify_external_catalogs: true
I20260617 20:16:44.327596 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_24eb651bcbec4bafbac0b0612438512f" } modify_external_catalogs: true
I20260617 20:16:44.327756 29375 ts_tablet_manager.cc:1950] T b5ddb72dae9345febe2a9a53bc2d89f6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.329986 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet b5ddb72dae9345febe2a9a53bc2d89f6 (table default.Table_c7b7e3bd549f44f897eb7364a000c40e [id=83c5102e80914ce69636ef845c3bad3f]) successfully deleted
I20260617 20:16:44.332639 29375 tablet_replica.cc:333] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.332922 29375 raft_consensus.cc:2243] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.333143 29375 raft_consensus.cc:2272] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.335686 29375 ts_tablet_manager.cc:1916] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.336252 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137cbb87d11c450995b63f7a8a7dece5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.339740 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_315b909d8d1c411f89063fecb8be5b84" } modify_external_catalogs: true
I20260617 20:16:44.339926 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_315b909d8d1c411f89063fecb8be5b84" } modify_external_catalogs: true
I20260617 20:16:44.342382 29378 tablet_bootstrap.cc:492] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.342555 29378 ts_tablet_manager.cc:1403] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260617 20:16:44.343405 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fe67ad77f1ce49b5937264b0a78665f5" } new_table_name: "default.Table_b3b3fd43238e4c979d4e814f42eb49ab" modify_external_catalogs: true
I20260617 20:16:44.343390 29378 raft_consensus.cc:359] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.343591 29378 raft_consensus.cc:385] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.343596 29383 tablet_bootstrap.cc:492] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.343679 29378 raft_consensus.cc:740] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.343781 29383 ts_tablet_manager.cc:1403] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.210s user 0.003s sys 0.001s
I20260617 20:16:44.343942 29378 consensus_queue.cc:260] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.344732 29383 raft_consensus.cc:359] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:44.344908 29383 raft_consensus.cc:385] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.344985 29383 raft_consensus.cc:740] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.345196 29383 consensus_queue.cc:260] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:44.348253 29378 ts_tablet_manager.cc:1434] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 20:16:44.348723 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cd1fcbb5998c47d3a94203871e26a5a7" } modify_external_catalogs: true
I20260617 20:16:44.348919 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cd1fcbb5998c47d3a94203871e26a5a7" } modify_external_catalogs: true
I20260617 20:16:44.349658 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet d723526a83174898a71a835b7cdbc467 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.349862 29240 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.351125 29378 tablet_bootstrap.cc:492] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.351086 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8eceb8f19afd47f2bf478ee57537dd7b" } modify_external_catalogs: true
I20260617 20:16:44.351326 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8eceb8f19afd47f2bf478ee57537dd7b" } modify_external_catalogs: true
I20260617 20:16:44.351490 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b9ea9adf3f7143cba867bf439590a359" } new_table_name: "default.Table_8955ebce08214381859b3c3c1ce00027" modify_external_catalogs: true
I20260617 20:16:44.352988 29378 tablet_bootstrap.cc:654] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.355990 29383 ts_tablet_manager.cc:1434] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260617 20:16:44.356271 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 42aeede5da974652898bccc8e0a38bce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.358959 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 61b9f6bff7b546ad94411325cc770d52
I20260617 20:16:44.359530 28665 catalog_manager.cc:6784] ReplaceTablet: tablet 61b9f6bff7b546ad94411325cc770d52 deleted and replaced by tablet bb4b3c917efb4c4aae1595af7ce1cd35
I20260617 20:16:44.359803 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 61b9f6bff7b546ad94411325cc770d52 with delete_type TABLET_DATA_DELETED (replaced by tablet bb4b3c917efb4c4aae1595af7ce1cd35) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.360303 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 61b9f6bff7b546ad94411325cc770d52 with delete_type TABLET_DATA_DELETED (replaced by tablet bb4b3c917efb4c4aae1595af7ce1cd35) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.362176 29377 tablet_replica.cc:333] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.362376 29377 raft_consensus.cc:2243] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.362550 29377 raft_consensus.cc:2272] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.362939 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet cd628a25f3a14b64a5f9a70d104b3dcf from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.363145 29377 ts_tablet_manager.cc:1916] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.363741 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0a57fb26789b4826858b2755f0f85b86" } modify_external_catalogs: true
I20260617 20:16:44.363940 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0a57fb26789b4826858b2755f0f85b86" } modify_external_catalogs: true
I20260617 20:16:44.361184 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 61b9f6bff7b546ad94411325cc770d52 with delete_type TABLET_DATA_DELETED (replaced by tablet bb4b3c917efb4c4aae1595af7ce1cd35) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.362946 29376 ts_tablet_manager.cc:1916] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.370260 29377 ts_tablet_manager.cc:1929] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.370441 29377 log.cc:1199] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/42aeede5da974652898bccc8e0a38bce
I20260617 20:16:44.370836 29377 ts_tablet_manager.cc:1950] T 42aeede5da974652898bccc8e0a38bce P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:44.371893 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 42aeede5da974652898bccc8e0a38bce (table default.Table_421f6bf3dab14ec58437bc887fb7b191 [id=eb811592c47c4ad695a19baf0cc91349]) successfully deleted
I20260617 20:16:44.372332 29379 tablet_bootstrap.cc:492] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.372486 29379 ts_tablet_manager.cc:1403] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.078s user 0.021s sys 0.016s
W20260617 20:16:44.372584 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 61b9f6bff7b546ad94411325cc770d52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61b9f6bff7b546ad94411325cc770d52 already in progress: creating tablet
I20260617 20:16:44.372666 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet adcd4689680e43b19318336fb5a3edb3
I20260617 20:16:44.373109 28663 catalog_manager.cc:6784] ReplaceTablet: tablet adcd4689680e43b19318336fb5a3edb3 deleted and replaced by tablet 93ff519f9db34a7b9a4686f09722a501
I20260617 20:16:44.373534 29379 raft_consensus.cc:359] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.373752 29379 raft_consensus.cc:385] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.373840 29379 raft_consensus.cc:740] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.374122 29379 consensus_queue.cc:260] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.375878 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet adcd4689680e43b19318336fb5a3edb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 93ff519f9db34a7b9a4686f09722a501) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.376492 29379 ts_tablet_manager.cc:1434] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260617 20:16:44.376945 29379 tablet_bootstrap.cc:492] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.378552 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_603e1a661c5e44b1a19230e537c10919"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.378696 29379 tablet_bootstrap.cc:654] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.379122 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet adcd4689680e43b19318336fb5a3edb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 93ff519f9db34a7b9a4686f09722a501) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:44.379207 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_603e1a661c5e44b1a19230e537c10919 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.380502 29383 tablet_bootstrap.cc:492] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.380676 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b5d6c47745104ab1811026f32cbb701f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.381235 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5d6c47745104ab1811026f32cbb701f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.387775 29383 tablet_bootstrap.cc:654] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.388092 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f3d06c0618db45689428b0c1125bd193
I20260617 20:16:44.389639 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet f3d06c0618db45689428b0c1125bd193 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.389959 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet f3d06c0618db45689428b0c1125bd193 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.390561 29376 ts_tablet_manager.cc:1929] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.390679 29376 log.cc:1199] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/3bff8e928b534201bac3c1d27878535f
I20260617 20:16:44.391049 29376 ts_tablet_manager.cc:1950] T 3bff8e928b534201bac3c1d27878535f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:44.391588 29375 ts_tablet_manager.cc:1929] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.391729 29375 log.cc:1199] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/42aeede5da974652898bccc8e0a38bce
I20260617 20:16:44.392107 29375 ts_tablet_manager.cc:1950] T 42aeede5da974652898bccc8e0a38bce P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.392055 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 3bff8e928b534201bac3c1d27878535f (table default.Table_87c4fdebf4f24b5aabd1a274ecd1d005 [id=7e09804e39894310ba5f841e3921d0c2]) successfully deleted
I20260617 20:16:44.389724 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet f3d06c0618db45689428b0c1125bd193 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:44.392884 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f3d06c0618db45689428b0c1125bd193 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3d06c0618db45689428b0c1125bd193 already in progress: creating tablet
I20260617 20:16:44.393072 29375 tablet_replica.cc:333] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
W20260617 20:16:44.393075 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4bd2621fc81a46c4945260a85a8d6aa2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4bd2621fc81a46c4945260a85a8d6aa2 already in progress: creating tablet
I20260617 20:16:44.390237 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet adcd4689680e43b19318336fb5a3edb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 93ff519f9db34a7b9a4686f09722a501) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.393275 29375 raft_consensus.cc:2243] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.393491 29375 raft_consensus.cc:2272] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.393501 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 42aeede5da974652898bccc8e0a38bce (table default.Table_421f6bf3dab14ec58437bc887fb7b191 [id=eb811592c47c4ad695a19baf0cc91349]) successfully deleted
I20260617 20:16:44.394009 29376 tablet_replica.cc:333] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:44.394198 29376 raft_consensus.cc:2243] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 20:16:44.394168 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet adcd4689680e43b19318336fb5a3edb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adcd4689680e43b19318336fb5a3edb3 already in progress: creating tablet
I20260617 20:16:44.394300 29375 ts_tablet_manager.cc:1916] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.394366 29376 raft_consensus.cc:2272] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.396744 29376 ts_tablet_manager.cc:1916] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.397214 29383 tablet_bootstrap.cc:492] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.397395 29383 ts_tablet_manager.cc:1403] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.002s
I20260617 20:16:44.398166 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5245e1ca36044f1998856786158677b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.399261 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5245e1ca36044f1998856786158677b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.399688 29383 raft_consensus.cc:359] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.399884 29383 raft_consensus.cc:385] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.399979 29383 raft_consensus.cc:740] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.400287 29383 consensus_queue.cc:260] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.404517 29383 ts_tablet_manager.cc:1434] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 20:16:44.406579 29375 ts_tablet_manager.cc:1929] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.406702 29375 log.cc:1199] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/a9a54cc7eccb4227be5fded7cc6e2a8b
I20260617 20:16:44.407071 29375 ts_tablet_manager.cc:1950] T a9a54cc7eccb4227be5fded7cc6e2a8b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.408041 29375 tablet_replica.cc:333] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.408237 29375 raft_consensus.cc:2243] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.408243 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet a9a54cc7eccb4227be5fded7cc6e2a8b (table default.Table_dd6ce0bb614b47a8a449e4b75ec58dce [id=da4afdf3f60e48e78eb52d454fa4142c]) successfully deleted
I20260617 20:16:44.408397 29375 raft_consensus.cc:2272] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.407114 29383 tablet_bootstrap.cc:492] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.410046 29379 tablet_bootstrap.cc:492] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.410199 29379 ts_tablet_manager.cc:1403] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.000s
I20260617 20:16:44.410871 29379 raft_consensus.cc:359] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.411046 29379 raft_consensus.cc:385] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.411110 29379 raft_consensus.cc:740] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.411373 29379 consensus_queue.cc:260] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.414394 29379 ts_tablet_manager.cc:1434] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:44.415060 29376 ts_tablet_manager.cc:1929] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.415234 29376 log.cc:1199] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/52d25188917845a28a926274976cbaf4
I20260617 20:16:44.415628 29376 ts_tablet_manager.cc:1950] T 52d25188917845a28a926274976cbaf4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
W20260617 20:16:44.417325 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac consensus state has no leader
I20260617 20:16:44.417455 29379 tablet_bootstrap.cc:492] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.418035 28667 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 9e136948cdf04799b8f8dd703cefaa20
I20260617 20:16:44.419917 29379 tablet_bootstrap.cc:654] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.420398 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet df72757ce3cd4651987bfb29dd8be77d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.421712 29383 tablet_bootstrap.cc:654] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.422343 29378 tablet_bootstrap.cc:492] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.422531 29378 ts_tablet_manager.cc:1403] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.071s user 0.005s sys 0.009s
I20260617 20:16:44.423326 29378 raft_consensus.cc:359] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.423535 29378 raft_consensus.cc:385] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.423504 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f550e50674e43b785d23c37ab28b956 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.423609 29378 raft_consensus.cc:740] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.423887 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet a9a54cc7eccb4227be5fded7cc6e2a8b with delete_type TABLET_DATA_DELETED (replaced by tablet d723526a83174898a71a835b7cdbc467) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.423897 29378 consensus_queue.cc:260] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.424322 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9d14a80a9dfb4132a326a22fffbe8152" } new_table_name: "default.Table_1e265a3fe8e441dda5f94d4199dcfb59" modify_external_catalogs: true
I20260617 20:16:44.426530 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 52d25188917845a28a926274976cbaf4 (table default.Table_8eceb8f19afd47f2bf478ee57537dd7b [id=9439537fd882414f94ec8dd957bbd86e]) successfully deleted
I20260617 20:16:44.429723 29378 ts_tablet_manager.cc:1434] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 20:16:44.429965 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d723526a83174898a71a835b7cdbc467
I20260617 20:16:44.430451 28666 catalog_manager.cc:6784] ReplaceTablet: tablet d723526a83174898a71a835b7cdbc467 deleted and replaced by tablet 7a81a3502f5d4602b65328577a668d62
I20260617 20:16:44.430684 29375 ts_tablet_manager.cc:1916] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.432113 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet d723526a83174898a71a835b7cdbc467 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a81a3502f5d4602b65328577a668d62) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.432456 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet d723526a83174898a71a835b7cdbc467 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a81a3502f5d4602b65328577a668d62) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.433245 29378 tablet_bootstrap.cc:492] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:44.433430 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet a9a54cc7eccb4227be5fded7cc6e2a8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a9a54cc7eccb4227be5fded7cc6e2a8b already in progress: creating tablet
I20260617 20:16:44.433820 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet d723526a83174898a71a835b7cdbc467 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a81a3502f5d4602b65328577a668d62) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:44.434231 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 511179f9875241128390708b55dba05e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 511179f9875241128390708b55dba05e already in progress: creating tablet
W20260617 20:16:44.434862 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet a42074d6374a4682a4948970720134e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a42074d6374a4682a4948970720134e4 already in progress: creating tablet
I20260617 20:16:44.435056 29378 tablet_bootstrap.cc:654] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:44.435078 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d723526a83174898a71a835b7cdbc467 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d723526a83174898a71a835b7cdbc467 already in progress: creating tablet
I20260617 20:16:44.435462 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet df72757ce3cd4651987bfb29dd8be77d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:44.435544 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5c047f3fab644c50aef4adfff153a85b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c047f3fab644c50aef4adfff153a85b already in progress: creating tablet
I20260617 20:16:44.435897 29377 tablet_replica.cc:333] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.436115 29377 raft_consensus.cc:2243] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.436318 29377 raft_consensus.cc:2272] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.437135 29377 ts_tablet_manager.cc:1916] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.437232 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9b2c56d481e24bc1ab3a3e3b690955cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.437847 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b2c56d481e24bc1ab3a3e3b690955cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:44.440435 28657 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet dd7079ea860149f19227264b8507685b consensus state has no leader
W20260617 20:16:44.441972 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet cd628a25f3a14b64a5f9a70d104b3dcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd628a25f3a14b64a5f9a70d104b3dcf already in progress: creating tablet
W20260617 20:16:44.442698 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet a340551ee95c4b6685213a4dbd21f6c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a340551ee95c4b6685213a4dbd21f6c1 already in progress: creating tablet
I20260617 20:16:44.443058 29376 tablet_replica.cc:333] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:44.443301 29376 raft_consensus.cc:2243] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.443521 29376 raft_consensus.cc:2272] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.444485 29376 ts_tablet_manager.cc:1916] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.446530 29377 ts_tablet_manager.cc:1929] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.446656 29377 log.cc:1199] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/df72757ce3cd4651987bfb29dd8be77d
I20260617 20:16:44.447021 29377 ts_tablet_manager.cc:1950] T df72757ce3cd4651987bfb29dd8be77d P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:16:44.447098 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55e4ef1f493c4f1289cfa192ce38161d consensus state has no leader
I20260617 20:16:44.448061 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet df72757ce3cd4651987bfb29dd8be77d (table default.Table_13dc7de987b143f8b177239c1488c2ad [id=44e40556c20646558eb58acec6ad5f05]) successfully deleted
I20260617 20:16:44.452330 29379 tablet_bootstrap.cc:492] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.452252 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_57b215ac8adc423e877c268e9fd1da1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.452521 29379 ts_tablet_manager.cc:1403] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.012s
W20260617 20:16:44.452816 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57b215ac8adc423e877c268e9fd1da1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.453294 29379 raft_consensus.cc:359] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.453537 29379 raft_consensus.cc:385] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.453622 29379 raft_consensus.cc:740] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.453900 29379 consensus_queue.cc:260] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.454854 29378 tablet_bootstrap.cc:492] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.454998 29378 ts_tablet_manager.cc:1403] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20260617 20:16:44.455832 29378 raft_consensus.cc:359] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.456001 29378 raft_consensus.cc:385] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.456084 29378 raft_consensus.cc:740] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.455617 29379 ts_tablet_manager.cc:1434] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:16:44.456346 29378 consensus_queue.cc:260] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.456440 29379 tablet_bootstrap.cc:492] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.459165 29378 ts_tablet_manager.cc:1434] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:16:44.460307 29378 tablet_bootstrap.cc:492] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.460309 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 680fe7bf06bf4dcdab15c7c95cb00daf
I20260617 20:16:44.460320 29375 ts_tablet_manager.cc:1929] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.460449 29375 log.cc:1199] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/4bd2621fc81a46c4945260a85a8d6aa2
I20260617 20:16:44.460796 29375 ts_tablet_manager.cc:1950] T 4bd2621fc81a46c4945260a85a8d6aa2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.461788 29375 tablet_replica.cc:333] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.462024 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 680fe7bf06bf4dcdab15c7c95cb00daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.462462 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 680fe7bf06bf4dcdab15c7c95cb00daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.462502 29378 tablet_bootstrap.cc:654] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.462538 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 4bd2621fc81a46c4945260a85a8d6aa2 (table default.Table_c0b49bddc6014a769317c2ecc24f9bfe [id=f447de1e65a64027ae9c8983d72195e0]) successfully deleted
W20260617 20:16:44.462781 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet a340551ee95c4b6685213a4dbd21f6c1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a340551ee95c4b6685213a4dbd21f6c1 already in progress: creating tablet
I20260617 20:16:44.463631 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 680fe7bf06bf4dcdab15c7c95cb00daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.464062 29379 tablet_bootstrap.cc:654] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:44.464273 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 680fe7bf06bf4dcdab15c7c95cb00daf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 680fe7bf06bf4dcdab15c7c95cb00daf already in progress: creating tablet
I20260617 20:16:44.465214 29376 ts_tablet_manager.cc:1929] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.465355 29376 log.cc:1199] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/0ba4e3bc4a2e40319e4da6ee04807bf6
I20260617 20:16:44.465714 29383 tablet_bootstrap.cc:492] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.466105 29383 ts_tablet_manager.cc:1403] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.059s user 0.010s sys 0.008s
I20260617 20:16:44.465972 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_372f28b39c8a48cb96c6e828eca3a5a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.466583 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_372f28b39c8a48cb96c6e828eca3a5a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.466796 29383 raft_consensus.cc:359] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.466988 29383 raft_consensus.cc:385] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.467099 29383 raft_consensus.cc:740] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.467299 29383 consensus_queue.cc:260] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.470635 29375 raft_consensus.cc:2243] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.470952 29375 raft_consensus.cc:2272] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.465739 29376 ts_tablet_manager.cc:1950] T 0ba4e3bc4a2e40319e4da6ee04807bf6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:44.471575 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd2621fc81a46c4945260a85a8d6aa2 with delete_type TABLET_DATA_DELETED (replaced by tablet f74494a3230448c983d8af0e553247bf) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.471820 29377 tablet_replica.cc:333] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.472023 29377 raft_consensus.cc:2243] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.472162 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 0ba4e3bc4a2e40319e4da6ee04807bf6 (table default.Table_e294d2f29d224d2d91c1d64901ccb8db [id=aec20b3f1911426694e0588bfd2ac962]) successfully deleted
I20260617 20:16:44.472199 29377 raft_consensus.cc:2272] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:44.472422 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 61b9f6bff7b546ad94411325cc770d52 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61b9f6bff7b546ad94411325cc770d52 already in progress: creating tablet
I20260617 20:16:44.472494 29383 ts_tablet_manager.cc:1434] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 20:16:44.472976 29377 ts_tablet_manager.cc:1916] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.473073 29375 ts_tablet_manager.cc:1916] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.474542 29383 tablet_bootstrap.cc:492] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.476270 29383 tablet_bootstrap.cc:654] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:44.476552 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet adcd4689680e43b19318336fb5a3edb3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adcd4689680e43b19318336fb5a3edb3 already in progress: creating tablet
I20260617 20:16:44.477257 28665 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet bb4b3c917efb4c4aae1595af7ce1cd35
W20260617 20:16:44.478482 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f3d06c0618db45689428b0c1125bd193 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3d06c0618db45689428b0c1125bd193 already in progress: creating tablet
I20260617 20:16:44.478873 29376 tablet_replica.cc:333] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:44.479147 29376 raft_consensus.cc:2243] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.479347 29376 raft_consensus.cc:2272] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.480069 29377 ts_tablet_manager.cc:1929] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.480212 29377 log.cc:1199] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/4bd2621fc81a46c4945260a85a8d6aa2
I20260617 20:16:44.480422 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.480566 29377 ts_tablet_manager.cc:1950] T 4bd2621fc81a46c4945260a85a8d6aa2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:16:44.481058 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.482070 29376 ts_tablet_manager.cc:1916] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.483793 29379 tablet_bootstrap.cc:492] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.483968 29379 ts_tablet_manager.cc:1403] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.004s
I20260617 20:16:44.484793 29379 raft_consensus.cc:359] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.484983 29379 raft_consensus.cc:385] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.485064 29379 raft_consensus.cc:740] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.485373 29379 consensus_queue.cc:260] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.488390 29379 ts_tablet_manager.cc:1434] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:44.488895 29379 tablet_bootstrap.cc:492] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.483932 29378 tablet_bootstrap.cc:492] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.489207 29378 ts_tablet_manager.cc:1403] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.005s
I20260617 20:16:44.490078 29378 raft_consensus.cc:359] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.490274 29378 raft_consensus.cc:385] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.490362 29378 raft_consensus.cc:740] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.490630 29378 consensus_queue.cc:260] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.490696 29376 ts_tablet_manager.cc:1929] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.490880 29376 log.cc:1199] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/df72757ce3cd4651987bfb29dd8be77d
I20260617 20:16:44.492004 28670 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 93ff519f9db34a7b9a4686f09722a501
I20260617 20:16:44.492427 29378 ts_tablet_manager.cc:1434] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:16:44.492784 29378 tablet_bootstrap.cc:492] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.493450 29379 tablet_bootstrap.cc:654] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.493551 29375 ts_tablet_manager.cc:1929] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.493659 29375 log.cc:1199] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/6d6af4b98fcb4161b7432280605224d9
I20260617 20:16:44.494082 29375 ts_tablet_manager.cc:1950] T 6d6af4b98fcb4161b7432280605224d9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.494575 29378 tablet_bootstrap.cc:654] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.495048 29375 tablet_replica.cc:333] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.495292 29375 raft_consensus.cc:2243] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.495466 29375 raft_consensus.cc:2272] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.496340 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 4bd2621fc81a46c4945260a85a8d6aa2 (table default.Table_c0b49bddc6014a769317c2ecc24f9bfe [id=f447de1e65a64027ae9c8983d72195e0]) successfully deleted
I20260617 20:16:44.497262 29376 ts_tablet_manager.cc:1950] T df72757ce3cd4651987bfb29dd8be77d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:44.498504 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet df72757ce3cd4651987bfb29dd8be77d (table default.Table_13dc7de987b143f8b177239c1488c2ad [id=44e40556c20646558eb58acec6ad5f05]) successfully deleted
W20260617 20:16:44.498880 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d723526a83174898a71a835b7cdbc467 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d723526a83174898a71a835b7cdbc467 already in progress: creating tablet
I20260617 20:16:44.499524 29375 ts_tablet_manager.cc:1916] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.499909 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 6d6af4b98fcb4161b7432280605224d9 (table default.Table_790a35cc325041b987a0185f1f3044a6 [id=c4b8f5740cdf4cc7912c732a21e3b13d]) successfully deleted
I20260617 20:16:44.500651 29378 tablet_bootstrap.cc:492] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.500795 29378 ts_tablet_manager.cc:1403] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
W20260617 20:16:44.501838 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 680fe7bf06bf4dcdab15c7c95cb00daf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 680fe7bf06bf4dcdab15c7c95cb00daf already in progress: creating tablet
I20260617 20:16:44.501662 29378 raft_consensus.cc:359] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.501994 29378 raft_consensus.cc:385] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.502084 29378 raft_consensus.cc:740] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.502360 29378 consensus_queue.cc:260] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.504700 29378 ts_tablet_manager.cc:1434] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:44.507231 29378 tablet_bootstrap.cc:492] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.507313 29375 ts_tablet_manager.cc:1929] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.507476 29375 log.cc:1199] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/511179f9875241128390708b55dba05e
W20260617 20:16:44.507771 29038 tablet.cc:2406] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 20:16:44.507887 29375 ts_tablet_manager.cc:1950] T 511179f9875241128390708b55dba05e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.508468 29375 tablet_replica.cc:333] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.508637 29375 raft_consensus.cc:2243] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.508811 29375 raft_consensus.cc:2272] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.509019 29378 tablet_bootstrap.cc:654] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.509070 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 511179f9875241128390708b55dba05e (table default.Table_5b1993d0c19d4c9a9d266ba632d99c39 [id=ac46308147954a68bc53d1b6684d1b62]) successfully deleted
I20260617 20:16:44.509608 29375 ts_tablet_manager.cc:1916] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.516428 29375 ts_tablet_manager.cc:1929] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.516575 29375 log.cc:1199] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/a42074d6374a4682a4948970720134e4
I20260617 20:16:44.516750 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2ef3a206c3e747ada8461a0af6a75a51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.517004 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 511179f9875241128390708b55dba05e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.517385 29379 tablet_bootstrap.cc:492] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
W20260617 20:16:44.517429 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ef3a206c3e747ada8461a0af6a75a51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.517589 29379 ts_tablet_manager.cc:1403] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.003s
I20260617 20:16:44.518584 29378 tablet_bootstrap.cc:492] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.518762 29378 ts_tablet_manager.cc:1403] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260617 20:16:44.517418 29375 ts_tablet_manager.cc:1950] T a42074d6374a4682a4948970720134e4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.519479 29378 raft_consensus.cc:359] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.519702 29378 raft_consensus.cc:385] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.519785 29378 raft_consensus.cc:740] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.520071 29378 consensus_queue.cc:260] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.520328 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet a42074d6374a4682a4948970720134e4 (table default.Table_389a4632b173428984db63f12fbe631f [id=22252c6160d540879efa900a2d3584c8]) successfully deleted
W20260617 20:16:44.521129 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5c047f3fab644c50aef4adfff153a85b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5c047f3fab644c50aef4adfff153a85b already in progress: creating tablet
I20260617 20:16:44.518539 29379 raft_consensus.cc:359] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.521557 29379 raft_consensus.cc:385] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.521678 29378 ts_tablet_manager.cc:1434] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:44.521683 29379 raft_consensus.cc:740] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.521991 29378 tablet_bootstrap.cc:492] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:44.522377 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet cd628a25f3a14b64a5f9a70d104b3dcf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd628a25f3a14b64a5f9a70d104b3dcf already in progress: creating tablet
I20260617 20:16:44.524223 29379 consensus_queue.cc:260] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
W20260617 20:16:44.525605 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet f3d06c0618db45689428b0c1125bd193 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3d06c0618db45689428b0c1125bd193 already in progress: creating tablet
I20260617 20:16:44.528155 29378 tablet_bootstrap.cc:654] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.528810 29375 tablet_replica.cc:333] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.529035 29375 raft_consensus.cc:2243] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.529605 29379 ts_tablet_manager.cc:1434] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260617 20:16:44.530668 29375 raft_consensus.cc:2272] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.530983 29379 tablet_bootstrap.cc:492] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.535178 29375 ts_tablet_manager.cc:1916] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.535902 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c0b49bddc6014a769317c2ecc24f9bfe" } new_table_name: "default.Table_a96bacccf2874d2ea84a7c20f9892640" modify_external_catalogs: true
I20260617 20:16:44.539055 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet cd628a25f3a14b64a5f9a70d104b3dcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.539958 29379 tablet_bootstrap.cc:654] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.547717 29375 ts_tablet_manager.cc:1929] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.552484 29375 log.cc:1199] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/3f550e50674e43b785d23c37ab28b956
I20260617 20:16:44.553068 29375 ts_tablet_manager.cc:1950] T 3f550e50674e43b785d23c37ab28b956 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:16:44.555596 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f2010232aed489ba61ec1ac423b2f2d consensus state has no leader
I20260617 20:16:44.555645 29379 tablet_bootstrap.cc:492] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.555856 29379 ts_tablet_manager.cc:1403] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.003s
I20260617 20:16:44.555888 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet a42074d6374a4682a4948970720134e4 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.557245 29379 raft_consensus.cc:359] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.557644 29379 raft_consensus.cc:385] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.557735 29379 raft_consensus.cc:740] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.557722 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_28cf82e4eadf4486803f82c018ee9df6" } new_table_name: "default.Table_44a28fd64ae04db19e9311c1a5206d4b" modify_external_catalogs: true
I20260617 20:16:44.558094 29379 consensus_queue.cc:260] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.560532 29379 ts_tablet_manager.cc:1434] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260617 20:16:44.562453 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_39997aeddd814c1d8b2dfc0b74b82277"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.563220 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39997aeddd814c1d8b2dfc0b74b82277 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.576162 29379 tablet_bootstrap.cc:492] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.581499 29383 tablet_bootstrap.cc:492] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.581871 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 3f550e50674e43b785d23c37ab28b956 (table default.Table_afc19b5045e2429a8e30a23563fbb900 [id=d1ef628fd67d49d3bd9bd960b9a54465]) successfully deleted
I20260617 20:16:44.582331 29379 tablet_bootstrap.cc:654] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:44.582562 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet a9a54cc7eccb4227be5fded7cc6e2a8b because the tablet was not found. No further retry: Not found: Tablet not found: a9a54cc7eccb4227be5fded7cc6e2a8b
W20260617 20:16:44.583122 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d723526a83174898a71a835b7cdbc467 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d723526a83174898a71a835b7cdbc467 already in progress: creating tablet
W20260617 20:16:44.583889 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 680fe7bf06bf4dcdab15c7c95cb00daf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 680fe7bf06bf4dcdab15c7c95cb00daf already in progress: creating tablet
W20260617 20:16:44.584580 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 511179f9875241128390708b55dba05e because the tablet was not found. No further retry: Not found: Tablet not found: 511179f9875241128390708b55dba05e
I20260617 20:16:44.584920 29375 tablet_replica.cc:333] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.585160 29375 raft_consensus.cc:2243] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.585438 29375 raft_consensus.cc:2272] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.586328 29375 ts_tablet_manager.cc:1916] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.590875 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2009053439224df4a7fdda13c182003e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.591446 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2009053439224df4a7fdda13c182003e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.594038 29383 ts_tablet_manager.cc:1403] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.120s user 0.028s sys 0.042s
I20260617 20:16:44.596068 29383 raft_consensus.cc:359] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.597738 29383 raft_consensus.cc:385] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.597904 29383 raft_consensus.cc:740] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.599440 29383 consensus_queue.cc:260] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.600740 29383 ts_tablet_manager.cc:1434] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 20:16:44.600988 29378 tablet_bootstrap.cc:492] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.601155 29378 ts_tablet_manager.cc:1403] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.079s user 0.007s sys 0.028s
I20260617 20:16:44.601869 29383 tablet_bootstrap.cc:492] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.602005 29378 raft_consensus.cc:359] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.602180 29378 raft_consensus.cc:385] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.602272 29378 raft_consensus.cc:740] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.602505 29378 consensus_queue.cc:260] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.605252 29378 ts_tablet_manager.cc:1434] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260617 20:16:44.606451 29378 tablet_bootstrap.cc:492] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.607636 29383 tablet_bootstrap.cc:654] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.611053 29378 tablet_bootstrap.cc:654] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.614876 29391 raft_consensus.cc:493] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:44.615056 29391 raft_consensus.cc:515] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.615929 29391 leader_election.cc:290] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:16:44.616858 29197 leader_election.cc:343] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3ae50375e5934acbb213379fb7c87989
W20260617 20:16:44.617187 29198 leader_election.cc:343] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 3ae50375e5934acbb213379fb7c87989
I20260617 20:16:44.617368 29198 leader_election.cc:304] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:44.617946 29391 raft_consensus.cc:2749] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:44.619218 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet adcd4689680e43b19318336fb5a3edb3 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.627022 29378 tablet_bootstrap.cc:492] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.627254 29378 ts_tablet_manager.cc:1403] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.001s
I20260617 20:16:44.628281 29378 raft_consensus.cc:359] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.628544 29378 raft_consensus.cc:385] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.628650 29378 raft_consensus.cc:740] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.628924 29378 consensus_queue.cc:260] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.629374 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.629596 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]). Expected version 2 got 0
W20260617 20:16:44.630280 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f74494a3230448c983d8af0e553247bf consensus state has no leader
I20260617 20:16:44.631944 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 (DEFAULT_TABLE table=default.Table_a5c3b69aae404d2291e8273318f4db21 [id=8696ed2b09fd4e06a0f2746537370766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.632402 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1199d8c7f1dc4b8f99301b8f60c687d1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:44.633910 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d66923e12e1843bcbcb3da93cf838b65 consensus state has no leader
I20260617 20:16:44.634375 29378 ts_tablet_manager.cc:1434] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 20:16:44.635501 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bc9d14d4c6734ab380f6fd753c50567d" } modify_external_catalogs: true
I20260617 20:16:44.635730 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bc9d14d4c6734ab380f6fd753c50567d" } modify_external_catalogs: true
I20260617 20:16:44.637253 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3074bd171fd54a10948acd223e1c6da7" } modify_external_catalogs: true
I20260617 20:16:44.637455 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3074bd171fd54a10948acd223e1c6da7" } modify_external_catalogs: true
I20260617 20:16:44.638473 29378 tablet_bootstrap.cc:492] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.640280 28661 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (table default.Table_b3b3fd43238e4c979d4e814f42eb49ab [id=3a41dd53c3974256877f193219240234]). Expected version 3 got 0
I20260617 20:16:44.640564 29378 tablet_bootstrap.cc:654] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.641135 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (table default.Table_b3b3fd43238e4c979d4e814f42eb49ab [id=3a41dd53c3974256877f193219240234]). Expected version 3 got 0
I20260617 20:16:44.642213 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 (DEFAULT_TABLE table=default.Table_a5c3b69aae404d2291e8273318f4db21 [id=8696ed2b09fd4e06a0f2746537370766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.642627 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1199d8c7f1dc4b8f99301b8f60c687d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.645156 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet adcd4689680e43b19318336fb5a3edb3 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.650274 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f2ec59ac5864da5a13965ca0724c387 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.651623 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a5c3b69aae404d2291e8273318f4db21" } new_table_name: "default.Table_0ba339c37163434e8c628ef515624fe1" modify_external_catalogs: true
I20260617 20:16:44.653318 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a34b5cc6e9f2434488cc50d41fb64a03" } new_table_name: "default.Table_aa9736ab22fd48bc862c930283895f27" modify_external_catalogs: true
I20260617 20:16:44.656807 29375 ts_tablet_manager.cc:1929] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.656958 29375 log.cc:1199] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/cd628a25f3a14b64a5f9a70d104b3dcf
I20260617 20:16:44.657341 29375 ts_tablet_manager.cc:1950] T cd628a25f3a14b64a5f9a70d104b3dcf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.658164 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 (DEFAULT_TABLE table=default.Table_a5c3b69aae404d2291e8273318f4db21 [id=8696ed2b09fd4e06a0f2746537370766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.658321 29108 tablet_service.cc:1511] Processing CreateTablet for tablet a79b56241ac84862868c664cca25654b (DEFAULT_TABLE table=default.Table_e48bc2c0d35c428da4dd3a65681b7c15 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.658660 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1199d8c7f1dc4b8f99301b8f60c687d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.658576 29242 tablet_service.cc:1511] Processing CreateTablet for tablet a79b56241ac84862868c664cca25654b (DEFAULT_TABLE table=default.Table_e48bc2c0d35c428da4dd3a65681b7c15 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.658880 29103 tablet_service.cc:1511] Processing CreateTablet for tablet d66923e12e1843bcbcb3da93cf838b65 (DEFAULT_TABLE table=default.Table_44a28fd64ae04db19e9311c1a5206d4b [id=b2d788fe99dd43689f8fa1f9fcea06a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.658993 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a79b56241ac84862868c664cca25654b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.659217 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66923e12e1843bcbcb3da93cf838b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.660274 29236 tablet_service.cc:1511] Processing CreateTablet for tablet d66923e12e1843bcbcb3da93cf838b65 (DEFAULT_TABLE table=default.Table_44a28fd64ae04db19e9311c1a5206d4b [id=b2d788fe99dd43689f8fa1f9fcea06a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.660836 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66923e12e1843bcbcb3da93cf838b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.661640 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 365e0ffb939047898243f72e4053d9a1 (DEFAULT_TABLE table=default.Table_a03f11705bbf4b679523c33e9fb71474 [id=fa80809528dd419192774bcc7ac5f5bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.661999 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365e0ffb939047898243f72e4053d9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.664898 29383 tablet_bootstrap.cc:492] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.665055 29383 ts_tablet_manager.cc:1403] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.063s user 0.021s sys 0.021s
I20260617 20:16:44.665648 29388 raft_consensus.cc:493] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:44.665804 29388 raft_consensus.cc:515] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.666465 29388 leader_election.cc:290] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:44.666754 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a79b56241ac84862868c664cca25654b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.667070 28964 tablet_service.cc:1511] Processing CreateTablet for tablet d66923e12e1843bcbcb3da93cf838b65 (DEFAULT_TABLE table=default.Table_44a28fd64ae04db19e9311c1a5206d4b [id=b2d788fe99dd43689f8fa1f9fcea06a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.667285 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd6c1769ed54ea8aed6ac91b9efe7ac" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:44.667467 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d66923e12e1843bcbcb3da93cf838b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.667721 28990 raft_consensus.cc:2468] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:44.668263 29062 leader_election.cc:304] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:44.668617 29388 raft_consensus.cc:2804] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:44.668751 29388 raft_consensus.cc:493] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:44.668861 29388 raft_consensus.cc:3060] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:44.669528 28667 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (table default.Table_b3b3fd43238e4c979d4e814f42eb49ab [id=3a41dd53c3974256877f193219240234]). Expected version 3 got 0
I20260617 20:16:44.669955 29378 tablet_bootstrap.cc:492] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.670094 29378 ts_tablet_manager.cc:1403] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.000s
I20260617 20:16:44.670948 29378 raft_consensus.cc:359] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.671129 29378 raft_consensus.cc:385] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.671077 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 365e0ffb939047898243f72e4053d9a1 (DEFAULT_TABLE table=default.Table_a03f11705bbf4b679523c33e9fb71474 [id=fa80809528dd419192774bcc7ac5f5bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.671250 29378 raft_consensus.cc:740] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.671245 28668 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (table default.Table_b3b3fd43238e4c979d4e814f42eb49ab [id=3a41dd53c3974256877f193219240234]). Expected version 3 got 0
I20260617 20:16:44.671484 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365e0ffb939047898243f72e4053d9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.671545 29378 consensus_queue.cc:260] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.673382 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd6c1769ed54ea8aed6ac91b9efe7ac" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:44.673738 29263 raft_consensus.cc:2468] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:44.674559 29378 ts_tablet_manager.cc:1434] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:16:44.674309 29383 raft_consensus.cc:359] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.674949 29383 raft_consensus.cc:385] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.674993 29378 tablet_bootstrap.cc:492] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.675043 29383 raft_consensus.cc:740] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.675266 29383 consensus_queue.cc:260] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.675829 29383 ts_tablet_manager.cc:1434] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260617 20:16:44.676107 29383 tablet_bootstrap.cc:492] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.676417 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet a9a54cc7eccb4227be5fded7cc6e2a8b with delete_type TABLET_DATA_DELETED (replaced by tablet d723526a83174898a71a835b7cdbc467) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.676684 28970 tablet_service.cc:1558] Processing DeleteTablet for tablet a42074d6374a4682a4948970720134e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.676745 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f550e50674e43b785d23c37ab28b956 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.676891 29377 tablet_replica.cc:333] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.677050 29377 raft_consensus.cc:2243] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.677217 29377 raft_consensus.cc:2272] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.677441 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 511179f9875241128390708b55dba05e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.678457 29377 ts_tablet_manager.cc:1916] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.678879 28963 tablet_service.cc:1511] Processing CreateTablet for tablet a79b56241ac84862868c664cca25654b (DEFAULT_TABLE table=default.Table_e48bc2c0d35c428da4dd3a65681b7c15 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.679826 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9b2c56d481e24bc1ab3a3e3b690955cd" } modify_external_catalogs: true
I20260617 20:16:44.680012 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9b2c56d481e24bc1ab3a3e3b690955cd" } modify_external_catalogs: true
I20260617 20:16:44.679792 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_39997aeddd814c1d8b2dfc0b74b82277" } modify_external_catalogs: true
I20260617 20:16:44.681156 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_39997aeddd814c1d8b2dfc0b74b82277" } modify_external_catalogs: true
I20260617 20:16:44.679239 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a79b56241ac84862868c664cca25654b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.684473 29383 tablet_bootstrap.cc:654] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.684576 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet cd628a25f3a14b64a5f9a70d104b3dcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.687218 29377 ts_tablet_manager.cc:1929] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.687366 29377 log.cc:1199] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/a9a54cc7eccb4227be5fded7cc6e2a8b
I20260617 20:16:44.687753 29377 ts_tablet_manager.cc:1950] T a9a54cc7eccb4227be5fded7cc6e2a8b P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:44.688540 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet cd628a25f3a14b64a5f9a70d104b3dcf (table default.Table_d0963241dd0f4d5f9be5d2bd34871072 [id=b5d358e515734a51b4a25fb7c90b2a66]) successfully deleted
I20260617 20:16:44.688829 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet a9a54cc7eccb4227be5fded7cc6e2a8b (table default.Table_dd6ce0bb614b47a8a449e4b75ec58dce [id=da4afdf3f60e48e78eb52d454fa4142c]) successfully deleted
I20260617 20:16:44.689256 29377 tablet_replica.cc:333] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.689530 29377 raft_consensus.cc:2243] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.689735 29377 raft_consensus.cc:2272] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.690466 29377 ts_tablet_manager.cc:1916] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.691756 29388 raft_consensus.cc:515] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.693076 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 365e0ffb939047898243f72e4053d9a1 (DEFAULT_TABLE table=default.Table_a03f11705bbf4b679523c33e9fb71474 [id=fa80809528dd419192774bcc7ac5f5bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.693511 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365e0ffb939047898243f72e4053d9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.691891 29378 tablet_bootstrap.cc:654] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.697742 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd6c1769ed54ea8aed6ac91b9efe7ac" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:44.697966 28990 raft_consensus.cc:3060] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:44.699262 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2009053439224df4a7fdda13c182003e" } modify_external_catalogs: true
I20260617 20:16:44.699497 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2009053439224df4a7fdda13c182003e" } modify_external_catalogs: true
I20260617 20:16:44.700922 29377 ts_tablet_manager.cc:1929] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.700968 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bd2621fc81a46c4945260a85a8d6aa2 with delete_type TABLET_DATA_DELETED (replaced by tablet f74494a3230448c983d8af0e553247bf) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.701283 29376 tablet_replica.cc:333] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:44.701500 29376 raft_consensus.cc:2243] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.701723 29376 raft_consensus.cc:2272] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.702039 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet a9a54cc7eccb4227be5fded7cc6e2a8b with delete_type TABLET_DATA_DELETED (replaced by tablet d723526a83174898a71a835b7cdbc467) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.701136 28990 raft_consensus.cc:2468] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:44.702821 29377 log.cc:1199] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/a42074d6374a4682a4948970720134e4
I20260617 20:16:44.703262 29377 ts_tablet_manager.cc:1950] T a42074d6374a4682a4948970720134e4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:44.703603 29379 tablet_bootstrap.cc:492] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.703810 29379 ts_tablet_manager.cc:1403] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.143s user 0.015s sys 0.031s
I20260617 20:16:44.704869 29379 raft_consensus.cc:359] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.705097 29376 ts_tablet_manager.cc:1916] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.704187 29378 tablet_bootstrap.cc:492] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.705142 29379 raft_consensus.cc:385] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.705250 29379 raft_consensus.cc:740] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.705418 29378 ts_tablet_manager.cc:1403] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.002s
I20260617 20:16:44.705565 29379 consensus_queue.cc:260] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.706264 29378 raft_consensus.cc:359] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.706514 29378 raft_consensus.cc:385] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.706624 29378 raft_consensus.cc:740] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.707029 29378 consensus_queue.cc:260] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.708595 29378 ts_tablet_manager.cc:1434] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:44.708714 29377 tablet_replica.cc:333] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.709642 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet a42074d6374a4682a4948970720134e4 (table default.Table_389a4632b173428984db63f12fbe631f [id=22252c6160d540879efa900a2d3584c8]) successfully deleted
I20260617 20:16:44.709712 29062 leader_election.cc:304] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:44.710067 29378 tablet_bootstrap.cc:492] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.711015 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]). Expected version 2 got 0
I20260617 20:16:44.711701 29378 tablet_bootstrap.cc:654] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.712970 29455 raft_consensus.cc:493] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:44.713191 29377 raft_consensus.cc:2243] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.713469 29377 raft_consensus.cc:2272] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.713788 29455 raft_consensus.cc:515] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.714648 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]). Expected version 2 got 0
I20260617 20:16:44.714706 29377 ts_tablet_manager.cc:1916] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.717340 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_68983d7d2bff43f4a914573626bafb37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.717916 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68983d7d2bff43f4a914573626bafb37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.718348 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7079ea860149f19227264b8507685b" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:44.718968 29063 leader_election.cc:343] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:44.719363 29455 leader_election.cc:290] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:44.719805 29456 raft_consensus.cc:2804] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:44.719998 29456 raft_consensus.cc:697] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:44.722059 29379 ts_tablet_manager.cc:1434] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.018s user 0.009s sys 0.001s
I20260617 20:16:44.722512 29379 tablet_bootstrap.cc:492] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.722853 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd6c1769ed54ea8aed6ac91b9efe7ac" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:44.723131 29263 raft_consensus.cc:3060] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:44.724951 29379 tablet_bootstrap.cc:654] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.720464 29456 consensus_queue.cc:237] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.726572 29263 raft_consensus.cc:2468] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:44.727367 29388 leader_election.cc:290] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:44.732122 29378 tablet_bootstrap.cc:492] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.732365 29378 ts_tablet_manager.cc:1403] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260617 20:16:44.733445 29378 raft_consensus.cc:359] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.733697 29378 raft_consensus.cc:385] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.733840 29378 raft_consensus.cc:740] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.734047 29376 ts_tablet_manager.cc:1929] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.734191 29376 log.cc:1199] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/4bd2621fc81a46c4945260a85a8d6aa2
I20260617 20:16:44.734228 29378 consensus_queue.cc:260] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.734622 29376 ts_tablet_manager.cc:1950] T 4bd2621fc81a46c4945260a85a8d6aa2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:44.737865 29378 ts_tablet_manager.cc:1434] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:16:44.738430 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 4bd2621fc81a46c4945260a85a8d6aa2 (table default.Table_a96bacccf2874d2ea84a7c20f9892640 [id=f447de1e65a64027ae9c8983d72195e0]) successfully deleted
I20260617 20:16:44.739322 29378 tablet_bootstrap.cc:492] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.739353 29379 tablet_bootstrap.cc:492] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.739514 29379 ts_tablet_manager.cc:1403] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.001s
I20260617 20:16:44.740274 29379 raft_consensus.cc:359] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.740484 29379 raft_consensus.cc:385] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.740556 29379 raft_consensus.cc:740] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.740830 29379 consensus_queue.cc:260] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.741276 29379 ts_tablet_manager.cc:1434] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:44.741640 29376 tablet_replica.cc:333] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:44.741851 29376 raft_consensus.cc:2243] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.742038 29376 raft_consensus.cc:2272] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.742652 29379 tablet_bootstrap.cc:492] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.743394 29376 ts_tablet_manager.cc:1916] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.744750 29379 tablet_bootstrap.cc:654] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.745533 29378 tablet_bootstrap.cc:654] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.748267 29379 tablet_bootstrap.cc:492] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.746578 29377 ts_tablet_manager.cc:1929] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.748427 29379 ts_tablet_manager.cc:1403] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.001s
I20260617 20:16:44.748602 29377 log.cc:1199] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/3f550e50674e43b785d23c37ab28b956
I20260617 20:16:44.749071 29377 ts_tablet_manager.cc:1950] T 3f550e50674e43b785d23c37ab28b956 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:44.749202 29379 raft_consensus.cc:359] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.749421 29379 raft_consensus.cc:385] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.749366 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7079ea860149f19227264b8507685b" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:44.749511 29379 raft_consensus.cc:740] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.749577 28990 raft_consensus.cc:2468] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:44.749706 29379 consensus_queue.cc:260] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.750221 29379 ts_tablet_manager.cc:1434] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:44.750094 29062 leader_election.cc:304] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:44.750567 29456 raft_consensus.cc:2804] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:44.750699 29456 raft_consensus.cc:493] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:44.750805 29456 raft_consensus.cc:3060] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:44.755071 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 3f550e50674e43b785d23c37ab28b956 (table default.Table_afc19b5045e2429a8e30a23563fbb900 [id=d1ef628fd67d49d3bd9bd960b9a54465]) successfully deleted
I20260617 20:16:44.755512 29376 ts_tablet_manager.cc:1929] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.755576 29377 tablet_replica.cc:333] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.755900 29377 raft_consensus.cc:2243] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.756080 29377 raft_consensus.cc:2272] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.756150 29456 raft_consensus.cc:515] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.757159 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7079ea860149f19227264b8507685b" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:44.757390 28990 raft_consensus.cc:3060] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:44.757642 29376 log.cc:1199] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/a9a54cc7eccb4227be5fded7cc6e2a8b
I20260617 20:16:44.758124 29376 ts_tablet_manager.cc:1950] T a9a54cc7eccb4227be5fded7cc6e2a8b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:44.759537 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet a9a54cc7eccb4227be5fded7cc6e2a8b (table default.Table_dd6ce0bb614b47a8a449e4b75ec58dce [id=da4afdf3f60e48e78eb52d454fa4142c]) successfully deleted
I20260617 20:16:44.760087 28990 raft_consensus.cc:2468] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:44.763018 29377 ts_tablet_manager.cc:1916] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.763334 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 46d7fa99c35646c59898738de38c88ed
I20260617 20:16:44.764492 28663 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 95bf5d8704614db68c8ce7c272c2fb13 (table default.Table_a34b5cc6e9f2434488cc50d41fb64a03 [id=727864a195db4e4585240fb48a508df7]). Expected version 3 got 0
I20260617 20:16:44.764973 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet cd312e8817ee4c8fb7377825a7e6122a
I20260617 20:16:44.766010 29062 leader_election.cc:304] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:44.766328 29457 raft_consensus.cc:2804] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:44.766490 29457 raft_consensus.cc:697] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:44.766544 29456 leader_election.cc:290] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:44.766794 29379 tablet_bootstrap.cc:492] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.766845 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6ed5c9767b364748ae14ecead288e68c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.767431 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ed5c9767b364748ae14ecead288e68c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.767249 29457 consensus_queue.cc:237] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.768538 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7fa99c35646c59898738de38c88ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.768863 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet cd312e8817ee4c8fb7377825a7e6122a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.769039 29379 tablet_bootstrap.cc:654] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.769496 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7079ea860149f19227264b8507685b" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
W20260617 20:16:44.769713 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 46d7fa99c35646c59898738de38c88ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46d7fa99c35646c59898738de38c88ed already in progress: creating tablet
I20260617 20:16:44.769892 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7fa99c35646c59898738de38c88ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:44.769976 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet cd312e8817ee4c8fb7377825a7e6122a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd312e8817ee4c8fb7377825a7e6122a already in progress: creating tablet
I20260617 20:16:44.770177 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet cd312e8817ee4c8fb7377825a7e6122a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.772423 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet cd312e8817ee4c8fb7377825a7e6122a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.772701 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 680fe7bf06bf4dcdab15c7c95cb00daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:44.775894 29063 leader_election.cc:343] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:44.777287 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7fa99c35646c59898738de38c88ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:44.781509 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 46d7fa99c35646c59898738de38c88ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46d7fa99c35646c59898738de38c88ed already in progress: creating tablet
I20260617 20:16:44.781920 29378 tablet_bootstrap.cc:492] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.782150 29378 ts_tablet_manager.cc:1403] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
W20260617 20:16:44.782474 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet cd312e8817ee4c8fb7377825a7e6122a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd312e8817ee4c8fb7377825a7e6122a already in progress: creating tablet
I20260617 20:16:44.782992 29378 raft_consensus.cc:359] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.783214 29378 raft_consensus.cc:385] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.783293 29378 raft_consensus.cc:740] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:16:44.783357 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1199d8c7f1dc4b8f99301b8f60c687d1 consensus state has no leader
I20260617 20:16:44.783560 29378 consensus_queue.cc:260] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:44.783756 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95bf5d8704614db68c8ce7c272c2fb13 consensus state has no leader
I20260617 20:16:44.784159 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_63ec8a56c11346edadaf156c2984a619"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.784327 29378 ts_tablet_manager.cc:1434] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:44.784624 29378 tablet_bootstrap.cc:492] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:44.784780 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63ec8a56c11346edadaf156c2984a619 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.784905 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a03f11705bbf4b679523c33e9fb71474" } new_table_name: "default.Table_0cc10f7657a2450294f6ce1e33fb609e" modify_external_catalogs: true
I20260617 20:16:44.785522 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac
I20260617 20:16:44.786069 28665 catalog_manager.cc:6784] ReplaceTablet: tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac deleted and replaced by tablet 60a43dd885aa4411a4177b67807b0ac4
I20260617 20:16:44.786188 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet f3d06c0618db45689428b0c1125bd193 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.786448 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e07e30476d764b83aabfde1a21b2d5a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.786966 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e07e30476d764b83aabfde1a21b2d5a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.788091 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5f2ec59ac5864da5a13965ca0724c387
I20260617 20:16:44.788519 28661 catalog_manager.cc:6784] ReplaceTablet: tablet 5f2ec59ac5864da5a13965ca0724c387 deleted and replaced by tablet d9b7880a039a497fbd0fb5d4f74e7d23
I20260617 20:16:44.788822 28668 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet e70add4968b949d782becb9422e956c2
I20260617 20:16:44.789119 28662 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet e92c0aac30544d15ae91a4d7d6e1d52c
I20260617 20:16:44.789641 28667 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet d418268371f148a2b125fb8f26e8db85
I20260617 20:16:44.789696 29377 ts_tablet_manager.cc:1929] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.789834 29377 log.cc:1199] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/511179f9875241128390708b55dba05e
I20260617 20:16:44.789914 29383 tablet_bootstrap.cc:492] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.789929 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac with delete_type TABLET_DATA_DELETED (replaced by tablet 60a43dd885aa4411a4177b67807b0ac4) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.790091 29383 ts_tablet_manager.cc:1403] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.114s user 0.006s sys 0.012s
I20260617 20:16:44.790192 29377 ts_tablet_manager.cc:1950] T 511179f9875241128390708b55dba05e P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:44.790921 29383 raft_consensus.cc:359] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.791122 29377 tablet_replica.cc:333] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.791174 29383 raft_consensus.cc:385] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.791251 29383 raft_consensus.cc:740] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.791289 29377 raft_consensus.cc:2243] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.791460 29377 raft_consensus.cc:2272] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.791698 29378 tablet_bootstrap.cc:654] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.791599 29383 consensus_queue.cc:260] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.793452 29375 tablet_replica.cc:333] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.793723 29375 raft_consensus.cc:2243] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:44.794243 29375 pending_rounds.cc:70] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:44.794486 29375 pending_rounds.cc:77] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955449768587264 op_type: NO_OP noop_request { }
I20260617 20:16:44.794690 29375 raft_consensus.cc:2889] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:44.794821 29375 raft_consensus.cc:2272] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.795642 29383 ts_tablet_manager.cc:1434] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260617 20:16:44.796240 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f2ec59ac5864da5a13965ca0724c387 with delete_type TABLET_DATA_DELETED (replaced by tablet d9b7880a039a497fbd0fb5d4f74e7d23) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.797852 29377 ts_tablet_manager.cc:1916] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.797868 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac with delete_type TABLET_DATA_DELETED (replaced by tablet 60a43dd885aa4411a4177b67807b0ac4) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.798097 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f2ec59ac5864da5a13965ca0724c387 with delete_type TABLET_DATA_DELETED (replaced by tablet d9b7880a039a497fbd0fb5d4f74e7d23) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.798301 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f550e50674e43b785d23c37ab28b956 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:43 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.798532 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f2ec59ac5864da5a13965ca0724c387 with delete_type TABLET_DATA_DELETED (replaced by tablet d9b7880a039a497fbd0fb5d4f74e7d23) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.798785 29383 tablet_bootstrap.cc:492] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.800591 29383 tablet_bootstrap.cc:654] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.800606 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 511179f9875241128390708b55dba05e (table default.Table_5b1993d0c19d4c9a9d266ba632d99c39 [id=ac46308147954a68bc53d1b6684d1b62]) successfully deleted
I20260617 20:16:44.805049 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_418bd070282540f0b7c6a3e27deff617"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.805629 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_418bd070282540f0b7c6a3e27deff617 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.808398 29375 ts_tablet_manager.cc:1916] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.812462 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac with delete_type TABLET_DATA_DELETED (replaced by tablet 60a43dd885aa4411a4177b67807b0ac4) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:44.816371 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 365e0ffb939047898243f72e4053d9a1 consensus state has no leader
I20260617 20:16:44.818331 29377 ts_tablet_manager.cc:1929] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.818467 29377 log.cc:1199] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/cd628a25f3a14b64a5f9a70d104b3dcf
I20260617 20:16:44.818842 29377 ts_tablet_manager.cc:1950] T cd628a25f3a14b64a5f9a70d104b3dcf P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:44.822039 28662 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 95bf5d8704614db68c8ce7c272c2fb13 (table default.Table_aa9736ab22fd48bc862c930283895f27 [id=727864a195db4e4585240fb48a508df7]). Expected version 4 got 0
I20260617 20:16:44.822381 28662 catalog_manager.cc:5696] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194). New cstate: current_term: 1 leader_uuid: "6d4ce30e1fce4591b64c398747f8d37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:44.823163 28662 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]). Expected version 2 got 0
I20260617 20:16:44.823365 28662 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet f23960607f8a4efcb56cd5f306dc3a85 (table default.Table_4d5105d9785547e587bf29e7bca97216 [id=d70c3654e0c4417e9ff68be4309793ba]). Expected version 2 got 0
I20260617 20:16:44.824581 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet cd628a25f3a14b64a5f9a70d104b3dcf (table default.Table_d0963241dd0f4d5f9be5d2bd34871072 [id=b5d358e515734a51b4a25fb7c90b2a66]) successfully deleted
I20260617 20:16:44.825380 28963 tablet_service.cc:1511] Processing CreateTablet for tablet c8c3089f552b449095eafc00da38e442 (DEFAULT_TABLE table=default.Table_2ef3a206c3e747ada8461a0af6a75a51 [id=9ad5766f74b54846be83c212929b3ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.825677 28958 tablet_service.cc:1511] Processing CreateTablet for tablet faa73e73cc9b4fb28cdc87d259f5e7bb (DEFAULT_TABLE table=default.Table_603e1a661c5e44b1a19230e537c10919 [id=6ac70796ad20486d8777f6d8518ee784]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.825910 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c3089f552b449095eafc00da38e442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.826184 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1dc756edd5473183afc75eef7112d6 (DEFAULT_TABLE table=default.Table_a945d2c9fc4e4ebf92224c1a32bec9be [id=0ece007078c749e3bd4bab93ada3b311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.826493 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1dc756edd5473183afc75eef7112d6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:44.826520 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet cd312e8817ee4c8fb7377825a7e6122a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cd312e8817ee4c8fb7377825a7e6122a already in progress: creating tablet
I20260617 20:16:44.827059 29377 tablet_replica.cc:333] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.827282 29377 raft_consensus.cc:2243] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.827469 29377 raft_consensus.cc:2272] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.828962 29377 ts_tablet_manager.cc:1916] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.829571 28964 tablet_service.cc:1511] Processing CreateTablet for tablet e0c44c3fa6f64f929d48de53f2502bfb (DEFAULT_TABLE table=default.Table_b5d6c47745104ab1811026f32cbb701f [id=2dda85266fd14be88479aa0ffec47512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.829677 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 689121cc9ca647cda1899cdd569da8f6 (DEFAULT_TABLE table=default.Table_5245e1ca36044f1998856786158677b3 [id=229a4fa545c84500af515f5992b547c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.829936 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c44c3fa6f64f929d48de53f2502bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.830170 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689121cc9ca647cda1899cdd569da8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.833439 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faa73e73cc9b4fb28cdc87d259f5e7bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.842543 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8b6941054a6c4fbdb08b804c8e6822f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.843216 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 689121cc9ca647cda1899cdd569da8f6 (DEFAULT_TABLE table=default.Table_5245e1ca36044f1998856786158677b3 [id=229a4fa545c84500af515f5992b547c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.843689 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689121cc9ca647cda1899cdd569da8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.843951 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1dc756edd5473183afc75eef7112d6 (DEFAULT_TABLE table=default.Table_a945d2c9fc4e4ebf92224c1a32bec9be [id=0ece007078c749e3bd4bab93ada3b311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.844381 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1dc756edd5473183afc75eef7112d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.845682 29108 tablet_service.cc:1511] Processing CreateTablet for tablet faa73e73cc9b4fb28cdc87d259f5e7bb (DEFAULT_TABLE table=default.Table_603e1a661c5e44b1a19230e537c10919 [id=6ac70796ad20486d8777f6d8518ee784]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.846203 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faa73e73cc9b4fb28cdc87d259f5e7bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.847564 29457 raft_consensus.cc:493] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:44.847728 29457 raft_consensus.cc:515] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.843701 29103 tablet_service.cc:1511] Processing CreateTablet for tablet e0c44c3fa6f64f929d48de53f2502bfb (DEFAULT_TABLE table=default.Table_b5d6c47745104ab1811026f32cbb701f [id=2dda85266fd14be88479aa0ffec47512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.849186 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c44c3fa6f64f929d48de53f2502bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.849907 29240 tablet_service.cc:1511] Processing CreateTablet for tablet faa73e73cc9b4fb28cdc87d259f5e7bb (DEFAULT_TABLE table=default.Table_603e1a661c5e44b1a19230e537c10919 [id=6ac70796ad20486d8777f6d8518ee784]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.850005 29236 tablet_service.cc:1511] Processing CreateTablet for tablet c8c3089f552b449095eafc00da38e442 (DEFAULT_TABLE table=default.Table_2ef3a206c3e747ada8461a0af6a75a51 [id=9ad5766f74b54846be83c212929b3ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.850351 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faa73e73cc9b4fb28cdc87d259f5e7bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.850710 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 689121cc9ca647cda1899cdd569da8f6 (DEFAULT_TABLE table=default.Table_5245e1ca36044f1998856786158677b3 [id=229a4fa545c84500af515f5992b547c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.851138 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689121cc9ca647cda1899cdd569da8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.850773 29377 ts_tablet_manager.cc:1929] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.851459 29377 log.cc:1199] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/680fe7bf06bf4dcdab15c7c95cb00daf
I20260617 20:16:44.851852 29377 ts_tablet_manager.cc:1950] T 680fe7bf06bf4dcdab15c7c95cb00daf P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:44.853068 29377 tablet_replica.cc:333] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:44.853247 29377 raft_consensus.cc:2243] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.853449 29377 raft_consensus.cc:2272] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.853606 29242 tablet_service.cc:1511] Processing CreateTablet for tablet e0c44c3fa6f64f929d48de53f2502bfb (DEFAULT_TABLE table=default.Table_b5d6c47745104ab1811026f32cbb701f [id=2dda85266fd14be88479aa0ffec47512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.853698 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680fe7bf06bf4dcdab15c7c95cb00daf" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:44.854048 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c44c3fa6f64f929d48de53f2502bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.857410 29243 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1dc756edd5473183afc75eef7112d6 (DEFAULT_TABLE table=default.Table_a945d2c9fc4e4ebf92224c1a32bec9be [id=0ece007078c749e3bd4bab93ada3b311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.857594 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8ca126699bab4f66b23ce38c90e050bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.857803 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1dc756edd5473183afc75eef7112d6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:44.858279 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ca126699bab4f66b23ce38c90e050bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.860165 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7c00b4f954c743869ac8b3236a50e532"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:44.861228 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet 1199d8c7f1dc4b8f99301b8f60c687d1 from {username='slave'} at 127.0.0.1:60552
W20260617 20:16:44.860800 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c00b4f954c743869ac8b3236a50e532 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.862097 29377 ts_tablet_manager.cc:1916] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:44.862370 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b6941054a6c4fbdb08b804c8e6822f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.862463 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_dd6ce0bb614b47a8a449e4b75ec58dce" } new_table_name: "default.Table_71003cb25e6e4229aba21f7dd04b7fe4" modify_external_catalogs: true
I20260617 20:16:44.863420 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 680fe7bf06bf4dcdab15c7c95cb00daf (table default.Table_8eceb8f19afd47f2bf478ee57537dd7b [id=9439537fd882414f94ec8dd957bbd86e]) successfully deleted
W20260617 20:16:44.863649 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 46d7fa99c35646c59898738de38c88ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46d7fa99c35646c59898738de38c88ed already in progress: creating tablet
W20260617 20:16:44.863860 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5f2ec59ac5864da5a13965ca0724c387 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f2ec59ac5864da5a13965ca0724c387 already in progress: creating tablet
I20260617 20:16:44.864713 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c3089f552b449095eafc00da38e442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.865428 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 751bffacfaa5427784de63d51fc903dd (DEFAULT_TABLE table=default.Table_57b215ac8adc423e877c268e9fd1da1e [id=ba042ddba3704bf490d642394b2c3f9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.865832 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 751bffacfaa5427784de63d51fc903dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.866393 29101 tablet_service.cc:1511] Processing CreateTablet for tablet c8c3089f552b449095eafc00da38e442 (DEFAULT_TABLE table=default.Table_2ef3a206c3e747ada8461a0af6a75a51 [id=9ad5766f74b54846be83c212929b3ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.866426 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_57173259c5b84c00b2a539220a0634b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.866895 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57173259c5b84c00b2a539220a0634b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.848829 29457 leader_election.cc:290] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:44.868270 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_44a28fd64ae04db19e9311c1a5206d4b" } new_table_name: "default.Table_6e5629496f81401d8671eaa061393d1f" modify_external_catalogs: true
I20260617 20:16:44.869364 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8c3089f552b449095eafc00da38e442. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:44.871644 29062 leader_election.cc:343] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 680fe7bf06bf4dcdab15c7c95cb00daf
W20260617 20:16:44.871843 29063 leader_election.cc:343] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:44.872394 29377 ts_tablet_manager.cc:1929] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.872535 29377 log.cc:1199] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/2fd6c1769ed54ea8aed6ac91b9efe7ac
I20260617 20:16:44.872772 29063 leader_election.cc:304] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:44.872898 29377 ts_tablet_manager.cc:1950] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:44.875667 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 00f16ff3bc57434592d1648c4944c157 (DEFAULT_TABLE table=default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.876070 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f16ff3bc57434592d1648c4944c157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.883033 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4be33993864c73ba8b4da9468a517b (DEFAULT_TABLE table=default.Table_372f28b39c8a48cb96c6e828eca3a5a3 [id=6e89910c5d7a4969a79960d34eff437c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.883445 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4be33993864c73ba8b4da9468a517b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.883538 29457 raft_consensus.cc:2749] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:44.884465 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (table default.Table_b3b3fd43238e4c979d4e814f42eb49ab [id=3a41dd53c3974256877f193219240234]) successfully deleted
I20260617 20:16:44.890869 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4be33993864c73ba8b4da9468a517b (DEFAULT_TABLE table=default.Table_372f28b39c8a48cb96c6e828eca3a5a3 [id=6e89910c5d7a4969a79960d34eff437c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.891260 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4be33993864c73ba8b4da9468a517b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.892004 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 751bffacfaa5427784de63d51fc903dd (DEFAULT_TABLE table=default.Table_57b215ac8adc423e877c268e9fd1da1e [id=ba042ddba3704bf490d642394b2c3f9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.892449 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 751bffacfaa5427784de63d51fc903dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.897608 29239 tablet_service.cc:1511] Processing CreateTablet for tablet c15392db137446b2bd84cf9f31337718 (DEFAULT_TABLE table=default.Table_f07486abff7b4958baba24d98d53df0a [id=4117392d45f54d7dab6a67372d5da4e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.898043 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15392db137446b2bd84cf9f31337718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.900910 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 751bffacfaa5427784de63d51fc903dd (DEFAULT_TABLE table=default.Table_57b215ac8adc423e877c268e9fd1da1e [id=ba042ddba3704bf490d642394b2c3f9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.901386 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 751bffacfaa5427784de63d51fc903dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.901602 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 00f16ff3bc57434592d1648c4944c157 (DEFAULT_TABLE table=default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.902877 29101 tablet_service.cc:1511] Processing CreateTablet for tablet c15392db137446b2bd84cf9f31337718 (DEFAULT_TABLE table=default.Table_f07486abff7b4958baba24d98d53df0a [id=4117392d45f54d7dab6a67372d5da4e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.903291 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15392db137446b2bd84cf9f31337718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.901997 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f16ff3bc57434592d1648c4944c157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.906417 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 7a81a3502f5d4602b65328577a668d62 (DEFAULT_TABLE table=default.Table_dd6ce0bb614b47a8a449e4b75ec58dce [id=da4afdf3f60e48e78eb52d454fa4142c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.906805 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a81a3502f5d4602b65328577a668d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.909076 29375 ts_tablet_manager.cc:1929] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:44.909188 29375 log.cc:1199] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/2fd6c1769ed54ea8aed6ac91b9efe7ac
I20260617 20:16:44.903676 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4be33993864c73ba8b4da9468a517b (DEFAULT_TABLE table=default.Table_372f28b39c8a48cb96c6e828eca3a5a3 [id=6e89910c5d7a4969a79960d34eff437c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.906435 28964 tablet_service.cc:1511] Processing CreateTablet for tablet c15392db137446b2bd84cf9f31337718 (DEFAULT_TABLE table=default.Table_f07486abff7b4958baba24d98d53df0a [id=4117392d45f54d7dab6a67372d5da4e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.909615 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4be33993864c73ba8b4da9468a517b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.909652 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15392db137446b2bd84cf9f31337718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.909649 29375 ts_tablet_manager.cc:1950] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.910645 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (table default.Table_b3b3fd43238e4c979d4e814f42eb49ab [id=3a41dd53c3974256877f193219240234]) successfully deleted
I20260617 20:16:44.910949 29376 tablet_replica.cc:333] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:44.911134 29376 raft_consensus.cc:2243] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.911317 29376 raft_consensus.cc:2272] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.916297 29103 tablet_service.cc:1511] Processing CreateTablet for tablet 7a81a3502f5d4602b65328577a668d62 (DEFAULT_TABLE table=default.Table_dd6ce0bb614b47a8a449e4b75ec58dce [id=da4afdf3f60e48e78eb52d454fa4142c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.918709 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_03cf9869e98c4989af103a1fc7bf8774"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:44.919286 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03cf9869e98c4989af103a1fc7bf8774 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:44.920161 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a81a3502f5d4602b65328577a668d62. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:44.925968 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5f2ec59ac5864da5a13965ca0724c387 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f2ec59ac5864da5a13965ca0724c387 already in progress: creating tablet
I20260617 20:16:44.927680 29378 tablet_bootstrap.cc:492] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.927830 29378 ts_tablet_manager.cc:1403] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.143s user 0.028s sys 0.023s
W20260617 20:16:44.928676 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7a81a3502f5d4602b65328577a668d62 consensus state has no leader
I20260617 20:16:44.928632 29378 raft_consensus.cc:359] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.928825 29378 raft_consensus.cc:385] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.928912 29378 raft_consensus.cc:740] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.929165 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet 365e0ffb939047898243f72e4053d9a1 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:44.929137 29378 consensus_queue.cc:260] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:44.929442 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 1199d8c7f1dc4b8f99301b8f60c687d1
I20260617 20:16:44.929929 28669 catalog_manager.cc:6784] ReplaceTablet: tablet 1199d8c7f1dc4b8f99301b8f60c687d1 deleted and replaced by tablet 808c455e74e645aa8e2b0d08ca81d4f9
W20260617 20:16:44.929932 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d66923e12e1843bcbcb3da93cf838b65 consensus state has no leader
I20260617 20:16:44.930965 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 808c455e74e645aa8e2b0d08ca81d4f9) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.932121 29378 ts_tablet_manager.cc:1434] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260617 20:16:44.931525 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1199d8c7f1dc4b8f99301b8f60c687d1 already in progress: creating tablet
W20260617 20:16:44.932989 28662 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet f23960607f8a4efcb56cd5f306dc3a85 (table default.Table_4d5105d9785547e587bf29e7bca97216 [id=d70c3654e0c4417e9ff68be4309793ba], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet f23960607f8a4efcb56cd5f306dc3a85 consensus state has no leader
I20260617 20:16:44.933331 29378 tablet_bootstrap.cc:492] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.933753 28667 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet f23960607f8a4efcb56cd5f306dc3a85 (table default.Table_4d5105d9785547e587bf29e7bca97216 [id=d70c3654e0c4417e9ff68be4309793ba]). Expected version 2 got 0
I20260617 20:16:44.934007 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 680fe7bf06bf4dcdab15c7c95cb00daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.934291 29375 tablet_replica.cc:333] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.934499 29375 raft_consensus.cc:2243] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.934652 29375 raft_consensus.cc:2272] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.934998 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 808c455e74e645aa8e2b0d08ca81d4f9) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:44.936021 29375 ts_tablet_manager.cc:1916] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:44.936870 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1199d8c7f1dc4b8f99301b8f60c687d1 already in progress: creating tablet
I20260617 20:16:44.937927 29378 tablet_bootstrap.cc:654] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.941180 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 7a81a3502f5d4602b65328577a668d62 (DEFAULT_TABLE table=default.Table_dd6ce0bb614b47a8a449e4b75ec58dce [id=da4afdf3f60e48e78eb52d454fa4142c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.941745 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a81a3502f5d4602b65328577a668d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.942102 28666 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 95bf5d8704614db68c8ce7c272c2fb13 (table default.Table_aa9736ab22fd48bc862c930283895f27 [id=727864a195db4e4585240fb48a508df7]). Expected version 4 got 0
I20260617 20:16:44.942118 29375 ts_tablet_manager.cc:1929] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.942260 29375 log.cc:1199] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/680fe7bf06bf4dcdab15c7c95cb00daf
I20260617 20:16:44.942636 29375 ts_tablet_manager.cc:1950] T 680fe7bf06bf4dcdab15c7c95cb00daf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:44.944835 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 808c455e74e645aa8e2b0d08ca81d4f9) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.948678 29103 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac with delete_type TABLET_DATA_DELETED (replaced by tablet 60a43dd885aa4411a4177b67807b0ac4) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.949184 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 00f16ff3bc57434592d1648c4944c157 (DEFAULT_TABLE table=default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:44.949753 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f16ff3bc57434592d1648c4944c157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:44.950059 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 680fe7bf06bf4dcdab15c7c95cb00daf (table default.Table_8eceb8f19afd47f2bf478ee57537dd7b [id=9439537fd882414f94ec8dd957bbd86e]) successfully deleted
I20260617 20:16:44.950755 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 365e0ffb939047898243f72e4053d9a1
W20260617 20:16:44.950835 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac because the tablet was not found. No further retry: Not found: Tablet not found: 2fd6c1769ed54ea8aed6ac91b9efe7ac
I20260617 20:16:44.951258 28668 catalog_manager.cc:6784] ReplaceTablet: tablet 365e0ffb939047898243f72e4053d9a1 deleted and replaced by tablet b162a0ef91d1447b838331ba6ef93bf4
I20260617 20:16:44.951591 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 365e0ffb939047898243f72e4053d9a1 with delete_type TABLET_DATA_DELETED (replaced by tablet b162a0ef91d1447b838331ba6ef93bf4) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.951879 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 365e0ffb939047898243f72e4053d9a1 with delete_type TABLET_DATA_DELETED (replaced by tablet b162a0ef91d1447b838331ba6ef93bf4) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:44.952579 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 365e0ffb939047898243f72e4053d9a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 365e0ffb939047898243f72e4053d9a1 already in progress: creating tablet
I20260617 20:16:44.952598 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet 365e0ffb939047898243f72e4053d9a1 with delete_type TABLET_DATA_DELETED (replaced by tablet b162a0ef91d1447b838331ba6ef93bf4) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:44.953188 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 365e0ffb939047898243f72e4053d9a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 365e0ffb939047898243f72e4053d9a1 already in progress: creating tablet
I20260617 20:16:44.954061 29379 tablet_bootstrap.cc:492] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:44.954219 29379 ts_tablet_manager.cc:1403] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.204s user 0.010s sys 0.019s
I20260617 20:16:44.955034 29379 raft_consensus.cc:359] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.955238 29379 raft_consensus.cc:385] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.955325 29379 raft_consensus.cc:740] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
W20260617 20:16:44.955633 29063 consensus_peers.cc:597] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:44.955776 29379 consensus_queue.cc:260] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.956017 29376 ts_tablet_manager.cc:1916] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.956488 29378 tablet_bootstrap.cc:492] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.956696 29378 ts_tablet_manager.cc:1403] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.000s
I20260617 20:16:44.958318 29379 ts_tablet_manager.cc:1434] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:16:44.959311 29379 tablet_bootstrap.cc:492] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:44.960099 28990 raft_consensus.cc:1275] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Refusing update from remote peer 6d4ce30e1fce4591b64c398747f8d37a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:44.960552 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet adcd4689680e43b19318336fb5a3edb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.960870 29375 tablet_replica.cc:333] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:44.961483 29375 raft_consensus.cc:2243] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.961769 29375 raft_consensus.cc:2272] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.962576 29375 ts_tablet_manager.cc:1916] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:44.962457 29457 consensus_queue.cc:1048] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:44.963528 29379 tablet_bootstrap.cc:654] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.963973 29383 tablet_bootstrap.cc:492] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:44.964130 29383 ts_tablet_manager.cc:1403] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.166s user 0.013s sys 0.001s
I20260617 20:16:44.964953 29383 raft_consensus.cc:359] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.965116 29383 raft_consensus.cc:385] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.965194 29383 raft_consensus.cc:740] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.965453 29383 consensus_queue.cc:260] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.966473 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6e5629496f81401d8671eaa061393d1f" } modify_external_catalogs: true
I20260617 20:16:44.966671 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6e5629496f81401d8671eaa061393d1f" } modify_external_catalogs: true
I20260617 20:16:44.967789 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_81c4de22d335419abd4b3910e9025510" } modify_external_catalogs: true
I20260617 20:16:44.967979 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_81c4de22d335419abd4b3910e9025510" } modify_external_catalogs: true
I20260617 20:16:44.968182 29378 raft_consensus.cc:359] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.968925 29378 raft_consensus.cc:385] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.969002 29378 raft_consensus.cc:740] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.969600 29378 consensus_queue.cc:260] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.971539 29378 ts_tablet_manager.cc:1434] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260617 20:16:44.973348 29378 tablet_bootstrap.cc:492] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.974958 29383 ts_tablet_manager.cc:1434] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260617 20:16:44.975291 29383 tablet_bootstrap.cc:492] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:44.976926 29378 tablet_bootstrap.cc:654] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.976974 29383 tablet_bootstrap.cc:654] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:44.982921 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d66923e12e1843bcbcb3da93cf838b65
I20260617 20:16:44.984242 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet d66923e12e1843bcbcb3da93cf838b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:44.984310 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet cd628a25f3a14b64a5f9a70d104b3dcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.984683 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet d66923e12e1843bcbcb3da93cf838b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:44.984956 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet d66923e12e1843bcbcb3da93cf838b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:44.986047 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d66923e12e1843bcbcb3da93cf838b65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d66923e12e1843bcbcb3da93cf838b65 already in progress: creating tablet
I20260617 20:16:44.987799 29376 ts_tablet_manager.cc:1929] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:44.987931 29376 log.cc:1199] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/2fd6c1769ed54ea8aed6ac91b9efe7ac
I20260617 20:16:44.988505 29376 ts_tablet_manager.cc:1950] T 2fd6c1769ed54ea8aed6ac91b9efe7ac P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:44.989951 29378 tablet_bootstrap.cc:492] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:44.990142 29378 ts_tablet_manager.cc:1403] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20260617 20:16:44.991170 29378 raft_consensus.cc:359] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.991385 29378 raft_consensus.cc:385] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:44.991478 29378 raft_consensus.cc:740] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:44.993278 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_603e1a661c5e44b1a19230e537c10919" } new_table_name: "default.Table_e0e8f7e180d64ca690dfea9446c257a1" modify_external_catalogs: true
I20260617 20:16:44.993505 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8b6941054a6c4fbdb08b804c8e6822f3" } new_table_name: "default.Table_649e9f8868b847939f847fc704618700" modify_external_catalogs: true
I20260617 20:16:44.995153 29376 tablet_replica.cc:333] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:44.995364 29376 raft_consensus.cc:2243] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:44.995553 29376 raft_consensus.cc:2272] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:44.999908 29468 mvcc.cc:204] Tried to move back new op lower bound from 7297955450678083584 to 7297955449930817536. Current Snapshot: MvccSnapshot[applied={T|T < 7297955450678083584}]
I20260617 20:16:45.000272 29376 ts_tablet_manager.cc:1916] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.001991 29391 raft_consensus.cc:493] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.002135 29391 raft_consensus.cc:515] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.002771 29391 leader_election.cc:290] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:45.003361 29378 consensus_queue.cc:260] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
W20260617 20:16:45.003814 29198 leader_election.cc:343] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: cd628a25f3a14b64a5f9a70d104b3dcf
W20260617 20:16:45.004703 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2c0988a73d547d08d0924784bff9222 has no consensus state
I20260617 20:16:45.005021 29378 ts_tablet_manager.cc:1434] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260617 20:16:45.006165 29378 tablet_bootstrap.cc:492] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:44.993552 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2420afe282984f72ab42715fbc33380a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.007623 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet faa73e73cc9b4fb28cdc87d259f5e7bb consensus state has no leader
I20260617 20:16:45.008304 29383 tablet_bootstrap.cc:492] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
W20260617 20:16:45.008389 29197 leader_election.cc:343] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: cd628a25f3a14b64a5f9a70d104b3dcf
I20260617 20:16:45.008520 29197 leader_election.cc:304] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:45.008646 29383 ts_tablet_manager.cc:1403] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.001s
I20260617 20:16:45.009006 29391 raft_consensus.cc:2749] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:45.009122 29378 tablet_bootstrap.cc:654] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.010493 29383 raft_consensus.cc:359] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:44.997062 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 2fd6c1769ed54ea8aed6ac91b9efe7ac (table default.Table_b3b3fd43238e4c979d4e814f42eb49ab [id=3a41dd53c3974256877f193219240234]) successfully deleted
W20260617 20:16:45.011315 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5f2ec59ac5864da5a13965ca0724c387 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f2ec59ac5864da5a13965ca0724c387 already in progress: creating tablet
I20260617 20:16:45.012182 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6ed5c9767b364748ae14ecead288e68c" } modify_external_catalogs: true
I20260617 20:16:45.012355 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6ed5c9767b364748ae14ecead288e68c" } modify_external_catalogs: true
I20260617 20:16:45.012818 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a96bacccf2874d2ea84a7c20f9892640" } modify_external_catalogs: true
I20260617 20:16:45.013001 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a96bacccf2874d2ea84a7c20f9892640" } modify_external_catalogs: true
I20260617 20:16:45.013501 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f2ec59ac5864da5a13965ca0724c387 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.013712 29470 mvcc.cc:204] Tried to move back new op lower bound from 7297955450678083584 to 7297955449930817536. Current Snapshot: MvccSnapshot[applied={T|T < 7297955450678083584}]
I20260617 20:16:45.012836 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet 1199d8c7f1dc4b8f99301b8f60c687d1 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.014760 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1e265a3fe8e441dda5f94d4199dcfb59" } modify_external_catalogs: true
I20260617 20:16:45.014966 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1e265a3fe8e441dda5f94d4199dcfb59" } modify_external_catalogs: true
W20260617 20:16:45.015405 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2420afe282984f72ab42715fbc33380a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.016316 29375 ts_tablet_manager.cc:1929] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.016475 29375 log.cc:1199] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/adcd4689680e43b19318336fb5a3edb3
I20260617 20:16:45.017381 29376 ts_tablet_manager.cc:1929] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.017547 29376 log.cc:1199] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/3f550e50674e43b785d23c37ab28b956
I20260617 20:16:45.018574 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4d5105d9785547e587bf29e7bca97216" } new_table_name: "default.Table_a2da3871debd45c093cb28141965de33" modify_external_catalogs: true
I20260617 20:16:45.018903 29376 ts_tablet_manager.cc:1950] T 3f550e50674e43b785d23c37ab28b956 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:45.018844 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_33168ad831b44c79a651427dd6011f2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.019347 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33168ad831b44c79a651427dd6011f2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.020069 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8e019e33cf25495289e2e63f59c874ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.020540 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e019e33cf25495289e2e63f59c874ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.022197 29383 raft_consensus.cc:385] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.022450 29383 raft_consensus.cc:740] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.022807 29383 consensus_queue.cc:260] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.022953 29376 tablet_replica.cc:333] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:45.023486 29376 raft_consensus.cc:2243] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.023720 29376 raft_consensus.cc:2272] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.024041 29383 ts_tablet_manager.cc:1434] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260617 20:16:45.024398 29383 tablet_bootstrap.cc:492] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:45.025394 29376 ts_tablet_manager.cc:1916] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.026979 29383 tablet_bootstrap.cc:654] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.035090 29378 tablet_bootstrap.cc:492] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:45.035318 29378 ts_tablet_manager.cc:1403] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.002s
I20260617 20:16:45.036604 29378 raft_consensus.cc:359] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.036890 29378 raft_consensus.cc:385] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.036991 29378 raft_consensus.cc:740] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.037338 29378 consensus_queue.cc:260] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.038249 29378 ts_tablet_manager.cc:1434] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260617 20:16:45.038594 29378 tablet_bootstrap.cc:492] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:45.040275 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 3f550e50674e43b785d23c37ab28b956 (table default.Table_afc19b5045e2429a8e30a23563fbb900 [id=d1ef628fd67d49d3bd9bd960b9a54465]) successfully deleted
W20260617 20:16:45.040565 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1199d8c7f1dc4b8f99301b8f60c687d1 already in progress: creating tablet
I20260617 20:16:45.041890 29378 tablet_bootstrap.cc:654] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.042362 29383 tablet_bootstrap.cc:492] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:45.042570 29383 ts_tablet_manager.cc:1403] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.002s
W20260617 20:16:45.043231 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f23960607f8a4efcb56cd5f306dc3a85 consensus state has no leader
I20260617 20:16:45.043514 29383 raft_consensus.cc:359] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.043710 29383 raft_consensus.cc:385] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.043838 29383 raft_consensus.cc:740] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.044142 29383 consensus_queue.cc:260] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.045014 29383 ts_tablet_manager.cc:1434] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:45.045342 29383 tablet_bootstrap.cc:492] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:45.045799 29376 ts_tablet_manager.cc:1929] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.045951 29376 log.cc:1199] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/cd628a25f3a14b64a5f9a70d104b3dcf
I20260617 20:16:45.046443 29376 ts_tablet_manager.cc:1950] T cd628a25f3a14b64a5f9a70d104b3dcf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:45.047284 29383 tablet_bootstrap.cc:654] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:45.054454 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 365e0ffb939047898243f72e4053d9a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 365e0ffb939047898243f72e4053d9a1 already in progress: creating tablet
I20260617 20:16:45.056329 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet 511179f9875241128390708b55dba05e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.056638 29383 tablet_bootstrap.cc:492] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:45.056859 29383 ts_tablet_manager.cc:1403] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260617 20:16:45.057741 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet a42074d6374a4682a4948970720134e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.057900 29383 raft_consensus.cc:359] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.058158 29383 raft_consensus.cc:385] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.058240 29383 raft_consensus.cc:740] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.058542 29383 consensus_queue.cc:260] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.059187 29383 ts_tablet_manager.cc:1434] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:45.059592 29383 tablet_bootstrap.cc:492] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:45.060904 29475 tablet.cc:1724] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:45.061595 29383 tablet_bootstrap.cc:654] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.063041 29390 raft_consensus.cc:493] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.063200 29390 raft_consensus.cc:515] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.065202 29390 leader_election.cc:290] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:45.071105 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet cd628a25f3a14b64a5f9a70d104b3dcf (table default.Table_d0963241dd0f4d5f9be5d2bd34871072 [id=b5d358e515734a51b4a25fb7c90b2a66]) successfully deleted
I20260617 20:16:45.071272 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_29efc4231c2a404db10313243e8b10fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.071429 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d66923e12e1843bcbcb3da93cf838b65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d66923e12e1843bcbcb3da93cf838b65 already in progress: creating tablet
W20260617 20:16:45.071873 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29efc4231c2a404db10313243e8b10fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.073818 29376 tablet_replica.cc:333] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:45.074954 29376 raft_consensus.cc:2243] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.075140 29376 raft_consensus.cc:2272] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.077077 29376 ts_tablet_manager.cc:1916] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.088198 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]). Expected version 2 got 0
I20260617 20:16:45.089743 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 95bf5d8704614db68c8ce7c272c2fb13 (table default.Table_aa9736ab22fd48bc862c930283895f27 [id=727864a195db4e4585240fb48a508df7]). Expected version 4 got 0
I20260617 20:16:45.095420 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 137cbb87d11c450995b63f7a8a7dece5
I20260617 20:16:45.096798 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 137cbb87d11c450995b63f7a8a7dece5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:45.097613 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 137cbb87d11c450995b63f7a8a7dece5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 137cbb87d11c450995b63f7a8a7dece5 already in progress: creating tablet
I20260617 20:16:45.101830 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 28146a1f84aa41ee88d9aea299256a90
I20260617 20:16:45.103430 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 28146a1f84aa41ee88d9aea299256a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.104254 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f74494a3230448c983d8af0e553247bf
W20260617 20:16:45.105122 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 28146a1f84aa41ee88d9aea299256a90 because the tablet was not found. No further retry: Not found: Tablet not found: 28146a1f84aa41ee88d9aea299256a90
I20260617 20:16:45.105652 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet f74494a3230448c983d8af0e553247bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.106287 29376 ts_tablet_manager.cc:1929] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:16:45.106317 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f74494a3230448c983d8af0e553247bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f74494a3230448c983d8af0e553247bf already in progress: creating tablet
I20260617 20:16:45.106446 29376 log.cc:1199] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/511179f9875241128390708b55dba05e
I20260617 20:16:45.107683 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4f2010232aed489ba61ec1ac423b2f2d
I20260617 20:16:45.106818 29376 ts_tablet_manager.cc:1950] T 511179f9875241128390708b55dba05e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:45.109859 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2010232aed489ba61ec1ac423b2f2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.110148 29377 tablet_replica.cc:333] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:45.110366 29377 raft_consensus.cc:2243] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.110541 29377 raft_consensus.cc:2272] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.110908 28881 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 28146a1f84aa41ee88d9aea299256a90
I20260617 20:16:45.111553 29377 ts_tablet_manager.cc:1916] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.114537 29376 tablet_replica.cc:333] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:45.114717 29376 raft_consensus.cc:2243] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.114916 29376 raft_consensus.cc:2272] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.114919 28669 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a] alter complete (version 2)
I20260617 20:16:45.116290 29376 ts_tablet_manager.cc:1916] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.116447 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet adcd4689680e43b19318336fb5a3edb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.117162 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c047f3fab644c50aef4adfff153a85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.119187 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 28146a1f84aa41ee88d9aea299256a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.120360 29377 ts_tablet_manager.cc:1929] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.120533 29377 log.cc:1199] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/4f2010232aed489ba61ec1ac423b2f2d
I20260617 20:16:45.120957 28964 tablet_service.cc:1511] Processing CreateTablet for tablet dd2df17b35a7483b93a6e89d42ac1a62 (DEFAULT_TABLE table=default.Table_63ec8a56c11346edadaf156c2984a619 [id=32c61aa9610e428fa8d5c794b078e0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.121519 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2df17b35a7483b93a6e89d42ac1a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.122537 29376 ts_tablet_manager.cc:1929] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.122642 29376 log.cc:1199] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/a42074d6374a4682a4948970720134e4
I20260617 20:16:45.123045 29376 ts_tablet_manager.cc:1950] T a42074d6374a4682a4948970720134e4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:45.124626 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 4516e7a7fa284eaa816558b2d58cd213 (DEFAULT_TABLE table=default.Table_68983d7d2bff43f4a914573626bafb37 [id=c02a5e81598b47b9830a236256da4bba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.125104 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4516e7a7fa284eaa816558b2d58cd213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.120960 29377 ts_tablet_manager.cc:1950] T 4f2010232aed489ba61ec1ac423b2f2d P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:45.135165 29377 tablet_replica.cc:333] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:45.135309 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 4f2010232aed489ba61ec1ac423b2f2d (table default.Table_1e265a3fe8e441dda5f94d4199dcfb59 [id=225c167b50aa4f898139245b0935968b]) successfully deleted
I20260617 20:16:45.135617 29377 raft_consensus.cc:2243] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.135993 29377 raft_consensus.cc:2272] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.139055 29377 ts_tablet_manager.cc:1916] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.139304 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d1ff9be288404322b20ddc908c3f5b23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.140120 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1ff9be288404322b20ddc908c3f5b23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.145105 29379 tablet_bootstrap.cc:492] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:45.145318 29379 ts_tablet_manager.cc:1403] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.186s user 0.008s sys 0.008s
I20260617 20:16:45.146207 29379 raft_consensus.cc:359] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.146394 29379 raft_consensus.cc:385] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.146473 29379 raft_consensus.cc:740] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.146679 29379 consensus_queue.cc:260] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.147136 29379 ts_tablet_manager.cc:1434] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:45.147445 29379 tablet_bootstrap.cc:492] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:45.149158 29379 tablet_bootstrap.cc:654] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.150609 29474 tablet.cc:1724] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:45.151882 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 28146a1f84aa41ee88d9aea299256a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.157335 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 137cbb87d11c450995b63f7a8a7dece5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.158460 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8dcdd3a47b274f128104cf843c511909"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.159171 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dcdd3a47b274f128104cf843c511909 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.160667 29375 ts_tablet_manager.cc:1950] T adcd4689680e43b19318336fb5a3edb3 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:45.162004 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e9f868b8616d4ca0940cba8937919fb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:45.162252 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1944004da2ec4937b26d524aa808d0b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.162550 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9f868b8616d4ca0940cba8937919fb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:45.162647 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1944004da2ec4937b26d524aa808d0b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.166214 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8955ebce08214381859b3c3c1ce00027" } new_table_name: "default.Table_a8c15278c7744f918c777fd75ebde5a9" modify_external_catalogs: true
I20260617 20:16:45.169064 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ef23aa968984448793f5605fea074d86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.169690 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef23aa968984448793f5605fea074d86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.172518 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c2b8466befbf483b926180cf0056a23a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.173017 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2b8466befbf483b926180cf0056a23a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.177524 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b5d6c47745104ab1811026f32cbb701f" } new_table_name: "default.Table_648063d260534042bb01e0ae092c195b" modify_external_catalogs: true
W20260617 20:16:45.188716 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55e4ef1f493c4f1289cfa192ce38161d consensus state has no leader
I20260617 20:16:45.192238 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a2da3871debd45c093cb28141965de33" } modify_external_catalogs: true
I20260617 20:16:45.192442 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a2da3871debd45c093cb28141965de33" } modify_external_catalogs: true
I20260617 20:16:45.205830 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2010232aed489ba61ec1ac423b2f2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.206084 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet f74494a3230448c983d8af0e553247bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.221860 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a8c15278c7744f918c777fd75ebde5a9" } new_table_name: "default.Table_2b054c3c845f4657a3339cf535372c22" modify_external_catalogs: true
I20260617 20:16:45.223778 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5245e1ca36044f1998856786158677b3" } new_table_name: "default.Table_81f4fb86b1a8470db7f74e35dc15a3fa" modify_external_catalogs: true
W20260617 20:16:45.230693 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e0c44c3fa6f64f929d48de53f2502bfb consensus state has no leader
I20260617 20:16:45.231343 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 28146a1f84aa41ee88d9aea299256a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.233109 29099 tablet_service.cc:1511] Processing CreateTablet for tablet dd2df17b35a7483b93a6e89d42ac1a62 (DEFAULT_TABLE table=default.Table_63ec8a56c11346edadaf156c2984a619 [id=32c61aa9610e428fa8d5c794b078e0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.233568 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f23960607f8a4efcb56cd5f306dc3a85
I20260617 20:16:45.234902 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2df17b35a7483b93a6e89d42ac1a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.237665 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 4516e7a7fa284eaa816558b2d58cd213 (DEFAULT_TABLE table=default.Table_68983d7d2bff43f4a914573626bafb37 [id=c02a5e81598b47b9830a236256da4bba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.238072 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4516e7a7fa284eaa816558b2d58cd213. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:45.239331 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55e4ef1f493c4f1289cfa192ce38161d consensus state has no leader
W20260617 20:16:45.240271 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 689121cc9ca647cda1899cdd569da8f6 consensus state has no leader
I20260617 20:16:45.241479 29388 raft_consensus.cc:493] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.241637 29388 raft_consensus.cc:515] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.242319 29388 leader_election.cc:290] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:45.242731 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5f983e7235224256bae836edd0ffbc09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:45.244138 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet f23960607f8a4efcb56cd5f306dc3a85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.244678 29375 tablet_replica.cc:333] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:45.244879 29375 raft_consensus.cc:2243] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.245062 29375 raft_consensus.cc:2272] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.245857 29375 ts_tablet_manager.cc:1916] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.249962 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet f23960607f8a4efcb56cd5f306dc3a85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.250124 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95bf5d8704614db68c8ce7c272c2fb13" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:45.250370 28990 raft_consensus.cc:2468] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:45.250847 29062 leader_election.cc:304] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:45.251245 29388 raft_consensus.cc:2804] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:45.251330 29388 raft_consensus.cc:493] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:45.251422 29388 raft_consensus.cc:3060] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:45.252945 29375 ts_tablet_manager.cc:1929] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.253093 29375 log.cc:1199] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/f23960607f8a4efcb56cd5f306dc3a85
I20260617 20:16:45.253482 29375 ts_tablet_manager.cc:1950] T f23960607f8a4efcb56cd5f306dc3a85 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:45.254561 29474 tablet.cc:1719] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: Skipping requested alter to schema version 2, tablet already version 2
I20260617 20:16:45.256827 29388 raft_consensus.cc:515] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.257815 29475 tablet.cc:1719] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: Skipping requested alter to schema version 2, tablet already version 2
W20260617 20:16:45.258793 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f983e7235224256bae836edd0ffbc09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.260627 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95bf5d8704614db68c8ce7c272c2fb13" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:45.260826 28989 raft_consensus.cc:3060] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:45.264011 28989 raft_consensus.cc:2468] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:45.264511 29062 leader_election.cc:304] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:45.264801 29457 raft_consensus.cc:2804] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:45.264918 29457 raft_consensus.cc:697] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:45.265167 29457 consensus_queue.cc:237] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.267611 28966 tablet_service.cc:1511] Processing CreateTablet for tablet fa513612e44148d7983b0db00d733888 (DEFAULT_TABLE table=default.Table_e07e30476d764b83aabfde1a21b2d5a6 [id=8ff99ac5540d43c7aebd37573a0c6790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.268055 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa513612e44148d7983b0db00d733888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.271382 29388 leader_election.cc:290] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:45.276935 28661 catalog_manager.cc:5696] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194). New cstate: current_term: 1 leader_uuid: "6d4ce30e1fce4591b64c398747f8d37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:45.277761 28661 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 95bf5d8704614db68c8ce7c272c2fb13 (table default.Table_aa9736ab22fd48bc862c930283895f27 [id=727864a195db4e4585240fb48a508df7]). Expected version 4 got 0
I20260617 20:16:45.285883 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_63ec8a56c11346edadaf156c2984a619" } new_table_name: "default.Table_26fbc7a31fb7435790febb8d25c7ef1e" modify_external_catalogs: true
I20260617 20:16:45.288232 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9e962aa5866b4b0bb2f4c1f6bb9257e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.288765 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e962aa5866b4b0bb2f4c1f6bb9257e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.289108 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8985331f7fce43788f3a355c861e8297"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.289901 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8985331f7fce43788f3a355c861e8297 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.290732 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_07f654ca505c4bc5bc80b432a51acaa8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.291278 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07f654ca505c4bc5bc80b432a51acaa8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.292474 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet adcd4689680e43b19318336fb5a3edb3 (table default.Table_24eb651bcbec4bafbac0b0612438512f [id=704477b29a8548ed9d8fd39b7e9e89a5]) successfully deleted
W20260617 20:16:45.292721 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d66923e12e1843bcbcb3da93cf838b65 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d66923e12e1843bcbcb3da93cf838b65 already in progress: creating tablet
W20260617 20:16:45.292994 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 28146a1f84aa41ee88d9aea299256a90 because the tablet was not found. No further retry: Not found: Tablet not found: 28146a1f84aa41ee88d9aea299256a90
W20260617 20:16:45.293207 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 137cbb87d11c450995b63f7a8a7dece5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 137cbb87d11c450995b63f7a8a7dece5 already in progress: creating tablet
W20260617 20:16:45.293464 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4f2010232aed489ba61ec1ac423b2f2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f2010232aed489ba61ec1ac423b2f2d already in progress: creating tablet
W20260617 20:16:45.293673 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet f74494a3230448c983d8af0e553247bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f74494a3230448c983d8af0e553247bf already in progress: creating tablet
W20260617 20:16:45.293911 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 28146a1f84aa41ee88d9aea299256a90 because the tablet was not found. No further retry: Not found: Tablet not found: 28146a1f84aa41ee88d9aea299256a90
I20260617 20:16:45.294097 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet f23960607f8a4efcb56cd5f306dc3a85 (table default.Table_a2da3871debd45c093cb28141965de33 [id=d70c3654e0c4417e9ff68be4309793ba]) successfully deleted
I20260617 20:16:45.296720 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c047f3fab644c50aef4adfff153a85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.297326 29375 tablet_replica.cc:333] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:45.297566 29375 raft_consensus.cc:2243] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.297816 29375 raft_consensus.cc:2272] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.298590 29375 ts_tablet_manager.cc:1916] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.299877 29379 tablet_bootstrap.cc:492] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:45.300105 29379 ts_tablet_manager.cc:1403] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.153s user 0.011s sys 0.001s
I20260617 20:16:45.301065 29379 raft_consensus.cc:359] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.301373 29379 raft_consensus.cc:385] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.301498 29379 raft_consensus.cc:740] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.301690 29390 raft_consensus.cc:493] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.301856 29390 raft_consensus.cc:515] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.301949 29379 consensus_queue.cc:260] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.302512 29390 leader_election.cc:290] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:45.303406 29379 ts_tablet_manager.cc:1434] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260617 20:16:45.306156 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd2df17b35a7483b93a6e89d42ac1a62 consensus state has no leader
I20260617 20:16:45.306576 29379 tablet_bootstrap.cc:492] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:45.308512 29379 tablet_bootstrap.cc:654] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.313742 28966 tablet_service.cc:1511] Processing CreateTablet for tablet d9b7880a039a497fbd0fb5d4f74e7d23 (DEFAULT_TABLE table=default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.314188 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b7880a039a497fbd0fb5d4f74e7d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.337159 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8dcdd3a47b274f128104cf843c511909" } modify_external_catalogs: true
I20260617 20:16:45.337430 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8dcdd3a47b274f128104cf843c511909" } modify_external_catalogs: true
I20260617 20:16:45.338398 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95bf5d8704614db68c8ce7c272c2fb13" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:45.338488 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95bf5d8704614db68c8ce7c272c2fb13" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:45.338662 29263 raft_consensus.cc:2468] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:45.338994 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c2b8466befbf483b926180cf0056a23a" } modify_external_catalogs: true
I20260617 20:16:45.339179 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c2b8466befbf483b926180cf0056a23a" } modify_external_catalogs: true
I20260617 20:16:45.339782 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet 137cbb87d11c450995b63f7a8a7dece5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.340495 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet 28146a1f84aa41ee88d9aea299256a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.340463 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_aa9736ab22fd48bc862c930283895f27" } modify_external_catalogs: true
I20260617 20:16:45.340731 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_aa9736ab22fd48bc862c930283895f27" } modify_external_catalogs: true
I20260617 20:16:45.341041 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet f74494a3230448c983d8af0e553247bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.341511 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d1ff9be288404322b20ddc908c3f5b23" } modify_external_catalogs: true
I20260617 20:16:45.341605 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2010232aed489ba61ec1ac423b2f2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.341763 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d1ff9be288404322b20ddc908c3f5b23" } modify_external_catalogs: true
I20260617 20:16:45.342193 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet 28146a1f84aa41ee88d9aea299256a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.342965 29234 tablet_service.cc:1511] Processing CreateTablet for tablet dd2df17b35a7483b93a6e89d42ac1a62 (DEFAULT_TABLE table=default.Table_63ec8a56c11346edadaf156c2984a619 [id=32c61aa9610e428fa8d5c794b078e0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.343385 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2df17b35a7483b93a6e89d42ac1a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.351197 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 4516e7a7fa284eaa816558b2d58cd213 (DEFAULT_TABLE table=default.Table_68983d7d2bff43f4a914573626bafb37 [id=c02a5e81598b47b9830a236256da4bba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.351622 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet f23960607f8a4efcb56cd5f306dc3a85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.351943 29239 tablet_service.cc:1511] Processing CreateTablet for tablet fa513612e44148d7983b0db00d733888 (DEFAULT_TABLE table=default.Table_e07e30476d764b83aabfde1a21b2d5a6 [id=8ff99ac5540d43c7aebd37573a0c6790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.351640 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4516e7a7fa284eaa816558b2d58cd213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.355705 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet d723526a83174898a71a835b7cdbc467 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.356248 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet 7a81a3502f5d4602b65328577a668d62 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.356544 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet a79b56241ac84862868c664cca25654b from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.356737 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet 00f16ff3bc57434592d1648c4944c157 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.357159 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 689121cc9ca647cda1899cdd569da8f6 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.357609 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa513612e44148d7983b0db00d733888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.358914 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 511179f9875241128390708b55dba05e (table default.Table_5b1993d0c19d4c9a9d266ba632d99c39 [id=ac46308147954a68bc53d1b6684d1b62]) successfully deleted
I20260617 20:16:45.359150 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet a42074d6374a4682a4948970720134e4 (table default.Table_389a4632b173428984db63f12fbe631f [id=22252c6160d540879efa900a2d3584c8]) successfully deleted
I20260617 20:16:45.359179 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c047f3fab644c50aef4adfff153a85b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:45.359380 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 137cbb87d11c450995b63f7a8a7dece5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 137cbb87d11c450995b63f7a8a7dece5 already in progress: creating tablet
W20260617 20:16:45.359601 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 28146a1f84aa41ee88d9aea299256a90 because the tablet was not found. No further retry: Not found: Tablet not found: 28146a1f84aa41ee88d9aea299256a90
W20260617 20:16:45.359783 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f74494a3230448c983d8af0e553247bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f74494a3230448c983d8af0e553247bf already in progress: creating tablet
W20260617 20:16:45.359959 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4f2010232aed489ba61ec1ac423b2f2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f2010232aed489ba61ec1ac423b2f2d already in progress: creating tablet
I20260617 20:16:45.331025 29375 ts_tablet_manager.cc:1929] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.335544 29099 tablet_service.cc:1511] Processing CreateTablet for tablet fa513612e44148d7983b0db00d733888 (DEFAULT_TABLE table=default.Table_e07e30476d764b83aabfde1a21b2d5a6 [id=8ff99ac5540d43c7aebd37573a0c6790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.360590 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa513612e44148d7983b0db00d733888. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:45.361119 28925 leader_election.cc:343] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: f23960607f8a4efcb56cd5f306dc3a85
W20260617 20:16:45.361441 28925 leader_election.cc:343] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: Tablet not RUNNING: STOPPED
I20260617 20:16:45.367133 29375 log.cc:1199] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/5c047f3fab644c50aef4adfff153a85b
I20260617 20:16:45.367553 29375 ts_tablet_manager.cc:1950] T 5c047f3fab644c50aef4adfff153a85b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:16:45.360147 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 28146a1f84aa41ee88d9aea299256a90 because the tablet was not found. No further retry: Not found: Tablet not found: 28146a1f84aa41ee88d9aea299256a90
W20260617 20:16:45.368971 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f23960607f8a4efcb56cd5f306dc3a85 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f23960607f8a4efcb56cd5f306dc3a85 already in progress: creating tablet
I20260617 20:16:45.370078 29099 tablet_service.cc:1511] Processing CreateTablet for tablet d9b7880a039a497fbd0fb5d4f74e7d23 (DEFAULT_TABLE table=default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.370532 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b7880a039a497fbd0fb5d4f74e7d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.386647 29237 tablet_service.cc:1511] Processing CreateTablet for tablet d9b7880a039a497fbd0fb5d4f74e7d23 (DEFAULT_TABLE table=default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.387125 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9b7880a039a497fbd0fb5d4f74e7d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.394644 28664 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet c2a0ee7652824b30b740c8474070f17d
I20260617 20:16:45.394949 28665 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet b613ea08cd734dfb9a47df7841281339
I20260617 20:16:45.396291 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f23960607f8a4efcb56cd5f306dc3a85" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:45.397043 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c047f3fab644c50aef4adfff153a85b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:45.400468 29379 tablet_bootstrap.cc:492] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:45.400688 29379 ts_tablet_manager.cc:1403] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.094s user 0.000s sys 0.004s
I20260617 20:16:45.402118 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 5c047f3fab644c50aef4adfff153a85b (table default.Table_0ec2cf7d7dc84aaa942f063bbcb984b9 [id=fb1fb1a6dbdd4b258aa91bb9e4f06ae2]) successfully deleted
I20260617 20:16:45.402542 29379 raft_consensus.cc:359] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.402825 29379 raft_consensus.cc:385] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.405501 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 60a43dd885aa4411a4177b67807b0ac4 (DEFAULT_TABLE table=default.Table_b3b3fd43238e4c979d4e814f42eb49ab [id=3a41dd53c3974256877f193219240234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.405983 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a43dd885aa4411a4177b67807b0ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.407264 29383 tablet_bootstrap.cc:492] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:45.407402 29383 ts_tablet_manager.cc:1403] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.348s user 0.033s sys 0.104s
I20260617 20:16:45.407630 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 689121cc9ca647cda1899cdd569da8f6
I20260617 20:16:45.408103 28666 catalog_manager.cc:6784] ReplaceTablet: tablet 689121cc9ca647cda1899cdd569da8f6 deleted and replaced by tablet 4332e33d60964bd6a0c7e7caaa6bdc76
I20260617 20:16:45.408193 29383 raft_consensus.cc:359] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.408370 29383 raft_consensus.cc:385] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.408453 29383 raft_consensus.cc:740] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.408675 29383 consensus_queue.cc:260] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.409212 29383 ts_tablet_manager.cc:1434] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:45.409543 29383 tablet_bootstrap.cc:492] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:45.409857 28669 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 29bdcc3ec82448368fbd23408cfa2ca4
I20260617 20:16:45.411248 29383 tablet_bootstrap.cc:654] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.418864 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 00f16ff3bc57434592d1648c4944c157
I20260617 20:16:45.419390 28670 catalog_manager.cc:6784] ReplaceTablet: tablet 00f16ff3bc57434592d1648c4944c157 deleted and replaced by tablet 65af976b808d42d4aeded71a00cf7252
I20260617 20:16:45.422197 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 60a43dd885aa4411a4177b67807b0ac4 (DEFAULT_TABLE table=default.Table_b3b3fd43238e4c979d4e814f42eb49ab [id=3a41dd53c3974256877f193219240234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.371681 28964 tablet_service.cc:1511] Processing CreateTablet for tablet 28146a1f84aa41ee88d9aea299256a90 (DEFAULT_TABLE table=default.Table_6ed5c9767b364748ae14ecead288e68c [id=eeb28ad64e5f425988b6e1667865134d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.422629 29239 tablet_service.cc:1511] Processing CreateTablet for tablet 28146a1f84aa41ee88d9aea299256a90 (DEFAULT_TABLE table=default.Table_6ed5c9767b364748ae14ecead288e68c [id=eeb28ad64e5f425988b6e1667865134d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.422725 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a43dd885aa4411a4177b67807b0ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.422935 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28146a1f84aa41ee88d9aea299256a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.423015 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28146a1f84aa41ee88d9aea299256a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.377207 29378 tablet_bootstrap.cc:492] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:45.425678 29378 ts_tablet_manager.cc:1403] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.387s user 0.049s sys 0.074s
I20260617 20:16:45.426452 29378 raft_consensus.cc:359] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.426620 29378 raft_consensus.cc:385] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.426698 29378 raft_consensus.cc:740] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.426918 29378 consensus_queue.cc:260] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.427204 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 28146a1f84aa41ee88d9aea299256a90 (DEFAULT_TABLE table=default.Table_6ed5c9767b364748ae14ecead288e68c [id=eeb28ad64e5f425988b6e1667865134d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.427495 29378 ts_tablet_manager.cc:1434] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:45.427610 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28146a1f84aa41ee88d9aea299256a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.427824 29378 tablet_bootstrap.cc:492] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:45.432112 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a79b56241ac84862868c664cca25654b
I20260617 20:16:45.432628 28668 catalog_manager.cc:6784] ReplaceTablet: tablet a79b56241ac84862868c664cca25654b deleted and replaced by tablet 1f85271eeb854194a968215ebc08f47a
I20260617 20:16:45.433552 28970 tablet_service.cc:1558] Processing DeleteTablet for tablet a79b56241ac84862868c664cca25654b with delete_type TABLET_DATA_DELETED (replaced by tablet 1f85271eeb854194a968215ebc08f47a) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.434079 29378 tablet_bootstrap.cc:654] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.435123 29383 tablet_bootstrap.cc:492] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:45.435315 29383 ts_tablet_manager.cc:1403] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.005s
I20260617 20:16:45.436208 29383 raft_consensus.cc:359] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.436408 29383 raft_consensus.cc:385] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.436467 29383 raft_consensus.cc:740] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.437724 29379 raft_consensus.cc:740] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.438072 29379 consensus_queue.cc:260] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.408849 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 689121cc9ca647cda1899cdd569da8f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4332e33d60964bd6a0c7e7caaa6bdc76) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.420223 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 00f16ff3bc57434592d1648c4944c157 with delete_type TABLET_DATA_DELETED (replaced by tablet 65af976b808d42d4aeded71a00cf7252) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:45.397805 28925 leader_election.cc:343] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:45.378741 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 60a43dd885aa4411a4177b67807b0ac4 (DEFAULT_TABLE table=default.Table_b3b3fd43238e4c979d4e814f42eb49ab [id=3a41dd53c3974256877f193219240234]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.439723 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60a43dd885aa4411a4177b67807b0ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.439805 28925 leader_election.cc:304] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:45.440325 29390 raft_consensus.cc:2749] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:45.440618 28657 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 55e4ef1f493c4f1289cfa192ce38161d (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 55e4ef1f493c4f1289cfa192ce38161d consensus state has no leader
W20260617 20:16:45.441247 28925 leader_election.cc:343] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:45.441484 28925 leader_election.cc:304] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:45.441790 29390 raft_consensus.cc:2749] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:45.441967 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet a340551ee95c4b6685213a4dbd21f6c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.443115 29379 ts_tablet_manager.cc:1434] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.042s user 0.002s sys 0.000s
I20260617 20:16:45.443681 29379 tablet_bootstrap.cc:492] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:45.444214 29383 consensus_queue.cc:260] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.444679 29383 ts_tablet_manager.cc:1434] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260617 20:16:45.444988 29383 tablet_bootstrap.cc:492] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:45.449930 29383 tablet_bootstrap.cc:654] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.449901 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_372f28b39c8a48cb96c6e828eca3a5a3" } new_table_name: "default.Table_e67bded1adac4a9194ee9f5f1131ed12" modify_external_catalogs: true
I20260617 20:16:45.451382 29379 tablet_bootstrap.cc:654] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.451349 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_610d3cf0500144c3a01784165c02fd7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.451884 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_610d3cf0500144c3a01784165c02fd7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.453048 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_baac68c808f240b481611d52f21d428e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.453593 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_baac68c808f240b481611d52f21d428e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.454579 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 689121cc9ca647cda1899cdd569da8f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4332e33d60964bd6a0c7e7caaa6bdc76) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.454679 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7c8ef6299d9f4b848e96bf3dc23d54d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.455132 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c8ef6299d9f4b848e96bf3dc23d54d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.455574 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 689121cc9ca647cda1899cdd569da8f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4332e33d60964bd6a0c7e7caaa6bdc76) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.456627 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7faeb47824fd4ccda24117958d1d1f09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.457069 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7faeb47824fd4ccda24117958d1d1f09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.457105 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 680fe7bf06bf4dcdab15c7c95cb00daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.457360 29376 tablet_replica.cc:333] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:45.457537 29376 raft_consensus.cc:2243] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.457710 29376 raft_consensus.cc:2272] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.458520 29376 ts_tablet_manager.cc:1916] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.459429 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_270b09836c954e6c94328615b8059bb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.459872 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_270b09836c954e6c94328615b8059bb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.367182 29377 ts_tablet_manager.cc:1929] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.461156 29377 log.cc:1199] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/adcd4689680e43b19318336fb5a3edb3
I20260617 20:16:45.461681 29377 ts_tablet_manager.cc:1950] T adcd4689680e43b19318336fb5a3edb3 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:45.462764 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet adcd4689680e43b19318336fb5a3edb3 (table default.Table_24eb651bcbec4bafbac0b0612438512f [id=704477b29a8548ed9d8fd39b7e9e89a5]) successfully deleted
I20260617 20:16:45.463171 29377 tablet_replica.cc:333] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:45.463431 29377 raft_consensus.cc:2243] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.463671 29377 raft_consensus.cc:2272] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.464571 29377 ts_tablet_manager.cc:1916] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.464874 29376 ts_tablet_manager.cc:1929] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.465026 29376 log.cc:1199] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/680fe7bf06bf4dcdab15c7c95cb00daf
I20260617 20:16:45.465473 29376 ts_tablet_manager.cc:1950] T 680fe7bf06bf4dcdab15c7c95cb00daf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:45.465759 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6a12b448d59c405096e0516741c0c32f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.466361 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a12b448d59c405096e0516741c0c32f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.466985 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 00f16ff3bc57434592d1648c4944c157 with delete_type TABLET_DATA_DELETED (replaced by tablet 65af976b808d42d4aeded71a00cf7252) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.467895 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 00f16ff3bc57434592d1648c4944c157 with delete_type TABLET_DATA_DELETED (replaced by tablet 65af976b808d42d4aeded71a00cf7252) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.470062 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet a79b56241ac84862868c664cca25654b with delete_type TABLET_DATA_DELETED (replaced by tablet 1f85271eeb854194a968215ebc08f47a) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.470908 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet a79b56241ac84862868c664cca25654b with delete_type TABLET_DATA_DELETED (replaced by tablet 1f85271eeb854194a968215ebc08f47a) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.472218 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet f23960607f8a4efcb56cd5f306dc3a85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.472508 29376 tablet_replica.cc:333] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:45.472779 29376 raft_consensus.cc:2243] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.473009 29376 raft_consensus.cc:2272] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.473837 29376 ts_tablet_manager.cc:1916] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:45.477486 28657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111) [suppressed 11 similar messages]
I20260617 20:16:45.479969 29376 ts_tablet_manager.cc:1929] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.480086 29376 log.cc:1199] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/f23960607f8a4efcb56cd5f306dc3a85
I20260617 20:16:45.480424 29376 ts_tablet_manager.cc:1950] T f23960607f8a4efcb56cd5f306dc3a85 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:45.486745 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 7a81a3502f5d4602b65328577a668d62
I20260617 20:16:45.487268 28662 catalog_manager.cc:6784] ReplaceTablet: tablet 7a81a3502f5d4602b65328577a668d62 deleted and replaced by tablet 097ca98ce2694c05b9b1ff4c0062cf28
I20260617 20:16:45.487331 29378 tablet_bootstrap.cc:492] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:45.487519 29378 ts_tablet_manager.cc:1403] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.014s
I20260617 20:16:45.488353 29378 raft_consensus.cc:359] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.488581 29378 raft_consensus.cc:385] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.488662 29378 raft_consensus.cc:740] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.489267 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81a3502f5d4602b65328577a668d62 with delete_type TABLET_DATA_DELETED (replaced by tablet 097ca98ce2694c05b9b1ff4c0062cf28) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.489341 29378 consensus_queue.cc:260] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.489900 29378 ts_tablet_manager.cc:1434] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:45.490245 29378 tablet_bootstrap.cc:492] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:45.494560 29377 ts_tablet_manager.cc:1929] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.494751 29377 log.cc:1199] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/5c047f3fab644c50aef4adfff153a85b
I20260617 20:16:45.495220 29377 ts_tablet_manager.cc:1950] T 5c047f3fab644c50aef4adfff153a85b P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:45.495805 29378 tablet_bootstrap.cc:654] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.496456 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 5c047f3fab644c50aef4adfff153a85b (table default.Table_0ec2cf7d7dc84aaa942f063bbcb984b9 [id=fb1fb1a6dbdd4b258aa91bb9e4f06ae2]) successfully deleted
W20260617 20:16:45.496981 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 28146a1f84aa41ee88d9aea299256a90 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 28146a1f84aa41ee88d9aea299256a90 already in progress: creating tablet
I20260617 20:16:45.499419 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ceb8ef16219d4297985dadd23cf17cea" } modify_external_catalogs: true
I20260617 20:16:45.499639 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ceb8ef16219d4297985dadd23cf17cea" } modify_external_catalogs: true
I20260617 20:16:45.505585 29377 tablet_replica.cc:333] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:16:45.505813 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d4be33993864c73ba8b4da9468a517b consensus state has no leader
I20260617 20:16:45.505865 29377 raft_consensus.cc:2243] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.506091 29377 raft_consensus.cc:2272] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.506273 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_03cf9869e98c4989af103a1fc7bf8774" } new_table_name: "default.Table_cd9432cef0ba46d9a560d5ba59f1d58d" modify_external_catalogs: true
I20260617 20:16:45.506791 29377 ts_tablet_manager.cc:1916] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.506886 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 95bf5d8704614db68c8ce7c272c2fb13
I20260617 20:16:45.507928 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_68983d7d2bff43f4a914573626bafb37" } new_table_name: "default.Table_a8bc5ca66b28452db1f7123e096f7379" modify_external_catalogs: true
I20260617 20:16:45.508002 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_57b215ac8adc423e877c268e9fd1da1e" } new_table_name: "default.Table_fc6995f292e54195899ee9c42fa0a9cc" modify_external_catalogs: true
I20260617 20:16:45.509583 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 95bf5d8704614db68c8ce7c272c2fb13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.518270 29377 ts_tablet_manager.cc:1929] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.518436 29377 log.cc:1199] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/f23960607f8a4efcb56cd5f306dc3a85
I20260617 20:16:45.518878 29377 ts_tablet_manager.cc:1950] T f23960607f8a4efcb56cd5f306dc3a85 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:45.520233 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet f23960607f8a4efcb56cd5f306dc3a85 (table default.Table_a2da3871debd45c093cb28141965de33 [id=d70c3654e0c4417e9ff68be4309793ba]) successfully deleted
W20260617 20:16:45.520929 29425 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 20:16:45.521528 29425 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 20:16:45.521705 29425 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260617 20:16:45.522475 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 689121cc9ca647cda1899cdd569da8f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 689121cc9ca647cda1899cdd569da8f6 already in progress: creating tablet
W20260617 20:16:45.522774 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 00f16ff3bc57434592d1648c4944c157 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00f16ff3bc57434592d1648c4944c157 already in progress: creating tablet
W20260617 20:16:45.530126 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet a79b56241ac84862868c664cca25654b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a79b56241ac84862868c664cca25654b already in progress: creating tablet
I20260617 20:16:45.530460 29390 raft_consensus.cc:493] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.530661 29390 raft_consensus.cc:515] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
W20260617 20:16:45.531009 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 689121cc9ca647cda1899cdd569da8f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 689121cc9ca647cda1899cdd569da8f6 already in progress: creating tablet
I20260617 20:16:45.531525 29390 leader_election.cc:290] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:16:45.531738 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 00f16ff3bc57434592d1648c4944c157 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00f16ff3bc57434592d1648c4944c157 already in progress: creating tablet
I20260617 20:16:45.532073 29377 tablet_replica.cc:333] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:45.532022 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b89b44c6cb2c41409a15708feec0c29b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:45.532327 29377 raft_consensus.cc:2243] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.532538 29377 raft_consensus.cc:2272] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:45.532757 28925 leader_election.cc:343] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:45.533547 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b89b44c6cb2c41409a15708feec0c29b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:45.533627 29377 ts_tablet_manager.cc:1916] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:45.535471 28925 leader_election.cc:343] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:45.535727 28925 leader_election.cc:304] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:45.536047 29390 raft_consensus.cc:2749] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:45.536741 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet a79b56241ac84862868c664cca25654b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a79b56241ac84862868c664cca25654b already in progress: creating tablet
W20260617 20:16:45.537256 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 689121cc9ca647cda1899cdd569da8f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 689121cc9ca647cda1899cdd569da8f6 already in progress: creating tablet
I20260617 20:16:45.539404 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 680fe7bf06bf4dcdab15c7c95cb00daf (table default.Table_8eceb8f19afd47f2bf478ee57537dd7b [id=9439537fd882414f94ec8dd957bbd86e]) successfully deleted
I20260617 20:16:45.539670 29383 tablet_bootstrap.cc:492] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:45.539835 29383 ts_tablet_manager.cc:1403] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.095s user 0.021s sys 0.044s
I20260617 20:16:45.540728 29383 raft_consensus.cc:359] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.541010 29383 raft_consensus.cc:385] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.541109 29383 raft_consensus.cc:740] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.541388 29383 consensus_queue.cc:260] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.541891 29383 ts_tablet_manager.cc:1434] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:45.542217 29383 tablet_bootstrap.cc:492] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:45.544131 29383 tablet_bootstrap.cc:654] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.544087 29486 raft_consensus.cc:493] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.544256 29486 raft_consensus.cc:515] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.545256 29486 leader_election.cc:290] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:45.547145 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b9f6bff7b546ad94411325cc770d52" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:45.547785 29063 leader_election.cc:343] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:45.550678 29425 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260617 20:16:45.550815 29425 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 20:16:45.550933 29425 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 20:16:45.551023 29425 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 20:16:45.551532 29379 tablet_bootstrap.cc:492] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:45.551949 29379 ts_tablet_manager.cc:1403] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.108s user 0.002s sys 0.001s
I20260617 20:16:45.552887 29379 raft_consensus.cc:359] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.553196 29379 raft_consensus.cc:385] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.553329 29379 raft_consensus.cc:740] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.553638 29379 consensus_queue.cc:260] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.560014 29379 ts_tablet_manager.cc:1434] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260617 20:16:45.560520 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b9f6bff7b546ad94411325cc770d52" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
W20260617 20:16:45.561235 29062 leader_election.cc:343] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:45.561817 29062 leader_election.cc:304] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:45.562475 29486 raft_consensus.cc:2749] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:45.563098 29377 ts_tablet_manager.cc:1929] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.563248 29377 log.cc:1199] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/a340551ee95c4b6685213a4dbd21f6c1
I20260617 20:16:45.544108 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]). Expected version 2 got 0
I20260617 20:16:45.563618 29377 ts_tablet_manager.cc:1950] T a340551ee95c4b6685213a4dbd21f6c1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:45.565207 29377 tablet_replica.cc:333] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:45.565411 29377 raft_consensus.cc:2243] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.565438 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet a340551ee95c4b6685213a4dbd21f6c1 (table default.Table_8768bdfdc4af4740898b1018fd51e808 [id=772f52014ca7448ba492233fd74402e9]) successfully deleted
I20260617 20:16:45.565578 29377 raft_consensus.cc:2272] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:45.565716 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 7a81a3502f5d4602b65328577a668d62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a81a3502f5d4602b65328577a668d62 already in progress: creating tablet
I20260617 20:16:45.566197 29379 tablet_bootstrap.cc:492] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:45.566709 29377 ts_tablet_manager.cc:1916] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:45.568514 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 00f16ff3bc57434592d1648c4944c157 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00f16ff3bc57434592d1648c4944c157 already in progress: creating tablet
I20260617 20:16:45.569355 29378 tablet_bootstrap.cc:492] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:45.569553 29378 ts_tablet_manager.cc:1403] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.079s user 0.005s sys 0.003s
I20260617 20:16:45.569976 29425 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.245.212:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.252:46059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.27.245.252
--webserver_port=42219
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 17 Jun 2026 19:49:13 UTC on bdcb31816ec0
build id 12442
ASAN enabled
I20260617 20:16:45.570735 29378 raft_consensus.cc:359] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.571059 29378 raft_consensus.cc:385] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.571231 29378 raft_consensus.cc:740] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.571874 29378 consensus_queue.cc:260] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.572201 29425 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 20:16:45.572908 29377 ts_tablet_manager.cc:1929] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.573011 29377 log.cc:1199] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/95bf5d8704614db68c8ce7c272c2fb13
I20260617 20:16:45.573423 29377 ts_tablet_manager.cc:1950] T 95bf5d8704614db68c8ce7c272c2fb13 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:45.575421 29378 ts_tablet_manager.cc:1434] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260617 20:16:45.575773 29425 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260617 20:16:45.576510 29378 tablet_bootstrap.cc:492] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:45.580257 29378 tablet_bootstrap.cc:654] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.574893 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 95bf5d8704614db68c8ce7c272c2fb13 (table default.Table_aa9736ab22fd48bc862c930283895f27 [id=727864a195db4e4585240fb48a508df7]) successfully deleted
W20260617 20:16:45.579768 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 751bffacfaa5427784de63d51fc903dd consensus state has no leader
W20260617 20:16:45.581597 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet a79b56241ac84862868c664cca25654b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a79b56241ac84862868c664cca25654b already in progress: creating tablet
I20260617 20:16:45.581802 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet f23960607f8a4efcb56cd5f306dc3a85 (table default.Table_a2da3871debd45c093cb28141965de33 [id=d70c3654e0c4417e9ff68be4309793ba]) successfully deleted
I20260617 20:16:45.582422 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81a3502f5d4602b65328577a668d62 with delete_type TABLET_DATA_DELETED (replaced by tablet 097ca98ce2694c05b9b1ff4c0062cf28) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:45.585055 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c65a4345552844fe9e7512105fd79877 has no consensus state
W20260617 20:16:45.587370 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4516e7a7fa284eaa816558b2d58cd213 consensus state has no leader
I20260617 20:16:45.589205 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81a3502f5d4602b65328577a668d62 with delete_type TABLET_DATA_DELETED (replaced by tablet 097ca98ce2694c05b9b1ff4c0062cf28) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.591401 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 95bf5d8704614db68c8ce7c272c2fb13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.591748 29375 tablet_replica.cc:333] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:45.591990 29375 raft_consensus.cc:2243] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:45.592273 29375 pending_rounds.cc:70] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:45.592350 29375 pending_rounds.cc:77] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955451968708608 op_type: NO_OP noop_request { }
I20260617 20:16:45.592473 29375 raft_consensus.cc:2889] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:45.592588 29375 raft_consensus.cc:2272] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.593725 29375 ts_tablet_manager.cc:1916] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.594136 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet f3d06c0618db45689428b0c1125bd193 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.594762 29379 tablet_bootstrap.cc:654] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.596913 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 95bf5d8704614db68c8ce7c272c2fb13 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.597231 29376 tablet_replica.cc:333] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:45.597451 29376 raft_consensus.cc:2243] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.597609 29376 raft_consensus.cc:2272] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.598129 29376 ts_tablet_manager.cc:1916] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.605118 29376 ts_tablet_manager.cc:1929] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.605406 29376 log.cc:1199] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/95bf5d8704614db68c8ce7c272c2fb13
I20260617 20:16:45.605814 29376 ts_tablet_manager.cc:1950] T 95bf5d8704614db68c8ce7c272c2fb13 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:45.595288 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 61b9f6bff7b546ad94411325cc770d52 with delete_type TABLET_DATA_DELETED (replaced by tablet bb4b3c917efb4c4aae1595af7ce1cd35) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.602686 29375 ts_tablet_manager.cc:1929] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:45.607097 29375 log.cc:1199] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/95bf5d8704614db68c8ce7c272c2fb13
I20260617 20:16:45.607589 29375 ts_tablet_manager.cc:1950] T 95bf5d8704614db68c8ce7c272c2fb13 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:45.608692 29375 tablet_replica.cc:333] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:45.608922 29375 raft_consensus.cc:2243] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.609117 29375 raft_consensus.cc:2272] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.609964 29375 ts_tablet_manager.cc:1916] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.611145 29390 raft_consensus.cc:493] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.611326 29390 raft_consensus.cc:515] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.612150 29390 leader_election.cc:290] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:45.612933 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d06c0618db45689428b0c1125bd193" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:45.613073 29500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:45.613664 28925 leader_election.cc:343] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: Tablet not RUNNING: STOPPED
I20260617 20:16:45.614303 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3d06c0618db45689428b0c1125bd193" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:45.614902 28925 leader_election.cc:343] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:45.615016 28925 leader_election.cc:304] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:45.615464 29390 raft_consensus.cc:2749] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:45.615698 29501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:45.629473 29425 server_base.cc:1061] running on GCE node
W20260617 20:16:45.630312 29504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:45.630437 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2010232aed489ba61ec1ac423b2f2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.631947 29425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 20:16:45.632256 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_55a046350f1148c194bb4200eb60c32c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:45.632728 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_71003cb25e6e4229aba21f7dd04b7fe4" } modify_external_catalogs: true
I20260617 20:16:45.632915 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_71003cb25e6e4229aba21f7dd04b7fe4" } modify_external_catalogs: true
W20260617 20:16:45.633055 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55a046350f1148c194bb4200eb60c32c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.634462 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9e962aa5866b4b0bb2f4c1f6bb9257e9" } new_table_name: "default.Table_c2ad7d91e2a84af3bddceffdaf386c94" modify_external_catalogs: true
I20260617 20:16:45.634553 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7faeb47824fd4ccda24117958d1d1f09" } modify_external_catalogs: true
I20260617 20:16:45.634713 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7faeb47824fd4ccda24117958d1d1f09" } modify_external_catalogs: true
I20260617 20:16:45.636045 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cc594b39ac1b42d1af3937765c5c4970"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.636690 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc594b39ac1b42d1af3937765c5c4970 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.637960 29378 tablet_bootstrap.cc:492] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:45.638166 29378 ts_tablet_manager.cc:1403] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.002s
I20260617 20:16:45.638111 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d064dca2cbed4024b9214ed6bccc811e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.638689 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d064dca2cbed4024b9214ed6bccc811e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.639179 29378 raft_consensus.cc:359] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.639429 29378 raft_consensus.cc:385] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.639523 29378 raft_consensus.cc:740] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:16:45.639974 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 7a81a3502f5d4602b65328577a668d62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a81a3502f5d4602b65328577a668d62 already in progress: creating tablet
I20260617 20:16:45.639892 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_befd7af4f63843d9bf259896e10ce0f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:45.640223 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 95bf5d8704614db68c8ce7c272c2fb13 (table default.Table_aa9736ab22fd48bc862c930283895f27 [id=727864a195db4e4585240fb48a508df7]) successfully deleted
W20260617 20:16:45.640416 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_befd7af4f63843d9bf259896e10ce0f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:45.640475 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 7a81a3502f5d4602b65328577a668d62 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a81a3502f5d4602b65328577a668d62 already in progress: creating tablet
I20260617 20:16:45.640571 29383 tablet_bootstrap.cc:492] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:45.640736 29383 ts_tablet_manager.cc:1403] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.099s user 0.031s sys 0.047s
I20260617 20:16:45.640802 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 95bf5d8704614db68c8ce7c272c2fb13 (table default.Table_aa9736ab22fd48bc862c930283895f27 [id=727864a195db4e4585240fb48a508df7]) successfully deleted
I20260617 20:16:45.640861 29425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 20:16:45.641535 29383 raft_consensus.cc:359] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.641714 29383 raft_consensus.cc:385] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.641774 29383 raft_consensus.cc:740] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.642001 29383 consensus_queue.cc:260] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.642148 29425 hybrid_clock.cc:648] HybridClock initialized: now 1781727405642063 us; error 83 us; skew 500 ppm
I20260617 20:16:45.642472 29383 ts_tablet_manager.cc:1434] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:45.642585 29425 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 20:16:45.642823 29383 tablet_bootstrap.cc:492] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:45.644134 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet 4516e7a7fa284eaa816558b2d58cd213 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.644042 29378 consensus_queue.cc:260] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.644805 29378 ts_tablet_manager.cc:1434] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260617 20:16:45.645159 29378 tablet_bootstrap.cc:492] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:45.646735 29383 tablet_bootstrap.cc:654] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.649619 29378 tablet_bootstrap.cc:654] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.651829 29379 tablet_bootstrap.cc:492] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:45.652020 29379 ts_tablet_manager.cc:1403] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.086s user 0.003s sys 0.000s
I20260617 20:16:45.652989 29379 raft_consensus.cc:359] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.653250 29379 raft_consensus.cc:385] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.653384 29379 raft_consensus.cc:740] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.653694 29379 consensus_queue.cc:260] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.656579 29379 ts_tablet_manager.cc:1434] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260617 20:16:45.656689 28666 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 852f3f111b184941a87d41ee11d59dda
I20260617 20:16:45.656934 29379 tablet_bootstrap.cc:492] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:45.657467 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7b59053006046e98d27c694808ca34d has no consensus state
I20260617 20:16:45.660568 29379 tablet_bootstrap.cc:654] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.664105 29383 tablet_bootstrap.cc:492] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:45.664286 29383 ts_tablet_manager.cc:1403] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.009s
I20260617 20:16:45.665282 29383 raft_consensus.cc:359] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.665553 29383 raft_consensus.cc:385] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.665657 29383 raft_consensus.cc:740] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.665951 29383 consensus_queue.cc:260] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.666539 29383 ts_tablet_manager.cc:1434] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:45.666900 29383 tablet_bootstrap.cc:492] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:45.669016 29383 tablet_bootstrap.cc:654] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.670436 29378 tablet_bootstrap.cc:492] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:45.670607 29378 ts_tablet_manager.cc:1403] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.002s
I20260617 20:16:45.671514 29378 raft_consensus.cc:359] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.671741 29378 raft_consensus.cc:385] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.671849 29378 raft_consensus.cc:740] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.672178 29378 consensus_queue.cc:260] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.672885 29378 ts_tablet_manager.cc:1434] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:45.673178 29378 tablet_bootstrap.cc:492] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:45.675544 29378 tablet_bootstrap.cc:654] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.680464 29425 webserver.cc:533] Webserver started at http://127.27.245.252:42219/ using document root <none> and password file <none>
I20260617 20:16:45.682272 29425 fs_manager.cc:362] Metadata directory not provided
I20260617 20:16:45.682442 29425 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 20:16:45.685699 29383 tablet_bootstrap.cc:492] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:45.685936 29383 ts_tablet_manager.cc:1403] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.000s
I20260617 20:16:45.686836 29383 raft_consensus.cc:359] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.687037 29383 raft_consensus.cc:385] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.687121 29383 raft_consensus.cc:740] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.687750 29383 consensus_queue.cc:260] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.688233 29383 ts_tablet_manager.cc:1434] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:45.688639 29383 tablet_bootstrap.cc:492] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:45.691062 29378 tablet_bootstrap.cc:492] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:45.691264 29378 ts_tablet_manager.cc:1403] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.000s
I20260617 20:16:45.692157 29378 raft_consensus.cc:359] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.692379 29378 raft_consensus.cc:385] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.692471 29378 raft_consensus.cc:740] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.692718 29375 ts_tablet_manager.cc:1929] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.692790 29378 consensus_queue.cc:260] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.692910 29375 log.cc:1199] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/f3d06c0618db45689428b0c1125bd193
I20260617 20:16:45.693420 29378 ts_tablet_manager.cc:1434] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260617 20:16:45.693753 29378 tablet_bootstrap.cc:492] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:45.693756 29425 fs_manager.cc:714] Time spent opening directory manager: real 0.008s user 0.003s sys 0.001s
I20260617 20:16:45.695091 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet 751bffacfaa5427784de63d51fc903dd from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.695428 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet a340551ee95c4b6685213a4dbd21f6c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.695550 29378 tablet_bootstrap.cc:654] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.696200 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_610d3cf0500144c3a01784165c02fd7e" } modify_external_catalogs: true
I20260617 20:16:45.696429 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_610d3cf0500144c3a01784165c02fd7e" } modify_external_catalogs: true
I20260617 20:16:45.698189 29383 tablet_bootstrap.cc:654] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.699008 29375 ts_tablet_manager.cc:1950] T f3d06c0618db45689428b0c1125bd193 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:45.701104 29378 tablet_bootstrap.cc:492] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:45.701320 29378 ts_tablet_manager.cc:1403] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260617 20:16:45.702322 29378 raft_consensus.cc:359] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.702557 29378 raft_consensus.cc:385] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.702668 29378 raft_consensus.cc:740] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.702725 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet f3d06c0618db45689428b0c1125bd193 (table default.Table_315b909d8d1c411f89063fecb8be5b84 [id=aca59faae56b44f5ae502160c7b43e4b]) successfully deleted
I20260617 20:16:45.702968 29378 consensus_queue.cc:260] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.703709 29519 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:45.704147 29378 ts_tablet_manager.cc:1434] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:16:45.704522 29379 tablet_bootstrap.cc:492] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:45.704705 29379 ts_tablet_manager.cc:1403] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.048s user 0.011s sys 0.008s
I20260617 20:16:45.705061 29378 tablet_bootstrap.cc:492] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:45.705756 29425 fs_manager.cc:730] Time spent opening block manager: real 0.010s user 0.005s sys 0.000s
I20260617 20:16:45.705678 29379 raft_consensus.cc:359] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.705900 29379 raft_consensus.cc:385] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.705998 29379 raft_consensus.cc:740] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.706300 29379 consensus_queue.cc:260] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.705945 29425 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data,/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal
uuid: "f5ea3f9265d84474ab3bced8dd5aecc5"
format_stamp: "Formatted at 2026-06-17 20:16:41 on dist-test-slave-dvcr"
I20260617 20:16:45.707110 29425 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 20:16:45.707778 29379 ts_tablet_manager.cc:1434] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:45.708068 29375 tablet_replica.cc:333] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:45.708241 29375 raft_consensus.cc:2243] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.708422 29375 raft_consensus.cc:2272] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.709195 29375 ts_tablet_manager.cc:1916] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.709576 29379 tablet_bootstrap.cc:492] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:45.713217 29378 tablet_bootstrap.cc:654] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.715853 29383 tablet_bootstrap.cc:492] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:45.716022 29383 ts_tablet_manager.cc:1403] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.002s
I20260617 20:16:45.717037 29383 raft_consensus.cc:359] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.717279 29383 raft_consensus.cc:385] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.717415 29383 raft_consensus.cc:740] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.717756 29383 consensus_queue.cc:260] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.719333 29383 ts_tablet_manager.cc:1434] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260617 20:16:45.719712 29383 tablet_bootstrap.cc:492] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:45.722095 29379 tablet_bootstrap.cc:654] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.722419 29378 tablet_bootstrap.cc:492] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:45.722568 29378 ts_tablet_manager.cc:1403] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260617 20:16:45.723343 29378 raft_consensus.cc:359] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.723534 29378 raft_consensus.cc:385] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.723598 29378 raft_consensus.cc:740] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.723822 29378 consensus_queue.cc:260] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.724220 29383 tablet_bootstrap.cc:654] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.724367 29378 ts_tablet_manager.cc:1434] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:45.724694 29378 tablet_bootstrap.cc:492] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:45.725871 29375 ts_tablet_manager.cc:1929] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.725999 29375 log.cc:1199] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/61b9f6bff7b546ad94411325cc770d52
I20260617 20:16:45.726344 29375 ts_tablet_manager.cc:1950] T 61b9f6bff7b546ad94411325cc770d52 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:45.727360 29378 tablet_bootstrap.cc:654] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.727447 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 61b9f6bff7b546ad94411325cc770d52 (table default.Table_0a57fb26789b4826858b2755f0f85b86 [id=d6d4c2a3dc5e41669e992a16ce5f16c4]) successfully deleted
I20260617 20:16:45.727843 29375 tablet_replica.cc:333] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:45.728044 29375 raft_consensus.cc:2243] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.728226 29375 raft_consensus.cc:2272] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.729161 29375 ts_tablet_manager.cc:1916] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.731189 29379 tablet_bootstrap.cc:492] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:45.731348 29379 ts_tablet_manager.cc:1403] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20260617 20:16:45.732219 29379 raft_consensus.cc:359] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.732406 29379 raft_consensus.cc:385] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.732501 29379 raft_consensus.cc:740] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.732802 29379 consensus_queue.cc:260] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.733110 29391 raft_consensus.cc:493] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.733258 29391 raft_consensus.cc:515] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.733966 29391 leader_election.cc:290] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:45.736703 29378 tablet_bootstrap.cc:492] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:45.736878 29378 ts_tablet_manager.cc:1403] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.003s
I20260617 20:16:45.737105 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b89b44c6cb2c41409a15708feec0c29b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:45.737437 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b89b44c6cb2c41409a15708feec0c29b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:45.737690 29127 raft_consensus.cc:2468] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:45.737884 29378 raft_consensus.cc:359] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.738101 28989 raft_consensus.cc:2468] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:45.738147 29198 leader_election.cc:304] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:45.738813 29391 raft_consensus.cc:2804] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:45.738965 29391 raft_consensus.cc:493] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:45.739085 29391 raft_consensus.cc:3060] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:45.742851 29391 raft_consensus.cc:515] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.744997 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b89b44c6cb2c41409a15708feec0c29b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:45.745201 28989 raft_consensus.cc:3060] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:45.748059 28989 raft_consensus.cc:2468] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:45.748587 29197 leader_election.cc:304] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:45.752009 29528 raft_consensus.cc:2804] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:45.761577 29391 leader_election.cc:290] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:45.762322 29528 raft_consensus.cc:697] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:45.762905 29528 consensus_queue.cc:237] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.763389 29379 ts_tablet_manager.cc:1434] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260617 20:16:45.765926 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 637b0b3e9cb648deaea6e63760b83255 (DEFAULT_TABLE table=default.Table_5f983e7235224256bae836edd0ffbc09 [id=7a4a3c7360114f72b54f5dd645215114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.766336 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637b0b3e9cb648deaea6e63760b83255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.767725 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet 7a81a3502f5d4602b65328577a668d62 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.768244 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet d723526a83174898a71a835b7cdbc467 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.770776 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b89b44c6cb2c41409a15708feec0c29b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:45.771056 29127 raft_consensus.cc:3060] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:45.771032 28665 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet b89b44c6cb2c41409a15708feec0c29b (table default.Table_675165a5585146af86731c73080a0f3f [id=8272ea6276314a28bca235431f8f3986]). Expected version 2 got 0
I20260617 20:16:45.771327 29239 tablet_service.cc:1511] Processing CreateTablet for tablet cc945cdd482f4a5593d4874e5303ecd2 (DEFAULT_TABLE table=default.Table_8985331f7fce43788f3a355c861e8297 [id=1222eab9683a43c681e8147c9ff67987]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.771786 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc945cdd482f4a5593d4874e5303ecd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.772480 28668 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 097ca98ce2694c05b9b1ff4c0062cf28
I20260617 20:16:45.773569 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 1f32ebd7448843b48b981d3d70a87023 (DEFAULT_TABLE table=default.Table_8e019e33cf25495289e2e63f59c874ef [id=ba10931c3fce41668047da142da71026]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.773722 28666 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet b89b44c6cb2c41409a15708feec0c29b (table default.Table_675165a5585146af86731c73080a0f3f [id=8272ea6276314a28bca235431f8f3986]). Expected version 2 got 0
I20260617 20:16:45.774751 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 637b0b3e9cb648deaea6e63760b83255 (DEFAULT_TABLE table=default.Table_5f983e7235224256bae836edd0ffbc09 [id=7a4a3c7360114f72b54f5dd645215114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.775128 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637b0b3e9cb648deaea6e63760b83255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.775355 29127 raft_consensus.cc:2468] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:45.777667 28963 tablet_service.cc:1511] Processing CreateTablet for tablet cc945cdd482f4a5593d4874e5303ecd2 (DEFAULT_TABLE table=default.Table_8985331f7fce43788f3a355c861e8297 [id=1222eab9683a43c681e8147c9ff67987]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.778067 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc945cdd482f4a5593d4874e5303ecd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.778313 28666 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet b89b44c6cb2c41409a15708feec0c29b (table default.Table_675165a5585146af86731c73080a0f3f [id=8272ea6276314a28bca235431f8f3986]). Expected version 2 got 0
I20260617 20:16:45.778643 28666 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 55e4ef1f493c4f1289cfa192ce38161d (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]). Expected version 3 got 0
I20260617 20:16:45.781662 28964 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9e12c91df344ee84a586b7d4a27071 (DEFAULT_TABLE table=default.Table_2420afe282984f72ab42715fbc33380a [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.782058 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9e12c91df344ee84a586b7d4a27071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.785460 29379 tablet_bootstrap.cc:492] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:45.785604 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 1f32ebd7448843b48b981d3d70a87023 (DEFAULT_TABLE table=default.Table_8e019e33cf25495289e2e63f59c874ef [id=ba10931c3fce41668047da142da71026]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.785898 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f32ebd7448843b48b981d3d70a87023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.787741 28661 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 0e31c1839d50467e90e0e006067b9a69
I20260617 20:16:45.787833 29379 tablet_bootstrap.cc:654] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:45.791141 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9e12c91df344ee84a586b7d4a27071 (DEFAULT_TABLE table=default.Table_2420afe282984f72ab42715fbc33380a [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.791574 29099 tablet_service.cc:1511] Processing CreateTablet for tablet cc945cdd482f4a5593d4874e5303ecd2 (DEFAULT_TABLE table=default.Table_8985331f7fce43788f3a355c861e8297 [id=1222eab9683a43c681e8147c9ff67987]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.792008 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 1f32ebd7448843b48b981d3d70a87023 (DEFAULT_TABLE table=default.Table_8e019e33cf25495289e2e63f59c874ef [id=ba10931c3fce41668047da142da71026]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.792672 28661 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b89b44c6cb2c41409a15708feec0c29b (table default.Table_675165a5585146af86731c73080a0f3f [id=8272ea6276314a28bca235431f8f3986]). Expected version 2 got 0
I20260617 20:16:45.765185 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 637b0b3e9cb648deaea6e63760b83255 (DEFAULT_TABLE table=default.Table_5f983e7235224256bae836edd0ffbc09 [id=7a4a3c7360114f72b54f5dd645215114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.794566 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet f74494a3230448c983d8af0e553247bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.794872 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 61b9f6bff7b546ad94411325cc770d52 with delete_type TABLET_DATA_DELETED (replaced by tablet bb4b3c917efb4c4aae1595af7ce1cd35) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.795327 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 9b96c186469e4e8a8baa0dcab96d66bf (DEFAULT_TABLE table=default.Table_33168ad831b44c79a651427dd6011f2b [id=1a6ef514b9104d7d92bce17d40b5e3f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.795377 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 (DEFAULT_TABLE table=default.Table_8ca126699bab4f66b23ce38c90e050bb [id=f119f85b0a244e149caec77aab7063ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.795770 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b96c186469e4e8a8baa0dcab96d66bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.795881 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 9d4702c06d3442ac966ef2daca8d4660 (DEFAULT_TABLE table=default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.796216 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d4702c06d3442ac966ef2daca8d4660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.797636 28967 tablet_service.cc:1511] Processing CreateTablet for tablet d2c0988a73d547d08d0924784bff9222 (DEFAULT_TABLE table=default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.798651 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c0988a73d547d08d0924784bff9222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.802538 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e48bc2c0d35c428da4dd3a65681b7c15" } new_table_name: "default.Table_8278dd326f2d440e9b3823471e55dff7" modify_external_catalogs: true
I20260617 20:16:45.803980 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_77d3422ed47c4d68ae6f518500ea89b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:45.804055 29103 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 (DEFAULT_TABLE table=default.Table_8ca126699bab4f66b23ce38c90e050bb [id=f119f85b0a244e149caec77aab7063ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.804327 29106 tablet_service.cc:1511] Processing CreateTablet for tablet d2c0988a73d547d08d0924784bff9222 (DEFAULT_TABLE table=default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:45.804530 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77d3422ed47c4d68ae6f518500ea89b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.804574 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 9d4702c06d3442ac966ef2daca8d4660 (DEFAULT_TABLE table=default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.805048 29104 tablet_service.cc:1511] Processing CreateTablet for tablet c65a4345552844fe9e7512105fd79877 (DEFAULT_TABLE table=default.Table_cd9432cef0ba46d9a560d5ba59f1d58d [id=6c1d98916a69411393b9f32eeb861bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.805365 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet d723526a83174898a71a835b7cdbc467 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a81a3502f5d4602b65328577a668d62) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.805702 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 (DEFAULT_TABLE table=default.Table_81f4fb86b1a8470db7f74e35dc15a3fa [id=229a4fa545c84500af515f5992b547c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.805810 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0df8b7b928674848aa205ce9c6e79410"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:45.806152 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 808c455e74e645aa8e2b0d08ca81d4f9 (DEFAULT_TABLE table=default.Table_0ba339c37163434e8c628ef515624fe1 [id=8696ed2b09fd4e06a0f2746537370766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.806150 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 2a9e12c91df344ee84a586b7d4a27071 (DEFAULT_TABLE table=default.Table_2420afe282984f72ab42715fbc33380a [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:45.806330 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0df8b7b928674848aa205ce9c6e79410 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.807478 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_20465bbedb344857a72376aa345ec532"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:45.807916 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20465bbedb344857a72376aa345ec532 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.808063 29096 tablet_service.cc:1511] Processing CreateTablet for tablet a76b0744ef2a472091999681d5639fec (DEFAULT_TABLE table=default.Table_e9f868b8616d4ca0940cba8937919fb2 [id=a3772e01cb314c7e88e85833d727617d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.808952 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet d9b7880a039a497fbd0fb5d4f74e7d23 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:45.809605 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 113fbbc739d04f529e82bc1cf1074bd7 (DEFAULT_TABLE table=default.Table_418bd070282540f0b7c6a3e27deff617 [id=3d369e1099c944688151bb38c8da0855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.809662 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7fa99c35646c59898738de38c88ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.810112 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 9b96c186469e4e8a8baa0dcab96d66bf (DEFAULT_TABLE table=default.Table_33168ad831b44c79a651427dd6011f2b [id=1a6ef514b9104d7d92bce17d40b5e3f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.738111 29378 raft_consensus.cc:385] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:45.810988 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 (DEFAULT_TABLE table=default.Table_81f4fb86b1a8470db7f74e35dc15a3fa [id=229a4fa545c84500af515f5992b547c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.811338 29377 tablet_replica.cc:333] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:45.811271 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_21d9cb8cc88843d286f599edcee65360"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:45.811555 29098 tablet_service.cc:1511] Processing CreateTablet for tablet a7b59053006046e98d27c694808ca34d (DEFAULT_TABLE table=default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:45.811772 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21d9cb8cc88843d286f599edcee65360 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.813522 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2a38be2e8e4796a98f1ae1d011249f (DEFAULT_TABLE table=default.Table_7c00b4f954c743869ac8b3236a50e532 [id=cd4abe077ee04673bad87834b3af273b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.812860 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.815198 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet d723526a83174898a71a835b7cdbc467 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a81a3502f5d4602b65328577a668d62) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.815238 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 808c455e74e645aa8e2b0d08ca81d4f9 (DEFAULT_TABLE table=default.Table_0ba339c37163434e8c628ef515624fe1 [id=8696ed2b09fd4e06a0f2746537370766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.817883 29093 tablet_service.cc:1511] Processing CreateTablet for tablet dd4f190a1005433ebcfbfe3a86aa9e70 (DEFAULT_TABLE table=default.Table_07f654ca505c4bc5bc80b432a51acaa8 [id=556d100af09b4115bb4acc3f5f4dfade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.818670 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d9b7880a039a497fbd0fb5d4f74e7d23
I20260617 20:16:45.815167 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet f3d06c0618db45689428b0c1125bd193 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.819710 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b7880a039a497fbd0fb5d4f74e7d23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:45.820063 29378 raft_consensus.cc:740] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:45.821280 29390 raft_consensus.cc:493] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.821511 29390 raft_consensus.cc:515] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.822846 29092 tablet_service.cc:1511] Processing CreateTablet for tablet b62b22ff17964ee6934023fb85e0b7ec (DEFAULT_TABLE table=default.Table_29efc4231c2a404db10313243e8b10fb [id=c0d29667017e4717bc645aed9382a886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.822949 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4ef1f493c4f1289cfa192ce38161d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:45.824630 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2a38be2e8e4796a98f1ae1d011249f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.824785 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f32ebd7448843b48b981d3d70a87023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.824905 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76b0744ef2a472091999681d5639fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.825219 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62b22ff17964ee6934023fb85e0b7ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.825551 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b96c186469e4e8a8baa0dcab96d66bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.826208 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b59053006046e98d27c694808ca34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.826270 29390 leader_election.cc:290] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:45.815217 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 113fbbc739d04f529e82bc1cf1074bd7 (DEFAULT_TABLE table=default.Table_418bd070282540f0b7c6a3e27deff617 [id=3d369e1099c944688151bb38c8da0855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.826864 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d4702c06d3442ac966ef2daca8d4660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.827636 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 3b67b915758d4ab0a8faa0227de08593 (DEFAULT_TABLE table=default.Table_ef23aa968984448793f5605fea074d86 [id=f521ee60b1604df983bce5d5c1d0b3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.828145 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:45.828374 28925 leader_election.cc:343] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:45.828558 29377 raft_consensus.cc:2243] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.828621 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4332e33d60964bd6a0c7e7caaa6bdc76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.828712 29377 raft_consensus.cc:2272] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.829006 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113fbbc739d04f529e82bc1cf1074bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.829361 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4332e33d60964bd6a0c7e7caaa6bdc76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.829383 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c0988a73d547d08d0924784bff9222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.829916 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9e12c91df344ee84a586b7d4a27071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.830036 28961 tablet_service.cc:1511] Processing CreateTablet for tablet a7b59053006046e98d27c694808ca34d (DEFAULT_TABLE table=default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.830341 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65a4345552844fe9e7512105fd79877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.830469 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b59053006046e98d27c694808ca34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.830791 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808c455e74e645aa8e2b0d08ca81d4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.831161 29377 ts_tablet_manager.cc:1916] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:45.831483 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4f190a1005433ebcfbfe3a86aa9e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.832053 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808c455e74e645aa8e2b0d08ca81d4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.832252 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f32ebd7448843b48b981d3d70a87023. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.832762 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc945cdd482f4a5593d4874e5303ecd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.815210 28957 tablet_service.cc:1511] Processing CreateTablet for tablet c65a4345552844fe9e7512105fd79877 (DEFAULT_TABLE table=default.Table_cd9432cef0ba46d9a560d5ba59f1d58d [id=6c1d98916a69411393b9f32eeb861bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.834035 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637b0b3e9cb648deaea6e63760b83255. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.828030 28968 tablet_service.cc:1511] Processing CreateTablet for tablet a76b0744ef2a472091999681d5639fec (DEFAULT_TABLE table=default.Table_e9f868b8616d4ca0940cba8937919fb2 [id=a3772e01cb314c7e88e85833d727617d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.836899 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113fbbc739d04f529e82bc1cf1074bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.841424 29089 tablet_service.cc:1511] Processing CreateTablet for tablet b162a0ef91d1447b838331ba6ef93bf4 (DEFAULT_TABLE table=default.Table_0cc10f7657a2450294f6ce1e33fb609e [id=fa80809528dd419192774bcc7ac5f5bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.841719 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 216f91e7bda148bc9334b19e3c868910 (DEFAULT_TABLE table=default.Table_1944004da2ec4937b26d524aa808d0b3 [id=295609419d07485fa5651914ddd75ce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.842139 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b162a0ef91d1447b838331ba6ef93bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.852123 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b7880a039a497fbd0fb5d4f74e7d23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:45.852761 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b67b915758d4ab0a8faa0227de08593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.853123 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2c4e735917a64110bf5ad7e1cbda2fcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:45.853976 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76b0744ef2a472091999681d5639fec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:45.853938 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c4e735917a64110bf5ad7e1cbda2fcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.855348 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7c8ef6299d9f4b848e96bf3dc23d54d5" } modify_external_catalogs: true
I20260617 20:16:45.855449 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a445cef5739e4885982b17bdd98216da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:45.855563 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7c8ef6299d9f4b848e96bf3dc23d54d5" } modify_external_catalogs: true
W20260617 20:16:45.856079 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a445cef5739e4885982b17bdd98216da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:45.851797 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2a38be2e8e4796a98f1ae1d011249f (DEFAULT_TABLE table=default.Table_7c00b4f954c743869ac8b3236a50e532 [id=cd4abe077ee04673bad87834b3af273b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.852783 29375 ts_tablet_manager.cc:1929] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.857337 29375 log.cc:1199] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/4f2010232aed489ba61ec1ac423b2f2d
I20260617 20:16:45.858012 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 3b67b915758d4ab0a8faa0227de08593 (DEFAULT_TABLE table=default.Table_ef23aa968984448793f5605fea074d86 [id=f521ee60b1604df983bce5d5c1d0b3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.859215 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 216f91e7bda148bc9334b19e3c868910 (DEFAULT_TABLE table=default.Table_1944004da2ec4937b26d524aa808d0b3 [id=295609419d07485fa5651914ddd75ce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.859549 28955 tablet_service.cc:1511] Processing CreateTablet for tablet b162a0ef91d1447b838331ba6ef93bf4 (DEFAULT_TABLE table=default.Table_0cc10f7657a2450294f6ce1e33fb609e [id=fa80809528dd419192774bcc7ac5f5bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.860402 28954 tablet_service.cc:1511] Processing CreateTablet for tablet b62b22ff17964ee6934023fb85e0b7ec (DEFAULT_TABLE table=default.Table_29efc4231c2a404db10313243e8b10fb [id=c0d29667017e4717bc645aed9382a886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.861470 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216f91e7bda148bc9334b19e3c868910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.863022 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65a4345552844fe9e7512105fd79877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.864344 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b67b915758d4ab0a8faa0227de08593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.866335 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2a38be2e8e4796a98f1ae1d011249f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.866734 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216f91e7bda148bc9334b19e3c868910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.869621 29391 raft_consensus.cc:493] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.869751 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 (DEFAULT_TABLE table=default.Table_8ca126699bab4f66b23ce38c90e050bb [id=f119f85b0a244e149caec77aab7063ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.869825 29391 raft_consensus.cc:515] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:45.870564 29391 leader_election.cc:290] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:45.872866 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b162a0ef91d1447b838331ba6ef93bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.878537 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62b22ff17964ee6934023fb85e0b7ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.887030 29425 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 20:16:45.888141 29425 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 20:16:45.888449 29425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 20:16:45.907708 29390 raft_consensus.cc:493] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.908977 29390 raft_consensus.cc:515] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.909746 29390 leader_election.cc:290] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:16:45.916918 28925 leader_election.cc:343] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 61b9f6bff7b546ad94411325cc770d52
I20260617 20:16:45.922478 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a9e12c91df344ee84a586b7d4a27071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.922644 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7079ea860149f19227264b8507685b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:45.923202 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 9d4702c06d3442ac966ef2daca8d4660 (DEFAULT_TABLE table=default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.923834 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.928643 29232 tablet_service.cc:1511] Processing CreateTablet for tablet d2c0988a73d547d08d0924784bff9222 (DEFAULT_TABLE table=default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.934626 29231 tablet_service.cc:1511] Processing CreateTablet for tablet a76b0744ef2a472091999681d5639fec (DEFAULT_TABLE table=default.Table_e9f868b8616d4ca0940cba8937919fb2 [id=a3772e01cb314c7e88e85833d727617d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.936883 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d4702c06d3442ac966ef2daca8d4660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.941695 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c0988a73d547d08d0924784bff9222. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.941752 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 808c455e74e645aa8e2b0d08ca81d4f9 (DEFAULT_TABLE table=default.Table_0ba339c37163434e8c628ef515624fe1 [id=8696ed2b09fd4e06a0f2746537370766]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.943749 29243 tablet_service.cc:1511] Processing CreateTablet for tablet 9b96c186469e4e8a8baa0dcab96d66bf (DEFAULT_TABLE table=default.Table_33168ad831b44c79a651427dd6011f2b [id=1a6ef514b9104d7d92bce17d40b5e3f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.944101 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 113fbbc739d04f529e82bc1cf1074bd7 (DEFAULT_TABLE table=default.Table_418bd070282540f0b7c6a3e27deff617 [id=3d369e1099c944688151bb38c8da0855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.959344 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 (DEFAULT_TABLE table=default.Table_81f4fb86b1a8470db7f74e35dc15a3fa [id=229a4fa545c84500af515f5992b547c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.959389 29377 ts_tablet_manager.cc:1929] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:45.959751 29377 log.cc:1199] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/f74494a3230448c983d8af0e553247bf
I20260617 20:16:45.959805 29238 tablet_service.cc:1511] Processing CreateTablet for tablet c65a4345552844fe9e7512105fd79877 (DEFAULT_TABLE table=default.Table_cd9432cef0ba46d9a560d5ba59f1d58d [id=6c1d98916a69411393b9f32eeb861bd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.960695 29377 ts_tablet_manager.cc:1950] T f74494a3230448c983d8af0e553247bf P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:45.961558 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2a38be2e8e4796a98f1ae1d011249f (DEFAULT_TABLE table=default.Table_7c00b4f954c743869ac8b3236a50e532 [id=cd4abe077ee04673bad87834b3af273b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.963896 29486 raft_consensus.cc:493] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:45.964102 29486 raft_consensus.cc:515] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:45.964888 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76b0744ef2a472091999681d5639fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.964939 29486 leader_election.cc:290] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:45.966379 29227 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b7880a039a497fbd0fb5d4f74e7d23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:45.966789 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65a4345552844fe9e7512105fd79877. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.968531 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4332e33d60964bd6a0c7e7caaa6bdc76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.970086 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b96c186469e4e8a8baa0dcab96d66bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.971057 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113fbbc739d04f529e82bc1cf1074bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.974223 28966 tablet_service.cc:1511] Processing CreateTablet for tablet dd4f190a1005433ebcfbfe3a86aa9e70 (DEFAULT_TABLE table=default.Table_07f654ca505c4bc5bc80b432a51acaa8 [id=556d100af09b4115bb4acc3f5f4dfade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.979759 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4f190a1005433ebcfbfe3a86aa9e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:45.984915 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd7079ea860149f19227264b8507685b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:45.983949 29230 tablet_service.cc:1511] Processing CreateTablet for tablet a7b59053006046e98d27c694808ca34d (DEFAULT_TABLE table=default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.987052 29226 tablet_service.cc:1511] Processing CreateTablet for tablet b62b22ff17964ee6934023fb85e0b7ec (DEFAULT_TABLE table=default.Table_29efc4231c2a404db10313243e8b10fb [id=c0d29667017e4717bc645aed9382a886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.988077 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 216f91e7bda148bc9334b19e3c868910 (DEFAULT_TABLE table=default.Table_1944004da2ec4937b26d524aa808d0b3 [id=295609419d07485fa5651914ddd75ce8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:45.989567 29062 leader_election.cc:343] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: a340551ee95c4b6685213a4dbd21f6c1
I20260617 20:16:45.996984 29377 tablet_replica.cc:333] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:45.997212 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet f74494a3230448c983d8af0e553247bf (table default.Table_a96bacccf2874d2ea84a7c20f9892640 [id=f447de1e65a64027ae9c8983d72195e0]) successfully deleted
I20260617 20:16:45.997272 29377 raft_consensus.cc:2243] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:45.997539 29377 raft_consensus.cc:2272] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:45.999384 29228 tablet_service.cc:1511] Processing CreateTablet for tablet dd4f190a1005433ebcfbfe3a86aa9e70 (DEFAULT_TABLE table=default.Table_07f654ca505c4bc5bc80b432a51acaa8 [id=556d100af09b4115bb4acc3f5f4dfade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:45.999908 29379 tablet_bootstrap.cc:492] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.000214 29379 ts_tablet_manager.cc:1403] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.215s user 0.049s sys 0.072s
I20260617 20:16:46.001978 29379 raft_consensus.cc:359] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.002456 29379 raft_consensus.cc:385] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.002576 29379 raft_consensus.cc:740] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.002943 29379 consensus_queue.cc:260] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.007354 29379 ts_tablet_manager.cc:1434] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260617 20:16:46.007864 29379 tablet_bootstrap.cc:492] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.010479 29375 ts_tablet_manager.cc:1950] T 4f2010232aed489ba61ec1ac423b2f2d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:46.012429 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 4f2010232aed489ba61ec1ac423b2f2d (table default.Table_1e265a3fe8e441dda5f94d4199dcfb59 [id=225c167b50aa4f898139245b0935968b]) successfully deleted
I20260617 20:16:46.013018 29379 tablet_bootstrap.cc:654] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.014211 29375 tablet_replica.cc:333] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:46.014519 29375 raft_consensus.cc:2243] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.016258 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 3b67b915758d4ab0a8faa0227de08593 (DEFAULT_TABLE table=default.Table_ef23aa968984448793f5605fea074d86 [id=f521ee60b1604df983bce5d5c1d0b3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.017894 29375 raft_consensus.cc:2272] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.019649 29375 ts_tablet_manager.cc:1916] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.025417 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4516e7a7fa284eaa816558b2d58cd213
I20260617 20:16:46.026139 28667 catalog_manager.cc:6784] ReplaceTablet: tablet 4516e7a7fa284eaa816558b2d58cd213 deleted and replaced by tablet 08911643f3ca451d80e2471b1b5b2342
I20260617 20:16:46.027889 28667 catalog_manager.cc:5696] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:46.028436 28667 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet b89b44c6cb2c41409a15708feec0c29b (table default.Table_675165a5585146af86731c73080a0f3f [id=8272ea6276314a28bca235431f8f3986]). Expected version 2 got 0
I20260617 20:16:46.030400 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 751bffacfaa5427784de63d51fc903dd
I20260617 20:16:46.030987 28670 catalog_manager.cc:6784] ReplaceTablet: tablet 751bffacfaa5427784de63d51fc903dd deleted and replaced by tablet e7f822e3f4ca4946a116ee172e83628b
I20260617 20:16:45.998512 29378 consensus_queue.cc:260] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.033903 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a945d2c9fc4e4ebf92224c1a32bec9be" } new_table_name: "default.Table_ae890a73f30b42e7979e4fb37ce8a1c0" modify_external_catalogs: true
W20260617 20:16:46.037186 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f85271eeb854194a968215ebc08f47a has no consensus state
I20260617 20:16:46.040663 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b3b3fd43238e4c979d4e814f42eb49ab" } new_table_name: "default.Table_fd835dc9ea8f4041b36c069dcac9d69a" modify_external_catalogs: true
W20260617 20:16:46.046017 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d9b7880a039a497fbd0fb5d4f74e7d23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9b7880a039a497fbd0fb5d4f74e7d23 already in progress: creating tablet
I20260617 20:16:46.044200 29225 tablet_service.cc:1511] Processing CreateTablet for tablet b162a0ef91d1447b838331ba6ef93bf4 (DEFAULT_TABLE table=default.Table_0cc10f7657a2450294f6ce1e33fb609e [id=fa80809528dd419192774bcc7ac5f5bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.048755 29262 raft_consensus.cc:3060] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.047837 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a340551ee95c4b6685213a4dbd21f6c1" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.050671 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b67b915758d4ab0a8faa0227de08593. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.051857 29263 raft_consensus.cc:2468] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:46.052407 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8985331f7fce43788f3a355c861e8297" } new_table_name: "default.Table_1d8cf3e5102141cc9d4f9c93d77d385e" modify_external_catalogs: true
I20260617 20:16:46.053624 29197 leader_election.cc:304] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:46.056514 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 751bffacfaa5427784de63d51fc903dd with delete_type TABLET_DATA_DELETED (replaced by tablet e7f822e3f4ca4946a116ee172e83628b) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.063077 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_55a046350f1148c194bb4200eb60c32c" } new_table_name: "default.Table_5f1cf137a6c043a9b03d4a334ae42ef8" modify_external_catalogs: true
W20260617 20:16:46.063877 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 751bffacfaa5427784de63d51fc903dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 751bffacfaa5427784de63d51fc903dd already in progress: creating tablet
I20260617 20:16:46.066520 29390 raft_consensus.cc:493] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.055224 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61b9f6bff7b546ad94411325cc770d52" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.066735 29390 raft_consensus.cc:515] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.057188 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4ef1f493c4f1289cfa192ce38161d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.067548 29390 leader_election.cc:290] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:46.070996 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 4516e7a7fa284eaa816558b2d58cd213 with delete_type TABLET_DATA_DELETED (replaced by tablet 08911643f3ca451d80e2471b1b5b2342) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.074615 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 751bffacfaa5427784de63d51fc903dd with delete_type TABLET_DATA_DELETED (replaced by tablet e7f822e3f4ca4946a116ee172e83628b) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:46.076419 28925 leader_election.cc:343] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.076578 28925 leader_election.cc:304] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:46.077216 28925 raft_consensus.cc:2686] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:16:46.077522 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 808c455e74e645aa8e2b0d08ca81d4f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:46.077696 28925 leader_election.cc:343] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.078361 28925 leader_election.cc:304] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.083946 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62b22ff17964ee6934023fb85e0b7ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.085085 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd4f190a1005433ebcfbfe3a86aa9e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.085217 29377 ts_tablet_manager.cc:1916] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.086009 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b162a0ef91d1447b838331ba6ef93bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.087836 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d723526a83174898a71a835b7cdbc467" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.091006 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b59053006046e98d27c694808ca34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.092552 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ac0c318d8f1947d99a30561f61ebb675"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:46.093206 29390 raft_consensus.cc:2749] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:46.093232 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac0c318d8f1947d99a30561f61ebb675 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:46.098104 28925 leader_election.cc:343] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.111306 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet 4516e7a7fa284eaa816558b2d58cd213 with delete_type TABLET_DATA_DELETED (replaced by tablet 08911643f3ca451d80e2471b1b5b2342) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:46.113185 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4516e7a7fa284eaa816558b2d58cd213 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4516e7a7fa284eaa816558b2d58cd213 already in progress: creating tablet
I20260617 20:16:46.118937 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2a38be2e8e4796a98f1ae1d011249f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.128398 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cc594b39ac1b42d1af3937765c5c4970" } modify_external_catalogs: true
I20260617 20:16:46.128654 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cc594b39ac1b42d1af3937765c5c4970" } modify_external_catalogs: true
I20260617 20:16:46.131080 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f2ec59ac5864da5a13965ca0724c387 with delete_type TABLET_DATA_DELETED (replaced by tablet d9b7880a039a497fbd0fb5d4f74e7d23) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.132716 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216f91e7bda148bc9334b19e3c868910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.134450 29378 ts_tablet_manager.cc:1434] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.397s user 0.003s sys 0.002s
I20260617 20:16:46.140761 29383 tablet_bootstrap.cc:492] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.146938 29378 tablet_bootstrap.cc:492] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.148934 29378 tablet_bootstrap.cc:654] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.162009 29378 tablet_bootstrap.cc:492] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.162236 29378 ts_tablet_manager.cc:1403] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.003s
I20260617 20:16:46.162854 29391 raft_consensus.cc:493] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.163300 29378 raft_consensus.cc:359] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.163543 29378 raft_consensus.cc:385] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.163909 29378 raft_consensus.cc:740] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.164258 29378 consensus_queue.cc:260] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.164873 29378 ts_tablet_manager.cc:1434] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:16:46.165263 29378 tablet_bootstrap.cc:492] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.165617 29383 ts_tablet_manager.cc:1403] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.430s user 0.018s sys 0.011s
I20260617 20:16:46.167160 29391 raft_consensus.cc:515] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.167559 29378 tablet_bootstrap.cc:654] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.167951 29391 leader_election.cc:290] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.172246 29377 ts_tablet_manager.cc:1929] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.172413 29377 log.cc:1199] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/61b9f6bff7b546ad94411325cc770d52
I20260617 20:16:46.172847 29377 ts_tablet_manager.cc:1950] T 61b9f6bff7b546ad94411325cc770d52 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:46.175926 29378 tablet_bootstrap.cc:492] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.176123 29378 ts_tablet_manager.cc:1403] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260617 20:16:46.176190 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 61b9f6bff7b546ad94411325cc770d52 (table default.Table_0a57fb26789b4826858b2755f0f85b86 [id=d6d4c2a3dc5e41669e992a16ce5f16c4]) successfully deleted
I20260617 20:16:46.177136 29378 raft_consensus.cc:359] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.177397 29378 raft_consensus.cc:385] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.177520 29378 raft_consensus.cc:740] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.178018 29377 tablet_replica.cc:333] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.178104 29378 consensus_queue.cc:260] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.178803 29378 ts_tablet_manager.cc:1434] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 20:16:46.179041 29377 raft_consensus.cc:2243] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.180922 29377 raft_consensus.cc:2272] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.179171 29378 tablet_bootstrap.cc:492] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.182299 29377 ts_tablet_manager.cc:1916] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:46.183382 29197 leader_election.cc:343] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 5c047f3fab644c50aef4adfff153a85b
I20260617 20:16:46.183828 29538 raft_consensus.cc:493] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.184022 29538 raft_consensus.cc:515] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.185041 29538 leader_election.cc:290] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.186619 29378 tablet_bootstrap.cc:654] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.194142 29377 ts_tablet_manager.cc:1929] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.197576 29377 log.cc:1199] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/46d7fa99c35646c59898738de38c88ed
I20260617 20:16:46.197911 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd312e8817ee4c8fb7377825a7e6122a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.195443 29378 tablet_bootstrap.cc:492] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.198901 29378 ts_tablet_manager.cc:1403] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.005s
W20260617 20:16:46.201191 28925 leader_election.cc:343] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.202257 29377 ts_tablet_manager.cc:1950] T 46d7fa99c35646c59898738de38c88ed P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:46.203560 29377 tablet_replica.cc:333] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.203675 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 46d7fa99c35646c59898738de38c88ed (table default.Table_bc9d14d4c6734ab380f6fd753c50567d [id=c654a7154f724dd8ac916d398c662cc9]) successfully deleted
I20260617 20:16:46.204567 29378 raft_consensus.cc:359] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.204842 29378 raft_consensus.cc:385] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.204924 29378 raft_consensus.cc:740] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.205310 29378 consensus_queue.cc:260] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.206053 29377 raft_consensus.cc:2243] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.206815 29377 raft_consensus.cc:2272] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.207497 29377 ts_tablet_manager.cc:1916] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.209520 29378 ts_tablet_manager.cc:1434] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260617 20:16:46.210454 29378 tablet_bootstrap.cc:492] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.212693 29378 tablet_bootstrap.cc:654] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.222119 29377 ts_tablet_manager.cc:1929] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.222304 29377 log.cc:1199] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/d723526a83174898a71a835b7cdbc467
I20260617 20:16:46.222760 29377 ts_tablet_manager.cc:1950] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:46.223744 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet d723526a83174898a71a835b7cdbc467 (table default.Table_71003cb25e6e4229aba21f7dd04b7fe4 [id=da4afdf3f60e48e78eb52d454fa4142c]) successfully deleted
I20260617 20:16:46.225373 29378 tablet_bootstrap.cc:492] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.225651 29378 ts_tablet_manager.cc:1403] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.002s
I20260617 20:16:46.226755 29378 raft_consensus.cc:359] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.227001 29378 raft_consensus.cc:385] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.228334 29378 raft_consensus.cc:740] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.228991 29378 consensus_queue.cc:260] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.230711 29378 ts_tablet_manager.cc:1434] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260617 20:16:46.231057 29378 tablet_bootstrap.cc:492] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.234105 29378 tablet_bootstrap.cc:654] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.235435 29377 tablet_replica.cc:333] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.235795 29377 raft_consensus.cc:2243] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.236059 29377 raft_consensus.cc:2272] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.236915 29377 ts_tablet_manager.cc:1916] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.239704 29383 raft_consensus.cc:359] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.242247 29378 tablet_bootstrap.cc:492] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.242522 29378 ts_tablet_manager.cc:1403] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260617 20:16:46.243572 29378 raft_consensus.cc:359] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.243901 29378 raft_consensus.cc:385] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.244040 29378 raft_consensus.cc:740] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.244403 29378 consensus_queue.cc:260] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.245604 29378 ts_tablet_manager.cc:1434] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:46.245958 29378 tablet_bootstrap.cc:492] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.247924 29378 tablet_bootstrap.cc:654] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.255600 29377 ts_tablet_manager.cc:1929] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.257221 29377 log.cc:1199] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/f3d06c0618db45689428b0c1125bd193
I20260617 20:16:46.257788 29377 ts_tablet_manager.cc:1950] T f3d06c0618db45689428b0c1125bd193 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:46.257066 29378 tablet_bootstrap.cc:492] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.258075 29378 ts_tablet_manager.cc:1403] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.001s
I20260617 20:16:46.258704 29383 raft_consensus.cc:385] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.259305 29378 raft_consensus.cc:359] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.259666 29378 raft_consensus.cc:385] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.259945 29378 raft_consensus.cc:740] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.260345 29378 consensus_queue.cc:260] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.261519 29378 ts_tablet_manager.cc:1434] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:46.261854 29378 tablet_bootstrap.cc:492] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.030047 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 4516e7a7fa284eaa816558b2d58cd213 with delete_type TABLET_DATA_DELETED (replaced by tablet 08911643f3ca451d80e2471b1b5b2342) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.034265 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7fa99c35646c59898738de38c88ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.041311 29486 raft_consensus.cc:493] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.056083 29063 leader_election.cc:304] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:46.153350 29379 tablet_bootstrap.cc:492] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.154973 29539 raft_consensus.cc:493] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.161466 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 751bffacfaa5427784de63d51fc903dd with delete_type TABLET_DATA_DELETED (replaced by tablet e7f822e3f4ca4946a116ee172e83628b) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.263211 29379 ts_tablet_manager.cc:1403] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.255s user 0.041s sys 0.093s
I20260617 20:16:46.264250 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet f3d06c0618db45689428b0c1125bd193 (table default.Table_315b909d8d1c411f89063fecb8be5b84 [id=aca59faae56b44f5ae502160c7b43e4b]) successfully deleted
I20260617 20:16:46.264401 29379 raft_consensus.cc:359] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.264590 29379 raft_consensus.cc:385] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.264683 29379 raft_consensus.cc:740] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.264897 29379 consensus_queue.cc:260] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.265395 29383 raft_consensus.cc:740] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.263312 29539 raft_consensus.cc:515] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:46.266126 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d9b7880a039a497fbd0fb5d4f74e7d23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9b7880a039a497fbd0fb5d4f74e7d23 already in progress: creating tablet
I20260617 20:16:46.266520 29539 leader_election.cc:290] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:46.263437 29063 raft_consensus.cc:2686] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260617 20:16:46.267349 29062 leader_election.cc:343] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d723526a83174898a71a835b7cdbc467
W20260617 20:16:46.267530 29063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 211459us
W20260617 20:16:46.267880 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 4516e7a7fa284eaa816558b2d58cd213 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4516e7a7fa284eaa816558b2d58cd213 already in progress: creating tablet
I20260617 20:16:46.268712 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd312e8817ee4c8fb7377825a7e6122a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:46.269217 28925 leader_election.cc:343] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.269428 28925 leader_election.cc:304] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.269603 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d723526a83174898a71a835b7cdbc467" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:46.269834 29128 raft_consensus.cc:2468] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:46.262966 29486 raft_consensus.cc:515] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.270308 28925 leader_election.cc:304] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:46.270500 28925 raft_consensus.cc:2686] T d723526a83174898a71a835b7cdbc467 P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:16:46.270562 29486 leader_election.cc:290] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:46.273176 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d723526a83174898a71a835b7cdbc467" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.273648 29538 raft_consensus.cc:2749] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:46.273893 29063 leader_election.cc:343] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.274022 29063 leader_election.cc:304] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.274443 29486 raft_consensus.cc:2749] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:46.275751 29062 leader_election.cc:343] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 46d7fa99c35646c59898738de38c88ed
I20260617 20:16:46.280081 29378 tablet_bootstrap.cc:654] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:46.280737 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 751bffacfaa5427784de63d51fc903dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 751bffacfaa5427784de63d51fc903dd already in progress: creating tablet
W20260617 20:16:46.281668 29198 leader_election.cc:343] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 5c047f3fab644c50aef4adfff153a85b
I20260617 20:16:46.281155 29377 tablet_replica.cc:333] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.281872 29383 consensus_queue.cc:260] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.282205 29377 raft_consensus.cc:2243] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.282652 29377 raft_consensus.cc:2272] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.281816 29198 leader_election.cc:304] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:46.282944 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46d7fa99c35646c59898738de38c88ed" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:46.283710 29063 leader_election.cc:343] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.283921 29063 leader_election.cc:304] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.284435 29377 ts_tablet_manager.cc:1916] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.284838 29486 raft_consensus.cc:2749] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:46.285425 29391 raft_consensus.cc:2749] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:46.285717 29383 ts_tablet_manager.cc:1434] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.117s user 0.001s sys 0.002s
I20260617 20:16:46.287483 29383 tablet_bootstrap.cc:492] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.292048 29379 ts_tablet_manager.cc:1434] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.028s user 0.000s sys 0.008s
I20260617 20:16:46.292431 29379 tablet_bootstrap.cc:492] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.294911 29379 tablet_bootstrap.cc:654] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.298976 29379 tablet_bootstrap.cc:492] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.299170 29379 ts_tablet_manager.cc:1403] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260617 20:16:46.300282 29379 raft_consensus.cc:359] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.300566 29379 raft_consensus.cc:385] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.300657 29379 raft_consensus.cc:740] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.301041 29379 consensus_queue.cc:260] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.301908 29378 tablet_bootstrap.cc:492] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.302101 29378 ts_tablet_manager.cc:1403] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.002s
I20260617 20:16:46.302201 29377 ts_tablet_manager.cc:1929] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.302314 29377 log.cc:1199] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/5f2ec59ac5864da5a13965ca0724c387
I20260617 20:16:46.302718 29377 ts_tablet_manager.cc:1950] T 5f2ec59ac5864da5a13965ca0724c387 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:46.301595 29379 ts_tablet_manager.cc:1434] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260617 20:16:46.303305 29378 raft_consensus.cc:359] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.303495 29378 raft_consensus.cc:385] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.303583 29378 raft_consensus.cc:740] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.303738 29379 tablet_bootstrap.cc:492] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.303813 29378 consensus_queue.cc:260] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.305126 29378 ts_tablet_manager.cc:1434] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:46.305444 29378 tablet_bootstrap.cc:492] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.306107 29379 tablet_bootstrap.cc:654] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.307013 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 5f2ec59ac5864da5a13965ca0724c387 (table default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]) successfully deleted
I20260617 20:16:46.308049 29378 tablet_bootstrap.cc:654] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.327065 29378 tablet_bootstrap.cc:492] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.327250 29378 ts_tablet_manager.cc:1403] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.002s
I20260617 20:16:46.328184 29378 raft_consensus.cc:359] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.328377 29378 raft_consensus.cc:385] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.328473 29378 raft_consensus.cc:740] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.328758 29378 consensus_queue.cc:260] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.334223 29375 ts_tablet_manager.cc:1929] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.334447 29391 raft_consensus.cc:493] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.335902 29383 tablet_bootstrap.cc:654] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.336338 29391 raft_consensus.cc:515] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.337023 29391 leader_election.cc:290] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.338164 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f2ec59ac5864da5a13965ca0724c387 with delete_type TABLET_DATA_DELETED (replaced by tablet d9b7880a039a497fbd0fb5d4f74e7d23) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.338841 28665 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet d6e8e301b77249d4a64fe4628bd8a7ce
I20260617 20:16:46.339244 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_132f26049e6b4fea9ea1c5a5f5525931"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:46.339810 29378 ts_tablet_manager.cc:1434] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
W20260617 20:16:46.339905 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_132f26049e6b4fea9ea1c5a5f5525931 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.341418 29378 tablet_bootstrap.cc:492] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.343182 29378 tablet_bootstrap.cc:654] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:46.343636 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5f2ec59ac5864da5a13965ca0724c387 because the tablet was not found. No further retry: Not found: Tablet not found: 5f2ec59ac5864da5a13965ca0724c387
W20260617 20:16:46.344179 29197 leader_election.cc:343] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: adcd4689680e43b19318336fb5a3edb3
W20260617 20:16:46.349445 29198 leader_election.cc:343] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: adcd4689680e43b19318336fb5a3edb3
I20260617 20:16:46.349653 29198 leader_election.cc:304] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:16:46.350409 28657 consensus_peers.cc:597] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a -> Peer f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059): Couldn't send request to peer f5ea3f9265d84474ab3bced8dd5aecc5. Status: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260617 20:16:46.350487 29391 raft_consensus.cc:2749] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:46.354007 29375 log.cc:1199] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/a340551ee95c4b6685213a4dbd21f6c1
I20260617 20:16:46.351686 29379 tablet_bootstrap.cc:492] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.359273 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet 9b96c186469e4e8a8baa0dcab96d66bf from {username='slave'} at 127.0.0.1:60552
W20260617 20:16:46.359776 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e1dc756edd5473183afc75eef7112d6 consensus state has no leader
I20260617 20:16:46.360004 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet 637b0b3e9cb648deaea6e63760b83255 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:46.362452 29378 tablet_bootstrap.cc:492] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.362685 29378 ts_tablet_manager.cc:1403] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.003s
I20260617 20:16:46.354913 29375 ts_tablet_manager.cc:1950] T a340551ee95c4b6685213a4dbd21f6c1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:46.355156 29379 ts_tablet_manager.cc:1403] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.051s user 0.013s sys 0.021s
I20260617 20:16:46.365248 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet a340551ee95c4b6685213a4dbd21f6c1 (table default.Table_8768bdfdc4af4740898b1018fd51e808 [id=772f52014ca7448ba492233fd74402e9]) successfully deleted
I20260617 20:16:46.365648 29378 raft_consensus.cc:359] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.365859 29378 raft_consensus.cc:385] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.365947 29378 raft_consensus.cc:740] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.366228 29378 consensus_queue.cc:260] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.366248 29379 raft_consensus.cc:359] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.366485 29379 raft_consensus.cc:385] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.366588 29379 raft_consensus.cc:740] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.366851 29379 consensus_queue.cc:260] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.368647 29378 ts_tablet_manager.cc:1434] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260617 20:16:46.368963 29378 tablet_bootstrap.cc:492] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.369524 29379 ts_tablet_manager.cc:1434] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:46.370103 29383 tablet_bootstrap.cc:492] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.370265 29383 ts_tablet_manager.cc:1403] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.084s user 0.002s sys 0.003s
I20260617 20:16:46.370464 29379 tablet_bootstrap.cc:492] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.371146 29383 raft_consensus.cc:359] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.371361 29383 raft_consensus.cc:385] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.371457 29383 raft_consensus.cc:740] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.371922 29383 consensus_queue.cc:260] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.372303 29379 tablet_bootstrap.cc:654] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.372341 29378 tablet_bootstrap.cc:654] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.373664 29538 raft_consensus.cc:493] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.373797 29538 raft_consensus.cc:515] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.374351 29538 leader_election.cc:290] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.374749 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137cbb87d11c450995b63f7a8a7dece5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.374894 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137cbb87d11c450995b63f7a8a7dece5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:46.375075 29128 raft_consensus.cc:2468] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:46.375553 28925 leader_election.cc:304] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:46.375609 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet adcd4689680e43b19318336fb5a3edb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.375862 29376 tablet_replica.cc:333] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:46.375835 29538 raft_consensus.cc:2804] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260617 20:16:46.375921 28925 leader_election.cc:343] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.375980 29538 raft_consensus.cc:493] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:46.376036 29376 raft_consensus.cc:2243] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.376077 29538 raft_consensus.cc:3060] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.376209 29376 raft_consensus.cc:2272] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.376784 29376 ts_tablet_manager.cc:1916] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.378343 29375 tablet_replica.cc:333] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:46.378855 29538 raft_consensus.cc:515] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.379356 29375 raft_consensus.cc:2243] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.380676 29383 ts_tablet_manager.cc:1434] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 20:16:46.381525 29538 leader_election.cc:290] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.380518 29375 raft_consensus.cc:2272] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.382071 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137cbb87d11c450995b63f7a8a7dece5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:46.382472 29128 raft_consensus.cc:3060] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.385632 29528 raft_consensus.cc:2749] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:46.385758 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137cbb87d11c450995b63f7a8a7dece5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:46.385990 29128 raft_consensus.cc:2468] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:46.386212 29383 tablet_bootstrap.cc:492] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:46.386278 28925 leader_election.cc:343] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.379422 29560 tablet.cc:1724] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:46.388021 29383 tablet_bootstrap.cc:654] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.389180 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c047f3fab644c50aef4adfff153a85b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.390843 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet a340551ee95c4b6685213a4dbd21f6c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.391616 28925 leader_election.cc:304] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.391463 29375 ts_tablet_manager.cc:1916] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.393724 29383 tablet_bootstrap.cc:492] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.393900 29383 ts_tablet_manager.cc:1403] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.002s
I20260617 20:16:46.395167 29376 ts_tablet_manager.cc:1929] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.395359 29376 log.cc:1199] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/adcd4689680e43b19318336fb5a3edb3
I20260617 20:16:46.395833 29376 ts_tablet_manager.cc:1950] T adcd4689680e43b19318336fb5a3edb3 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:46.395990 29383 raft_consensus.cc:359] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.396212 29383 raft_consensus.cc:385] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.396294 29383 raft_consensus.cc:740] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.397233 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet adcd4689680e43b19318336fb5a3edb3 (table default.Table_24eb651bcbec4bafbac0b0612438512f [id=704477b29a8548ed9d8fd39b7e9e89a5]) successfully deleted
I20260617 20:16:46.397629 29376 tablet_replica.cc:333] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:46.397877 29376 raft_consensus.cc:2243] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.397926 29383 consensus_queue.cc:260] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.398277 29376 raft_consensus.cc:2272] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.399583 29376 ts_tablet_manager.cc:1916] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.402676 29538 raft_consensus.cc:2804] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:46.403533 29379 tablet_bootstrap.cc:492] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.403702 29379 ts_tablet_manager.cc:1403] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.001s
I20260617 20:16:46.404562 29379 raft_consensus.cc:359] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.404772 29379 raft_consensus.cc:385] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.404852 29379 raft_consensus.cc:740] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.405102 29379 consensus_queue.cc:260] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.405616 29379 ts_tablet_manager.cc:1434] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:46.405967 29379 tablet_bootstrap.cc:492] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.407824 29379 tablet_bootstrap.cc:654] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.413368 29390 raft_consensus.cc:493] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.413589 29390 raft_consensus.cc:515] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.414379 29390 leader_election.cc:290] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.414676 29378 tablet_bootstrap.cc:492] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.414842 29378 ts_tablet_manager.cc:1403] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.002s
I20260617 20:16:46.414810 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365e0ffb939047898243f72e4053d9a1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.414805 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365e0ffb939047898243f72e4053d9a1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:46.415434 28925 leader_election.cc:343] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:46.415737 28925 leader_election.cc:343] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.415863 28925 leader_election.cc:304] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.415815 29378 raft_consensus.cc:359] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.416036 29378 raft_consensus.cc:385] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.416169 29378 raft_consensus.cc:740] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.416435 29378 consensus_queue.cc:260] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.416560 29390 raft_consensus.cc:2749] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:46.417097 29378 ts_tablet_manager.cc:1434] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:46.417766 29378 tablet_bootstrap.cc:492] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.420053 29378 tablet_bootstrap.cc:654] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.432588 29376 ts_tablet_manager.cc:1929] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.433033 29375 ts_tablet_manager.cc:1929] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:16:46.435014 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60a43dd885aa4411a4177b67807b0ac4 consensus state has no leader
W20260617 20:16:46.435842 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc945cdd482f4a5593d4874e5303ecd2 consensus state has no leader
I20260617 20:16:46.398494 29383 ts_tablet_manager.cc:1434] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:46.436625 29383 tablet_bootstrap.cc:492] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.439112 29383 tablet_bootstrap.cc:654] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.440089 29376 log.cc:1199] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/5c047f3fab644c50aef4adfff153a85b
I20260617 20:16:46.440554 29376 ts_tablet_manager.cc:1950] T 5c047f3fab644c50aef4adfff153a85b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
W20260617 20:16:46.440742 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98467525f81f4a48878eae17e3a9c982 has no consensus state
I20260617 20:16:46.441533 29376 tablet_replica.cc:333] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:46.441706 29376 raft_consensus.cc:2243] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.441993 29376 raft_consensus.cc:2272] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.434331 29560 tablet.cc:1719] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: Skipping requested alter to schema version 2, tablet already version 2
I20260617 20:16:46.442893 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 5c047f3fab644c50aef4adfff153a85b (table default.Table_0ec2cf7d7dc84aaa942f063bbcb984b9 [id=fb1fb1a6dbdd4b258aa91bb9e4f06ae2]) successfully deleted
I20260617 20:16:46.443195 29390 raft_consensus.cc:493] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.443794 29376 ts_tablet_manager.cc:1916] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.443215 29379 tablet_bootstrap.cc:492] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.444133 29379 ts_tablet_manager.cc:1403] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.007s
W20260617 20:16:46.444725 28654 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 689121cc9ca647cda1899cdd569da8f6 (table default.Table_81f4fb86b1a8470db7f74e35dc15a3fa [id=229a4fa545c84500af515f5992b547c7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 689121cc9ca647cda1899cdd569da8f6 consensus state has no leader
I20260617 20:16:46.445088 29379 raft_consensus.cc:359] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.445348 29379 raft_consensus.cc:385] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.445457 29379 raft_consensus.cc:740] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.445602 28666 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet daec73a6c2e24a82a3cd8d993d620d5c
I20260617 20:16:46.445740 29379 consensus_queue.cc:260] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.447036 29379 ts_tablet_manager.cc:1434] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:46.447386 29379 tablet_bootstrap.cc:492] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.449118 29383 tablet_bootstrap.cc:492] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.449344 29383 ts_tablet_manager.cc:1403] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.001s
I20260617 20:16:46.449433 29375 log.cc:1199] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/d723526a83174898a71a835b7cdbc467
I20260617 20:16:46.450542 29383 raft_consensus.cc:359] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.450819 29383 raft_consensus.cc:385] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.450925 29383 raft_consensus.cc:740] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.451150 29383 consensus_queue.cc:260] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.452291 29383 ts_tablet_manager.cc:1434] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:46.452579 29383 tablet_bootstrap.cc:492] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.452589 29375 ts_tablet_manager.cc:1950] T d723526a83174898a71a835b7cdbc467 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:46.454107 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet d723526a83174898a71a835b7cdbc467 (table default.Table_71003cb25e6e4229aba21f7dd04b7fe4 [id=da4afdf3f60e48e78eb52d454fa4142c]) successfully deleted
I20260617 20:16:46.454774 29383 tablet_bootstrap.cc:654] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.459167 29379 tablet_bootstrap.cc:654] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:46.459915 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d9b7880a039a497fbd0fb5d4f74e7d23 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9b7880a039a497fbd0fb5d4f74e7d23 already in progress: creating tablet
I20260617 20:16:46.460107 29376 ts_tablet_manager.cc:1929] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.460222 29376 log.cc:1199] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/a340551ee95c4b6685213a4dbd21f6c1
I20260617 20:16:46.460541 29376 ts_tablet_manager.cc:1950] T a340551ee95c4b6685213a4dbd21f6c1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
W20260617 20:16:46.461426 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4516e7a7fa284eaa816558b2d58cd213 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4516e7a7fa284eaa816558b2d58cd213 already in progress: creating tablet
I20260617 20:16:46.463613 29545 mvcc.cc:204] Tried to move back new op lower bound from 7297955451531776000 to 7297955449930817536. Current Snapshot: MvccSnapshot[applied={T|T < 7297955451531776000}]
I20260617 20:16:46.465051 29128 raft_consensus.cc:1275] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Refusing update from remote peer a8c0aea0206f44d683ed3b6b18c719f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:46.465322 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_bf43c1c307304b35a6b33eb8fb011be2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:46.466007 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf43c1c307304b35a6b33eb8fb011be2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.465948 29528 consensus_queue.cc:1048] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:46.467716 29383 tablet_bootstrap.cc:492] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.467883 29383 ts_tablet_manager.cc:1403] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260617 20:16:46.467823 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_81f4fb86b1a8470db7f74e35dc15a3fa" } modify_external_catalogs: true
I20260617 20:16:46.468024 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_81f4fb86b1a8470db7f74e35dc15a3fa" } modify_external_catalogs: true
I20260617 20:16:46.468852 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet a340551ee95c4b6685213a4dbd21f6c1 (table default.Table_8768bdfdc4af4740898b1018fd51e808 [id=772f52014ca7448ba492233fd74402e9]) successfully deleted
I20260617 20:16:46.469076 29383 raft_consensus.cc:359] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.469264 29383 raft_consensus.cc:385] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.469368 29383 raft_consensus.cc:740] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.469779 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_675165a5585146af86731c73080a0f3f" } modify_external_catalogs: true
I20260617 20:16:46.469777 29383 consensus_queue.cc:260] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.469941 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_675165a5585146af86731c73080a0f3f" } modify_external_catalogs: true
I20260617 20:16:46.470595 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1adceba2479a4de983fda635f00aea06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:46.471199 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1adceba2479a4de983fda635f00aea06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.471491 29383 ts_tablet_manager.cc:1434] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:46.472846 29383 tablet_bootstrap.cc:492] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.472527 29375 tablet_replica.cc:333] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:46.473275 28661 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]). Expected version 2 got 0
I20260617 20:16:46.473340 29375 raft_consensus.cc:2243] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.473555 29375 raft_consensus.cc:2272] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.474629 29383 tablet_bootstrap.cc:654] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.474879 29375 ts_tablet_manager.cc:1916] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.474887 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e0e8f7e180d64ca690dfea9446c257a1" } modify_external_catalogs: true
I20260617 20:16:46.475044 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e0e8f7e180d64ca690dfea9446c257a1" } modify_external_catalogs: true
I20260617 20:16:46.476186 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 61b9f6bff7b546ad94411325cc770d52 with delete_type TABLET_DATA_DELETED (replaced by tablet bb4b3c917efb4c4aae1595af7ce1cd35) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.476467 29376 tablet_replica.cc:333] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:46.476761 29376 raft_consensus.cc:2243] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.477020 29376 raft_consensus.cc:2272] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.480113 29549 raft_consensus.cc:493] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.480300 29549 raft_consensus.cc:515] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.481235 29549 leader_election.cc:290] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:46.483451 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd312e8817ee4c8fb7377825a7e6122a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:46.483970 29063 leader_election.cc:343] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.485042 29376 ts_tablet_manager.cc:1916] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.486593 29383 tablet_bootstrap.cc:492] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.486747 29383 ts_tablet_manager.cc:1403] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.001s
I20260617 20:16:46.489589 29383 raft_consensus.cc:359] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.489782 29383 raft_consensus.cc:385] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.489651 29390 raft_consensus.cc:515] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.489893 29383 raft_consensus.cc:740] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.490167 29383 consensus_queue.cc:260] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.490767 29383 ts_tablet_manager.cc:1434] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:46.491082 29383 tablet_bootstrap.cc:492] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.492357 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c3089f552b449095eafc00da38e442" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.492805 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c3089f552b449095eafc00da38e442" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:46.493281 29376 ts_tablet_manager.cc:1929] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.493485 29376 log.cc:1199] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/61b9f6bff7b546ad94411325cc770d52
I20260617 20:16:46.494033 29376 ts_tablet_manager.cc:1950] T 61b9f6bff7b546ad94411325cc770d52 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:46.494016 29390 leader_election.cc:290] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:46.494184 29390 raft_consensus.cc:493] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.494577 29379 tablet_bootstrap.cc:492] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.494736 29379 ts_tablet_manager.cc:1403] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.002s
I20260617 20:16:46.495306 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 61b9f6bff7b546ad94411325cc770d52 (table default.Table_0a57fb26789b4826858b2755f0f85b86 [id=d6d4c2a3dc5e41669e992a16ce5f16c4]) successfully deleted
I20260617 20:16:46.495379 29390 raft_consensus.cc:515] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.495733 29379 raft_consensus.cc:359] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.495934 29379 raft_consensus.cc:385] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.496006 29379 raft_consensus.cc:740] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.496284 29379 consensus_queue.cc:260] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.496788 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd312e8817ee4c8fb7377825a7e6122a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:46.497015 28989 raft_consensus.cc:2468] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:46.497124 28990 raft_consensus.cc:1275] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Refusing update from remote peer a8c0aea0206f44d683ed3b6b18c719f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:46.497778 29062 leader_election.cc:304] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.498071 29528 consensus_queue.cc:1048] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:16:46.499120 28925 leader_election.cc:343] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.499415 29383 tablet_bootstrap.cc:654] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:46.499400 28925 leader_election.cc:343] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.499554 28925 leader_election.cc:304] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.500713 29538 raft_consensus.cc:697] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:46.500874 29574 tablet.cc:1724] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:46.501544 29571 raft_consensus.cc:2749] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:46.503332 29379 ts_tablet_manager.cc:1434] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260617 20:16:46.503690 29379 tablet_bootstrap.cc:492] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.501157 29538 consensus_queue.cc:237] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.506341 29486 raft_consensus.cc:2804] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:46.506474 29486 raft_consensus.cc:493] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:46.506600 29486 raft_consensus.cc:3060] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.510370 29486 raft_consensus.cc:515] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.511415 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd312e8817ee4c8fb7377825a7e6122a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:46.511670 28990 raft_consensus.cc:3060] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.513078 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd312e8817ee4c8fb7377825a7e6122a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
W20260617 20:16:46.513655 29063 leader_election.cc:343] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.513899 29486 leader_election.cc:290] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:46.516304 29378 tablet_bootstrap.cc:492] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.516474 29378 ts_tablet_manager.cc:1403] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.099s user 0.013s sys 0.029s
I20260617 20:16:46.516620 29588 tablet.cc:1724] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:46.517227 29378 raft_consensus.cc:359] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.517462 29378 raft_consensus.cc:385] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.519831 29391 raft_consensus.cc:493] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.520006 29391 raft_consensus.cc:515] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.520522 29391 leader_election.cc:290] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.520937 29378 raft_consensus.cc:740] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.521204 29378 consensus_queue.cc:260] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.521512 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689121cc9ca647cda1899cdd569da8f6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:46.521721 29378 ts_tablet_manager.cc:1434] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:16:46.522050 29378 tablet_bootstrap.cc:492] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.523203 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689121cc9ca647cda1899cdd569da8f6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.523955 29378 tablet_bootstrap.cc:654] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:46.524874 28925 leader_election.cc:343] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:46.525467 28925 leader_election.cc:343] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.525600 28925 leader_election.cc:304] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.526408 29574 tablet.cc:1719] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: Skipping requested alter to schema version 2, tablet already version 2
W20260617 20:16:46.527614 29197 leader_election.cc:343] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f3d06c0618db45689428b0c1125bd193
I20260617 20:16:46.528769 29588 tablet.cc:1719] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: Skipping requested alter to schema version 2, tablet already version 2
I20260617 20:16:46.529066 29571 raft_consensus.cc:2749] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:46.519457 29390 leader_election.cc:290] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:46.531687 29383 tablet_bootstrap.cc:492] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.531875 29383 ts_tablet_manager.cc:1403] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.041s user 0.006s sys 0.005s
I20260617 20:16:46.532804 29378 tablet_bootstrap.cc:492] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.532719 29383 raft_consensus.cc:359] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.532925 29383 raft_consensus.cc:385] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.532951 29378 ts_tablet_manager.cc:1403] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260617 20:16:46.532999 29383 raft_consensus.cc:740] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.533233 29383 consensus_queue.cc:260] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.533789 29383 ts_tablet_manager.cc:1434] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:46.533736 29378 raft_consensus.cc:359] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.533926 29378 raft_consensus.cc:385] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.534024 29378 raft_consensus.cc:740] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.534147 29383 tablet_bootstrap.cc:492] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.534327 29378 consensus_queue.cc:260] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.534691 28990 raft_consensus.cc:2468] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:46.536674 29383 tablet_bootstrap.cc:654] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.535296 29378 ts_tablet_manager.cc:1434] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:46.537806 29378 tablet_bootstrap.cc:492] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.537940 29379 tablet_bootstrap.cc:654] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.538740 29062 leader_election.cc:304] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.539495 29486 raft_consensus.cc:2804] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:46.539649 29378 tablet_bootstrap.cc:654] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.539832 29486 raft_consensus.cc:697] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:46.540164 29486 consensus_queue.cc:237] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.540717 29375 ts_tablet_manager.cc:1929] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.540910 29375 log.cc:1199] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/46d7fa99c35646c59898738de38c88ed
I20260617 20:16:46.543956 29378 tablet_bootstrap.cc:492] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.544119 29378 ts_tablet_manager.cc:1403] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260617 20:16:46.544870 29378 raft_consensus.cc:359] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.545050 29378 raft_consensus.cc:385] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.545118 29378 raft_consensus.cc:740] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:16:46.545251 29198 leader_election.cc:343] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: f3d06c0618db45689428b0c1125bd193
I20260617 20:16:46.545436 29198 leader_election.cc:304] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:46.545862 29556 raft_consensus.cc:2749] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:46.546041 29375 ts_tablet_manager.cc:1950] T 46d7fa99c35646c59898738de38c88ed P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:46.546422 29587 raft_consensus.cc:493] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.546593 29587 raft_consensus.cc:515] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.547016 29378 consensus_queue.cc:260] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.547490 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 46d7fa99c35646c59898738de38c88ed (table default.Table_bc9d14d4c6734ab380f6fd753c50567d [id=c654a7154f724dd8ac916d398c662cc9]) successfully deleted
I20260617 20:16:46.548228 29378 ts_tablet_manager.cc:1434] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:16:46.548523 29378 tablet_bootstrap.cc:492] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.550086 29378 tablet_bootstrap.cc:654] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.551390 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet 216f91e7bda148bc9334b19e3c868910 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:46.552116 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_418bd070282540f0b7c6a3e27deff617" } new_table_name: "default.Table_a1d87ddabcbe4a0e85e6587ff00a5b4d" modify_external_catalogs: true
I20260617 20:16:46.552865 29379 tablet_bootstrap.cc:492] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.553007 29379 ts_tablet_manager.cc:1403] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.002s
I20260617 20:16:46.553820 29379 raft_consensus.cc:359] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.553977 29379 raft_consensus.cc:385] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.554046 29379 raft_consensus.cc:740] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.554226 29379 consensus_queue.cc:260] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.554800 29379 ts_tablet_manager.cc:1434] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:46.555035 29379 tablet_bootstrap.cc:492] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.555982 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet e0c44c3fa6f64f929d48de53f2502bfb (table default.Table_648063d260534042bb01e0ae092c195b [id=2dda85266fd14be88479aa0ffec47512]). Expected version 1 got 0
I20260617 20:16:46.556252 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet faa73e73cc9b4fb28cdc87d259f5e7bb (table default.Table_e0e8f7e180d64ca690dfea9446c257a1 [id=6ac70796ad20486d8777f6d8518ee784]). Expected version 1 got 0
I20260617 20:16:46.556515 29379 tablet_bootstrap.cc:654] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.557577 28662 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 55e4ef1f493c4f1289cfa192ce38161d (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]). Expected version 3 got 0
I20260617 20:16:46.558292 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1d839677a1834e13914e3c77a8f38f01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:46.558818 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d839677a1834e13914e3c77a8f38f01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.560644 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 33e4407aa01642ffb03eba1b220afdba (DEFAULT_TABLE table=default.Table_befd7af4f63843d9bf259896e10ce0f5 [id=257569c30deb403b8d3925a0925308be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.561049 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e4407aa01642ffb03eba1b220afdba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.561221 29378 tablet_bootstrap.cc:492] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.561385 29378 ts_tablet_manager.cc:1403] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.002s
I20260617 20:16:46.561625 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 8eee68618cdf462283d7fd9f098c2a0d (DEFAULT_TABLE table=default.Table_d064dca2cbed4024b9214ed6bccc811e [id=b8a30f476ef24c6b8b533d15499492fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.562013 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eee68618cdf462283d7fd9f098c2a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.562129 29378 raft_consensus.cc:359] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.562302 29378 raft_consensus.cc:385] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.562389 29378 raft_consensus.cc:740] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.562592 29378 consensus_queue.cc:260] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.564649 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 1f85271eeb854194a968215ebc08f47a (DEFAULT_TABLE table=default.Table_8278dd326f2d440e9b3823471e55dff7 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.565032 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f85271eeb854194a968215ebc08f47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.565626 29383 tablet_bootstrap.cc:492] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.565678 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 55e4ef1f493c4f1289cfa192ce38161d (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]). Expected version 3 got 0
I20260617 20:16:46.565809 29383 ts_tablet_manager.cc:1403] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.001s
I20260617 20:16:46.566737 29383 raft_consensus.cc:359] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.566931 29383 raft_consensus.cc:385] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.567018 29383 raft_consensus.cc:740] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.567230 29383 consensus_queue.cc:260] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.567261 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8fba56a5136b4fbdadd7d783aaf1e9e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:46.567404 29378 ts_tablet_manager.cc:1434] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 20:16:46.567708 29378 tablet_bootstrap.cc:492] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:46.567773 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fba56a5136b4fbdadd7d783aaf1e9e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.567793 29383 ts_tablet_manager.cc:1434] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:46.568084 29383 tablet_bootstrap.cc:492] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.569909 29383 tablet_bootstrap.cc:654] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.575021 29378 tablet_bootstrap.cc:654] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:46.580289 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 751bffacfaa5427784de63d51fc903dd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 751bffacfaa5427784de63d51fc903dd already in progress: creating tablet
I20260617 20:16:46.580582 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 8eee68618cdf462283d7fd9f098c2a0d (DEFAULT_TABLE table=default.Table_d064dca2cbed4024b9214ed6bccc811e [id=b8a30f476ef24c6b8b533d15499492fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.580966 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eee68618cdf462283d7fd9f098c2a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.581598 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 1f85271eeb854194a968215ebc08f47a (DEFAULT_TABLE table=default.Table_8278dd326f2d440e9b3823471e55dff7 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.581916 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2010232aed489ba61ec1ac423b2f2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.582130 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet f3d06c0618db45689428b0c1125bd193 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.582293 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 46d7fa99c35646c59898738de38c88ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.582485 29376 tablet_replica.cc:333] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:46.582665 29376 raft_consensus.cc:2243] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.582839 29376 raft_consensus.cc:2272] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.583575 29376 ts_tablet_manager.cc:1916] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.586798 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f85271eeb854194a968215ebc08f47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.586917 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 33e4407aa01642ffb03eba1b220afdba (DEFAULT_TABLE table=default.Table_befd7af4f63843d9bf259896e10ce0f5 [id=257569c30deb403b8d3925a0925308be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.587157 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 8eee68618cdf462283d7fd9f098c2a0d (DEFAULT_TABLE table=default.Table_d064dca2cbed4024b9214ed6bccc811e [id=b8a30f476ef24c6b8b533d15499492fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.587445 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e4407aa01642ffb03eba1b220afdba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.587738 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 1f85271eeb854194a968215ebc08f47a (DEFAULT_TABLE table=default.Table_8278dd326f2d440e9b3823471e55dff7 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.588069 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f85271eeb854194a968215ebc08f47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.589648 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 98467525f81f4a48878eae17e3a9c982 (DEFAULT_TABLE table=default.Table_5f1cf137a6c043a9b03d4a334ae42ef8 [id=7be1ef9796444187a095e577b3f29690]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.589998 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98467525f81f4a48878eae17e3a9c982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.593583 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eee68618cdf462283d7fd9f098c2a0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.596748 29378 tablet_bootstrap.cc:492] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.596951 29378 ts_tablet_manager.cc:1403] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.002s
I20260617 20:16:46.597748 29378 raft_consensus.cc:359] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.597949 29378 raft_consensus.cc:385] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.598009 29378 raft_consensus.cc:740] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.598227 29378 consensus_queue.cc:260] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.599339 29376 ts_tablet_manager.cc:1929] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.599472 29376 log.cc:1199] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/4f2010232aed489ba61ec1ac423b2f2d
I20260617 20:16:46.599835 29376 ts_tablet_manager.cc:1950] T 4f2010232aed489ba61ec1ac423b2f2d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:46.600757 29376 tablet_replica.cc:333] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:46.600987 29376 raft_consensus.cc:2243] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.603142 29378 ts_tablet_manager.cc:1434] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 20:16:46.603574 29378 tablet_bootstrap.cc:492] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.605676 29378 tablet_bootstrap.cc:654] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.609357 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 33e4407aa01642ffb03eba1b220afdba (DEFAULT_TABLE table=default.Table_befd7af4f63843d9bf259896e10ce0f5 [id=257569c30deb403b8d3925a0925308be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.611157 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 4f2010232aed489ba61ec1ac423b2f2d (table default.Table_1e265a3fe8e441dda5f94d4199dcfb59 [id=225c167b50aa4f898139245b0935968b]) successfully deleted
I20260617 20:16:46.611690 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e4407aa01642ffb03eba1b220afdba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.616500 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 98467525f81f4a48878eae17e3a9c982 (DEFAULT_TABLE table=default.Table_5f1cf137a6c043a9b03d4a334ae42ef8 [id=7be1ef9796444187a095e577b3f29690]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.616921 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98467525f81f4a48878eae17e3a9c982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.617604 29378 tablet_bootstrap.cc:492] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.617733 29378 ts_tablet_manager.cc:1403] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20260617 20:16:46.618458 29378 raft_consensus.cc:359] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.618628 29378 raft_consensus.cc:385] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.618716 29378 raft_consensus.cc:740] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.621734 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 569e339c17764486a65a1c3b43c92adf (DEFAULT_TABLE table=default.Table_6a12b448d59c405096e0516741c0c32f [id=edd51a8755804964934adedfa19328a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.622054 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 65af976b808d42d4aeded71a00cf7252 (DEFAULT_TABLE table=default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.622275 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569e339c17764486a65a1c3b43c92adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.622282 29378 consensus_queue.cc:260] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.622469 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65af976b808d42d4aeded71a00cf7252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.624245 29378 ts_tablet_manager.cc:1434] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260617 20:16:46.624948 29378 tablet_bootstrap.cc:492] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.621762 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 65af976b808d42d4aeded71a00cf7252 (DEFAULT_TABLE table=default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.625666 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 8e704d08c0da484a986c9d882a42e6f1 (DEFAULT_TABLE table=default.Table_270b09836c954e6c94328615b8059bb0 [id=c1ee5736ea3541af850fd0c99d5fbcfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.625804 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65af976b808d42d4aeded71a00cf7252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.626094 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e704d08c0da484a986c9d882a42e6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.626899 29378 tablet_bootstrap.cc:654] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.629634 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 (DEFAULT_TABLE table=default.Table_baac68c808f240b481611d52f21d428e [id=e6d0b31f8a8c40e8a9c5bf4ee11ea293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.630069 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:46.631557 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 113fbbc739d04f529e82bc1cf1074bd7 consensus state has no leader
I20260617 20:16:46.633615 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet faa73e73cc9b4fb28cdc87d259f5e7bb
I20260617 20:16:46.634477 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet 1d4be33993864c73ba8b4da9468a517b from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:46.637393 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 9b96c186469e4e8a8baa0dcab96d66bf
I20260617 20:16:46.637885 28667 catalog_manager.cc:6784] ReplaceTablet: tablet 9b96c186469e4e8a8baa0dcab96d66bf deleted and replaced by tablet f136e42eb9034a05a5e0c7dc3b3117d7
I20260617 20:16:46.638170 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet 28146a1f84aa41ee88d9aea299256a90 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:46.638341 29587 leader_election.cc:290] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.639168 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4332e33d60964bd6a0c7e7caaa6bdc76
I20260617 20:16:46.639926 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4f9c31d448d24a98a74ff2af7407a2b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:46.640579 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f9c31d448d24a98a74ff2af7407a2b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.645397 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6f68970fea69478eba2df21752f2ea0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:46.646059 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f68970fea69478eba2df21752f2ea0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.649839 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1199d8c7f1dc4b8f99301b8f60c687d1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:46.650139 29128 raft_consensus.cc:2468] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:46.652251 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet 365e0ffb939047898243f72e4053d9a1 with delete_type TABLET_DATA_DELETED (replaced by tablet b162a0ef91d1447b838331ba6ef93bf4) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.652477 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet faa73e73cc9b4fb28cdc87d259f5e7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.652547 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 637b0b3e9cb648deaea6e63760b83255
I20260617 20:16:46.652554 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 808c455e74e645aa8e2b0d08ca81d4f9) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.652760 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b96c186469e4e8a8baa0dcab96d66bf with delete_type TABLET_DATA_DELETED (replaced by tablet f136e42eb9034a05a5e0c7dc3b3117d7) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.652920 29377 tablet_replica.cc:333] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.652976 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.653033 28670 catalog_manager.cc:6784] ReplaceTablet: tablet 637b0b3e9cb648deaea6e63760b83255 deleted and replaced by tablet 8880f8eadaa44887a49adf0ef157965e
I20260617 20:16:46.653187 29377 raft_consensus.cc:2243] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.653216 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet cd312e8817ee4c8fb7377825a7e6122a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.653370 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ef23aa968984448793f5605fea074d86" } modify_external_catalogs: true
I20260617 20:16:46.653463 29377 raft_consensus.cc:2272] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.653559 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet d66923e12e1843bcbcb3da93cf838b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.653554 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ef23aa968984448793f5605fea074d86" } modify_external_catalogs: true
I20260617 20:16:46.653466 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet a79b56241ac84862868c664cca25654b with delete_type TABLET_DATA_DELETED (replaced by tablet 1f85271eeb854194a968215ebc08f47a) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.652781 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 137cbb87d11c450995b63f7a8a7dece5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.654538 29377 ts_tablet_manager.cc:1916] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.654994 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 216f91e7bda148bc9334b19e3c868910
I20260617 20:16:46.655445 28668 catalog_manager.cc:6784] ReplaceTablet: tablet 216f91e7bda148bc9334b19e3c868910 deleted and replaced by tablet b3ea76ad1ec64d22a64bdd4c97e288c6
I20260617 20:16:46.655817 28925 leader_election.cc:304] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:46.655809 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1e538f92939a4b92a73136b53c355327"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:46.659627 29556 raft_consensus.cc:493] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.659816 29556 raft_consensus.cc:515] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.660033 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2f2534b9a19341bdb7f92a6da5470fea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:46.660552 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f2534b9a19341bdb7f92a6da5470fea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.660677 29556 leader_election.cc:290] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.662107 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4ef1f493c4f1289cfa192ce38161d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:46.662241 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 8e704d08c0da484a986c9d882a42e6f1 (DEFAULT_TABLE table=default.Table_270b09836c954e6c94328615b8059bb0 [id=c1ee5736ea3541af850fd0c99d5fbcfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.662359 29128 raft_consensus.cc:2468] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:46.662704 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e704d08c0da484a986c9d882a42e6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.663296 29198 leader_election.cc:304] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:46.663600 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 65af976b808d42d4aeded71a00cf7252 (DEFAULT_TABLE table=default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.663997 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65af976b808d42d4aeded71a00cf7252. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.664136 29391 raft_consensus.cc:2804] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:46.664223 29391 raft_consensus.cc:493] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:46.664322 29391 raft_consensus.cc:3060] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.665395 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 (DEFAULT_TABLE table=default.Table_baac68c808f240b481611d52f21d428e [id=e6d0b31f8a8c40e8a9c5bf4ee11ea293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.665848 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.663301 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1199d8c7f1dc4b8f99301b8f60c687d1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.667758 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 637b0b3e9cb648deaea6e63760b83255 with delete_type TABLET_DATA_DELETED (replaced by tablet 8880f8eadaa44887a49adf0ef157965e) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:46.667963 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e538f92939a4b92a73136b53c355327 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.667991 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 8e704d08c0da484a986c9d882a42e6f1 (DEFAULT_TABLE table=default.Table_270b09836c954e6c94328615b8059bb0 [id=c1ee5736ea3541af850fd0c99d5fbcfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.668371 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e704d08c0da484a986c9d882a42e6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.669358 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4ef1f493c4f1289cfa192ce38161d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:46.669472 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 216f91e7bda148bc9334b19e3c868910 with delete_type TABLET_DATA_DELETED (replaced by tablet b3ea76ad1ec64d22a64bdd4c97e288c6) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.669577 28989 raft_consensus.cc:2468] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:46.670444 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2c4e735917a64110bf5ad7e1cbda2fcd" } new_table_name: "default.Table_505122dc15184b1ebf4723f9624205c6" modify_external_catalogs: true
I20260617 20:16:46.676043 29377 ts_tablet_manager.cc:1929] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.679380 29377 log.cc:1199] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/365e0ffb939047898243f72e4053d9a1
I20260617 20:16:46.679898 29377 ts_tablet_manager.cc:1950] T 365e0ffb939047898243f72e4053d9a1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:46.681205 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 365e0ffb939047898243f72e4053d9a1 (table default.Table_0cc10f7657a2450294f6ce1e33fb609e [id=fa80809528dd419192774bcc7ac5f5bf]) successfully deleted
I20260617 20:16:46.681715 29377 tablet_replica.cc:333] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.682056 29377 raft_consensus.cc:2243] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.682343 29377 raft_consensus.cc:2272] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.682529 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 569e339c17764486a65a1c3b43c92adf (DEFAULT_TABLE table=default.Table_6a12b448d59c405096e0516741c0c32f [id=edd51a8755804964934adedfa19328a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.682976 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569e339c17764486a65a1c3b43c92adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.687706 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3b67b915758d4ab0a8faa0227de08593
I20260617 20:16:46.688951 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b67b915758d4ab0a8faa0227de08593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.691038 29377 ts_tablet_manager.cc:1916] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:46.693712 28925 leader_election.cc:343] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.696141 28661 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 55e4ef1f493c4f1289cfa192ce38161d (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]). Expected version 3 got 0
I20260617 20:16:46.697049 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b89b44c6cb2c41409a15708feec0c29b
I20260617 20:16:46.697433 29587 raft_consensus.cc:2804] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:46.697646 29587 raft_consensus.cc:493] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:46.697845 29587 raft_consensus.cc:3060] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.698001 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet b89b44c6cb2c41409a15708feec0c29b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:46.700634 29587 raft_consensus.cc:515] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.701578 29391 raft_consensus.cc:515] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.701818 28639 master_runner.cc:187] Error getting master registration for 127.27.245.252:46059: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111),
I20260617 20:16:46.702004 28639 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260617 20:16:46.702553 29391 leader_election.cc:290] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.703316 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1199d8c7f1dc4b8f99301b8f60c687d1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:46.703545 29127 raft_consensus.cc:3060] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.705952 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4ef1f493c4f1289cfa192ce38161d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:46.706187 29128 raft_consensus.cc:3060] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.709085 29128 raft_consensus.cc:2468] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:46.709637 29198 leader_election.cc:304] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:46.710860 29377 ts_tablet_manager.cc:1929] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.715471 29127 raft_consensus.cc:2468] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:46.716239 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1199d8c7f1dc4b8f99301b8f60c687d1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:46.716888 29391 raft_consensus.cc:2804] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:46.717722 29391 raft_consensus.cc:697] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:46.718400 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b96c186469e4e8a8baa0dcab96d66bf with delete_type TABLET_DATA_DELETED (replaced by tablet f136e42eb9034a05a5e0c7dc3b3117d7) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.718468 29391 consensus_queue.cc:237] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.719521 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.720331 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b96c186469e4e8a8baa0dcab96d66bf with delete_type TABLET_DATA_DELETED (replaced by tablet f136e42eb9034a05a5e0c7dc3b3117d7) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.721200 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 637b0b3e9cb648deaea6e63760b83255 with delete_type TABLET_DATA_DELETED (replaced by tablet 8880f8eadaa44887a49adf0ef157965e) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.721500 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet faa73e73cc9b4fb28cdc87d259f5e7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.721787 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 637b0b3e9cb648deaea6e63760b83255 with delete_type TABLET_DATA_DELETED (replaced by tablet 8880f8eadaa44887a49adf0ef157965e) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.713932 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4ef1f493c4f1289cfa192ce38161d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:46.722723 29377 log.cc:1199] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/faa73e73cc9b4fb28cdc87d259f5e7bb
I20260617 20:16:46.722952 28990 raft_consensus.cc:3060] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.716228 28925 leader_election.cc:304] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:46.723242 29377 ts_tablet_manager.cc:1950] T faa73e73cc9b4fb28cdc87d259f5e7bb P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:46.723413 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet faa73e73cc9b4fb28cdc87d259f5e7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:46.723378 28925 leader_election.cc:343] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.723750 29377 tablet_replica.cc:333] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.723976 29377 raft_consensus.cc:2243] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.723940 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet faa73e73cc9b4fb28cdc87d259f5e7bb (table default.Table_e0e8f7e180d64ca690dfea9446c257a1 [id=6ac70796ad20486d8777f6d8518ee784]) successfully deleted
I20260617 20:16:46.724148 29377 raft_consensus.cc:2272] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.724244 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.725168 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 (DEFAULT_TABLE table=default.Table_baac68c808f240b481611d52f21d428e [id=e6d0b31f8a8c40e8a9c5bf4ee11ea293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.725618 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.727142 28990 raft_consensus.cc:2468] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:46.727718 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 98467525f81f4a48878eae17e3a9c982 (DEFAULT_TABLE table=default.Table_5f1cf137a6c043a9b03d4a334ae42ef8 [id=7be1ef9796444187a095e577b3f29690]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.727795 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 216f91e7bda148bc9334b19e3c868910 with delete_type TABLET_DATA_DELETED (replaced by tablet b3ea76ad1ec64d22a64bdd4c97e288c6) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.728157 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98467525f81f4a48878eae17e3a9c982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.728124 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 216f91e7bda148bc9334b19e3c868910 with delete_type TABLET_DATA_DELETED (replaced by tablet b3ea76ad1ec64d22a64bdd4c97e288c6) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.732105 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b67b915758d4ab0a8faa0227de08593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.732719 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 569e339c17764486a65a1c3b43c92adf (DEFAULT_TABLE table=default.Table_6a12b448d59c405096e0516741c0c32f [id=edd51a8755804964934adedfa19328a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.733233 29587 leader_election.cc:290] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.734431 29377 ts_tablet_manager.cc:1916] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.735648 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 569e339c17764486a65a1c3b43c92adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.743782 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet d723526a83174898a71a835b7cdbc467 with delete_type TABLET_DATA_DELETED (replaced by tablet 7a81a3502f5d4602b65328577a668d62) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.743810 29377 ts_tablet_manager.cc:1929] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.743858 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet f74494a3230448c983d8af0e553247bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.743963 29377 log.cc:1199] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/1199d8c7f1dc4b8f99301b8f60c687d1
I20260617 20:16:46.732861 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b67b915758d4ab0a8faa0227de08593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.744086 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f2ec59ac5864da5a13965ca0724c387 with delete_type TABLET_DATA_DELETED (replaced by tablet d9b7880a039a497fbd0fb5d4f74e7d23) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.735025 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet b89b44c6cb2c41409a15708feec0c29b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:46.744352 29377 ts_tablet_manager.cc:1950] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:46.746469 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet b89b44c6cb2c41409a15708feec0c29b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.746743 29375 tablet_replica.cc:333] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:46.747684 29375 raft_consensus.cc:2243] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.748044 29375 raft_consensus.cc:2272] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.601147 29376 raft_consensus.cc:2272] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.749109 29375 ts_tablet_manager.cc:1916] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:46.749773 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 9b96c186469e4e8a8baa0dcab96d66bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b96c186469e4e8a8baa0dcab96d66bf already in progress: creating tablet
W20260617 20:16:46.750051 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4332e33d60964bd6a0c7e7caaa6bdc76 already in progress: creating tablet
I20260617 20:16:46.750721 29376 ts_tablet_manager.cc:1916] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.756043 29375 ts_tablet_manager.cc:1929] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:16:46.758656 29375 log.cc:1199] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/b89b44c6cb2c41409a15708feec0c29b
I20260617 20:16:46.759192 29375 ts_tablet_manager.cc:1950] T b89b44c6cb2c41409a15708feec0c29b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:16:46.759449 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 637b0b3e9cb648deaea6e63760b83255 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 637b0b3e9cb648deaea6e63760b83255 already in progress: creating tablet
W20260617 20:16:46.759749 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet faa73e73cc9b4fb28cdc87d259f5e7bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet faa73e73cc9b4fb28cdc87d259f5e7bb already in progress: creating tablet
W20260617 20:16:46.760015 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 216f91e7bda148bc9334b19e3c868910 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 216f91e7bda148bc9334b19e3c868910 already in progress: creating tablet
W20260617 20:16:46.760229 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3b67b915758d4ab0a8faa0227de08593 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b67b915758d4ab0a8faa0227de08593 already in progress: creating tablet
I20260617 20:16:46.767810 29376 ts_tablet_manager.cc:1929] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.768072 28707 master_runner.cc:187] Error getting master registration for 127.27.245.252:46059: Network error: Client connection negotiation failed: client connection to 127.27.245.252:46059: connect: Connection refused (error 111),
I20260617 20:16:46.774528 28707 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260617 20:16:46.774835 29609 tablet.cc:1724] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:46.776423 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet f74494a3230448c983d8af0e553247bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.776660 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet a79b56241ac84862868c664cca25654b with delete_type TABLET_DATA_DELETED (replaced by tablet 1f85271eeb854194a968215ebc08f47a) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.777148 29375 tablet_replica.cc:333] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:46.777355 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 1199d8c7f1dc4b8f99301b8f60c687d1 (table default.Table_0ba339c37163434e8c628ef515624fe1 [id=8696ed2b09fd4e06a0f2746537370766]) successfully deleted
I20260617 20:16:46.777452 29375 raft_consensus.cc:2243] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.777490 29377 tablet_replica.cc:333] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.777652 29375 raft_consensus.cc:2272] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.777679 29377 raft_consensus.cc:2243] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 20:16:46.778033 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 9b96c186469e4e8a8baa0dcab96d66bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b96c186469e4e8a8baa0dcab96d66bf already in progress: creating tablet
W20260617 20:16:46.778236 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4332e33d60964bd6a0c7e7caaa6bdc76 already in progress: creating tablet
I20260617 20:16:46.778478 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 137cbb87d11c450995b63f7a8a7dece5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.778609 29375 ts_tablet_manager.cc:1916] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.781747 29377 raft_consensus.cc:2272] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.782557 29376 log.cc:1199] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/f3d06c0618db45689428b0c1125bd193
I20260617 20:16:46.783408 29377 ts_tablet_manager.cc:1916] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.784363 29376 ts_tablet_manager.cc:1950] T f3d06c0618db45689428b0c1125bd193 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:46.784706 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet b89b44c6cb2c41409a15708feec0c29b (table default.Table_675165a5585146af86731c73080a0f3f [id=8272ea6276314a28bca235431f8f3986]) successfully deleted
I20260617 20:16:46.785439 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 808c455e74e645aa8e2b0d08ca81d4f9) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.785543 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f2ec59ac5864da5a13965ca0724c387 with delete_type TABLET_DATA_DELETED (replaced by tablet d9b7880a039a497fbd0fb5d4f74e7d23) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.788786 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet cd312e8817ee4c8fb7377825a7e6122a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.789803 29383 tablet_bootstrap.cc:492] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.790032 29383 ts_tablet_manager.cc:1403] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.222s user 0.022s sys 0.030s
I20260617 20:16:46.790916 29383 raft_consensus.cc:359] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.791231 29383 raft_consensus.cc:385] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.791369 29383 raft_consensus.cc:740] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.791666 29383 consensus_queue.cc:260] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.792385 29383 ts_tablet_manager.cc:1434] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:46.792496 29587 raft_consensus.cc:493] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.792761 29383 tablet_bootstrap.cc:492] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.793206 29556 raft_consensus.cc:493] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.793391 29556 raft_consensus.cc:515] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.794137 29556 leader_election.cc:290] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.795276 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74494a3230448c983d8af0e553247bf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:46.795596 29127 raft_consensus.cc:2468] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:46.796511 29198 leader_election.cc:304] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:46.796798 29556 raft_consensus.cc:2804] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:46.796933 29556 raft_consensus.cc:493] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:46.797042 29556 raft_consensus.cc:3060] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.797325 29587 raft_consensus.cc:515] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.798636 29587 leader_election.cc:290] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:46.798810 29378 tablet_bootstrap.cc:492] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.798811 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81a3502f5d4602b65328577a668d62" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.799000 29378 ts_tablet_manager.cc:1403] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.174s user 0.021s sys 0.021s
W20260617 20:16:46.799288 28925 leader_election.cc:343] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.799750 29378 raft_consensus.cc:359] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.800010 29378 raft_consensus.cc:385] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.800110 29378 raft_consensus.cc:740] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.800184 29383 tablet_bootstrap.cc:654] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.800388 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81a3502f5d4602b65328577a668d62" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:46.801102 28925 leader_election.cc:343] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.801239 28925 leader_election.cc:304] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.801728 29587 raft_consensus.cc:2749] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:46.802165 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d064dca2cbed4024b9214ed6bccc811e" } modify_external_catalogs: true
I20260617 20:16:46.802358 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d064dca2cbed4024b9214ed6bccc811e" } modify_external_catalogs: true
I20260617 20:16:46.802850 29375 ts_tablet_manager.cc:1929] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.802932 29556 raft_consensus.cc:515] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.802934 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0181eddc78fc4d47b1b0bbd67645ad04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:46.803074 29375 log.cc:1199] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/a79b56241ac84862868c664cca25654b
W20260617 20:16:46.803527 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0181eddc78fc4d47b1b0bbd67645ad04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.803639 29556 leader_election.cc:290] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.803679 29375 ts_tablet_manager.cc:1950] T a79b56241ac84862868c664cca25654b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:46.804250 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74494a3230448c983d8af0e553247bf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:46.804455 29127 raft_consensus.cc:3060] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.804653 29376 tablet_replica.cc:333] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:46.804862 29376 raft_consensus.cc:2243] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.805025 29376 raft_consensus.cc:2272] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.805352 29378 consensus_queue.cc:260] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.805661 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_98b224ec50f84ea494d5b70aeaa1f728"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:46.805866 29375 tablet_replica.cc:333] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:46.805935 29378 ts_tablet_manager.cc:1434] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
W20260617 20:16:46.806180 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98b224ec50f84ea494d5b70aeaa1f728 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.807911 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b50a2ea6dd054c8282ce507b0c871fb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:46.808246 29127 raft_consensus.cc:2468] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:16:46.808447 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b50a2ea6dd054c8282ce507b0c871fb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.808703 29198 leader_election.cc:304] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:46.809021 29556 raft_consensus.cc:2804] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:46.809078 29375 raft_consensus.cc:2243] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.809173 29556 raft_consensus.cc:697] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:46.809496 29556 consensus_queue.cc:237] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.809957 29375 raft_consensus.cc:2272] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.810389 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ae890a73f30b42e7979e4fb37ce8a1c0" } new_table_name: "default.Table_8b66113312ca4c2297d9b65f8c6dcf6c" modify_external_catalogs: true
I20260617 20:16:46.810668 29376 ts_tablet_manager.cc:1916] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.811367 29375 ts_tablet_manager.cc:1916] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.811743 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1adceba2479a4de983fda635f00aea06" } new_table_name: "default.Table_70b590da38ef4a27ae05d708c04f63b4" modify_external_catalogs: true
I20260617 20:16:46.813045 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a8bc5ca66b28452db1f7123e096f7379" } new_table_name: "default.Table_b8d39f0ee1bc44e6be713e55e522b9f3" modify_external_catalogs: true
W20260617 20:16:46.814394 29197 leader_election.cc:343] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f74494a3230448c983d8af0e553247bf
I20260617 20:16:46.814867 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet a79b56241ac84862868c664cca25654b (table default.Table_8278dd326f2d440e9b3823471e55dff7 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]) successfully deleted
I20260617 20:16:46.815189 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet f3d06c0618db45689428b0c1125bd193 (table default.Table_315b909d8d1c411f89063fecb8be5b84 [id=aca59faae56b44f5ae502160c7b43e4b]) successfully deleted
I20260617 20:16:46.815315 29378 tablet_bootstrap.cc:492] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.822412 29376 ts_tablet_manager.cc:1929] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.822729 29376 log.cc:1199] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/46d7fa99c35646c59898738de38c88ed
I20260617 20:16:46.823518 29378 tablet_bootstrap.cc:654] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.824198 29376 ts_tablet_manager.cc:1950] T 46d7fa99c35646c59898738de38c88ed P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:46.825970 29377 ts_tablet_manager.cc:1929] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.826084 29377 log.cc:1199] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/cd312e8817ee4c8fb7377825a7e6122a
I20260617 20:16:46.826218 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 46d7fa99c35646c59898738de38c88ed (table default.Table_bc9d14d4c6734ab380f6fd753c50567d [id=c654a7154f724dd8ac916d398c662cc9]) successfully deleted
I20260617 20:16:46.826409 29377 ts_tablet_manager.cc:1950] T cd312e8817ee4c8fb7377825a7e6122a P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:16:46.827329 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 9b96c186469e4e8a8baa0dcab96d66bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b96c186469e4e8a8baa0dcab96d66bf already in progress: creating tablet
W20260617 20:16:46.828380 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 637b0b3e9cb648deaea6e63760b83255 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 637b0b3e9cb648deaea6e63760b83255 already in progress: creating tablet
I20260617 20:16:46.828878 29379 tablet_bootstrap.cc:492] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.829071 29379 ts_tablet_manager.cc:1403] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.274s user 0.007s sys 0.060s
W20260617 20:16:46.829591 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet faa73e73cc9b4fb28cdc87d259f5e7bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet faa73e73cc9b4fb28cdc87d259f5e7bb already in progress: creating tablet
I20260617 20:16:46.829643 29375 ts_tablet_manager.cc:1929] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.829816 29375 log.cc:1199] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/f74494a3230448c983d8af0e553247bf
I20260617 20:16:46.829975 29379 raft_consensus.cc:359] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.830195 29379 raft_consensus.cc:385] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.830246 29375 ts_tablet_manager.cc:1950] T f74494a3230448c983d8af0e553247bf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:46.830288 29379 raft_consensus.cc:740] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.830633 29379 consensus_queue.cc:260] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.831171 29375 tablet_replica.cc:333] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:46.831269 29379 ts_tablet_manager.cc:1434] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260617 20:16:46.831343 29375 raft_consensus.cc:2243] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.831516 29375 raft_consensus.cc:2272] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.831718 29383 tablet_bootstrap.cc:492] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.831856 29383 ts_tablet_manager.cc:1403] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.004s
I20260617 20:16:46.831872 29587 raft_consensus.cc:493] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.832010 29375 ts_tablet_manager.cc:1916] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.832016 29587 raft_consensus.cc:515] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.832619 29383 raft_consensus.cc:359] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.832707 29587 leader_election.cc:290] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:46.832785 29383 raft_consensus.cc:385] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.832882 29383 raft_consensus.cc:740] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.833138 29383 consensus_queue.cc:260] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.833746 29383 ts_tablet_manager.cc:1434] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:46.833879 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f16ff3bc57434592d1648c4944c157" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.834110 29383 tablet_bootstrap.cc:492] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:46.834270 29197 leader_election.cc:343] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f74494a3230448c983d8af0e553247bf
W20260617 20:16:46.834698 28925 leader_election.cc:343] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:46.830880 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4332e33d60964bd6a0c7e7caaa6bdc76 already in progress: creating tablet
I20260617 20:16:46.835356 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet f74494a3230448c983d8af0e553247bf (table default.Table_a96bacccf2874d2ea84a7c20f9892640 [id=f447de1e65a64027ae9c8983d72195e0]) successfully deleted
I20260617 20:16:46.838945 29383 tablet_bootstrap.cc:654] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:46.843766 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1fa15915b0ec44ff8b66920e4c207536 has no consensus state
I20260617 20:16:46.847226 29383 tablet_bootstrap.cc:492] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.847409 29383 ts_tablet_manager.cc:1403] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s
I20260617 20:16:46.848151 29383 raft_consensus.cc:359] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.848347 29383 raft_consensus.cc:385] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.848431 29383 raft_consensus.cc:740] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.848675 29383 consensus_queue.cc:260] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.849388 29383 ts_tablet_manager.cc:1434] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:46.849514 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_193918a467ca4fb4852f3e3f90ab8f84"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:46.850127 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_193918a467ca4fb4852f3e3f90ab8f84 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.850667 29383 tablet_bootstrap.cc:492] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.852627 29376 tablet_replica.cc:333] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:46.852633 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet d66923e12e1843bcbcb3da93cf838b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.852804 29383 tablet_bootstrap.cc:654] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.852914 29376 raft_consensus.cc:2243] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 20:16:46.853135 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 216f91e7bda148bc9334b19e3c868910 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 216f91e7bda148bc9334b19e3c868910 already in progress: creating tablet
I20260617 20:16:46.857671 29376 raft_consensus.cc:2272] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.858846 29376 ts_tablet_manager.cc:1916] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.859050 29587 raft_consensus.cc:493] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.859236 29587 raft_consensus.cc:515] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.859963 29587 leader_election.cc:290] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:46.860863 29383 tablet_bootstrap.cc:492] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.860903 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15392db137446b2bd84cf9f31337718" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:46.861006 29383 ts_tablet_manager.cc:1403] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
W20260617 20:16:46.861572 28925 leader_election.cc:343] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.861873 29383 raft_consensus.cc:359] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.862037 29383 raft_consensus.cc:385] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.862112 29383 raft_consensus.cc:740] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.862077 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15392db137446b2bd84cf9f31337718" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:46.862322 29383 consensus_queue.cc:260] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.862077 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f16ff3bc57434592d1648c4944c157" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:46.862701 28925 leader_election.cc:343] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.862839 28925 leader_election.cc:304] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.863624 29587 raft_consensus.cc:2749] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:46.864105 28925 leader_election.cc:343] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:46.864239 28925 leader_election.cc:304] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:46.864673 29556 raft_consensus.cc:493] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:46.864825 29556 raft_consensus.cc:515] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.865015 29375 ts_tablet_manager.cc:1929] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.865136 29375 log.cc:1199] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/137cbb87d11c450995b63f7a8a7dece5
I20260617 20:16:46.865458 29556 leader_election.cc:290] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.865541 29375 ts_tablet_manager.cc:1950] T 137cbb87d11c450995b63f7a8a7dece5 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:46.866418 29375 tablet_replica.cc:333] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:46.866616 29375 raft_consensus.cc:2243] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.866618 29587 raft_consensus.cc:2749] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:46.866758 29375 raft_consensus.cc:2272] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.867107 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 137cbb87d11c450995b63f7a8a7dece5 (table default.Table_81c4de22d335419abd4b3910e9025510 [id=0466c781ca0e4145b9f25b606c0edc5d]) successfully deleted
I20260617 20:16:46.868350 29377 tablet_replica.cc:333] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.868539 29377 raft_consensus.cc:2243] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.868678 29377 raft_consensus.cc:2272] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.868371 29379 tablet_bootstrap.cc:492] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.869174 29377 ts_tablet_manager.cc:1916] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.872943 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f2ec59ac5864da5a13965ca0724c387" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:46.873083 29383 ts_tablet_manager.cc:1434] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260617 20:16:46.873570 29383 tablet_bootstrap.cc:492] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.873713 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet cd312e8817ee4c8fb7377825a7e6122a (table default.Table_3074bd171fd54a10948acd223e1c6da7 [id=1d46529c95a44c2c91c54e5b16a5f7ed]) successfully deleted
I20260617 20:16:46.873139 29127 raft_consensus.cc:2468] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:46.874701 29198 leader_election.cc:304] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:46.875109 29556 raft_consensus.cc:2804] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:46.875203 29556 raft_consensus.cc:493] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:46.875322 29556 raft_consensus.cc:3060] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.876185 29377 ts_tablet_manager.cc:1929] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.876313 29377 log.cc:1199] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/d66923e12e1843bcbcb3da93cf838b65
I20260617 20:16:46.876693 29377 ts_tablet_manager.cc:1950] T d66923e12e1843bcbcb3da93cf838b65 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:46.877629 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet d66923e12e1843bcbcb3da93cf838b65 (table default.Table_6e5629496f81401d8671eaa061393d1f [id=b2d788fe99dd43689f8fa1f9fcea06a5]) successfully deleted
I20260617 20:16:46.879303 29556 raft_consensus.cc:515] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
W20260617 20:16:46.881351 29197 leader_election.cc:343] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 5f2ec59ac5864da5a13965ca0724c387
I20260617 20:16:46.881655 29556 leader_election.cc:290] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:46.879765 29383 tablet_bootstrap.cc:654] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.883024 29609 tablet.cc:1719] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: Skipping requested alter to schema version 2, tablet already version 2
I20260617 20:16:46.883285 29379 tablet_bootstrap.cc:654] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.883487 29375 ts_tablet_manager.cc:1916] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.883996 29377 tablet_replica.cc:333] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.884102 29378 tablet_bootstrap.cc:492] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.885429 29378 ts_tablet_manager.cc:1403] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.013s
I20260617 20:16:46.885725 29377 raft_consensus.cc:2243] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.885947 29377 raft_consensus.cc:2272] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.886489 29378 raft_consensus.cc:359] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:46.886634 29197 leader_election.cc:343] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 5f2ec59ac5864da5a13965ca0724c387
I20260617 20:16:46.886732 29378 raft_consensus.cc:385] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.886945 29378 raft_consensus.cc:740] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.887253 29378 consensus_queue.cc:260] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.888787 29378 ts_tablet_manager.cc:1434] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:16:46.889163 29378 tablet_bootstrap.cc:492] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.890208 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f2ec59ac5864da5a13965ca0724c387" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:46.890419 29127 raft_consensus.cc:3060] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:46.890559 29377 ts_tablet_manager.cc:1916] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.892166 29376 ts_tablet_manager.cc:1929] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.893955 29378 tablet_bootstrap.cc:654] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.894934 29376 log.cc:1199] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/d723526a83174898a71a835b7cdbc467
I20260617 20:16:46.897694 29127 raft_consensus.cc:2468] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:46.896142 29376 ts_tablet_manager.cc:1950] T d723526a83174898a71a835b7cdbc467 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:46.898944 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet d723526a83174898a71a835b7cdbc467 (table default.Table_71003cb25e6e4229aba21f7dd04b7fe4 [id=da4afdf3f60e48e78eb52d454fa4142c]) successfully deleted
I20260617 20:16:46.901180 29378 tablet_bootstrap.cc:492] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:46.901500 29376 tablet_replica.cc:333] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:46.903087 29383 tablet_bootstrap.cc:492] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:46.903326 29383 ts_tablet_manager.cc:1403] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.002s
I20260617 20:16:46.904182 29383 raft_consensus.cc:359] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.904546 29383 raft_consensus.cc:385] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.904681 29383 raft_consensus.cc:740] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.904783 29375 ts_tablet_manager.cc:1929] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.904768 29198 leader_election.cc:304] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:46.904994 29383 consensus_queue.cc:260] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.905341 29391 raft_consensus.cc:2804] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:46.905476 29391 raft_consensus.cc:697] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:46.905515 29375 log.cc:1199] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/1199d8c7f1dc4b8f99301b8f60c687d1
I20260617 20:16:46.905704 29391 consensus_queue.cc:237] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.905893 29375 ts_tablet_manager.cc:1950] T 1199d8c7f1dc4b8f99301b8f60c687d1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:16:46.906064 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d0c245563fe44b59d32616bd35d3dae has no consensus state
I20260617 20:16:46.907395 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5f983e7235224256bae836edd0ffbc09" } new_table_name: "default.Table_e45ba70d8b294bf99ddca3f80857df76" modify_external_catalogs: true
I20260617 20:16:46.908221 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 1199d8c7f1dc4b8f99301b8f60c687d1 (table default.Table_0ba339c37163434e8c628ef515624fe1 [id=8696ed2b09fd4e06a0f2746537370766]) successfully deleted
I20260617 20:16:46.909085 29375 tablet_replica.cc:333] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:46.909523 29375 raft_consensus.cc:2243] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:46.909994 29375 raft_consensus.cc:2272] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.911211 29383 ts_tablet_manager.cc:1434] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 20:16:46.911546 29383 tablet_bootstrap.cc:492] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:46.912075 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1d8cf3e5102141cc9d4f9c93d77d385e" } modify_external_catalogs: true
I20260617 20:16:46.912276 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1d8cf3e5102141cc9d4f9c93d77d385e" } modify_external_catalogs: true
I20260617 20:16:46.912545 29379 tablet_bootstrap.cc:492] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.912676 29379 ts_tablet_manager.cc:1403] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.000s
I20260617 20:16:46.913496 29379 raft_consensus.cc:359] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.913678 29379 raft_consensus.cc:385] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.913782 29379 raft_consensus.cc:740] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.914093 29379 consensus_queue.cc:260] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:46.916394 29383 tablet_bootstrap.cc:654] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.919900 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 365e0ffb939047898243f72e4053d9a1 with delete_type TABLET_DATA_DELETED (replaced by tablet b162a0ef91d1447b838331ba6ef93bf4) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:46.921813 29376 raft_consensus.cc:2243] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
W20260617 20:16:46.922396 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08911643f3ca451d80e2471b1b5b2342 has no consensus state
I20260617 20:16:46.922871 29378 ts_tablet_manager.cc:1403] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20260617 20:16:46.923749 29378 raft_consensus.cc:359] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.923986 29378 raft_consensus.cc:385] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.924072 29378 raft_consensus.cc:740] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.924316 29378 consensus_queue.cc:260] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:46.925343 29376 pending_rounds.cc:70] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:46.925550 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e07e30476d764b83aabfde1a21b2d5a6" } modify_external_catalogs: true
I20260617 20:16:46.925577 29376 pending_rounds.cc:77] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955458294681600 op_type: NO_OP noop_request { }
I20260617 20:16:46.925711 29376 raft_consensus.cc:2889] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:46.925719 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e07e30476d764b83aabfde1a21b2d5a6" } modify_external_catalogs: true
I20260617 20:16:46.925822 29376 raft_consensus.cc:2272] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.926069 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_192e626b5490454ba063186aa68e2157"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:46.926635 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_192e626b5490454ba063186aa68e2157 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.928537 29379 ts_tablet_manager.cc:1434] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260617 20:16:46.934417 29378 ts_tablet_manager.cc:1434] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260617 20:16:46.936313 29378 tablet_bootstrap.cc:492] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:46.937767 29379 tablet_bootstrap.cc:492] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.940783 29378 tablet_bootstrap.cc:654] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.941768 29379 tablet_bootstrap.cc:654] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.943603 29375 ts_tablet_manager.cc:1916] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.944840 29379 tablet_bootstrap.cc:492] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:46.945087 29379 ts_tablet_manager.cc:1403] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260617 20:16:46.946292 29379 raft_consensus.cc:359] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.946689 29379 raft_consensus.cc:385] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:46.946967 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_34162dc1609a4227bb4824e0674ecf7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:46.947631 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34162dc1609a4227bb4824e0674ecf7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:46.949190 29379 raft_consensus.cc:740] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:46.949517 29379 consensus_queue.cc:260] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:46.950574 29379 ts_tablet_manager.cc:1434] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:16:46.950948 29379 tablet_bootstrap.cc:492] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:46.952014 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 57e19abe093a40f6886908a8a3a0cad4 (DEFAULT_TABLE table=default.Table_bf43c1c307304b35a6b33eb8fb011be2 [id=c36f4aec7e564c10b3782a48ecdafef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.952461 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e19abe093a40f6886908a8a3a0cad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.952610 28670 catalog_manager.cc:5696] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:46.953024 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 55e4ef1f493c4f1289cfa192ce38161d (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]). Expected version 3 got 0
I20260617 20:16:46.954985 29379 tablet_bootstrap.cc:654] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:46.920384 29377 ts_tablet_manager.cc:1929] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.955555 29377 log.cc:1199] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/a79b56241ac84862868c664cca25654b
I20260617 20:16:46.955965 29377 ts_tablet_manager.cc:1950] T a79b56241ac84862868c664cca25654b P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:46.957147 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet a79b56241ac84862868c664cca25654b (table default.Table_8278dd326f2d440e9b3823471e55dff7 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]) successfully deleted
I20260617 20:16:46.957254 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 57e19abe093a40f6886908a8a3a0cad4 (DEFAULT_TABLE table=default.Table_bf43c1c307304b35a6b33eb8fb011be2 [id=c36f4aec7e564c10b3782a48ecdafef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.957617 29377 tablet_replica.cc:333] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:46.957690 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e19abe093a40f6886908a8a3a0cad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.957834 29377 raft_consensus.cc:2243] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:46.958242 29377 pending_rounds.cc:70] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: Trying to abort 1 pending ops.
I20260617 20:16:46.958423 29377 pending_rounds.cc:77] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955457149194240 op_type: NO_OP noop_request { }
I20260617 20:16:46.958555 29377 raft_consensus.cc:2889] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:46.958671 29377 raft_consensus.cc:2272] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.960553 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 5b65814c56424256b53d3c9f94c1b74a (DEFAULT_TABLE table=default.Table_a445cef5739e4885982b17bdd98216da [id=cb0d51091f8245b9b5a1468752343edc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.960590 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 5b65814c56424256b53d3c9f94c1b74a (DEFAULT_TABLE table=default.Table_a445cef5739e4885982b17bdd98216da [id=cb0d51091f8245b9b5a1468752343edc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.960937 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b65814c56424256b53d3c9f94c1b74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.960948 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b65814c56424256b53d3c9f94c1b74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.961510 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 (DEFAULT_TABLE table=default.Table_132f26049e6b4fea9ea1c5a5f5525931 [id=8b2c257acdb0498f8c9c4e8e44535f31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.961638 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 (DEFAULT_TABLE table=default.Table_132f26049e6b4fea9ea1c5a5f5525931 [id=8b2c257acdb0498f8c9c4e8e44535f31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.961859 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.961989 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.965665 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 5b65814c56424256b53d3c9f94c1b74a (DEFAULT_TABLE table=default.Table_a445cef5739e4885982b17bdd98216da [id=cb0d51091f8245b9b5a1468752343edc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.965842 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 (DEFAULT_TABLE table=default.Table_132f26049e6b4fea9ea1c5a5f5525931 [id=8b2c257acdb0498f8c9c4e8e44535f31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.966063 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b65814c56424256b53d3c9f94c1b74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.966209 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.966288 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 57e19abe093a40f6886908a8a3a0cad4 (DEFAULT_TABLE table=default.Table_bf43c1c307304b35a6b33eb8fb011be2 [id=c36f4aec7e564c10b3782a48ecdafef7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.966658 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e19abe093a40f6886908a8a3a0cad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.972301 29375 ts_tablet_manager.cc:1929] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:46.972465 29375 log.cc:1199] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/5f2ec59ac5864da5a13965ca0724c387
I20260617 20:16:46.973327 29375 ts_tablet_manager.cc:1950] T 5f2ec59ac5864da5a13965ca0724c387 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:46.974253 29375 tablet_replica.cc:333] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:46.974368 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa15915b0ec44ff8b66920e4c207536 (DEFAULT_TABLE table=default.Table_505122dc15184b1ebf4723f9624205c6 [id=d037cdc970c044ec92ca7b0b46be209f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.974468 29375 raft_consensus.cc:2243] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:46.974709 29375 pending_rounds.cc:70] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:46.974787 29375 pending_rounds.cc:77] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955457196707840 op_type: NO_OP noop_request { }
I20260617 20:16:46.974860 29377 ts_tablet_manager.cc:1916] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:46.974902 29375 raft_consensus.cc:2889] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:46.975023 29375 raft_consensus.cc:2272] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:46.975699 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 5f2ec59ac5864da5a13965ca0724c387 (table default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]) successfully deleted
I20260617 20:16:46.975781 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa15915b0ec44ff8b66920e4c207536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.977654 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa15915b0ec44ff8b66920e4c207536 (DEFAULT_TABLE table=default.Table_505122dc15184b1ebf4723f9624205c6 [id=d037cdc970c044ec92ca7b0b46be209f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.977887 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 1fa15915b0ec44ff8b66920e4c207536 (DEFAULT_TABLE table=default.Table_505122dc15184b1ebf4723f9624205c6 [id=d037cdc970c044ec92ca7b0b46be209f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.978087 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa15915b0ec44ff8b66920e4c207536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.978240 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa15915b0ec44ff8b66920e4c207536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.987834 29106 tablet_service.cc:1511] Processing CreateTablet for tablet dcd999d88d954e50810cc01b297a27a9 (DEFAULT_TABLE table=default.Table_21d9cb8cc88843d286f599edcee65360 [id=f373633ff0ce4822b7884195b431df9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.988421 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd999d88d954e50810cc01b297a27a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.994834 29225 tablet_service.cc:1511] Processing CreateTablet for tablet dcd999d88d954e50810cc01b297a27a9 (DEFAULT_TABLE table=default.Table_21d9cb8cc88843d286f599edcee65360 [id=f373633ff0ce4822b7884195b431df9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.995440 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd999d88d954e50810cc01b297a27a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.995249 28954 tablet_service.cc:1511] Processing CreateTablet for tablet dcd999d88d954e50810cc01b297a27a9 (DEFAULT_TABLE table=default.Table_21d9cb8cc88843d286f599edcee65360 [id=f373633ff0ce4822b7884195b431df9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.996088 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcd999d88d954e50810cc01b297a27a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.996032 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 3e287ba95be7408b8fc75e6f0709d8f1 (DEFAULT_TABLE table=default.Table_20465bbedb344857a72376aa345ec532 [id=f673f240ab2341c39c57117ea2e4d92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.996479 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e287ba95be7408b8fc75e6f0709d8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.997700 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 3e287ba95be7408b8fc75e6f0709d8f1 (DEFAULT_TABLE table=default.Table_20465bbedb344857a72376aa345ec532 [id=f673f240ab2341c39c57117ea2e4d92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:46.998119 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e287ba95be7408b8fc75e6f0709d8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:46.999668 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 17917ffc3e8f43afb2a8bc413159137c (DEFAULT_TABLE table=default.Table_ac0c318d8f1947d99a30561f61ebb675 [id=8d93392a8f2d47608dc8535439b92c72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.000068 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17917ffc3e8f43afb2a8bc413159137c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.001626 28959 tablet_service.cc:1511] Processing CreateTablet for tablet a8eefc4f3c7d4f468c0adca837b73bb2 (DEFAULT_TABLE table=default.Table_0df8b7b928674848aa205ce9c6e79410 [id=405880e9419e43449f08e705aab0ba7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.002039 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8eefc4f3c7d4f468c0adca837b73bb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.008584 29093 tablet_service.cc:1511] Processing CreateTablet for tablet a8eefc4f3c7d4f468c0adca837b73bb2 (DEFAULT_TABLE table=default.Table_0df8b7b928674848aa205ce9c6e79410 [id=405880e9419e43449f08e705aab0ba7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.009196 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8eefc4f3c7d4f468c0adca837b73bb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.010251 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 3e287ba95be7408b8fc75e6f0709d8f1 (DEFAULT_TABLE table=default.Table_20465bbedb344857a72376aa345ec532 [id=f673f240ab2341c39c57117ea2e4d92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.010799 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e287ba95be7408b8fc75e6f0709d8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.013773 29229 tablet_service.cc:1511] Processing CreateTablet for tablet a8eefc4f3c7d4f468c0adca837b73bb2 (DEFAULT_TABLE table=default.Table_0df8b7b928674848aa205ce9c6e79410 [id=405880e9419e43449f08e705aab0ba7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.014365 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8eefc4f3c7d4f468c0adca837b73bb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.019042 29587 raft_consensus.cc:493] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.019239 29587 raft_consensus.cc:515] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.019923 29587 leader_election.cc:290] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:47.020694 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bffacfaa5427784de63d51fc903dd" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:47.021317 28925 leader_election.cc:343] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.022148 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bffacfaa5427784de63d51fc903dd" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:47.022805 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8880f8eadaa44887a49adf0ef157965e has no consensus state
W20260617 20:16:47.024334 28925 leader_election.cc:343] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.024523 28925 leader_election.cc:304] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:47.024744 29383 tablet_bootstrap.cc:492] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:47.024890 29383 ts_tablet_manager.cc:1403] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.113s user 0.018s sys 0.007s
I20260617 20:16:47.025025 29587 raft_consensus.cc:2749] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.025969 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 17917ffc3e8f43afb2a8bc413159137c (DEFAULT_TABLE table=default.Table_ac0c318d8f1947d99a30561f61ebb675 [id=8d93392a8f2d47608dc8535439b92c72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.026525 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17917ffc3e8f43afb2a8bc413159137c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.027274 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8c70a2be0e4b406880787a57850701ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.027880 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c70a2be0e4b406880787a57850701ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.030230 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 17917ffc3e8f43afb2a8bc413159137c (DEFAULT_TABLE table=default.Table_ac0c318d8f1947d99a30561f61ebb675 [id=8d93392a8f2d47608dc8535439b92c72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.030663 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17917ffc3e8f43afb2a8bc413159137c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.031831 29376 ts_tablet_manager.cc:1916] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.032557 29549 raft_consensus.cc:493] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.032733 29549 raft_consensus.cc:515] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:47.033416 29549 leader_election.cc:290] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:47.034633 29062 leader_election.cc:343] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 365e0ffb939047898243f72e4053d9a1
I20260617 20:16:47.037845 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 28146a1f84aa41ee88d9aea299256a90 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.038487 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 113fbbc739d04f529e82bc1cf1074bd7 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.031786 29383 raft_consensus.cc:359] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:47.032964 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0c245563fe44b59d32616bd35d3dae (DEFAULT_TABLE table=default.Table_70b590da38ef4a27ae05d708c04f63b4 [id=aba28f2e637d403fb4225835adef96cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.035161 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365e0ffb939047898243f72e4053d9a1" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:47.042450 29262 raft_consensus.cc:2468] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:47.042529 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0c245563fe44b59d32616bd35d3dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.043177 29063 leader_election.cc:304] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:47.043854 29549 raft_consensus.cc:2804] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:47.043983 29549 raft_consensus.cc:493] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:47.044111 29549 raft_consensus.cc:3060] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.045554 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0c245563fe44b59d32616bd35d3dae (DEFAULT_TABLE table=default.Table_70b590da38ef4a27ae05d708c04f63b4 [id=aba28f2e637d403fb4225835adef96cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.045984 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0c245563fe44b59d32616bd35d3dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.049968 29383 raft_consensus.cc:385] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.050172 29383 raft_consensus.cc:740] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.050535 29383 consensus_queue.cc:260] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:47.051389 29383 ts_tablet_manager.cc:1434] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20260617 20:16:47.051838 29383 tablet_bootstrap.cc:492] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:47.053166 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet faa73e73cc9b4fb28cdc87d259f5e7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.054328 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0c245563fe44b59d32616bd35d3dae (DEFAULT_TABLE table=default.Table_70b590da38ef4a27ae05d708c04f63b4 [id=aba28f2e637d403fb4225835adef96cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.054767 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0c245563fe44b59d32616bd35d3dae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.059468 29377 ts_tablet_manager.cc:1929] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:47.059655 29377 log.cc:1199] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/137cbb87d11c450995b63f7a8a7dece5
I20260617 20:16:47.060204 29377 ts_tablet_manager.cc:1950] T 137cbb87d11c450995b63f7a8a7dece5 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.061659 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 137cbb87d11c450995b63f7a8a7dece5 (table default.Table_81c4de22d335419abd4b3910e9025510 [id=0466c781ca0e4145b9f25b606c0edc5d]) successfully deleted
W20260617 20:16:47.062366 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 637b0b3e9cb648deaea6e63760b83255 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 637b0b3e9cb648deaea6e63760b83255 already in progress: creating tablet
W20260617 20:16:47.063016 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 216f91e7bda148bc9334b19e3c868910 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 216f91e7bda148bc9334b19e3c868910 already in progress: creating tablet
W20260617 20:16:47.063664 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3b67b915758d4ab0a8faa0227de08593 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b67b915758d4ab0a8faa0227de08593 already in progress: creating tablet
I20260617 20:16:47.064000 29377 tablet_replica.cc:333] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.064296 29377 raft_consensus.cc:2243] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.064632 29377 raft_consensus.cc:2272] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.065726 29377 ts_tablet_manager.cc:1916] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.065761 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ac0c318d8f1947d99a30561f61ebb675" } modify_external_catalogs: true
I20260617 20:16:47.065933 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ac0c318d8f1947d99a30561f61ebb675" } modify_external_catalogs: true
I20260617 20:16:47.066653 29378 tablet_bootstrap.cc:492] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:47.067410 29378 ts_tablet_manager.cc:1403] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.131s user 0.010s sys 0.013s
I20260617 20:16:47.070103 29383 tablet_bootstrap.cc:654] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.071017 29378 raft_consensus.cc:359] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.071266 29378 raft_consensus.cc:385] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.072404 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 08911643f3ca451d80e2471b1b5b2342 (DEFAULT_TABLE table=default.Table_b8d39f0ee1bc44e6be713e55e522b9f3 [id=c02a5e81598b47b9830a236256da4bba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.072932 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08911643f3ca451d80e2471b1b5b2342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.076098 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 1d4be33993864c73ba8b4da9468a517b
I20260617 20:16:47.076575 28662 catalog_manager.cc:6784] ReplaceTablet: tablet 1d4be33993864c73ba8b4da9468a517b deleted and replaced by tablet 64bb6d176a4845eca312848ae5104647
I20260617 20:16:47.076730 28966 tablet_service.cc:1511] Processing CreateTablet for tablet e7f822e3f4ca4946a116ee172e83628b (DEFAULT_TABLE table=default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.076881 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_33168ad831b44c79a651427dd6011f2b" } modify_external_catalogs: true
I20260617 20:16:47.077044 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_33168ad831b44c79a651427dd6011f2b" } modify_external_catalogs: true
I20260617 20:16:47.077214 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f822e3f4ca4946a116ee172e83628b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.071401 29378 raft_consensus.cc:740] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.079134 28666 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_ae890a73f30b42e7979e4fb37ce8a1c0 [id=0ece007078c749e3bd4bab93ada3b311]). Expected version 1 got 0
W20260617 20:16:47.080274 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e1dc756edd5473183afc75eef7112d6 consensus state has no leader
I20260617 20:16:47.080334 29378 consensus_queue.cc:260] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.080535 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f2ec59ac5864da5a13965ca0724c387 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.080991 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet 55e4ef1f493c4f1289cfa192ce38161d from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.082077 29378 ts_tablet_manager.cc:1434] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260617 20:16:47.082536 29378 tablet_bootstrap.cc:492] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.083968 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1ee5913d94914aba95dc4be83307dbe1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.084936 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ee5913d94914aba95dc4be83307dbe1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.086930 29383 tablet_bootstrap.cc:492] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:47.088003 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81a3502f5d4602b65328577a668d62 with delete_type TABLET_DATA_DELETED (replaced by tablet 097ca98ce2694c05b9b1ff4c0062cf28) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.088330 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet faa73e73cc9b4fb28cdc87d259f5e7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.088435 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 00f16ff3bc57434592d1648c4944c157 with delete_type TABLET_DATA_DELETED (replaced by tablet 65af976b808d42d4aeded71a00cf7252) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.088581 29099 tablet_service.cc:1511] Processing CreateTablet for tablet e7f822e3f4ca4946a116ee172e83628b (DEFAULT_TABLE table=default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.088688 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 137cbb87d11c450995b63f7a8a7dece5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.089183 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f822e3f4ca4946a116ee172e83628b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.089440 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d4be33993864c73ba8b4da9468a517b with delete_type TABLET_DATA_DELETED (replaced by tablet 64bb6d176a4845eca312848ae5104647) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.091266 28959 tablet_service.cc:1558] Processing DeleteTablet for tablet 751bffacfaa5427784de63d51fc903dd with delete_type TABLET_DATA_DELETED (replaced by tablet e7f822e3f4ca4946a116ee172e83628b) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.091653 29377 ts_tablet_manager.cc:1929] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:16:47.090517 29226 tablet_service.cc:1511] Processing CreateTablet for tablet e7f822e3f4ca4946a116ee172e83628b (DEFAULT_TABLE table=default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.093761 29549 raft_consensus.cc:515] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:47.093917 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7f822e3f4ca4946a116ee172e83628b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.094679 29549 leader_election.cc:290] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:47.095188 29062 leader_election.cc:343] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 365e0ffb939047898243f72e4053d9a1
I20260617 20:16:47.095204 29391 raft_consensus.cc:493] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.095376 29391 raft_consensus.cc:515] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:47.096055 29391 leader_election.cc:290] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:16:47.097028 29198 leader_election.cc:343] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 137cbb87d11c450995b63f7a8a7dece5
I20260617 20:16:47.097385 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365e0ffb939047898243f72e4053d9a1" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:47.097589 29262 raft_consensus.cc:3060] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.100409 29262 raft_consensus.cc:2468] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:47.101078 29063 leader_election.cc:304] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:47.101905 29383 ts_tablet_manager.cc:1403] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.004s
I20260617 20:16:47.102319 29549 raft_consensus.cc:2804] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:47.102865 29549 raft_consensus.cc:697] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:47.103027 29383 raft_consensus.cc:359] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.103225 29383 raft_consensus.cc:385] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.103305 29383 raft_consensus.cc:740] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.103547 29383 consensus_queue.cc:260] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.104118 29383 ts_tablet_manager.cc:1434] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:47.104444 29383 tablet_bootstrap.cc:492] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:47.102135 29197 leader_election.cc:343] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 137cbb87d11c450995b63f7a8a7dece5
I20260617 20:16:47.103483 29549 consensus_queue.cc:237] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:47.107831 29377 log.cc:1199] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/b89b44c6cb2c41409a15708feec0c29b
I20260617 20:16:47.108567 29377 ts_tablet_manager.cc:1950] T b89b44c6cb2c41409a15708feec0c29b P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.108219 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1a416f802948d5bc150855d82b54c1 (DEFAULT_TABLE table=default.Table_77d3422ed47c4d68ae6f518500ea89b1 [id=071053dd948345bd9bc5d8b3cffe7935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.108639 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 08911643f3ca451d80e2471b1b5b2342 (DEFAULT_TABLE table=default.Table_b8d39f0ee1bc44e6be713e55e522b9f3 [id=c02a5e81598b47b9830a236256da4bba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.110241 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet b89b44c6cb2c41409a15708feec0c29b (table default.Table_675165a5585146af86731c73080a0f3f [id=8272ea6276314a28bca235431f8f3986]) successfully deleted
I20260617 20:16:47.093202 29378 tablet_bootstrap.cc:654] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.101635 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1a416f802948d5bc150855d82b54c1 (DEFAULT_TABLE table=default.Table_77d3422ed47c4d68ae6f518500ea89b1 [id=071053dd948345bd9bc5d8b3cffe7935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.108702 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 689121cc9ca647cda1899cdd569da8f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4332e33d60964bd6a0c7e7caaa6bdc76) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.111784 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1a416f802948d5bc150855d82b54c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.113869 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 8eee68618cdf462283d7fd9f098c2a0d
I20260617 20:16:47.114763 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7d193ca323a14554af974ae3b173fa07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.115345 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7d193ca323a14554af974ae3b173fa07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.117468 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eee68618cdf462283d7fd9f098c2a0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.109083 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1a416f802948d5bc150855d82b54c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.118690 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08911643f3ca451d80e2471b1b5b2342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.118362 29197 leader_election.cc:304] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:47.120002 29391 raft_consensus.cc:2749] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.122185 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eee68618cdf462283d7fd9f098c2a0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.122421 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 08911643f3ca451d80e2471b1b5b2342 (DEFAULT_TABLE table=default.Table_b8d39f0ee1bc44e6be713e55e522b9f3 [id=c02a5e81598b47b9830a236256da4bba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.122897 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08911643f3ca451d80e2471b1b5b2342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.114809 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eee68618cdf462283d7fd9f098c2a0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.115903 29549 raft_consensus.cc:493] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.123956 29549 raft_consensus.cc:515] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.124647 29549 leader_election.cc:290] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:47.125454 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d4be33993864c73ba8b4da9468a517b with delete_type TABLET_DATA_DELETED (replaced by tablet 64bb6d176a4845eca312848ae5104647) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:47.125525 29062 leader_election.cc:343] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: faa73e73cc9b4fb28cdc87d259f5e7bb
I20260617 20:16:47.117520 29375 ts_tablet_manager.cc:1916] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.125921 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faa73e73cc9b4fb28cdc87d259f5e7bb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:47.126942 29063 leader_election.cc:343] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.127070 29063 leader_election.cc:304] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:47.127525 29549 raft_consensus.cc:2749] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.127770 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet cc945cdd482f4a5593d4874e5303ecd2
I20260617 20:16:47.128523 29379 tablet_bootstrap.cc:492] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:47.128647 29379 ts_tablet_manager.cc:1403] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.178s user 0.025s sys 0.065s
I20260617 20:16:47.129463 29379 raft_consensus.cc:359] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.129644 29379 raft_consensus.cc:385] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.129741 29379 raft_consensus.cc:740] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.130023 29391 raft_consensus.cc:493] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.130087 29379 consensus_queue.cc:260] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.130172 29391 raft_consensus.cc:515] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:47.130752 29391 leader_election.cc:290] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:47.130779 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet cc945cdd482f4a5593d4874e5303ecd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.131167 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet cc945cdd482f4a5593d4874e5303ecd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.131640 29379 ts_tablet_manager.cc:1434] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:47.131916 29379 tablet_bootstrap.cc:492] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:47.132331 29198 leader_election.cc:343] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: a79b56241ac84862868c664cca25654b
W20260617 20:16:47.132678 29197 leader_election.cc:343] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: a79b56241ac84862868c664cca25654b
I20260617 20:16:47.132802 29197 leader_election.cc:304] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:47.133385 29391 raft_consensus.cc:2749] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.133736 29379 tablet_bootstrap.cc:654] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.133916 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d4be33993864c73ba8b4da9468a517b with delete_type TABLET_DATA_DELETED (replaced by tablet 64bb6d176a4845eca312848ae5104647) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.137316 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d7edab01c4d54274953659f1ad4a4969"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.138373 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1a416f802948d5bc150855d82b54c1 (DEFAULT_TABLE table=default.Table_77d3422ed47c4d68ae6f518500ea89b1 [id=071053dd948345bd9bc5d8b3cffe7935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.138839 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1a416f802948d5bc150855d82b54c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.139865 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 1199d8c7f1dc4b8f99301b8f60c687d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 808c455e74e645aa8e2b0d08ca81d4f9) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.141433 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet dd2df17b35a7483b93a6e89d42ac1a62 (table default.Table_26fbc7a31fb7435790febb8d25c7ef1e [id=32c61aa9610e428fa8d5c794b078e0a1]). Expected version 1 got 0
I20260617 20:16:47.141790 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 365e0ffb939047898243f72e4053d9a1 with delete_type TABLET_DATA_DELETED (replaced by tablet b162a0ef91d1447b838331ba6ef93bf4) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.141067 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet a79b56241ac84862868c664cca25654b with delete_type TABLET_DATA_DELETED (replaced by tablet 1f85271eeb854194a968215ebc08f47a) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.141252 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 137cbb87d11c450995b63f7a8a7dece5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.142606 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet fa513612e44148d7983b0db00d733888
I20260617 20:16:47.142688 29378 tablet_bootstrap.cc:492] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:47.142845 29378 ts_tablet_manager.cc:1403] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.001s
I20260617 20:16:47.143123 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet cd312e8817ee4c8fb7377825a7e6122a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.143647 29378 raft_consensus.cc:359] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.143872 29378 raft_consensus.cc:385] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.143934 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_8b66113312ca4c2297d9b65f8c6dcf6c [id=0ece007078c749e3bd4bab93ada3b311]). Expected version 2 got 0
I20260617 20:16:47.143946 29378 raft_consensus.cc:740] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.144171 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet fa513612e44148d7983b0db00d733888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.144258 29378 consensus_queue.cc:260] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.144685 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8ffb0a0b802f41e386bc73ae7574b693"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.144986 29376 ts_tablet_manager.cc:1929] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:47.144479 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet fa513612e44148d7983b0db00d733888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.145116 29376 log.cc:1199] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/f74494a3230448c983d8af0e553247bf
I20260617 20:16:47.145534 29377 tablet_replica.cc:333] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.145713 29377 raft_consensus.cc:2243] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.147104 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_114940544693456c815446c3d3ec85bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.147583 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_114940544693456c815446c3d3ec85bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.150439 29376 ts_tablet_manager.cc:1950] T f74494a3230448c983d8af0e553247bf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:47.150465 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet b89b44c6cb2c41409a15708feec0c29b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.150506 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet cc945cdd482f4a5593d4874e5303ecd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.150758 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 4516e7a7fa284eaa816558b2d58cd213 with delete_type TABLET_DATA_DELETED (replaced by tablet 08911643f3ca451d80e2471b1b5b2342) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.150785 29375 ts_tablet_manager.cc:1929] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 20:16:47.145262 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ffb0a0b802f41e386bc73ae7574b693 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.151326 29375 log.cc:1199] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/cd312e8817ee4c8fb7377825a7e6122a
I20260617 20:16:47.151970 29375 ts_tablet_manager.cc:1950] T cd312e8817ee4c8fb7377825a7e6122a P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:47.141376 29383 tablet_bootstrap.cc:654] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.142522 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet d66923e12e1843bcbcb3da93cf838b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:44 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.152510 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b7880a039a497fbd0fb5d4f74e7d23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.152587 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet f74494a3230448c983d8af0e553247bf (table default.Table_a96bacccf2874d2ea84a7c20f9892640 [id=f447de1e65a64027ae9c8983d72195e0]) successfully deleted
W20260617 20:16:47.153101 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7edab01c4d54274953659f1ad4a4969 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.155228 29377 raft_consensus.cc:2272] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.155876 29377 ts_tablet_manager.cc:1916] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.156577 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet fa513612e44148d7983b0db00d733888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.157066 29378 ts_tablet_manager.cc:1434] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20260617 20:16:47.155405 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet cd312e8817ee4c8fb7377825a7e6122a (table default.Table_3074bd171fd54a10948acd223e1c6da7 [id=1d46529c95a44c2c91c54e5b16a5f7ed]) successfully deleted
I20260617 20:16:47.158267 29375 tablet_replica.cc:333] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:47.158680 29375 raft_consensus.cc:2243] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.159435 29375 raft_consensus.cc:2272] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:47.160254 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3b67b915758d4ab0a8faa0227de08593 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b67b915758d4ab0a8faa0227de08593 already in progress: creating tablet
I20260617 20:16:47.161072 29375 ts_tablet_manager.cc:1916] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.162138 29378 tablet_bootstrap.cc:492] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.176144 29383 tablet_bootstrap.cc:492] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:47.176515 29383 ts_tablet_manager.cc:1403] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.072s user 0.000s sys 0.007s
I20260617 20:16:47.178022 29383 raft_consensus.cc:359] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.178385 29383 raft_consensus.cc:385] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.178560 29383 raft_consensus.cc:740] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.178824 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_192e626b5490454ba063186aa68e2157" } new_table_name: "default.Table_4f05d3ae468a4e5c83b7566458bc52a4" modify_external_catalogs: true
I20260617 20:16:47.178910 29383 consensus_queue.cc:260] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.182104 29383 ts_tablet_manager.cc:1434] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:16:47.183569 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 113fbbc739d04f529e82bc1cf1074bd7
I20260617 20:16:47.184149 28663 catalog_manager.cc:6784] ReplaceTablet: tablet 113fbbc739d04f529e82bc1cf1074bd7 deleted and replaced by tablet 75519f97f1ce49ceb3a739ba7c7bc239
I20260617 20:16:47.184531 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fb580c3d4089464aa53ff2360464aaae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.184880 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 113fbbc739d04f529e82bc1cf1074bd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 75519f97f1ce49ceb3a739ba7c7bc239) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:47.185191 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb580c3d4089464aa53ff2360464aaae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.185392 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 113fbbc739d04f529e82bc1cf1074bd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 75519f97f1ce49ceb3a739ba7c7bc239) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.185982 29376 tablet_replica.cc:333] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:47.187584 29383 tablet_bootstrap.cc:492] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:47.187954 29378 tablet_bootstrap.cc:654] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.189141 29376 raft_consensus.cc:2243] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:47.189502 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 113fbbc739d04f529e82bc1cf1074bd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 75519f97f1ce49ceb3a739ba7c7bc239) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.189666 29376 raft_consensus.cc:2272] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.192077 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 17917ffc3e8f43afb2a8bc413159137c
I20260617 20:16:47.192940 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 17917ffc3e8f43afb2a8bc413159137c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.193501 28662 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet f136e42eb9034a05a5e0c7dc3b3117d7
I20260617 20:16:47.194377 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 17917ffc3e8f43afb2a8bc413159137c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.194620 28662 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_8b66113312ca4c2297d9b65f8c6dcf6c [id=0ece007078c749e3bd4bab93ada3b311]). Expected version 2 got 0
I20260617 20:16:47.195456 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e9f868b8616d4ca0940cba8937919fb2" } new_table_name: "default.Table_9f236274be424e44818107f2fed5331c" modify_external_catalogs: true
I20260617 20:16:47.197190 29383 tablet_bootstrap.cc:654] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.197976 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 17917ffc3e8f43afb2a8bc413159137c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.199507 29377 ts_tablet_manager.cc:1929] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.199651 29377 log.cc:1199] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/7a81a3502f5d4602b65328577a668d62
I20260617 20:16:47.200110 29377 ts_tablet_manager.cc:1950] T 7a81a3502f5d4602b65328577a668d62 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.203385 29375 ts_tablet_manager.cc:1929] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.203616 29375 log.cc:1199] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/d66923e12e1843bcbcb3da93cf838b65
I20260617 20:16:47.203751 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_8b66113312ca4c2297d9b65f8c6dcf6c [id=0ece007078c749e3bd4bab93ada3b311]). Expected version 2 got 0
I20260617 20:16:47.204046 29375 ts_tablet_manager.cc:1950] T d66923e12e1843bcbcb3da93cf838b65 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:47.205610 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_193918a467ca4fb4852f3e3f90ab8f84" } new_table_name: "default.Table_12d399d17f9f409981bfd90c85d8b012" modify_external_catalogs: true
I20260617 20:16:47.205770 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet d66923e12e1843bcbcb3da93cf838b65 (table default.Table_6e5629496f81401d8671eaa061393d1f [id=b2d788fe99dd43689f8fa1f9fcea06a5]) successfully deleted
I20260617 20:16:47.206180 29376 ts_tablet_manager.cc:1916] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.209920 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 7a81a3502f5d4602b65328577a668d62 (table default.Table_71003cb25e6e4229aba21f7dd04b7fe4 [id=da4afdf3f60e48e78eb52d454fa4142c]) successfully deleted
I20260617 20:16:47.209988 29377 tablet_replica.cc:333] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.210227 29377 raft_consensus.cc:2243] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 20:16:47.210551 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet faa73e73cc9b4fb28cdc87d259f5e7bb because the tablet was not found. No further retry: Not found: Tablet not found: faa73e73cc9b4fb28cdc87d259f5e7bb
I20260617 20:16:47.209508 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 28146a1f84aa41ee88d9aea299256a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.212976 29377 raft_consensus.cc:2272] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.213158 29375 tablet_replica.cc:333] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:47.213832 29375 raft_consensus.cc:2243] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:47.214200 29375 pending_rounds.cc:70] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:47.214289 29375 pending_rounds.cc:77] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955459506462720 op_type: NO_OP noop_request { }
I20260617 20:16:47.214478 29375 raft_consensus.cc:2889] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:47.215224 29377 ts_tablet_manager.cc:1916] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.215939 29383 tablet_bootstrap.cc:492] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:47.216161 29383 ts_tablet_manager.cc:1403] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260617 20:16:47.217207 29383 raft_consensus.cc:359] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.217516 29383 raft_consensus.cc:385] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.217614 29383 raft_consensus.cc:740] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.217985 29383 consensus_queue.cc:260] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.221410 29383 ts_tablet_manager.cc:1434] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260617 20:16:47.221815 29383 tablet_bootstrap.cc:492] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:47.222307 29375 raft_consensus.cc:2272] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.224205 29375 ts_tablet_manager.cc:1916] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.225350 29383 tablet_bootstrap.cc:654] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.229699 29376 ts_tablet_manager.cc:1929] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:16:47.230023 29391 raft_consensus.cc:493] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.230233 29391 raft_consensus.cc:515] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:47.231153 29391 leader_election.cc:290] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:16:47.233477 29197 leader_election.cc:343] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1199d8c7f1dc4b8f99301b8f60c687d1
I20260617 20:16:47.234004 29375 ts_tablet_manager.cc:1929] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:47.234156 29375 log.cc:1199] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/365e0ffb939047898243f72e4053d9a1
W20260617 20:16:47.234390 29198 leader_election.cc:343] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 1199d8c7f1dc4b8f99301b8f60c687d1
I20260617 20:16:47.234516 29198 leader_election.cc:304] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:47.234645 29375 ts_tablet_manager.cc:1950] T 365e0ffb939047898243f72e4053d9a1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:47.235071 29391 raft_consensus.cc:2749] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.229914 29376 log.cc:1199] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/b89b44c6cb2c41409a15708feec0c29b
I20260617 20:16:47.237102 29376 ts_tablet_manager.cc:1950] T b89b44c6cb2c41409a15708feec0c29b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:47.237576 29377 ts_tablet_manager.cc:1929] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.239341 29377 log.cc:1199] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/00f16ff3bc57434592d1648c4944c157
I20260617 20:16:47.239398 29375 tablet_replica.cc:333] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:47.239650 29375 raft_consensus.cc:2243] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.239902 29375 raft_consensus.cc:2272] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.241181 29377 ts_tablet_manager.cc:1950] T 00f16ff3bc57434592d1648c4944c157 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.241596 29375 ts_tablet_manager.cc:1916] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.244575 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_64b36c5ea008434c9becd24d6a19eb0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.246470 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 00f16ff3bc57434592d1648c4944c157 (table default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]) successfully deleted
W20260617 20:16:47.248106 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 137cbb87d11c450995b63f7a8a7dece5 because the tablet was not found. No further retry: Not found: Tablet not found: 137cbb87d11c450995b63f7a8a7dece5
I20260617 20:16:47.249017 29377 tablet_replica.cc:333] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.249760 29377 raft_consensus.cc:2243] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.251200 29377 raft_consensus.cc:2272] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.252322 29377 ts_tablet_manager.cc:1916] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.252592 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 55e4ef1f493c4f1289cfa192ce38161d
I20260617 20:16:47.253129 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_29efc4231c2a404db10313243e8b10fb" } new_table_name: "default.Table_905925f76ee34413b4808ebf86465758" modify_external_catalogs: true
I20260617 20:16:47.254762 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e4ef1f493c4f1289cfa192ce38161d with delete_type TABLET_DATA_DELETED (replaced by tablet 67a3124306094c72ad78e5473aa35bdb) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.235924 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 365e0ffb939047898243f72e4053d9a1 (table default.Table_0cc10f7657a2450294f6ce1e33fb609e [id=fa80809528dd419192774bcc7ac5f5bf]) successfully deleted
I20260617 20:16:47.266933 28664 catalog_manager.cc:6784] ReplaceTablet: tablet 55e4ef1f493c4f1289cfa192ce38161d deleted and replaced by tablet 67a3124306094c72ad78e5473aa35bdb
W20260617 20:16:47.267148 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64b36c5ea008434c9becd24d6a19eb0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.267773 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet b89b44c6cb2c41409a15708feec0c29b (table default.Table_675165a5585146af86731c73080a0f3f [id=8272ea6276314a28bca235431f8f3986]) successfully deleted
I20260617 20:16:47.268496 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_577f6b872d804b24ae25b7c1469442d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.269019 29378 tablet_bootstrap.cc:492] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
W20260617 20:16:47.269099 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_577f6b872d804b24ae25b7c1469442d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.269315 29378 ts_tablet_manager.cc:1403] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.107s user 0.004s sys 0.016s
I20260617 20:16:47.269948 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet faa73e73cc9b4fb28cdc87d259f5e7bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.270166 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet 00f16ff3bc57434592d1648c4944c157 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.270180 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e4ef1f493c4f1289cfa192ce38161d with delete_type TABLET_DATA_DELETED (replaced by tablet 67a3124306094c72ad78e5473aa35bdb) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.269173 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_88946ea5179f45118a05f7dddcdd92b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.270848 29378 raft_consensus.cc:359] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.270977 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e4ef1f493c4f1289cfa192ce38161d with delete_type TABLET_DATA_DELETED (replaced by tablet 67a3124306094c72ad78e5473aa35bdb) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:47.270982 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88946ea5179f45118a05f7dddcdd92b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.271099 29378 raft_consensus.cc:385] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.271201 29378 raft_consensus.cc:740] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.271477 29378 consensus_queue.cc:260] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.271680 29587 raft_consensus.cc:493] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.271828 29587 raft_consensus.cc:515] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.272534 29587 leader_election.cc:290] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:47.273123 29376 tablet_replica.cc:333] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:47.273384 29376 raft_consensus.cc:2243] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:47.273981 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c44c3fa6f64f929d48de53f2502bfb" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:47.274067 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c44c3fa6f64f929d48de53f2502bfb" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:47.274711 28925 leader_election.cc:343] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:47.274959 28925 leader_election.cc:343] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.275096 28925 leader_election.cc:304] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:47.275987 29587 raft_consensus.cc:2749] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.276533 29376 pending_rounds.cc:70] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:47.276844 29376 pending_rounds.cc:77] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955458688204800 op_type: NO_OP noop_request { }
I20260617 20:16:47.277217 29376 raft_consensus.cc:2889] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:47.277633 29376 raft_consensus.cc:2272] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.278985 29378 ts_tablet_manager.cc:1434] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20260617 20:16:47.281736 29378 tablet_bootstrap.cc:492] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.282946 29375 ts_tablet_manager.cc:1929] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.283090 29375 log.cc:1199] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/faa73e73cc9b4fb28cdc87d259f5e7bb
I20260617 20:16:47.284073 29383 tablet_bootstrap.cc:492] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:47.284281 29383 ts_tablet_manager.cc:1403] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.063s user 0.006s sys 0.001s
I20260617 20:16:47.285641 29379 tablet_bootstrap.cc:492] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:47.285815 29379 ts_tablet_manager.cc:1403] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.154s user 0.047s sys 0.053s
I20260617 20:16:47.286525 29378 tablet_bootstrap.cc:654] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.286724 29379 raft_consensus.cc:359] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.286985 29379 raft_consensus.cc:385] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.287076 29379 raft_consensus.cc:740] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.287379 29379 consensus_queue.cc:260] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.288261 29379 ts_tablet_manager.cc:1434] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:47.288426 29377 ts_tablet_manager.cc:1929] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.288542 29377 log.cc:1199] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/751bffacfaa5427784de63d51fc903dd
I20260617 20:16:47.288605 29379 tablet_bootstrap.cc:492] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:47.288925 29377 ts_tablet_manager.cc:1950] T 751bffacfaa5427784de63d51fc903dd P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.292276 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 751bffacfaa5427784de63d51fc903dd (table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]) successfully deleted
I20260617 20:16:47.293330 29378 tablet_bootstrap.cc:492] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
W20260617 20:16:47.294196 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a76b0744ef2a472091999681d5639fec consensus state has no leader
I20260617 20:16:47.294692 29378 ts_tablet_manager.cc:1403] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.002s
I20260617 20:16:47.295444 29378 raft_consensus.cc:359] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.295681 29378 raft_consensus.cc:385] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.295756 29378 raft_consensus.cc:740] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.296015 29378 consensus_queue.cc:260] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.293968 29377 tablet_replica.cc:333] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.296599 29377 raft_consensus.cc:2243] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.296643 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0df8b7b928674848aa205ce9c6e79410" } new_table_name: "default.Table_6072f76a9b944eda8c05a7486c823fff" modify_external_catalogs: true
I20260617 20:16:47.297040 29377 raft_consensus.cc:2272] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.297443 29375 ts_tablet_manager.cc:1950] T faa73e73cc9b4fb28cdc87d259f5e7bb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:47.298439 29377 ts_tablet_manager.cc:1916] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.298862 29375 tablet_replica.cc:333] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:47.299075 29375 raft_consensus.cc:2243] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.299255 29375 raft_consensus.cc:2272] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.299818 29375 ts_tablet_manager.cc:1916] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.301680 29379 tablet_bootstrap.cc:654] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.302117 29378 ts_tablet_manager.cc:1434] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260617 20:16:47.302999 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet 9d2a38be2e8e4796a98f1ae1d011249f from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.303557 29378 tablet_bootstrap.cc:492] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.305646 29378 tablet_bootstrap.cc:654] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:47.305902 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d738ab2f8c784c76947a3a76bd040219 has no consensus state
I20260617 20:16:47.312852 29376 ts_tablet_manager.cc:1916] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.313710 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet faa73e73cc9b4fb28cdc87d259f5e7bb (table default.Table_e0e8f7e180d64ca690dfea9446c257a1 [id=6ac70796ad20486d8777f6d8518ee784]) successfully deleted
W20260617 20:16:47.314008 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 1d4be33993864c73ba8b4da9468a517b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d4be33993864c73ba8b4da9468a517b already in progress: creating tablet
W20260617 20:16:47.314250 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 8eee68618cdf462283d7fd9f098c2a0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eee68618cdf462283d7fd9f098c2a0d already in progress: creating tablet
W20260617 20:16:47.314447 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet cc945cdd482f4a5593d4874e5303ecd2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc945cdd482f4a5593d4874e5303ecd2 already in progress: creating tablet
W20260617 20:16:47.314659 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet fa513612e44148d7983b0db00d733888 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fa513612e44148d7983b0db00d733888 already in progress: creating tablet
W20260617 20:16:47.314833 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 113fbbc739d04f529e82bc1cf1074bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 113fbbc739d04f529e82bc1cf1074bd7 already in progress: creating tablet
W20260617 20:16:47.315055 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 17917ffc3e8f43afb2a8bc413159137c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17917ffc3e8f43afb2a8bc413159137c already in progress: creating tablet
I20260617 20:16:47.317550 29379 tablet_bootstrap.cc:492] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:47.317713 29379 ts_tablet_manager.cc:1403] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.000s
W20260617 20:16:47.317963 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e53946c85ab4a8286a6e174cc411c5e has no consensus state
I20260617 20:16:47.318547 29379 raft_consensus.cc:359] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.318750 29379 raft_consensus.cc:385] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.317394 29378 tablet_bootstrap.cc:492] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:47.318864 29379 raft_consensus.cc:740] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.319103 29378 ts_tablet_manager.cc:1403] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.003s
I20260617 20:16:47.319093 29379 consensus_queue.cc:260] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.319949 29379 ts_tablet_manager.cc:1434] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:47.320004 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2ef3a206c3e747ada8461a0af6a75a51" } modify_external_catalogs: true
I20260617 20:16:47.320178 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2ef3a206c3e747ada8461a0af6a75a51" } modify_external_catalogs: true
I20260617 20:16:47.320253 29379 tablet_bootstrap.cc:492] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:47.320815 29378 raft_consensus.cc:359] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.321008 29378 raft_consensus.cc:385] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.321094 29378 raft_consensus.cc:740] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.322014 29379 tablet_bootstrap.cc:654] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.322371 29377 ts_tablet_manager.cc:1929] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.322497 29377 log.cc:1199] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/689121cc9ca647cda1899cdd569da8f6
I20260617 20:16:47.322825 29377 ts_tablet_manager.cc:1950] T 689121cc9ca647cda1899cdd569da8f6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.323774 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 689121cc9ca647cda1899cdd569da8f6 (table default.Table_81f4fb86b1a8470db7f74e35dc15a3fa [id=229a4fa545c84500af515f5992b547c7]) successfully deleted
I20260617 20:16:47.324611 29378 consensus_queue.cc:260] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.324851 29375 ts_tablet_manager.cc:1929] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.325013 29375 log.cc:1199] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/55e4ef1f493c4f1289cfa192ce38161d
I20260617 20:16:47.325793 29378 ts_tablet_manager.cc:1434] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 20:16:47.326550 29378 tablet_bootstrap.cc:492] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.328581 29378 tablet_bootstrap.cc:654] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.328946 29375 ts_tablet_manager.cc:1950] T 55e4ef1f493c4f1289cfa192ce38161d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:47.329571 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 55e4ef1f493c4f1289cfa192ce38161d (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]) successfully deleted
W20260617 20:16:47.330490 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 8eee68618cdf462283d7fd9f098c2a0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eee68618cdf462283d7fd9f098c2a0d already in progress: creating tablet
W20260617 20:16:47.330976 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b62b22ff17964ee6934023fb85e0b7ec consensus state has no leader
I20260617 20:16:47.331118 29377 tablet_replica.cc:333] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.333518 29377 raft_consensus.cc:2243] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.333743 29377 raft_consensus.cc:2272] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.334302 29377 ts_tablet_manager.cc:1916] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.335703 29379 tablet_bootstrap.cc:492] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:47.335896 29379 ts_tablet_manager.cc:1403] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260617 20:16:47.337174 29379 raft_consensus.cc:359] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.337409 29379 raft_consensus.cc:385] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.337496 29379 raft_consensus.cc:740] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.337723 29379 consensus_queue.cc:260] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.339169 29379 ts_tablet_manager.cc:1434] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 20:16:47.339478 29379 tablet_bootstrap.cc:492] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:47.341157 29379 tablet_bootstrap.cc:654] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.344300 29377 ts_tablet_manager.cc:1929] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.344434 29377 log.cc:1199] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/1d4be33993864c73ba8b4da9468a517b
I20260617 20:16:47.344790 29377 ts_tablet_manager.cc:1950] T 1d4be33993864c73ba8b4da9468a517b P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.344909 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8278dd326f2d440e9b3823471e55dff7" } modify_external_catalogs: true
I20260617 20:16:47.345114 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8278dd326f2d440e9b3823471e55dff7" } modify_external_catalogs: true
I20260617 20:16:47.346438 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet 4332e33d60964bd6a0c7e7caaa6bdc76 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.347731 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cd9432cef0ba46d9a560d5ba59f1d58d" } modify_external_catalogs: true
I20260617 20:16:47.347903 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cd9432cef0ba46d9a560d5ba59f1d58d" } modify_external_catalogs: true
I20260617 20:16:47.348671 29376 ts_tablet_manager.cc:1929] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:47.356184 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 1d4be33993864c73ba8b4da9468a517b (table default.Table_e67bded1adac4a9194ee9f5f1131ed12 [id=6e89910c5d7a4969a79960d34eff437c]) successfully deleted
W20260617 20:16:47.356469 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8eefc4f3c7d4f468c0adca837b73bb2 consensus state has no leader
I20260617 20:16:47.356704 29379 tablet_bootstrap.cc:492] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:47.356882 29379 ts_tablet_manager.cc:1403] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.001s
I20260617 20:16:47.357664 29377 tablet_replica.cc:333] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.357726 29379 raft_consensus.cc:359] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.358048 29379 raft_consensus.cc:385] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.358153 29379 raft_consensus.cc:740] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.358368 29379 consensus_queue.cc:260] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.359247 29379 ts_tablet_manager.cc:1434] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:47.359309 28667 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 60a43dd885aa4411a4177b67807b0ac4 (table default.Table_fd835dc9ea8f4041b36c069dcac9d69a [id=3a41dd53c3974256877f193219240234]). Expected version 4 got 0
I20260617 20:16:47.359539 29379 tablet_bootstrap.cc:492] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:47.359300 29377 raft_consensus.cc:2243] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.363240 29106 tablet_service.cc:1511] Processing CreateTablet for tablet d738ab2f8c784c76947a3a76bd040219 (DEFAULT_TABLE table=default.Table_12d399d17f9f409981bfd90c85d8b012 [id=cde5899e2baa4b2b9fe34bb5d11ebe13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.363690 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d738ab2f8c784c76947a3a76bd040219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.364055 28667 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 60a43dd885aa4411a4177b67807b0ac4 (table default.Table_fd835dc9ea8f4041b36c069dcac9d69a [id=3a41dd53c3974256877f193219240234]). Expected version 4 got 0
I20260617 20:16:47.366451 28954 tablet_service.cc:1511] Processing CreateTablet for tablet d738ab2f8c784c76947a3a76bd040219 (DEFAULT_TABLE table=default.Table_12d399d17f9f409981bfd90c85d8b012 [id=cde5899e2baa4b2b9fe34bb5d11ebe13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.366958 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d738ab2f8c784c76947a3a76bd040219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.367040 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 (DEFAULT_TABLE table=default.Table_b50a2ea6dd054c8282ce507b0c871fb2 [id=7d0ccdf07bf14fd1b7fd55deb990bdae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.367182 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 379ef43e02ec4bbbb03f2d6a53a66403 (DEFAULT_TABLE table=default.Table_0181eddc78fc4d47b1b0bbd67645ad04 [id=de3384ef7984460abc15ca893a9f8c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.367251 29093 tablet_service.cc:1511] Processing CreateTablet for tablet a857c28d94f04dabb9a57aeca662b836 (DEFAULT_TABLE table=default.Table_1e538f92939a4b92a73136b53c355327 [id=3201002f51ca4f788cc1e153333862d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.367440 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.367718 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a857c28d94f04dabb9a57aeca662b836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.369603 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 (DEFAULT_TABLE table=default.Table_b50a2ea6dd054c8282ce507b0c871fb2 [id=7d0ccdf07bf14fd1b7fd55deb990bdae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.370012 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.371404 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 379ef43e02ec4bbbb03f2d6a53a66403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.372989 29549 raft_consensus.cc:493] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.373013 29651 raft_consensus.cc:493] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.373171 29549 raft_consensus.cc:515] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.373164 29651 raft_consensus.cc:515] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.374010 29549 leader_election.cc:290] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:47.374089 29651 leader_election.cc:290] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:47.374348 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 637b0b3e9cb648deaea6e63760b83255 with delete_type TABLET_DATA_DELETED (replaced by tablet 8880f8eadaa44887a49adf0ef157965e) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.378115 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1dc756edd5473183afc75eef7112d6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:47.378326 29127 raft_consensus.cc:2468] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:47.379000 28955 tablet_service.cc:1511] Processing CreateTablet for tablet a857c28d94f04dabb9a57aeca662b836 (DEFAULT_TABLE table=default.Table_1e538f92939a4b92a73136b53c355327 [id=3201002f51ca4f788cc1e153333862d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.379300 28925 leader_election.cc:304] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:47.379451 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a857c28d94f04dabb9a57aeca662b836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.380493 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 7e48a4a827d44afca912dc8723be4542 (DEFAULT_TABLE table=default.Table_4f9c31d448d24a98a74ff2af7407a2b1 [id=b24f0a25c8574b62842179a4c9bbc2f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.380867 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e48a4a827d44afca912dc8723be4542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.381584 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 7e48a4a827d44afca912dc8723be4542 (DEFAULT_TABLE table=default.Table_4f9c31d448d24a98a74ff2af7407a2b1 [id=b24f0a25c8574b62842179a4c9bbc2f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.381938 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e48a4a827d44afca912dc8723be4542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.384783 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 7b00437fb76c4000ad89c99ab2da2261 (DEFAULT_TABLE table=default.Table_6f68970fea69478eba2df21752f2ea0a [id=40e28570c43d428b90d13ccc0123be2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.385236 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b00437fb76c4000ad89c99ab2da2261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.385672 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 379ef43e02ec4bbbb03f2d6a53a66403 (DEFAULT_TABLE table=default.Table_0181eddc78fc4d47b1b0bbd67645ad04 [id=de3384ef7984460abc15ca893a9f8c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.386092 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 379ef43e02ec4bbbb03f2d6a53a66403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.387888 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_56f5d206c3934a59a6ef16d7c15e3de6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.388397 29062 leader_election.cc:343] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 751bffacfaa5427784de63d51fc903dd
W20260617 20:16:47.388427 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56f5d206c3934a59a6ef16d7c15e3de6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.365465 29228 tablet_service.cc:1511] Processing CreateTablet for tablet d738ab2f8c784c76947a3a76bd040219 (DEFAULT_TABLE table=default.Table_12d399d17f9f409981bfd90c85d8b012 [id=cde5899e2baa4b2b9fe34bb5d11ebe13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.389667 29651 raft_consensus.cc:2804] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:47.389729 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d738ab2f8c784c76947a3a76bd040219. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.390107 29651 raft_consensus.cc:493] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:47.390234 29651 raft_consensus.cc:3060] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.365821 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 (DEFAULT_TABLE table=default.Table_b50a2ea6dd054c8282ce507b0c871fb2 [id=7d0ccdf07bf14fd1b7fd55deb990bdae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.392779 29383 raft_consensus.cc:359] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.393049 29383 raft_consensus.cc:385] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.366335 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 379ef43e02ec4bbbb03f2d6a53a66403 (DEFAULT_TABLE table=default.Table_0181eddc78fc4d47b1b0bbd67645ad04 [id=de3384ef7984460abc15ca893a9f8c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.393527 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 379ef43e02ec4bbbb03f2d6a53a66403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.393472 29383 raft_consensus.cc:740] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.393723 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.374809 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1dc756edd5473183afc75eef7112d6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:47.393951 29262 raft_consensus.cc:2468] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:47.377243 29229 tablet_service.cc:1511] Processing CreateTablet for tablet a857c28d94f04dabb9a57aeca662b836 (DEFAULT_TABLE table=default.Table_1e538f92939a4b92a73136b53c355327 [id=3201002f51ca4f788cc1e153333862d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.394615 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a857c28d94f04dabb9a57aeca662b836. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.395766 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_baac68c808f240b481611d52f21d428e" } modify_external_catalogs: true
I20260617 20:16:47.395951 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_baac68c808f240b481611d52f21d428e" } modify_external_catalogs: true
I20260617 20:16:47.377599 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 7e48a4a827d44afca912dc8723be4542 (DEFAULT_TABLE table=default.Table_4f9c31d448d24a98a74ff2af7407a2b1 [id=b24f0a25c8574b62842179a4c9bbc2f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.378942 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "751bffacfaa5427784de63d51fc903dd" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:47.379792 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 7b00437fb76c4000ad89c99ab2da2261 (DEFAULT_TABLE table=default.Table_6f68970fea69478eba2df21752f2ea0a [id=40e28570c43d428b90d13ccc0123be2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.397853 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e48a4a827d44afca912dc8723be4542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.398228 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b00437fb76c4000ad89c99ab2da2261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.400295 29383 consensus_queue.cc:260] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.402462 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f07486abff7b4958baba24d98d53df0a" } modify_external_catalogs: true
I20260617 20:16:47.402657 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f07486abff7b4958baba24d98d53df0a" } modify_external_catalogs: true
I20260617 20:16:47.402465 29651 raft_consensus.cc:515] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.403543 29651 leader_election.cc:290] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:47.403699 29063 leader_election.cc:343] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.403844 29063 leader_election.cc:304] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:47.404131 29549 raft_consensus.cc:2749] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.404623 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1dc756edd5473183afc75eef7112d6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:47.404809 29127 raft_consensus.cc:3060] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.407510 29127 raft_consensus.cc:2468] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:47.409394 28925 leader_election.cc:304] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:47.412776 29651 raft_consensus.cc:2804] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:47.412786 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1dc756edd5473183afc75eef7112d6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:47.412957 29651 raft_consensus.cc:697] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:47.413254 29651 consensus_queue.cc:237] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.416009 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 1f85271eeb854194a968215ebc08f47a
I20260617 20:16:47.417768 29383 ts_tablet_manager.cc:1434] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.131s user 0.002s sys 0.000s
I20260617 20:16:47.417820 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet 3b67b915758d4ab0a8faa0227de08593 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.418190 29383 tablet_bootstrap.cc:492] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:47.418201 29261 raft_consensus.cc:3060] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.421592 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f85271eeb854194a968215ebc08f47a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.422551 29377 raft_consensus.cc:2272] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.423336 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 9d2a38be2e8e4796a98f1ae1d011249f
I20260617 20:16:47.423804 28662 catalog_manager.cc:6784] ReplaceTablet: tablet 9d2a38be2e8e4796a98f1ae1d011249f deleted and replaced by tablet e58fbec4a9f14ddda42b5a4c0263972c
I20260617 20:16:47.424518 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d2a38be2e8e4796a98f1ae1d011249f with delete_type TABLET_DATA_DELETED (replaced by tablet e58fbec4a9f14ddda42b5a4c0263972c) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.425175 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 689121cc9ca647cda1899cdd569da8f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4332e33d60964bd6a0c7e7caaa6bdc76) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:47.427018 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 1f85271eeb854194a968215ebc08f47a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f85271eeb854194a968215ebc08f47a already in progress: creating tablet
I20260617 20:16:47.427556 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d2a38be2e8e4796a98f1ae1d011249f with delete_type TABLET_DATA_DELETED (replaced by tablet e58fbec4a9f14ddda42b5a4c0263972c) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.427760 29377 ts_tablet_manager.cc:1916] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.428328 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f85271eeb854194a968215ebc08f47a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.428767 29376 log.cc:1199] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/5f2ec59ac5864da5a13965ca0724c387
I20260617 20:16:47.429244 29378 tablet_bootstrap.cc:492] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:47.429443 29378 ts_tablet_manager.cc:1403] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.103s user 0.008s sys 0.003s
W20260617 20:16:47.430055 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 9d2a38be2e8e4796a98f1ae1d011249f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d2a38be2e8e4796a98f1ae1d011249f already in progress: creating tablet
I20260617 20:16:47.430075 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 7b00437fb76c4000ad89c99ab2da2261 (DEFAULT_TABLE table=default.Table_6f68970fea69478eba2df21752f2ea0a [id=40e28570c43d428b90d13ccc0123be2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.430342 29378 raft_consensus.cc:359] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.430506 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b00437fb76c4000ad89c99ab2da2261. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.430570 29378 raft_consensus.cc:385] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.430651 29378 raft_consensus.cc:740] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.430971 29378 consensus_queue.cc:260] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.431571 29378 ts_tablet_manager.cc:1434] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:16:47.431869 29378 tablet_bootstrap.cc:492] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.433894 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 5e53946c85ab4a8286a6e174cc411c5e (DEFAULT_TABLE table=default.Table_4f05d3ae468a4e5c83b7566458bc52a4 [id=e682c8658ea84718a5e3909a6f6b7246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.434335 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e53946c85ab4a8286a6e174cc411c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.436640 29378 tablet_bootstrap.cc:654] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.447615 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f85271eeb854194a968215ebc08f47a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.448650 29379 tablet_bootstrap.cc:654] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.451083 29261 raft_consensus.cc:2468] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:47.452950 29377 ts_tablet_manager.cc:1929] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.453117 29377 log.cc:1199] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/cc945cdd482f4a5593d4874e5303ecd2
I20260617 20:16:47.453541 29377 ts_tablet_manager.cc:1950] T cc945cdd482f4a5593d4874e5303ecd2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.454653 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet cc945cdd482f4a5593d4874e5303ecd2 (table default.Table_1d8cf3e5102141cc9d4f9c93d77d385e [id=1222eab9683a43c681e8147c9ff67987]) successfully deleted
W20260617 20:16:47.455417 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet b89b44c6cb2c41409a15708feec0c29b because the tablet was not found. No further retry: Not found: Tablet not found: b89b44c6cb2c41409a15708feec0c29b
I20260617 20:16:47.456671 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c8c3089f552b449095eafc00da38e442
I20260617 20:16:47.457193 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d2a38be2e8e4796a98f1ae1d011249f with delete_type TABLET_DATA_DELETED (replaced by tablet e58fbec4a9f14ddda42b5a4c0263972c) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.458017 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet c8c3089f552b449095eafc00da38e442 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.458709 29377 tablet_replica.cc:333] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.458948 29377 raft_consensus.cc:2243] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.459203 29377 raft_consensus.cc:2272] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.459827 29377 ts_tablet_manager.cc:1916] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.460798 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet c8c3089f552b449095eafc00da38e442 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:47.461216 28654 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet b62b22ff17964ee6934023fb85e0b7ec (table default.Table_905925f76ee34413b4808ebf86465758 [id=c0d29667017e4717bc645aed9382a886], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b62b22ff17964ee6934023fb85e0b7ec consensus state has no leader
I20260617 20:16:47.461644 29383 tablet_bootstrap.cc:654] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.462132 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet c8c3089f552b449095eafc00da38e442 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.462512 29375 tablet_replica.cc:333] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:47.462751 29375 raft_consensus.cc:2243] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.462958 29375 raft_consensus.cc:2272] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.463708 28663 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet e0c44c3fa6f64f929d48de53f2502bfb (table default.Table_648063d260534042bb01e0ae092c195b [id=2dda85266fd14be88479aa0ffec47512]). Expected version 1 got 0
I20260617 20:16:47.463860 29375 ts_tablet_manager.cc:1916] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.466609 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 751bffacfaa5427784de63d51fc903dd with delete_type TABLET_DATA_DELETED (replaced by tablet e7f822e3f4ca4946a116ee172e83628b) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.466611 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 689121cc9ca647cda1899cdd569da8f6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4332e33d60964bd6a0c7e7caaa6bdc76) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.471710 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 5e53946c85ab4a8286a6e174cc411c5e (DEFAULT_TABLE table=default.Table_4f05d3ae468a4e5c83b7566458bc52a4 [id=e682c8658ea84718a5e3909a6f6b7246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.472368 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e53946c85ab4a8286a6e174cc411c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.474035 29377 ts_tablet_manager.cc:1929] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.474180 29377 log.cc:1199] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/4516e7a7fa284eaa816558b2d58cd213
I20260617 20:16:47.474573 29377 ts_tablet_manager.cc:1950] T 4516e7a7fa284eaa816558b2d58cd213 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.475759 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 4516e7a7fa284eaa816558b2d58cd213 (table default.Table_b8d39f0ee1bc44e6be713e55e522b9f3 [id=c02a5e81598b47b9830a236256da4bba]) successfully deleted
I20260617 20:16:47.478366 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 5e53946c85ab4a8286a6e174cc411c5e (DEFAULT_TABLE table=default.Table_4f05d3ae468a4e5c83b7566458bc52a4 [id=e682c8658ea84718a5e3909a6f6b7246]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.478883 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e53946c85ab4a8286a6e174cc411c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.479377 29587 raft_consensus.cc:493] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.479538 29587 raft_consensus.cc:515] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.480454 29587 leader_election.cc:290] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:47.480860 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_34435a212241411bbcd81477e4c63723"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.481458 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b7880a039a497fbd0fb5d4f74e7d23" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:47.481528 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34435a212241411bbcd81477e4c63723 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.481769 28955 tablet_service.cc:1511] Processing CreateTablet for tablet b3ea76ad1ec64d22a64bdd4c97e288c6 (DEFAULT_TABLE table=default.Table_1944004da2ec4937b26d524aa808d0b3 [id=295609419d07485fa5651914ddd75ce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.482272 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ea76ad1ec64d22a64bdd4c97e288c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:47.482594 28925 leader_election.cc:343] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.483049 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_81cf092bd1634c3a82380616f225e4d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.483599 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81cf092bd1634c3a82380616f225e4d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.485157 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c7a5b7a15b93440a82590a995e13b32c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.485631 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b7880a039a497fbd0fb5d4f74e7d23" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:47.485714 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7a5b7a15b93440a82590a995e13b32c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.486955 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e30e536f03054ddb96f199ff4df720f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.487484 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e30e536f03054ddb96f199ff4df720f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.488046 29375 ts_tablet_manager.cc:1929] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.488191 29375 log.cc:1199] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/c8c3089f552b449095eafc00da38e442
I20260617 20:16:47.488605 29375 ts_tablet_manager.cc:1950] T c8c3089f552b449095eafc00da38e442 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:16:47.489168 28925 leader_election.cc:343] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.489487 28925 leader_election.cc:304] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:47.489673 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6e09b7b68e1f406e8e0893e0f3dfba11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.490213 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e09b7b68e1f406e8e0893e0f3dfba11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.490249 29587 raft_consensus.cc:2749] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.491659 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet 1fa15915b0ec44ff8b66920e4c207536 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.493217 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet c8c3089f552b449095eafc00da38e442 (table default.Table_2ef3a206c3e747ada8461a0af6a75a51 [id=9ad5766f74b54846be83c212929b3ecb]) successfully deleted
I20260617 20:16:47.493602 29375 tablet_replica.cc:333] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:47.493913 29375 raft_consensus.cc:2243] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.494120 29375 raft_consensus.cc:2272] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.494899 29376 ts_tablet_manager.cc:1950] T 5f2ec59ac5864da5a13965ca0724c387 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:47.496383 29377 tablet_replica.cc:333] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.496501 29391 raft_consensus.cc:493] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.496616 29377 raft_consensus.cc:2243] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.496814 29377 raft_consensus.cc:2272] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.496747 29391 raft_consensus.cc:515] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:47.497617 29391 leader_election.cc:290] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:47.497831 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c65a4345552844fe9e7512105fd79877
I20260617 20:16:47.499830 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet c65a4345552844fe9e7512105fd79877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.500648 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet c65a4345552844fe9e7512105fd79877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:47.501053 29197 leader_election.cc:343] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: cd312e8817ee4c8fb7377825a7e6122a
W20260617 20:16:47.501228 29198 leader_election.cc:343] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: cd312e8817ee4c8fb7377825a7e6122a
I20260617 20:16:47.501444 29198 leader_election.cc:304] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:47.502039 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet c65a4345552844fe9e7512105fd79877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.502483 29391 raft_consensus.cc:2749] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.502884 29587 raft_consensus.cc:493] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.503049 29587 raft_consensus.cc:515] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.503090 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_de0e4c82e4f54440a70e579ac74c0edd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.503690 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de0e4c82e4f54440a70e579ac74c0edd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.503819 29587 leader_election.cc:290] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:47.504401 29377 ts_tablet_manager.cc:1916] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.504735 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2df17b35a7483b93a6e89d42ac1a62" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:47.505951 28925 leader_election.cc:343] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.505985 29106 tablet_service.cc:1511] Processing CreateTablet for tablet b3ea76ad1ec64d22a64bdd4c97e288c6 (DEFAULT_TABLE table=default.Table_1944004da2ec4937b26d524aa808d0b3 [id=295609419d07485fa5651914ddd75ce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.506410 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ea76ad1ec64d22a64bdd4c97e288c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.506361 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2df17b35a7483b93a6e89d42ac1a62" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:47.509989 28925 leader_election.cc:343] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.510205 28925 leader_election.cc:304] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:47.510735 29549 raft_consensus.cc:493] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.510983 29549 raft_consensus.cc:515] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.511466 29377 ts_tablet_manager.cc:1929] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.511616 29377 log.cc:1199] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/d9b7880a039a497fbd0fb5d4f74e7d23
I20260617 20:16:47.512099 29549 leader_election.cc:290] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:47.512535 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c44c3fa6f64f929d48de53f2502bfb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:47.512775 28989 raft_consensus.cc:2468] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:47.512961 29391 raft_consensus.cc:493] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.513175 29391 raft_consensus.cc:515] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.513338 29062 leader_election.cc:304] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:47.513913 29377 ts_tablet_manager.cc:1950] T d9b7880a039a497fbd0fb5d4f74e7d23 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.514065 29391 leader_election.cc:290] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:47.515120 29549 raft_consensus.cc:2804] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:47.515195 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet d9b7880a039a497fbd0fb5d4f74e7d23 (table default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]) successfully deleted
I20260617 20:16:47.515261 29549 raft_consensus.cc:493] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:47.515380 29549 raft_consensus.cc:3060] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.515728 29377 tablet_replica.cc:333] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.516477 29651 raft_consensus.cc:2749] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.516964 29377 raft_consensus.cc:2243] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.517225 29377 raft_consensus.cc:2272] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.517994 29377 ts_tablet_manager.cc:1916] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:47.520413 29198 leader_election.cc:343] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: c8c3089f552b449095eafc00da38e442
I20260617 20:16:47.522074 29376 tablet_replica.cc:333] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:47.522372 29376 raft_consensus.cc:2243] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.522606 29376 raft_consensus.cc:2272] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.522921 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c3089f552b449095eafc00da38e442" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:47.523175 28989 raft_consensus.cc:2468] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:47.525022 29197 leader_election.cc:304] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:47.526050 29391 raft_consensus.cc:2804] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:47.526156 29391 raft_consensus.cc:493] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:47.526270 29391 raft_consensus.cc:3060] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.526924 29549 raft_consensus.cc:515] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.528293 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c44c3fa6f64f929d48de53f2502bfb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:47.528535 28989 raft_consensus.cc:3060] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.529088 29391 raft_consensus.cc:515] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.529939 29391 leader_election.cc:290] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:47.529800 29671 consensus_queue.cc:1048] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:47.530694 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c44c3fa6f64f929d48de53f2502bfb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:47.531307 29377 ts_tablet_manager.cc:1929] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.531505 29377 log.cc:1199] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/fa513612e44148d7983b0db00d733888
I20260617 20:16:47.532053 29377 ts_tablet_manager.cc:1950] T fa513612e44148d7983b0db00d733888 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.532683 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8c3089f552b449095eafc00da38e442" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:47.532871 28990 raft_consensus.cc:3060] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.533289 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet fa513612e44148d7983b0db00d733888 (table default.Table_e07e30476d764b83aabfde1a21b2d5a6 [id=8ff99ac5540d43c7aebd37573a0c6790]) successfully deleted
W20260617 20:16:47.534075 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 113fbbc739d04f529e82bc1cf1074bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 113fbbc739d04f529e82bc1cf1074bd7 already in progress: creating tablet
W20260617 20:16:47.534756 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 17917ffc3e8f43afb2a8bc413159137c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17917ffc3e8f43afb2a8bc413159137c already in progress: creating tablet
I20260617 20:16:47.535162 29377 tablet_replica.cc:333] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.535477 29377 raft_consensus.cc:2243] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.535748 29377 raft_consensus.cc:2272] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.536705 29377 ts_tablet_manager.cc:1916] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.537179 28990 raft_consensus.cc:2468] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:16:47.538729 29063 leader_election.cc:343] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:47.539934 29198 leader_election.cc:343] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: c8c3089f552b449095eafc00da38e442
I20260617 20:16:47.540503 28667 catalog_manager.cc:5696] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } }
I20260617 20:16:47.540977 28667 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_8b66113312ca4c2297d9b65f8c6dcf6c [id=0ece007078c749e3bd4bab93ada3b311]). Expected version 2 got 0
I20260617 20:16:47.541623 29486 raft_consensus.cc:493] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.541811 29486 raft_consensus.cc:515] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.542615 29486 leader_election.cc:290] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:47.542627 29197 leader_election.cc:304] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:47.542927 29671 raft_consensus.cc:2804] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:47.543097 29671 raft_consensus.cc:697] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:47.543385 29671 consensus_queue.cc:237] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:47.544176 29062 leader_election.cc:343] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 689121cc9ca647cda1899cdd569da8f6
I20260617 20:16:47.544808 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c44c3fa6f64f929d48de53f2502bfb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:47.532004 28989 raft_consensus.cc:2468] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:47.546080 29062 leader_election.cc:304] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:47.546447 29486 raft_consensus.cc:2804] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:47.546701 29379 tablet_bootstrap.cc:492] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:47.546932 29379 ts_tablet_manager.cc:1403] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.187s user 0.011s sys 0.000s
I20260617 20:16:47.547966 29379 raft_consensus.cc:359] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.548180 29379 raft_consensus.cc:385] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.548306 29379 raft_consensus.cc:740] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.548645 29379 consensus_queue.cc:260] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.550817 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 16d0360ec78844a1be3d5f51259bbcdf (DEFAULT_TABLE table=default.Table_98b224ec50f84ea494d5b70aeaa1f728 [id=a27723f7b3f545288e30fe60ff87669b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.551290 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d0360ec78844a1be3d5f51259bbcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.554229 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9
I20260617 20:16:47.554867 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f32ebd7448843b48b981d3d70a87023 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.554903 29486 raft_consensus.cc:697] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:47.555181 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.555215 29486 consensus_queue.cc:237] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.560889 29377 ts_tablet_manager.cc:1929] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.561070 29377 log.cc:1199] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/28146a1f84aa41ee88d9aea299256a90
I20260617 20:16:47.527962 29549 leader_election.cc:290] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:47.563087 29063 leader_election.cc:343] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.563544 29377 ts_tablet_manager.cc:1950] T 28146a1f84aa41ee88d9aea299256a90 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.564046 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689121cc9ca647cda1899cdd569da8f6" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:47.564411 29261 raft_consensus.cc:2468] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:47.564587 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 64bb6d176a4845eca312848ae5104647 (DEFAULT_TABLE table=default.Table_e67bded1adac4a9194ee9f5f1131ed12 [id=6e89910c5d7a4969a79960d34eff437c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.564724 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 28146a1f84aa41ee88d9aea299256a90 (table default.Table_6ed5c9767b364748ae14ecead288e68c [id=eeb28ad64e5f425988b6e1667865134d]) successfully deleted
I20260617 20:16:47.565048 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bb6d176a4845eca312848ae5104647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.565881 29063 leader_election.cc:304] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:47.566488 29675 raft_consensus.cc:2804] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:47.567242 29377 tablet_replica.cc:333] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.567448 29675 raft_consensus.cc:493] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:47.567785 29675 raft_consensus.cc:3060] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.571401 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.574717 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 64bb6d176a4845eca312848ae5104647 (DEFAULT_TABLE table=default.Table_e67bded1adac4a9194ee9f5f1131ed12 [id=6e89910c5d7a4969a79960d34eff437c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.575212 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bb6d176a4845eca312848ae5104647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.575791 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c15392db137446b2bd84cf9f31337718
I20260617 20:16:47.576797 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet c15392db137446b2bd84cf9f31337718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.578245 29675 raft_consensus.cc:515] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.579322 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 16d0360ec78844a1be3d5f51259bbcdf (DEFAULT_TABLE table=default.Table_98b224ec50f84ea494d5b70aeaa1f728 [id=a27723f7b3f545288e30fe60ff87669b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.579777 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d0360ec78844a1be3d5f51259bbcdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:47.580132 29062 leader_election.cc:343] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 689121cc9ca647cda1899cdd569da8f6
I20260617 20:16:47.580395 29675 leader_election.cc:290] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:47.581640 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.583083 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0cc10f7657a2450294f6ce1e33fb609e" } new_table_name: "default.Table_921dd6771a094e7cb638a0bcd034177e" modify_external_catalogs: true
I20260617 20:16:47.584448 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689121cc9ca647cda1899cdd569da8f6" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:47.584708 29261 raft_consensus.cc:3060] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.585110 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 64bb6d176a4845eca312848ae5104647 (DEFAULT_TABLE table=default.Table_e67bded1adac4a9194ee9f5f1131ed12 [id=6e89910c5d7a4969a79960d34eff437c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.587760 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bb6d176a4845eca312848ae5104647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.587984 28955 tablet_service.cc:1511] Processing CreateTablet for tablet b1b3565799894d82a3cc29ab2a19307c (DEFAULT_TABLE table=default.Table_2f2534b9a19341bdb7f92a6da5470fea [id=2133bdb470c34a7dbc0508a2d780094b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.588124 29261 raft_consensus.cc:2468] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:47.588469 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b3565799894d82a3cc29ab2a19307c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.545198 29376 ts_tablet_manager.cc:1916] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.594837 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1e538f92939a4b92a73136b53c355327" } new_table_name: "default.Table_1d1b3b6470e146c189f41d0e2fcd63c5" modify_external_catalogs: true
I20260617 20:16:47.588691 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 16d0360ec78844a1be3d5f51259bbcdf (DEFAULT_TABLE table=default.Table_98b224ec50f84ea494d5b70aeaa1f728 [id=a27723f7b3f545288e30fe60ff87669b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.589164 29063 leader_election.cc:304] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:47.597580 29379 ts_tablet_manager.cc:1434] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.051s user 0.003s sys 0.000s
I20260617 20:16:47.598076 29379 tablet_bootstrap.cc:492] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:47.599067 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16d0360ec78844a1be3d5f51259bbcdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.600564 29379 tablet_bootstrap.cc:654] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.603274 29675 raft_consensus.cc:2804] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:47.603506 29675 raft_consensus.cc:697] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:47.604002 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 70698bb6ff6f4fe0b465f2974fcc24ea (DEFAULT_TABLE table=default.Table_34162dc1609a4227bb4824e0674ecf7c [id=b997135a77454a3b83cbd538427aa2f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.604054 29675 consensus_queue.cc:237] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.604545 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70698bb6ff6f4fe0b465f2974fcc24ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.609011 29379 tablet_bootstrap.cc:492] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:47.609238 29379 ts_tablet_manager.cc:1403] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20260617 20:16:47.610123 29379 raft_consensus.cc:359] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.610352 29379 raft_consensus.cc:385] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.610466 29379 raft_consensus.cc:740] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.610716 29379 consensus_queue.cc:260] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.611285 29379 ts_tablet_manager.cc:1434] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:47.611726 29379 tablet_bootstrap.cc:492] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:47.611881 29549 raft_consensus.cc:493] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.612952 29549 raft_consensus.cc:515] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.613873 29549 leader_election.cc:290] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:47.614209 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 5f2ec59ac5864da5a13965ca0724c387 (table default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]) successfully deleted
I20260617 20:16:47.614333 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15392db137446b2bd84cf9f31337718" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
W20260617 20:16:47.614550 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 8eee68618cdf462283d7fd9f098c2a0d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eee68618cdf462283d7fd9f098c2a0d already in progress: creating tablet
I20260617 20:16:47.614568 28989 raft_consensus.cc:2468] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
W20260617 20:16:47.614781 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 1d4be33993864c73ba8b4da9468a517b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d4be33993864c73ba8b4da9468a517b already in progress: creating tablet
I20260617 20:16:47.615103 29062 leader_election.cc:304] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:47.615619 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet c15392db137446b2bd84cf9f31337718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.615947 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet c15392db137446b2bd84cf9f31337718 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.617105 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15392db137446b2bd84cf9f31337718" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:47.617223 29095 tablet_service.cc:1511] Processing CreateTablet for tablet b1b3565799894d82a3cc29ab2a19307c (DEFAULT_TABLE table=default.Table_2f2534b9a19341bdb7f92a6da5470fea [id=2133bdb470c34a7dbc0508a2d780094b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.617267 28954 tablet_service.cc:1511] Processing CreateTablet for tablet d1654ae96ce041fa9b9b881af7dd342e (DEFAULT_TABLE table=default.Table_1d839677a1834e13914e3c77a8f38f01 [id=82e506e43d294d23988395ecdb33cffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.617676 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b3565799894d82a3cc29ab2a19307c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.617700 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1654ae96ce041fa9b9b881af7dd342e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.617797 29675 raft_consensus.cc:2804] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:47.617880 29675 raft_consensus.cc:493] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:47.617976 29675 raft_consensus.cc:3060] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:47.618938 29063 leader_election.cc:343] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.620966 29675 raft_consensus.cc:515] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.621625 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_70b590da38ef4a27ae05d708c04f63b4" } new_table_name: "default.Table_df31bee3761040b9973aa917f8f1e0a0" modify_external_catalogs: true
I20260617 20:16:47.622999 29225 tablet_service.cc:1511] Processing CreateTablet for tablet b3ea76ad1ec64d22a64bdd4c97e288c6 (DEFAULT_TABLE table=default.Table_1944004da2ec4937b26d524aa808d0b3 [id=295609419d07485fa5651914ddd75ce8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.623430 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ea76ad1ec64d22a64bdd4c97e288c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.624828 29379 tablet_bootstrap.cc:654] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.626827 29383 tablet_bootstrap.cc:492] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:47.626989 29383 ts_tablet_manager.cc:1403] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.209s user 0.004s sys 0.007s
I20260617 20:16:47.627784 29383 raft_consensus.cc:359] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.627990 29383 raft_consensus.cc:385] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.628497 29383 raft_consensus.cc:740] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.628777 29383 consensus_queue.cc:260] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.629737 29383 ts_tablet_manager.cc:1434] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:16:47.630095 29383 tablet_bootstrap.cc:492] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:47.631198 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_505122dc15184b1ebf4723f9624205c6" } new_table_name: "default.Table_20b86d94fc1845f7890c393e5f122ae7" modify_external_catalogs: true
I20260617 20:16:47.631862 29383 tablet_bootstrap.cc:654] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:47.635586 29198 consensus_peers.cc:597] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55e4ef1f493c4f1289cfa192ce38161d. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:47.641160 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 0bbef4cc28ef46288cfc7d1933c71710 (DEFAULT_TABLE table=default.Table_8fba56a5136b4fbdadd7d783aaf1e9e9 [id=9850785700a84b33a30caf29ab508aea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.641564 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet e0c44c3fa6f64f929d48de53f2502bfb (table default.Table_648063d260534042bb01e0ae092c195b [id=2dda85266fd14be88479aa0ffec47512]). Expected version 1 got 0
I20260617 20:16:47.641651 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bbef4cc28ef46288cfc7d1933c71710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.642908 28665 catalog_manager.cc:5696] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194). New cstate: current_term: 1 leader_uuid: "6d4ce30e1fce4591b64c398747f8d37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:47.643298 28665 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet e0c44c3fa6f64f929d48de53f2502bfb (table default.Table_648063d260534042bb01e0ae092c195b [id=2dda85266fd14be88479aa0ffec47512]). Expected version 1 got 0
I20260617 20:16:47.643618 29375 ts_tablet_manager.cc:1916] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.647123 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 70698bb6ff6f4fe0b465f2974fcc24ea (DEFAULT_TABLE table=default.Table_34162dc1609a4227bb4824e0674ecf7c [id=b997135a77454a3b83cbd538427aa2f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.647395 29099 tablet_service.cc:1511] Processing CreateTablet for tablet d1654ae96ce041fa9b9b881af7dd342e (DEFAULT_TABLE table=default.Table_1d839677a1834e13914e3c77a8f38f01 [id=82e506e43d294d23988395ecdb33cffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.647730 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70698bb6ff6f4fe0b465f2974fcc24ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.648710 29242 tablet_service.cc:1511] Processing CreateTablet for tablet b1b3565799894d82a3cc29ab2a19307c (DEFAULT_TABLE table=default.Table_2f2534b9a19341bdb7f92a6da5470fea [id=2133bdb470c34a7dbc0508a2d780094b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.648816 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 70698bb6ff6f4fe0b465f2974fcc24ea (DEFAULT_TABLE table=default.Table_34162dc1609a4227bb4824e0674ecf7c [id=b997135a77454a3b83cbd538427aa2f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.649176 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b3565799894d82a3cc29ab2a19307c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.653776 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1654ae96ce041fa9b9b881af7dd342e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.655369 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 8880f8eadaa44887a49adf0ef157965e (DEFAULT_TABLE table=default.Table_e45ba70d8b294bf99ddca3f80857df76 [id=7a4a3c7360114f72b54f5dd645215114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.655875 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8880f8eadaa44887a49adf0ef157965e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.656052 29671 raft_consensus.cc:493] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.656211 29671 raft_consensus.cc:515] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:16:47.656903 29671 leader_election.cc:290] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:47.657409 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 1fa15915b0ec44ff8b66920e4c207536
I20260617 20:16:47.657864 28669 catalog_manager.cc:6784] ReplaceTablet: tablet 1fa15915b0ec44ff8b66920e4c207536 deleted and replaced by tablet d4130f3529ef4adaa4cedf12e53b6895
W20260617 20:16:47.658206 29197 leader_election.cc:343] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d66923e12e1843bcbcb3da93cf838b65
I20260617 20:16:47.658242 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fa15915b0ec44ff8b66920e4c207536 with delete_type TABLET_DATA_DELETED (replaced by tablet d4130f3529ef4adaa4cedf12e53b6895) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:47.659644 29198 leader_election.cc:343] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: d66923e12e1843bcbcb3da93cf838b65
I20260617 20:16:47.659782 29198 leader_election.cc:304] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:47.660034 29671 raft_consensus.cc:2749] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.660281 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70698bb6ff6f4fe0b465f2974fcc24ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.661170 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 0bbef4cc28ef46288cfc7d1933c71710 (DEFAULT_TABLE table=default.Table_8fba56a5136b4fbdadd7d783aaf1e9e9 [id=9850785700a84b33a30caf29ab508aea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.661618 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bbef4cc28ef46288cfc7d1933c71710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.661621 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_99e2a4b9958548c38b48f359a9a50f00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.662171 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99e2a4b9958548c38b48f359a9a50f00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.663525 29229 tablet_service.cc:1511] Processing CreateTablet for tablet d1654ae96ce041fa9b9b881af7dd342e (DEFAULT_TABLE table=default.Table_1d839677a1834e13914e3c77a8f38f01 [id=82e506e43d294d23988395ecdb33cffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.663914 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1654ae96ce041fa9b9b881af7dd342e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.671895 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15392db137446b2bd84cf9f31337718" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
W20260617 20:16:47.672446 29063 leader_election.cc:343] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.673261 29377 raft_consensus.cc:2243] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.673852 29377 pending_rounds.cc:70] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: Trying to abort 1 pending ops.
I20260617 20:16:47.673928 29377 pending_rounds.cc:77] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955457923174400 op_type: NO_OP noop_request { }
I20260617 20:16:47.674049 29377 raft_consensus.cc:2889] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:47.674160 29377 raft_consensus.cc:2272] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.680981 29378 tablet_bootstrap.cc:492] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:47.681136 29378 ts_tablet_manager.cc:1403] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.249s user 0.020s sys 0.046s
I20260617 20:16:47.682103 29378 raft_consensus.cc:359] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.682310 29378 raft_consensus.cc:385] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.682397 29378 raft_consensus.cc:740] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.682644 29378 consensus_queue.cc:260] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.683537 29378 ts_tablet_manager.cc:1434] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:47.683848 29378 tablet_bootstrap.cc:492] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.684054 29587 raft_consensus.cc:493] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.684209 29587 raft_consensus.cc:515] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.684823 29587 leader_election.cc:290] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:47.685328 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a43dd885aa4411a4177b67807b0ac4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:47.685842 28925 leader_election.cc:343] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:47.687232 29197 consensus_peers.cc:597] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:47.687779 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a43dd885aa4411a4177b67807b0ac4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:47.688428 29378 tablet_bootstrap.cc:654] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:47.688865 28925 leader_election.cc:343] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.689018 28925 leader_election.cc:304] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:47.689343 29587 raft_consensus.cc:2749] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.690649 29377 ts_tablet_manager.cc:1916] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.692895 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 1f32ebd7448843b48b981d3d70a87023
I20260617 20:16:47.693356 28670 catalog_manager.cc:6784] ReplaceTablet: tablet 1f32ebd7448843b48b981d3d70a87023 deleted and replaced by tablet 44b9b042412f4b219c1dbbe4ed5cde1a
I20260617 20:16:47.693554 29675 leader_election.cc:290] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:47.695359 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 0bbef4cc28ef46288cfc7d1933c71710 (DEFAULT_TABLE table=default.Table_8fba56a5136b4fbdadd7d783aaf1e9e9 [id=9850785700a84b33a30caf29ab508aea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.695899 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bbef4cc28ef46288cfc7d1933c71710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.697135 29378 tablet_bootstrap.cc:492] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:47.697340 29378 ts_tablet_manager.cc:1403] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.003s
I20260617 20:16:47.697561 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c15392db137446b2bd84cf9f31337718" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:47.697865 28988 raft_consensus.cc:3060] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.699186 29378 raft_consensus.cc:359] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.699432 29378 raft_consensus.cc:385] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.700464 29377 ts_tablet_manager.cc:1929] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:47.700373 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1b50b384a47942e89ce8033d7d491a1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.700618 29377 log.cc:1199] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/55e4ef1f493c4f1289cfa192ce38161d
W20260617 20:16:47.701035 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b50b384a47942e89ce8033d7d491a1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.701085 29377 ts_tablet_manager.cc:1950] T 55e4ef1f493c4f1289cfa192ce38161d P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.702219 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 55e4ef1f493c4f1289cfa192ce38161d (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]) successfully deleted
I20260617 20:16:47.702723 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4f9c31d448d24a98a74ff2af7407a2b1" } new_table_name: "default.Table_e6908a670d534e828a0770f48cace3db" modify_external_catalogs: true
I20260617 20:16:47.703780 29379 tablet_bootstrap.cc:492] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:47.703941 29379 ts_tablet_manager.cc:1403] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.092s user 0.001s sys 0.004s
W20260617 20:16:47.703989 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b162a0ef91d1447b838331ba6ef93bf4 consensus state has no leader
I20260617 20:16:47.704767 29379 raft_consensus.cc:359] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.704970 29379 raft_consensus.cc:385] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.705063 29379 raft_consensus.cc:740] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.705365 29379 consensus_queue.cc:260] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.705889 29379 ts_tablet_manager.cc:1434] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:47.706243 29379 tablet_bootstrap.cc:492] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:47.708001 29379 tablet_bootstrap.cc:654] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.708247 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_706c0e9f917f49388f2da836758dcf8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.708801 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_706c0e9f917f49388f2da836758dcf8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.711652 29376 ts_tablet_manager.cc:1929] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.711982 29376 log.cc:1199] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/1199d8c7f1dc4b8f99301b8f60c687d1
I20260617 20:16:47.714073 29376 ts_tablet_manager.cc:1950] T 1199d8c7f1dc4b8f99301b8f60c687d1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
W20260617 20:16:47.715046 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a857c28d94f04dabb9a57aeca662b836 consensus state has no leader
I20260617 20:16:47.715260 29486 raft_consensus.cc:493] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.715405 29486 raft_consensus.cc:515] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.717274 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4be33993864c73ba8b4da9468a517b" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:47.719610 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 8880f8eadaa44887a49adf0ef157965e (DEFAULT_TABLE table=default.Table_e45ba70d8b294bf99ddca3f80857df76 [id=7a4a3c7360114f72b54f5dd645215114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.719678 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8e019e33cf25495289e2e63f59c874ef" } modify_external_catalogs: true
I20260617 20:16:47.719882 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8e019e33cf25495289e2e63f59c874ef" } modify_external_catalogs: true
I20260617 20:16:47.720191 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fa15915b0ec44ff8b66920e4c207536 with delete_type TABLET_DATA_DELETED (replaced by tablet d4130f3529ef4adaa4cedf12e53b6895) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.702560 29377 tablet_replica.cc:333] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.701251 28988 raft_consensus.cc:2468] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:47.699522 29378 raft_consensus.cc:740] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.720717 29377 raft_consensus.cc:2243] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.720912 29377 raft_consensus.cc:2272] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.720795 29378 consensus_queue.cc:260] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.721365 29378 ts_tablet_manager.cc:1434] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20260617 20:16:47.721690 29377 ts_tablet_manager.cc:1916] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.721696 29378 tablet_bootstrap.cc:492] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.723641 29378 tablet_bootstrap.cc:654] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.726505 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f32ebd7448843b48b981d3d70a87023 with delete_type TABLET_DATA_DELETED (replaced by tablet 44b9b042412f4b219c1dbbe4ed5cde1a) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.727035 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8880f8eadaa44887a49adf0ef157965e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.727977 29377 ts_tablet_manager.cc:1929] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.728093 29377 log.cc:1199] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/637b0b3e9cb648deaea6e63760b83255
I20260617 20:16:47.728464 29377 ts_tablet_manager.cc:1950] T 637b0b3e9cb648deaea6e63760b83255 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.729395 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 637b0b3e9cb648deaea6e63760b83255 (table default.Table_e45ba70d8b294bf99ddca3f80857df76 [id=7a4a3c7360114f72b54f5dd645215114]) successfully deleted
I20260617 20:16:47.702674 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f32ebd7448843b48b981d3d70a87023 with delete_type TABLET_DATA_DELETED (replaced by tablet 44b9b042412f4b219c1dbbe4ed5cde1a) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:47.730502 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 9d2a38be2e8e4796a98f1ae1d011249f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d2a38be2e8e4796a98f1ae1d011249f already in progress: creating tablet
W20260617 20:16:47.731088 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 1f85271eeb854194a968215ebc08f47a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f85271eeb854194a968215ebc08f47a already in progress: creating tablet
I20260617 20:16:47.731448 29377 tablet_replica.cc:333] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.731873 29377 raft_consensus.cc:2243] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.734153 29377 raft_consensus.cc:2272] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.734494 29261 raft_consensus.cc:1275] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Refusing update from remote peer 5ca3d93189744132bbf55ac01f3a8254: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:47.735167 29587 consensus_queue.cc:1048] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:47.736229 29377 ts_tablet_manager.cc:1916] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.737501 29681 raft_consensus.cc:493] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.737624 29681 raft_consensus.cc:515] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.738301 29681 leader_election.cc:290] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:47.739328 29197 leader_election.cc:343] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: faa73e73cc9b4fb28cdc87d259f5e7bb
I20260617 20:16:47.741252 29486 leader_election.cc:290] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:47.743541 29383 tablet_bootstrap.cc:492] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:47.743674 29383 ts_tablet_manager.cc:1403] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.114s user 0.001s sys 0.002s
W20260617 20:16:47.743734 29062 leader_election.cc:343] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1d4be33993864c73ba8b4da9468a517b
I20260617 20:16:47.743988 29062 leader_election.cc:304] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:47.744382 29383 raft_consensus.cc:359] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.744552 29383 raft_consensus.cc:385] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.744623 29383 raft_consensus.cc:740] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
W20260617 20:16:47.745230 29063 leader_election.cc:343] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:47.745497 29063 leader_election.cc:304] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:47.746311 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 8880f8eadaa44887a49adf0ef157965e (DEFAULT_TABLE table=default.Table_e45ba70d8b294bf99ddca3f80857df76 [id=7a4a3c7360114f72b54f5dd645215114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.747532 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8880f8eadaa44887a49adf0ef157965e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.747958 29486 raft_consensus.cc:2804] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
W20260617 20:16:47.748471 29198 leader_election.cc:343] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: faa73e73cc9b4fb28cdc87d259f5e7bb
I20260617 20:16:47.748612 29198 leader_election.cc:304] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:47.748699 29486 raft_consensus.cc:697] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:47.748952 29486 consensus_queue.cc:237] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.749076 29681 raft_consensus.cc:2749] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.749697 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fa15915b0ec44ff8b66920e4c207536 with delete_type TABLET_DATA_DELETED (replaced by tablet d4130f3529ef4adaa4cedf12e53b6895) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.750016 29675 raft_consensus.cc:2749] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.751442 29128 raft_consensus.cc:1275] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Refusing update from remote peer 5ca3d93189744132bbf55ac01f3a8254: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:47.751916 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f32ebd7448843b48b981d3d70a87023 with delete_type TABLET_DATA_DELETED (replaced by tablet 44b9b042412f4b219c1dbbe4ed5cde1a) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.752106 29587 consensus_queue.cc:1048] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:16:47.752650 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d0c245563fe44b59d32616bd35d3dae consensus state has no leader
I20260617 20:16:47.753144 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 9d4702c06d3442ac966ef2daca8d4660 from {username='slave'} at 127.0.0.1:60552
W20260617 20:16:47.761233 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4130f3529ef4adaa4cedf12e53b6895 has no consensus state
I20260617 20:16:47.761555 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet dd2df17b35a7483b93a6e89d42ac1a62 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.762318 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet 9d2a38be2e8e4796a98f1ae1d011249f from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.762413 29378 tablet_bootstrap.cc:492] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:47.762558 29378 ts_tablet_manager.cc:1403] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.007s
I20260617 20:16:47.763212 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet e0c44c3fa6f64f929d48de53f2502bfb (table default.Table_648063d260534042bb01e0ae092c195b [id=2dda85266fd14be88479aa0ffec47512]). Expected version 1 got 0
I20260617 20:16:47.763411 29378 raft_consensus.cc:359] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.763588 29378 raft_consensus.cc:385] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.763675 29378 raft_consensus.cc:740] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.763885 29378 consensus_queue.cc:260] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.764530 29378 ts_tablet_manager.cc:1434] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:47.764822 29378 tablet_bootstrap.cc:492] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.763207 29383 consensus_queue.cc:260] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.766664 29378 tablet_bootstrap.cc:654] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:47.770098 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e48a4a827d44afca912dc8723be4542 consensus state has no leader
I20260617 20:16:47.770816 28664 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 44b9b042412f4b219c1dbbe4ed5cde1a
I20260617 20:16:47.773226 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bf43c1c307304b35a6b33eb8fb011be2" } modify_external_catalogs: true
I20260617 20:16:47.773504 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bf43c1c307304b35a6b33eb8fb011be2" } modify_external_catalogs: true
I20260617 20:16:47.773198 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_648063d260534042bb01e0ae092c195b" } modify_external_catalogs: true
I20260617 20:16:47.774111 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_648063d260534042bb01e0ae092c195b" } modify_external_catalogs: true
I20260617 20:16:47.775012 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_486a2491b91d4d4899c49ae5065acbcd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.773226 29383 ts_tablet_manager.cc:1434] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20260617 20:16:47.775238 29376 tablet_replica.cc:333] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:16:47.775588 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_486a2491b91d4d4899c49ae5065acbcd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.777062 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2f2534b9a19341bdb7f92a6da5470fea" } modify_external_catalogs: true
I20260617 20:16:47.777228 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2f2534b9a19341bdb7f92a6da5470fea" } modify_external_catalogs: true
I20260617 20:16:47.778719 29376 raft_consensus.cc:2243] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.779054 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 1199d8c7f1dc4b8f99301b8f60c687d1 (table default.Table_0ba339c37163434e8c628ef515624fe1 [id=8696ed2b09fd4e06a0f2746537370766]) successfully deleted
I20260617 20:16:47.779610 29378 tablet_bootstrap.cc:492] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:47.779790 29378 ts_tablet_manager.cc:1403] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.002s
I20260617 20:16:47.779322 29383 tablet_bootstrap.cc:492] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:47.780319 29376 raft_consensus.cc:2272] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.782016 29378 raft_consensus.cc:359] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.782250 29378 raft_consensus.cc:385] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.782332 29378 raft_consensus.cc:740] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.783106 29376 ts_tablet_manager.cc:1916] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.783110 29378 consensus_queue.cc:260] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.783799 29425 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.252:46059
I20260617 20:16:47.786399 29425 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-2/data/info.pb
I20260617 20:16:47.786753 29379 tablet_bootstrap.cc:492] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:47.786994 29379 ts_tablet_manager.cc:1403] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.081s user 0.002s sys 0.006s
I20260617 20:16:47.787317 29698 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.252:46059 every 8 connection(s)
I20260617 20:16:47.788858 29378 ts_tablet_manager.cc:1434] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260617 20:16:47.790800 29379 raft_consensus.cc:359] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.791076 29379 raft_consensus.cc:385] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.791405 29379 raft_consensus.cc:740] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.791469 28631 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRePpQS/build/asan/bin/kudu as pid 29425
I20260617 20:16:47.791733 29379 consensus_queue.cc:260] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.792361 29379 ts_tablet_manager.cc:1434] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 20:16:47.792721 29379 tablet_bootstrap.cc:492] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:47.794896 29383 tablet_bootstrap.cc:654] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.799615 29375 ts_tablet_manager.cc:1929] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.799891 29375 log.cc:1199] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/751bffacfaa5427784de63d51fc903dd
I20260617 20:16:47.800638 29375 ts_tablet_manager.cc:1950] T 751bffacfaa5427784de63d51fc903dd P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:47.801931 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet e0c44c3fa6f64f929d48de53f2502bfb
I20260617 20:16:47.802130 29378 tablet_bootstrap.cc:492] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.803078 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet e0c44c3fa6f64f929d48de53f2502bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.811468 29377 ts_tablet_manager.cc:1929] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.811655 29377 log.cc:1199] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/c8c3089f552b449095eafc00da38e442
I20260617 20:16:47.811811 29383 tablet_bootstrap.cc:492] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:47.812032 29383 ts_tablet_manager.cc:1403] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.002s
I20260617 20:16:47.812203 29377 ts_tablet_manager.cc:1950] T c8c3089f552b449095eafc00da38e442 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:47.813059 29383 raft_consensus.cc:359] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.813336 29383 raft_consensus.cc:385] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.813383 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet c8c3089f552b449095eafc00da38e442 (table default.Table_2ef3a206c3e747ada8461a0af6a75a51 [id=9ad5766f74b54846be83c212929b3ecb]) successfully deleted
I20260617 20:16:47.813426 29383 raft_consensus.cc:740] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.813778 29377 tablet_replica.cc:333] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:47.818893 29681 raft_consensus.cc:493] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.819105 29681 raft_consensus.cc:515] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.819973 29681 leader_election.cc:290] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:47.820713 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c44c3fa6f64f929d48de53f2502bfb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:47.821066 28988 raft_consensus.cc:2393] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 6d4ce30e1fce4591b64c398747f8d37a in this term.
I20260617 20:16:47.823161 29378 tablet_bootstrap.cc:654] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.827121 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0ba339c37163434e8c628ef515624fe1" } modify_external_catalogs: true
I20260617 20:16:47.827354 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0ba339c37163434e8c628ef515624fe1" } modify_external_catalogs: true
I20260617 20:16:47.828164 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet e0c44c3fa6f64f929d48de53f2502bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.830099 29262 raft_consensus.cc:3060] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:47.831735 29375 tablet_replica.cc:333] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:47.831739 29383 consensus_queue.cc:260] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.831924 29375 raft_consensus.cc:2243] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:47.832171 29375 pending_rounds.cc:70] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:47.832231 29375 pending_rounds.cc:77] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955461565890560 op_type: NO_OP noop_request { }
I20260617 20:16:47.832340 29375 raft_consensus.cc:2889] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:47.832422 29375 raft_consensus.cc:2272] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.832556 29383 ts_tablet_manager.cc:1434] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.020s user 0.000s sys 0.003s
I20260617 20:16:47.832854 29383 tablet_bootstrap.cc:492] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:47.833142 29262 raft_consensus.cc:1275] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Refusing update from remote peer 6d4ce30e1fce4591b64c398747f8d37a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:47.833349 29375 ts_tablet_manager.cc:1916] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.834628 29383 tablet_bootstrap.cc:654] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.835000 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 751bffacfaa5427784de63d51fc903dd (table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]) successfully deleted
I20260617 20:16:47.813977 29377 raft_consensus.cc:2243] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 20:16:47.836217 29587 raft_consensus.cc:670] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260617 20:16:47.836618 29377 raft_consensus.cc:2272] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.837364 29377 ts_tablet_manager.cc:1916] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.804852 29379 tablet_bootstrap.cc:654] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.820472 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0c44c3fa6f64f929d48de53f2502bfb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:47.841476 29198 leader_election.cc:304] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:47.841802 29681 raft_consensus.cc:2749] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:47.826045 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet e0c44c3fa6f64f929d48de53f2502bfb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.842622 29376 ts_tablet_manager.cc:1929] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:47.845679 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_8b66113312ca4c2297d9b65f8c6dcf6c [id=0ece007078c749e3bd4bab93ada3b311]). Expected version 2 got 0
I20260617 20:16:47.846221 29376 log.cc:1199] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/365e0ffb939047898243f72e4053d9a1
I20260617 20:16:47.846720 29376 ts_tablet_manager.cc:1950] T 365e0ffb939047898243f72e4053d9a1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:47.847934 29376 tablet_replica.cc:333] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:47.848013 29675 consensus_queue.cc:1048] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:47.848230 29376 raft_consensus.cc:2243] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:47.848405 29376 raft_consensus.cc:2272] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.848582 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d4be33993864c73ba8b4da9468a517b with delete_type TABLET_DATA_DELETED (replaced by tablet 64bb6d176a4845eca312848ae5104647) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.849083 29376 ts_tablet_manager.cc:1916] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:47.845827 29709 tablet.cc:1724] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:47.849823 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 365e0ffb939047898243f72e4053d9a1 (table default.Table_921dd6771a094e7cb638a0bcd034177e [id=fa80809528dd419192774bcc7ac5f5bf]) successfully deleted
I20260617 20:16:47.851044 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81a3502f5d4602b65328577a668d62 with delete_type TABLET_DATA_DELETED (replaced by tablet 097ca98ce2694c05b9b1ff4c0062cf28) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.853181 29378 tablet_bootstrap.cc:492] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:47.855796 29378 ts_tablet_manager.cc:1403] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.002s
I20260617 20:16:47.857117 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a52db3bf8ffa484aace6788058b23821"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.857985 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a52db3bf8ffa484aace6788058b23821 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.856709 29708 tablet.cc:1724] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:47.861198 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f73d839e67c548629526669e7310da0c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.861469 29035 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
W20260617 20:16:47.861867 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f73d839e67c548629526669e7310da0c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.863071 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1049746575e44a9ab370495af7e4dea9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.863533 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1049746575e44a9ab370495af7e4dea9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.860790 29378 raft_consensus.cc:359] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.864462 29378 raft_consensus.cc:385] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.864599 29378 raft_consensus.cc:740] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.864866 29378 consensus_queue.cc:260] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.877483 28670 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_8b66113312ca4c2297d9b65f8c6dcf6c [id=0ece007078c749e3bd4bab93ada3b311]). Expected version 2 got 0
I20260617 20:16:47.879760 29699 sys_catalog.cc:263] Verifying existing consensus state
I20260617 20:16:47.880468 28661 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_8b66113312ca4c2297d9b65f8c6dcf6c [id=0ece007078c749e3bd4bab93ada3b311]). Expected version 2 got 0
I20260617 20:16:47.882261 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 00f16ff3bc57434592d1648c4944c157 with delete_type TABLET_DATA_DELETED (replaced by tablet 65af976b808d42d4aeded71a00cf7252) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.884661 29699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Bootstrap starting.
I20260617 20:16:47.884678 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 3a17f7ef070d4879a520a3eb6bdf3d23 (DEFAULT_TABLE table=default.Table_6e09b7b68e1f406e8e0893e0f3dfba11 [id=75b4797252e34fb0a8875cf4c084cfc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.885179 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a17f7ef070d4879a520a3eb6bdf3d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.886287 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c4a8619e08d149b4a6b953b12275af99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.886906 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4a8619e08d149b4a6b953b12275af99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.894860 29173 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:47.897774 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7412226c178b4fdfa79664f5975d834a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.898392 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7412226c178b4fdfa79664f5975d834a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.901538 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 (DEFAULT_TABLE table=default.Table_c7a5b7a15b93440a82590a995e13b32c [id=efd2f4062eb343f491281fdab6875c9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.901971 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ea43994a0a42fe9e16d7bc6a2118e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.903219 29699 log.cc:826] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Log is configured to *not* fsync() on all Append() calls
I20260617 20:16:47.910188 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e4ef1f493c4f1289cfa192ce38161d with delete_type TABLET_DATA_DELETED (replaced by tablet 67a3124306094c72ad78e5473aa35bdb) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.910810 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 57e19abe093a40f6886908a8a3a0cad4
I20260617 20:16:47.911104 29378 ts_tablet_manager.cc:1434] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.053s user 0.002s sys 0.000s
I20260617 20:16:47.912213 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 3a17f7ef070d4879a520a3eb6bdf3d23 (DEFAULT_TABLE table=default.Table_6e09b7b68e1f406e8e0893e0f3dfba11 [id=75b4797252e34fb0a8875cf4c084cfc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.912560 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 (DEFAULT_TABLE table=default.Table_c7a5b7a15b93440a82590a995e13b32c [id=efd2f4062eb343f491281fdab6875c9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.912662 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a17f7ef070d4879a520a3eb6bdf3d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.913251 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ea43994a0a42fe9e16d7bc6a2118e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.913618 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e19abe093a40f6886908a8a3a0cad4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.913647 28988 raft_consensus.cc:1275] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Refusing update from remote peer 6d4ce30e1fce4591b64c398747f8d37a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:47.914840 29486 consensus_queue.cc:1048] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:47.916071 29379 tablet_bootstrap.cc:492] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:47.916093 29378 tablet_bootstrap.cc:492] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:47.916306 29379 ts_tablet_manager.cc:1403] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.124s user 0.004s sys 0.000s
I20260617 20:16:47.917328 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e19abe093a40f6886908a8a3a0cad4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.917627 29379 raft_consensus.cc:359] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.917845 29379 raft_consensus.cc:385] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:47.917934 29379 raft_consensus.cc:740] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:47.920945 29710 tablet.cc:1724] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:47.918222 29379 consensus_queue.cc:260] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:47.922537 29379 ts_tablet_manager.cc:1434] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:16:47.923696 29379 tablet_bootstrap.cc:492] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:47.926827 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:47.928460 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5f1cf137a6c043a9b03d4a334ae42ef8" } new_table_name: "default.Table_b299a2d2bb2d43c0a27ba56bfd754a14" modify_external_catalogs: true
I20260617 20:16:47.929416 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_34162dc1609a4227bb4824e0674ecf7c" } new_table_name: "default.Table_324930e6680749aeb68583d56acef5eb" modify_external_catalogs: true
I20260617 20:16:47.932466 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5716b279b26c4d29a3259333d3661d7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:47.933189 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5716b279b26c4d29a3259333d3661d7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.934012 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 227d8a0d46294108a6b98a1a4b67fd6d (DEFAULT_TABLE table=default.Table_88946ea5179f45118a05f7dddcdd92b0 [id=de24e09cee8e4f28998625c2697769b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.934548 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227d8a0d46294108a6b98a1a4b67fd6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.941421 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 227d8a0d46294108a6b98a1a4b67fd6d (DEFAULT_TABLE table=default.Table_88946ea5179f45118a05f7dddcdd92b0 [id=de24e09cee8e4f28998625c2697769b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.945879 29378 tablet_bootstrap.cc:654] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.947098 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 808c455e74e645aa8e2b0d08ca81d4f9
I20260617 20:16:47.949003 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 808c455e74e645aa8e2b0d08ca81d4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.946748 29106 tablet_service.cc:1511] Processing CreateTablet for tablet c21b585707b146ed9c015d150d858681 (DEFAULT_TABLE table=default.Table_577f6b872d804b24ae25b7c1469442d8 [id=cd2fab71637e4b968e9957070c30c936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.951440 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 3a17f7ef070d4879a520a3eb6bdf3d23 (DEFAULT_TABLE table=default.Table_6e09b7b68e1f406e8e0893e0f3dfba11 [id=75b4797252e34fb0a8875cf4c084cfc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.951894 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a17f7ef070d4879a520a3eb6bdf3d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.954207 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 808c455e74e645aa8e2b0d08ca81d4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.956964 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 808c455e74e645aa8e2b0d08ca81d4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.957207 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e19abe093a40f6886908a8a3a0cad4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.957933 29226 tablet_service.cc:1511] Processing CreateTablet for tablet c21b585707b146ed9c015d150d858681 (DEFAULT_TABLE table=default.Table_577f6b872d804b24ae25b7c1469442d8 [id=cd2fab71637e4b968e9957070c30c936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.958429 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21b585707b146ed9c015d150d858681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.959340 29308 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:47.959596 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 9d4702c06d3442ac966ef2daca8d4660
I20260617 20:16:47.960145 28666 catalog_manager.cc:6784] ReplaceTablet: tablet 9d4702c06d3442ac966ef2daca8d4660 deleted and replaced by tablet 488b06f05d9b4273a61bcb2d6e0ad796
I20260617 20:16:47.960311 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d4702c06d3442ac966ef2daca8d4660 with delete_type TABLET_DATA_DELETED (replaced by tablet 488b06f05d9b4273a61bcb2d6e0ad796) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.960395 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet fa513612e44148d7983b0db00d733888 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:47.960822 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d4702c06d3442ac966ef2daca8d4660 with delete_type TABLET_DATA_DELETED (replaced by tablet 488b06f05d9b4273a61bcb2d6e0ad796) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:47.961581 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d4702c06d3442ac966ef2daca8d4660 with delete_type TABLET_DATA_DELETED (replaced by tablet 488b06f05d9b4273a61bcb2d6e0ad796) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:47.961736 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8b66113312ca4c2297d9b65f8c6dcf6c" } new_table_name: "default.Table_7e16fff91c254edc8becd81ac1de334f" modify_external_catalogs: true
I20260617 20:16:47.961989 29093 tablet_service.cc:1511] Processing CreateTablet for tablet c8d373f177494f1486fcae4a67a13041 (DEFAULT_TABLE table=default.Table_fb580c3d4089464aa53ff2360464aaae [id=9abd27ea648b4d3f9fb79584fe4e9fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.965098 29379 tablet_bootstrap.cc:654] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:47.965914 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227d8a0d46294108a6b98a1a4b67fd6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.968827 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d373f177494f1486fcae4a67a13041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.969465 29375 ts_tablet_manager.cc:1929] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:47.969600 29375 log.cc:1199] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/689121cc9ca647cda1899cdd569da8f6
I20260617 20:16:47.970052 29375 ts_tablet_manager.cc:1950] T 689121cc9ca647cda1899cdd569da8f6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:47.974678 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b1b3565799894d82a3cc29ab2a19307c
I20260617 20:16:47.975556 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_34435a212241411bbcd81477e4c63723" } new_table_name: "default.Table_ba7486cf24e2468aba2d211a8431a444" modify_external_catalogs: true
I20260617 20:16:47.976747 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 227d8a0d46294108a6b98a1a4b67fd6d (DEFAULT_TABLE table=default.Table_88946ea5179f45118a05f7dddcdd92b0 [id=de24e09cee8e4f28998625c2697769b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.979717 29486 raft_consensus.cc:493] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:47.979982 29486 raft_consensus.cc:515] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:47.981153 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 (DEFAULT_TABLE table=default.Table_c7a5b7a15b93440a82590a995e13b32c [id=efd2f4062eb343f491281fdab6875c9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:47.981530 29486 leader_election.cc:290] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:47.983048 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f16ff3bc57434592d1648c4944c157" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:47.984290 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet b1b3565799894d82a3cc29ab2a19307c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.984714 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21b585707b146ed9c015d150d858681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:47.985471 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet dd2df17b35a7483b93a6e89d42ac1a62
I20260617 20:16:47.985994 28662 catalog_manager.cc:6784] ReplaceTablet: tablet dd2df17b35a7483b93a6e89d42ac1a62 deleted and replaced by tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb
I20260617 20:16:47.988535 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1254365c45264df3acca54185cd4ff6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.989030 29375 tablet_replica.cc:333] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
W20260617 20:16:47.989171 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1254365c45264df3acca54185cd4ff6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:47.989236 29375 raft_consensus.cc:2243] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:47.989573 29375 pending_rounds.cc:70] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:47.989637 29375 pending_rounds.cc:77] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955462147563520 op_type: NO_OP noop_request { }
I20260617 20:16:47.989784 29375 raft_consensus.cc:2889] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:47.989885 29375 raft_consensus.cc:2272] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:47.991003 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet dd2df17b35a7483b93a6e89d42ac1a62 with delete_type TABLET_DATA_DELETED (replaced by tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:47.991291 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4de9b511b49b48cca1674d8532df65cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:47.991791 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 689121cc9ca647cda1899cdd569da8f6 (table default.Table_81f4fb86b1a8470db7f74e35dc15a3fa [id=229a4fa545c84500af515f5992b547c7]) successfully deleted
W20260617 20:16:47.991925 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4de9b511b49b48cca1674d8532df65cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:47.992225 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet c65a4345552844fe9e7512105fd79877 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c65a4345552844fe9e7512105fd79877 already in progress: creating tablet
W20260617 20:16:47.992549 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 already in progress: creating tablet
I20260617 20:16:48.003419 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 640f53137c21443cbfc274c084ce13ef (DEFAULT_TABLE table=default.Table_7d193ca323a14554af974ae3b173fa07 [id=2d1a8cb755fb4625b83e93bca0e70898]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.004930 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (DEFAULT_TABLE table=default.Table_114940544693456c815446c3d3ec85bd [id=6a948594185b42128136770dbe3f0ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.007340 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e30e536f03054ddb96f199ff4df720f4" } new_table_name: "default.Table_b69715660a0e44959e855ca44fb09056" modify_external_catalogs: true
I20260617 20:16:48.007781 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 0859e56b5b7a483ea5e751f0468cbab8 (DEFAULT_TABLE table=default.Table_1ee5913d94914aba95dc4be83307dbe1 [id=4052e9bb44674d6b9936c1c6f004488f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.010082 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ea43994a0a42fe9e16d7bc6a2118e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.012778 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet b1b3565799894d82a3cc29ab2a19307c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.013048 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640f53137c21443cbfc274c084ce13ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.013134 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet dd2df17b35a7483b93a6e89d42ac1a62 with delete_type TABLET_DATA_DELETED (replaced by tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.013497 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0859e56b5b7a483ea5e751f0468cbab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.023269 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_20465bbedb344857a72376aa345ec532" } modify_external_catalogs: true
I20260617 20:16:48.023507 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_20465bbedb344857a72376aa345ec532" } modify_external_catalogs: true
I20260617 20:16:48.027721 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 0859e56b5b7a483ea5e751f0468cbab8 (DEFAULT_TABLE table=default.Table_1ee5913d94914aba95dc4be83307dbe1 [id=4052e9bb44674d6b9936c1c6f004488f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.028235 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c99389d24d4a8d8c934f0a9b9c2825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.028990 29699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=5 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260617 20:16:48.029711 29699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Bootstrap complete.
I20260617 20:16:48.013563 29383 tablet_bootstrap.cc:492] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.017392 29232 tablet_service.cc:1511] Processing CreateTablet for tablet c8d373f177494f1486fcae4a67a13041 (DEFAULT_TABLE table=default.Table_fb580c3d4089464aa53ff2360464aaae [id=9abd27ea648b4d3f9fb79584fe4e9fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.033540 29383 ts_tablet_manager.cc:1403] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.201s user 0.032s sys 0.021s
I20260617 20:16:48.017539 29230 tablet_service.cc:1511] Processing CreateTablet for tablet b3278efaad07403ca0a2baecad46d0f1 (DEFAULT_TABLE table=default.Table_8ffb0a0b802f41e386bc73ae7574b693 [id=35f8afdc04fb4a1ebb52996f33d62d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.017989 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (DEFAULT_TABLE table=default.Table_114940544693456c815446c3d3ec85bd [id=6a948594185b42128136770dbe3f0ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.018057 29262 raft_consensus.cc:2468] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
W20260617 20:16:48.036420 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98467525f81f4a48878eae17e3a9c982 consensus state has no leader
I20260617 20:16:48.022991 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 1a725364bb9646e6bc80fc4f67d04a16 (DEFAULT_TABLE table=default.Table_8c70a2be0e4b406880787a57850701ca [id=a8259ff095ae4a3e99259235698d998f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.038142 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a215554510c74346a7e3d04c99b98de2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.038740 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a215554510c74346a7e3d04c99b98de2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.021806 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 227d8a0d46294108a6b98a1a4b67fd6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.040426 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a725364bb9646e6bc80fc4f67d04a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.040628 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c99389d24d4a8d8c934f0a9b9c2825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.036455 29383 raft_consensus.cc:359] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.041774 29093 tablet_service.cc:1511] Processing CreateTablet for tablet b3278efaad07403ca0a2baecad46d0f1 (DEFAULT_TABLE table=default.Table_8ffb0a0b802f41e386bc73ae7574b693 [id=35f8afdc04fb4a1ebb52996f33d62d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.042881 29063 leader_election.cc:304] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:48.043569 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0859e56b5b7a483ea5e751f0468cbab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.044055 29486 raft_consensus.cc:2804] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:48.044178 29486 raft_consensus.cc:493] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:48.044507 29486 raft_consensus.cc:3060] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:48.046193 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet b1b3565799894d82a3cc29ab2a19307c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.048111 28952 tablet_service.cc:1511] Processing CreateTablet for tablet c21b585707b146ed9c015d150d858681 (DEFAULT_TABLE table=default.Table_577f6b872d804b24ae25b7c1469442d8 [id=cd2fab71637e4b968e9957070c30c936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.048379 29486 raft_consensus.cc:515] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.048662 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 1a725364bb9646e6bc80fc4f67d04a16 (DEFAULT_TABLE table=default.Table_8c70a2be0e4b406880787a57850701ca [id=a8259ff095ae4a3e99259235698d998f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.049224 28959 tablet_service.cc:1511] Processing CreateTablet for tablet c8d373f177494f1486fcae4a67a13041 (DEFAULT_TABLE table=default.Table_fb580c3d4089464aa53ff2360464aaae [id=9abd27ea648b4d3f9fb79584fe4e9fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.049654 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d373f177494f1486fcae4a67a13041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.049954 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 640f53137c21443cbfc274c084ce13ef (DEFAULT_TABLE table=default.Table_7d193ca323a14554af974ae3b173fa07 [id=2d1a8cb755fb4625b83e93bca0e70898]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.051026 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3278efaad07403ca0a2baecad46d0f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:48.051935 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 70698bb6ff6f4fe0b465f2974fcc24ea consensus state has no leader
I20260617 20:16:48.050493 29096 tablet_service.cc:1511] Processing CreateTablet for tablet d4130f3529ef4adaa4cedf12e53b6895 (DEFAULT_TABLE table=default.Table_20b86d94fc1845f7890c393e5f122ae7 [id=d037cdc970c044ec92ca7b0b46be209f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.054311 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21b585707b146ed9c015d150d858681. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.055454 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet dd2df17b35a7483b93a6e89d42ac1a62 with delete_type TABLET_DATA_DELETED (replaced by tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.058279 28961 tablet_service.cc:1511] Processing CreateTablet for tablet b3278efaad07403ca0a2baecad46d0f1 (DEFAULT_TABLE table=default.Table_8ffb0a0b802f41e386bc73ae7574b693 [id=35f8afdc04fb4a1ebb52996f33d62d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.059046 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3278efaad07403ca0a2baecad46d0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.060194 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a725364bb9646e6bc80fc4f67d04a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.060868 29375 ts_tablet_manager.cc:1916] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.061806 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640f53137c21443cbfc274c084ce13ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.063551 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 640f53137c21443cbfc274c084ce13ef (DEFAULT_TABLE table=default.Table_7d193ca323a14554af974ae3b173fa07 [id=2d1a8cb755fb4625b83e93bca0e70898]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.064792 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4130f3529ef4adaa4cedf12e53b6895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.065909 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (DEFAULT_TABLE table=default.Table_114940544693456c815446c3d3ec85bd [id=6a948594185b42128136770dbe3f0ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.067646 28669 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_8b66113312ca4c2297d9b65f8c6dcf6c [id=0ece007078c749e3bd4bab93ada3b311] alter complete (version 2)
I20260617 20:16:48.068048 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 640f53137c21443cbfc274c084ce13ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.068439 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet 569e339c17764486a65a1c3b43c92adf from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:48.073652 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c99389d24d4a8d8c934f0a9b9c2825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.065064 29486 leader_election.cc:290] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:48.074738 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 0859e56b5b7a483ea5e751f0468cbab8 (DEFAULT_TABLE table=default.Table_1ee5913d94914aba95dc4be83307dbe1 [id=4052e9bb44674d6b9936c1c6f004488f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.076165 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0859e56b5b7a483ea5e751f0468cbab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.077430 28969 tablet_service.cc:1511] Processing CreateTablet for tablet d4130f3529ef4adaa4cedf12e53b6895 (DEFAULT_TABLE table=default.Table_20b86d94fc1845f7890c393e5f122ae7 [id=d037cdc970c044ec92ca7b0b46be209f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.077848 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4130f3529ef4adaa4cedf12e53b6895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.080209 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 1a725364bb9646e6bc80fc4f67d04a16 (DEFAULT_TABLE table=default.Table_8c70a2be0e4b406880787a57850701ca [id=a8259ff095ae4a3e99259235698d998f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.080580 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a725364bb9646e6bc80fc4f67d04a16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.082531 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet 113fbbc739d04f529e82bc1cf1074bd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 75519f97f1ce49ceb3a739ba7c7bc239) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.085357 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1b50b384a47942e89ce8033d7d491a1b" } modify_external_catalogs: true
I20260617 20:16:48.085575 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1b50b384a47942e89ce8033d7d491a1b" } modify_external_catalogs: true
W20260617 20:16:48.088228 29062 leader_election.cc:343] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 00f16ff3bc57434592d1648c4944c157
W20260617 20:16:48.090458 29062 leader_election.cc:343] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 00f16ff3bc57434592d1648c4944c157
W20260617 20:16:48.093462 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97541af7c02d46b98106692d92778741 consensus state has no leader
I20260617 20:16:48.097000 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d3c4a4f115524492993663ad7da2da7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.097990 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3c4a4f115524492993663ad7da2da7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.108374 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_56731cc7022548f8a230b1f50b31109f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.108992 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56731cc7022548f8a230b1f50b31109f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.120003 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ec45adce56ca4e659ed5b9f6d5997fc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.120617 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec45adce56ca4e659ed5b9f6d5997fc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.122720 29383 raft_consensus.cc:385] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.123054 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3278efaad07403ca0a2baecad46d0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.123052 29383 raft_consensus.cc:740] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.127775 29379 tablet_bootstrap.cc:492] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
W20260617 20:16:48.128412 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af9c687fe56f42af82dd4728ca53cd32 consensus state has no leader
I20260617 20:16:48.131989 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d8e5051525524f83add520910c7b6236"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.132658 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8e5051525524f83add520910c7b6236 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.132658 29383 consensus_queue.cc:260] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.133996 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f16ff3bc57434592d1648c4944c157" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:48.134277 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8d373f177494f1486fcae4a67a13041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.134620 29262 raft_consensus.cc:3060] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:48.136106 29383 ts_tablet_manager.cc:1434] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.101s user 0.001s sys 0.001s
I20260617 20:16:48.136475 29383 tablet_bootstrap.cc:492] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.138437 29383 tablet_bootstrap.cc:654] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.139582 29377 ts_tablet_manager.cc:1929] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.139763 29377 log.cc:1199] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/c65a4345552844fe9e7512105fd79877
I20260617 20:16:48.140189 29377 ts_tablet_manager.cc:1950] T c65a4345552844fe9e7512105fd79877 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:48.140682 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3e287ba95be7408b8fc75e6f0709d8f1
I20260617 20:16:48.140928 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet c65a4345552844fe9e7512105fd79877 (table default.Table_cd9432cef0ba46d9a560d5ba59f1d58d [id=6c1d98916a69411393b9f32eeb861bd7]) successfully deleted
I20260617 20:16:48.141727 29377 tablet_replica.cc:333] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:16:48.144420 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 already in progress: creating tablet
I20260617 20:16:48.149531 29708 tablet.cc:1724] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:48.151180 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e287ba95be7408b8fc75e6f0709d8f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.152428 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1ee5913d94914aba95dc4be83307dbe1" } modify_external_catalogs: true
I20260617 20:16:48.152653 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1ee5913d94914aba95dc4be83307dbe1" } modify_external_catalogs: true
I20260617 20:16:48.157080 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e287ba95be7408b8fc75e6f0709d8f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.157493 29377 raft_consensus.cc:2243] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.157706 29377 raft_consensus.cc:2272] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:48.158715 29377 ts_tablet_manager.cc:1916] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.159765 29378 tablet_bootstrap.cc:492] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:48.159932 29378 ts_tablet_manager.cc:1403] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.248s user 0.025s sys 0.027s
I20260617 20:16:48.160745 29378 raft_consensus.cc:359] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.163240 29378 raft_consensus.cc:385] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.163399 29378 raft_consensus.cc:740] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.164268 29699 raft_consensus.cc:359] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:48.165352 29699 raft_consensus.cc:740] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5ea3f9265d84474ab3bced8dd5aecc5, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.166229 29699 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:48.166942 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:48.167080 29378 consensus_queue.cc:260] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.168046 29226 tablet_service.cc:1511] Processing CreateTablet for tablet d4130f3529ef4adaa4cedf12e53b6895 (DEFAULT_TABLE table=default.Table_20b86d94fc1845f7890c393e5f122ae7 [id=d037cdc970c044ec92ca7b0b46be209f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.168491 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4130f3529ef4adaa4cedf12e53b6895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.170382 29262 raft_consensus.cc:2468] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:48.171011 29378 ts_tablet_manager.cc:1434] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260617 20:16:48.172202 29378 tablet_bootstrap.cc:492] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:48.176662 29378 tablet_bootstrap.cc:654] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.181811 29587 raft_consensus.cc:493] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.182011 29587 raft_consensus.cc:515] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.182744 29587 leader_election.cc:290] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:48.184072 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113fbbc739d04f529e82bc1cf1074bd7" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:48.184682 28925 leader_election.cc:343] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.186528 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7d193ca323a14554af974ae3b173fa07" } modify_external_catalogs: true
I20260617 20:16:48.186745 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7d193ca323a14554af974ae3b173fa07" } modify_external_catalogs: true
I20260617 20:16:48.188139 29708 tablet.cc:1724] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:16:48.189188 28666 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_7e16fff91c254edc8becd81ac1de334f [id=0ece007078c749e3bd4bab93ada3b311]). Expected version 3 got 2
I20260617 20:16:48.191105 29383 tablet_bootstrap.cc:492] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.191326 29383 ts_tablet_manager.cc:1403] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.000s
I20260617 20:16:48.193753 29383 raft_consensus.cc:359] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.194151 29383 raft_consensus.cc:385] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.194288 29383 raft_consensus.cc:740] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.194712 29383 consensus_queue.cc:260] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.203316 29709 tablet.cc:1724] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:16:48.204526 29383 ts_tablet_manager.cc:1434] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.013s user 0.000s sys 0.003s
I20260617 20:16:48.205258 29383 tablet_bootstrap.cc:492] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.207119 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 4e27c5834baa48ed953fccef54e6c52b (DEFAULT_TABLE table=default.Table_56f5d206c3934a59a6ef16d7c15e3de6 [id=6c3209da79fb4c518d0583b668a9209e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.207551 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e27c5834baa48ed953fccef54e6c52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.208535 29379 ts_tablet_manager.cc:1403] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.205s user 0.006s sys 0.007s
I20260617 20:16:48.213413 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 569e339c17764486a65a1c3b43c92adf
I20260617 20:16:48.213959 28669 catalog_manager.cc:6784] ReplaceTablet: tablet 569e339c17764486a65a1c3b43c92adf deleted and replaced by tablet f4de5dafb1474de1911148bb3b4527cf
I20260617 20:16:48.215530 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 00f16ff3bc57434592d1648c4944c157 with delete_type TABLET_DATA_DELETED (replaced by tablet 65af976b808d42d4aeded71a00cf7252) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.216471 29709 tablet.cc:1724] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:48.217325 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 569e339c17764486a65a1c3b43c92adf with delete_type TABLET_DATA_DELETED (replaced by tablet f4de5dafb1474de1911148bb3b4527cf) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.220640 29721 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:48.221242 29721 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:16:48.222150 29699 sys_catalog.cc:565] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260617 20:16:48.231966 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 569e339c17764486a65a1c3b43c92adf with delete_type TABLET_DATA_DELETED (replaced by tablet f4de5dafb1474de1911148bb3b4527cf) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.232435 29383 tablet_bootstrap.cc:654] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.233422 29587 raft_consensus.cc:493] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.233654 29587 raft_consensus.cc:515] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.234496 29587 leader_election.cc:290] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:48.235553 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c0988a73d547d08d0924784bff9222" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:48.236304 28925 leader_election.cc:343] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.242798 29063 leader_election.cc:304] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:48.243397 29383 tablet_bootstrap.cc:492] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.243557 29383 ts_tablet_manager.cc:1403] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20260617 20:16:48.244349 29383 raft_consensus.cc:359] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.244592 29383 raft_consensus.cc:385] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.244673 29383 raft_consensus.cc:740] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.244997 29383 consensus_queue.cc:260] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.245733 29383 ts_tablet_manager.cc:1434] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:48.246943 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b69715660a0e44959e855ca44fb09056" } modify_external_catalogs: true
I20260617 20:16:48.247176 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b69715660a0e44959e855ca44fb09056" } modify_external_catalogs: true
I20260617 20:16:48.251639 29710 tablet.cc:1724] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:48.253479 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e287ba95be7408b8fc75e6f0709d8f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.253537 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 751bffacfaa5427784de63d51fc903dd with delete_type TABLET_DATA_DELETED (replaced by tablet e7f822e3f4ca4946a116ee172e83628b) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.253849 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d4be33993864c73ba8b4da9468a517b with delete_type TABLET_DATA_DELETED (replaced by tablet 64bb6d176a4845eca312848ae5104647) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.256227 29486 raft_consensus.cc:493] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.256465 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7ccf01ded0f84e49b3d9791d7ba4096a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.257228 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ccf01ded0f84e49b3d9791d7ba4096a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.258490 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 4e27c5834baa48ed953fccef54e6c52b (DEFAULT_TABLE table=default.Table_56f5d206c3934a59a6ef16d7c15e3de6 [id=6c3209da79fb4c518d0583b668a9209e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.258985 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e27c5834baa48ed953fccef54e6c52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.268617 28668 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet db890c271ab842aba05c50667247d03b
I20260617 20:16:48.269974 29376 ts_tablet_manager.cc:1929] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.270471 29376 log.cc:1199] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/a79b56241ac84862868c664cca25654b
I20260617 20:16:48.271281 29376 ts_tablet_manager.cc:1950] T a79b56241ac84862868c664cca25654b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:48.272675 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 189) took 1132 ms. Trace:
I20260617 20:16:48.272923 29376 rpcz_store.cc:276] 0617 20:16:47.140406 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.140731 (+ 325us) service_pool.cc:224] Handling call
0617 20:16:47.847861 (+707130us) ts_tablet_manager.cc:1151] Deleting tablet a79b56241ac84862868c664cca25654b
0617 20:16:47.847873 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:48.227100 (+379227us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:48.250250 (+ 23150us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:48.272573 (+ 22323us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":705919}
I20260617 20:16:48.275161 29376 tablet_replica.cc:333] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:48.275591 29376 raft_consensus.cc:2243] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.276083 29376 raft_consensus.cc:2272] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:48.276753 29383 tablet_bootstrap.cc:492] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.278646 29383 tablet_bootstrap.cc:654] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.279842 29681 raft_consensus.cc:493] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.279982 29681 raft_consensus.cc:515] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.280707 29681 leader_election.cc:290] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:48.281098 28955 tablet_service.cc:1511] Processing CreateTablet for tablet d076991ad9fb4498a11fd22fa8339889 (DEFAULT_TABLE table=default.Table_de0e4c82e4f54440a70e579ac74c0edd [id=7eab30028e33494792adc5d948da0727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.281709 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d076991ad9fb4498a11fd22fa8339889. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:48.281872 29197 leader_election.cc:343] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1d4be33993864c73ba8b4da9468a517b
I20260617 20:16:48.286262 29486 raft_consensus.cc:515] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.287055 29486 leader_election.cc:290] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:48.287487 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113fbbc739d04f529e82bc1cf1074bd7" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:48.287757 29062 leader_election.cc:343] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 7a81a3502f5d4602b65328577a668d62
I20260617 20:16:48.289350 29675 raft_consensus.cc:2804] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:48.289546 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c0988a73d547d08d0924784bff9222" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:48.291327 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b7a63933af3e47a8a667503faf321e91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.291962 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7a63933af3e47a8a667503faf321e91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.291967 29232 tablet_service.cc:1511] Processing CreateTablet for tablet d076991ad9fb4498a11fd22fa8339889 (DEFAULT_TABLE table=default.Table_de0e4c82e4f54440a70e579ac74c0edd [id=7eab30028e33494792adc5d948da0727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.292476 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d076991ad9fb4498a11fd22fa8339889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.293568 29379 raft_consensus.cc:359] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.293768 29379 raft_consensus.cc:385] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.297868 29675 raft_consensus.cc:697] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:48.298291 29675 consensus_queue.cc:237] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.302395 29376 ts_tablet_manager.cc:1916] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.307999 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b8d39f0ee1bc44e6be713e55e522b9f3" } new_table_name: "default.Table_2243e46086a84c17ab8420d0c86112f0" modify_external_catalogs: true
I20260617 20:16:48.313221 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 67a3124306094c72ad78e5473aa35bdb (DEFAULT_TABLE table=default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.313804 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a3124306094c72ad78e5473aa35bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.314878 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 67a3124306094c72ad78e5473aa35bdb (DEFAULT_TABLE table=default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.315279 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a3124306094c72ad78e5473aa35bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.320829 29379 raft_consensus.cc:740] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.321707 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1254365c45264df3acca54185cd4ff6a" } new_table_name: "default.Table_3a768181eca84e2f9d6eb43239795801" modify_external_catalogs: true
I20260617 20:16:48.321969 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 4e27c5834baa48ed953fccef54e6c52b (DEFAULT_TABLE table=default.Table_56f5d206c3934a59a6ef16d7c15e3de6 [id=6c3209da79fb4c518d0583b668a9209e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.323459 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 569e339c17764486a65a1c3b43c92adf with delete_type TABLET_DATA_DELETED (replaced by tablet f4de5dafb1474de1911148bb3b4527cf) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.324539 29107 tablet_service.cc:1511] Processing CreateTablet for tablet d076991ad9fb4498a11fd22fa8339889 (DEFAULT_TABLE table=default.Table_de0e4c82e4f54440a70e579ac74c0edd [id=7eab30028e33494792adc5d948da0727]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.328861 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e27c5834baa48ed953fccef54e6c52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.329561 28966 tablet_service.cc:1511] Processing CreateTablet for tablet e58fbec4a9f14ddda42b5a4c0263972c (DEFAULT_TABLE table=default.Table_7c00b4f954c743869ac8b3236a50e532 [id=cd4abe077ee04673bad87834b3af273b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.329646 29379 consensus_queue.cc:260] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.330001 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58fbec4a9f14ddda42b5a4c0263972c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.330292 29379 ts_tablet_manager.cc:1434] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.122s user 0.001s sys 0.001s
I20260617 20:16:48.330601 29379 tablet_bootstrap.cc:492] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:48.333923 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d076991ad9fb4498a11fd22fa8339889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.333930 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 67a3124306094c72ad78e5473aa35bdb (DEFAULT_TABLE table=default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.334779 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a3124306094c72ad78e5473aa35bdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.335492 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2cc66b9f491541379d5bb95e9d64b6db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:48.336009 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 086bd3079e8f4a6d85ccc681a38a47b0 (DEFAULT_TABLE table=default.Table_d7edab01c4d54274953659f1ad4a4969 [id=cb568e8af2da4807b99a6d07c57afca9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:48.336072 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cc66b9f491541379d5bb95e9d64b6db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.336410 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086bd3079e8f4a6d85ccc681a38a47b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.339159 29095 tablet_service.cc:1511] Processing CreateTablet for tablet e58fbec4a9f14ddda42b5a4c0263972c (DEFAULT_TABLE table=default.Table_7c00b4f954c743869ac8b3236a50e532 [id=cd4abe077ee04673bad87834b3af273b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.339365 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 086bd3079e8f4a6d85ccc681a38a47b0 (DEFAULT_TABLE table=default.Table_d7edab01c4d54274953659f1ad4a4969 [id=cb568e8af2da4807b99a6d07c57afca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.340853 29587 raft_consensus.cc:493] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.341051 29587 raft_consensus.cc:515] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.342223 29587 leader_election.cc:290] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:48.342373 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 0859e56b5b7a483ea5e751f0468cbab8
I20260617 20:16:48.343613 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 0859e56b5b7a483ea5e751f0468cbab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.346419 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_98b224ec50f84ea494d5b70aeaa1f728" } new_table_name: "default.Table_160815abfba040f29bfce92cd08c5e46" modify_external_catalogs: true
I20260617 20:16:48.349459 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086bd3079e8f4a6d85ccc681a38a47b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.350718 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 0859e56b5b7a483ea5e751f0468cbab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.351890 29728 raft_consensus.cc:493] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.352095 29728 raft_consensus.cc:515] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.353132 29728 leader_election.cc:290] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:48.353406 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2df17b35a7483b93a6e89d42ac1a62" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:48.353516 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58fbec4a9f14ddda42b5a4c0263972c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.353633 28988 raft_consensus.cc:2468] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:48.354151 29062 leader_election.cc:304] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:48.355029 29378 tablet_bootstrap.cc:492] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:48.355199 29378 ts_tablet_manager.cc:1403] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.183s user 0.004s sys 0.004s
I20260617 20:16:48.356021 29378 raft_consensus.cc:359] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.356209 29378 raft_consensus.cc:385] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.356294 29378 raft_consensus.cc:740] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.356523 29378 consensus_queue.cc:260] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.356788 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 640f53137c21443cbfc274c084ce13ef
I20260617 20:16:48.357728 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 640f53137c21443cbfc274c084ce13ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.358556 29378 ts_tablet_manager.cc:1434] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:48.359220 29377 ts_tablet_manager.cc:1929] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.359373 29377 log.cc:1199] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/c15392db137446b2bd84cf9f31337718
I20260617 20:16:48.359722 29377 ts_tablet_manager.cc:1950] T c15392db137446b2bd84cf9f31337718 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:48.361752 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9844fab126448895c4c9d4c3c78d76 (DEFAULT_TABLE table=default.Table_64b36c5ea008434c9becd24d6a19eb0c [id=8b51ca1875e847c5b75b682be93e6107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.362155 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9844fab126448895c4c9d4c3c78d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.362412 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9844fab126448895c4c9d4c3c78d76 (DEFAULT_TABLE table=default.Table_64b36c5ea008434c9becd24d6a19eb0c [id=8b51ca1875e847c5b75b682be93e6107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.363538 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 97541af7c02d46b98106692d92778741 (DEFAULT_TABLE table=default.Table_ba7486cf24e2468aba2d211a8431a444 [id=f608d4e53a0f4d37af562e6ce53576d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.364291 29106 tablet_service.cc:1511] Processing CreateTablet for tablet af9c687fe56f42af82dd4728ca53cd32 (DEFAULT_TABLE table=default.Table_b69715660a0e44959e855ca44fb09056 [id=6fe28533c9a445a88d8bcb86636c4905]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.365602 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 0e6cee209a5a44d6b35eb50e9c33228f (DEFAULT_TABLE table=default.Table_81cf092bd1634c3a82380616f225e4d6 [id=313f374332bf42b5bafbd20afd819a30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.366457 29378 tablet_bootstrap.cc:492] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:48.366845 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 75519f97f1ce49ceb3a739ba7c7bc239 (DEFAULT_TABLE table=default.Table_a1d87ddabcbe4a0e85e6587ff00a5b4d [id=3d369e1099c944688151bb38c8da0855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.366849 28956 tablet_service.cc:1511] Processing CreateTablet for tablet af9c687fe56f42af82dd4728ca53cd32 (DEFAULT_TABLE table=default.Table_b69715660a0e44959e855ca44fb09056 [id=6fe28533c9a445a88d8bcb86636c4905]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.367194 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 97541af7c02d46b98106692d92778741 (DEFAULT_TABLE table=default.Table_ba7486cf24e2468aba2d211a8431a444 [id=f608d4e53a0f4d37af562e6ce53576d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.367487 29035 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:48.369267 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97541af7c02d46b98106692d92778741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.367549 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 75519f97f1ce49ceb3a739ba7c7bc239 (DEFAULT_TABLE table=default.Table_a1d87ddabcbe4a0e85e6587ff00a5b4d [id=3d369e1099c944688151bb38c8da0855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.367858 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 0e6cee209a5a44d6b35eb50e9c33228f (DEFAULT_TABLE table=default.Table_81cf092bd1634c3a82380616f225e4d6 [id=313f374332bf42b5bafbd20afd819a30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.369905 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4702c06d3442ac966ef2daca8d4660" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:48.370666 28925 leader_election.cc:343] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.372267 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 086bd3079e8f4a6d85ccc681a38a47b0 (DEFAULT_TABLE table=default.Table_d7edab01c4d54274953659f1ad4a4969 [id=cb568e8af2da4807b99a6d07c57afca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.372687 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086bd3079e8f4a6d85ccc681a38a47b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.373528 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 640f53137c21443cbfc274c084ce13ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.374151 29587 raft_consensus.cc:493] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.374328 29587 raft_consensus.cc:515] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.374919 29587 leader_election.cc:290] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:48.375890 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 640f53137c21443cbfc274c084ce13ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.376257 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 97541af7c02d46b98106692d92778741 (DEFAULT_TABLE table=default.Table_ba7486cf24e2468aba2d211a8431a444 [id=f608d4e53a0f4d37af562e6ce53576d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.377249 29378 tablet_bootstrap.cc:654] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.377626 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97541af7c02d46b98106692d92778741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.378692 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6cee209a5a44d6b35eb50e9c33228f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.379819 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 75519f97f1ce49ceb3a739ba7c7bc239 (DEFAULT_TABLE table=default.Table_a1d87ddabcbe4a0e85e6587ff00a5b4d [id=3d369e1099c944688151bb38c8da0855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.380389 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 0e6cee209a5a44d6b35eb50e9c33228f (DEFAULT_TABLE table=default.Table_81cf092bd1634c3a82380616f225e4d6 [id=313f374332bf42b5bafbd20afd819a30]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.380801 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f32ebd7448843b48b981d3d70a87023" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:48.381163 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet 0859e56b5b7a483ea5e751f0468cbab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.381570 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97541af7c02d46b98106692d92778741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.384907 29226 tablet_service.cc:1511] Processing CreateTablet for tablet e58fbec4a9f14ddda42b5a4c0263972c (DEFAULT_TABLE table=default.Table_7c00b4f954c743869ac8b3236a50e532 [id=cd4abe077ee04673bad87834b3af273b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.385331 29242 tablet_service.cc:1511] Processing CreateTablet for tablet af9c687fe56f42af82dd4728ca53cd32 (DEFAULT_TABLE table=default.Table_b69715660a0e44959e855ca44fb09056 [id=6fe28533c9a445a88d8bcb86636c4905]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:48.385456 28925 leader_election.cc:343] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.385753 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75519f97f1ce49ceb3a739ba7c7bc239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.385687 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 9f9844fab126448895c4c9d4c3c78d76 (DEFAULT_TABLE table=default.Table_64b36c5ea008434c9becd24d6a19eb0c [id=8b51ca1875e847c5b75b682be93e6107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.386168 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75519f97f1ce49ceb3a739ba7c7bc239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.387545 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9c687fe56f42af82dd4728ca53cd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.388311 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9844fab126448895c4c9d4c3c78d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.389505 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6cee209a5a44d6b35eb50e9c33228f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.389510 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9c687fe56f42af82dd4728ca53cd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.390322 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58fbec4a9f14ddda42b5a4c0263972c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.394965 28666 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_7e16fff91c254edc8becd81ac1de334f [id=0ece007078c749e3bd4bab93ada3b311] alter complete (version 3)
I20260617 20:16:48.396824 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a81a3502f5d4602b65328577a668d62 with delete_type TABLET_DATA_DELETED (replaced by tablet 097ca98ce2694c05b9b1ff4c0062cf28) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.398314 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fad470e9ef3042889cc803e1d6df2218"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.398921 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fad470e9ef3042889cc803e1d6df2218 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.401842 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1a3b194179894c7896294d19efce6c25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.402398 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a3b194179894c7896294d19efce6c25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.406106 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet c15392db137446b2bd84cf9f31337718 (table default.Table_f07486abff7b4958baba24d98d53df0a [id=4117392d45f54d7dab6a67372d5da4e0]) successfully deleted
W20260617 20:16:48.406857 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 1fa15915b0ec44ff8b66920e4c207536 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fa15915b0ec44ff8b66920e4c207536 already in progress: creating tablet
I20260617 20:16:48.407168 29377 tablet_replica.cc:333] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:48.407853 29377 raft_consensus.cc:2243] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.408047 29377 raft_consensus.cc:2272] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:48.408567 29377 ts_tablet_manager.cc:1916] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.410928 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet af9c687fe56f42af82dd4728ca53cd32
I20260617 20:16:48.412806 29587 raft_consensus.cc:493] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.413039 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet af9c687fe56f42af82dd4728ca53cd32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.412979 29587 raft_consensus.cc:515] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.413932 29587 leader_election.cc:290] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:48.420845 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce9f5deea614e6d9e02e88d3d5ff2c6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:48.421427 28925 leader_election.cc:343] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.421806 29377 ts_tablet_manager.cc:1929] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.422027 29377 log.cc:1199] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/1f32ebd7448843b48b981d3d70a87023
I20260617 20:16:48.422501 29377 ts_tablet_manager.cc:1950] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:48.423594 29377 tablet_replica.cc:333] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:48.423585 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet af9c687fe56f42af82dd4728ca53cd32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.423924 29377 raft_consensus.cc:2243] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.424165 29377 raft_consensus.cc:2272] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:48.425118 29377 ts_tablet_manager.cc:1916] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.426976 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ec45adce56ca4e659ed5b9f6d5997fc2" } new_table_name: "default.Table_2d3a3741a94b4e86baf5a8e1eb46ee44" modify_external_catalogs: true
I20260617 20:16:48.430322 29383 tablet_bootstrap.cc:492] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.430519 29383 ts_tablet_manager.cc:1403] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.154s user 0.015s sys 0.014s
I20260617 20:16:48.431499 29383 raft_consensus.cc:359] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.431725 29383 raft_consensus.cc:385] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.431807 29383 raft_consensus.cc:740] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.432077 29383 consensus_queue.cc:260] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.432548 29383 ts_tablet_manager.cc:1434] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:48.432914 29383 tablet_bootstrap.cc:492] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.436172 29681 raft_consensus.cc:493] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.436354 29681 raft_consensus.cc:515] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:48.436542 29197 consensus_peers.cc:597] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8c3089f552b449095eafc00da38e442. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:48.437096 29681 leader_election.cc:290] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:48.438031 29383 tablet_bootstrap.cc:654] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:48.438540 29197 leader_election.cc:343] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 751bffacfaa5427784de63d51fc903dd
I20260617 20:16:48.439741 29728 raft_consensus.cc:2804] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260617 20:16:48.440536 29063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 126562us
I20260617 20:16:48.444334 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af9c687fe56f42af82dd4728ca53cd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.446779 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_befd7af4f63843d9bf259896e10ce0f5" } modify_external_catalogs: true
I20260617 20:16:48.447014 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_befd7af4f63843d9bf259896e10ce0f5" } modify_external_catalogs: true
I20260617 20:16:48.453279 29377 ts_tablet_manager.cc:1929] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:48.455744 29377 log.cc:1199] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/e0c44c3fa6f64f929d48de53f2502bfb
I20260617 20:16:48.456431 29377 ts_tablet_manager.cc:1950] T e0c44c3fa6f64f929d48de53f2502bfb P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:48.458247 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet e0c44c3fa6f64f929d48de53f2502bfb (table default.Table_648063d260534042bb01e0ae092c195b [id=2dda85266fd14be88479aa0ffec47512]) successfully deleted
W20260617 20:16:48.458712 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08911643f3ca451d80e2471b1b5b2342 consensus state has no leader
W20260617 20:16:48.460749 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 55e4ef1f493c4f1289cfa192ce38161d because the tablet was not found. No further retry: Not found: Tablet not found: 55e4ef1f493c4f1289cfa192ce38161d
I20260617 20:16:48.460878 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75519f97f1ce49ceb3a739ba7c7bc239. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:48.461037 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 57e19abe093a40f6886908a8a3a0cad4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57e19abe093a40f6886908a8a3a0cad4 already in progress: creating tablet
I20260617 20:16:48.461207 29377 tablet_replica.cc:333] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:16:48.461319 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 808c455e74e645aa8e2b0d08ca81d4f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 808c455e74e645aa8e2b0d08ca81d4f9 already in progress: creating tablet
I20260617 20:16:48.461618 29377 raft_consensus.cc:2243] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.461895 29377 raft_consensus.cc:2272] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:48.461966 28657 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 97541af7c02d46b98106692d92778741 (table default.Table_ba7486cf24e2468aba2d211a8431a444 [id=f608d4e53a0f4d37af562e6ce53576d8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 97541af7c02d46b98106692d92778741 consensus state has no leader
I20260617 20:16:48.462658 29377 ts_tablet_manager.cc:1916] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.463836 29383 tablet_bootstrap.cc:492] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.464077 29383 ts_tablet_manager.cc:1403] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.006s
I20260617 20:16:48.465112 29383 raft_consensus.cc:359] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.465422 29383 raft_consensus.cc:385] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.465567 29383 raft_consensus.cc:740] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.465924 29383 consensus_queue.cc:260] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.466441 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81a3502f5d4602b65328577a668d62" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:48.466701 29261 raft_consensus.cc:2468] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
W20260617 20:16:48.467353 28925 leader_election.cc:343] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.467566 28925 leader_election.cc:304] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:48.468180 29587 raft_consensus.cc:2749] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:48.468845 28925 leader_election.cc:343] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.468990 28925 leader_election.cc:304] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:48.469472 29587 raft_consensus.cc:2749] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:48.470680 29383 ts_tablet_manager.cc:1434] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260617 20:16:48.470821 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2df17b35a7483b93a6e89d42ac1a62" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:48.471038 29261 raft_consensus.cc:2468] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:48.473275 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f1d4ead31fe746b3ac30b939a8d7885d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.474474 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1d4ead31fe746b3ac30b939a8d7885d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.475131 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet af9c687fe56f42af82dd4728ca53cd32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.473774 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_26fbc7a31fb7435790febb8d25c7ef1e" } new_table_name: "default.Table_5309bfd681fb429ca8e543eb2f52fada" modify_external_catalogs: true
I20260617 20:16:48.479204 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e6cee209a5a44d6b35eb50e9c33228f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.482805 29375 ts_tablet_manager.cc:1929] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:48.485196 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 4516e7a7fa284eaa816558b2d58cd213 with delete_type TABLET_DATA_DELETED (replaced by tablet 08911643f3ca451d80e2471b1b5b2342) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:48.486127 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2db0467c5e64e38961d3b0e66375544 has no consensus state
I20260617 20:16:48.486898 29728 raft_consensus.cc:493] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:48.487447 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9844fab126448895c4c9d4c3c78d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.490134 29383 tablet_bootstrap.cc:492] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.491307 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_324930e6680749aeb68583d56acef5eb" } modify_external_catalogs: true
I20260617 20:16:48.491494 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_324930e6680749aeb68583d56acef5eb" } modify_external_catalogs: true
I20260617 20:16:48.492554 29383 tablet_bootstrap.cc:654] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.494863 29308 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:48.495823 29728 raft_consensus.cc:3060] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:48.498059 29379 tablet_bootstrap.cc:654] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.500604 29377 ts_tablet_manager.cc:1929] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.503142 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet cc945cdd482f4a5593d4874e5303ecd2 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:48.503181 29383 tablet_bootstrap.cc:492] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.503369 29383 ts_tablet_manager.cc:1403] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.001s
I20260617 20:16:48.504369 29383 raft_consensus.cc:359] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.504617 29383 raft_consensus.cc:385] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.504694 29383 raft_consensus.cc:740] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.505216 29383 consensus_queue.cc:260] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.507061 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_62c85e3d42be4e9ca7183846e7d67145"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.507668 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62c85e3d42be4e9ca7183846e7d67145 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.512197 29383 ts_tablet_manager.cc:1434] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
W20260617 20:16:48.515902 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 16d0360ec78844a1be3d5f51259bbcdf consensus state has no leader
I20260617 20:16:48.516352 29383 tablet_bootstrap.cc:492] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.518987 29377 log.cc:1199] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/9d4702c06d3442ac966ef2daca8d4660
I20260617 20:16:48.519623 29377 ts_tablet_manager.cc:1950] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:48.520568 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 9d4702c06d3442ac966ef2daca8d4660 (table default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]) successfully deleted
I20260617 20:16:48.520759 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 216f91e7bda148bc9334b19e3c868910 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:48.521073 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 4516e7a7fa284eaa816558b2d58cd213 with delete_type TABLET_DATA_DELETED (replaced by tablet 08911643f3ca451d80e2471b1b5b2342) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.521389 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d4f8ff9bb47c440b96251b7d063e73f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.522094 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4f8ff9bb47c440b96251b7d063e73f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:48.523952 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet b1b3565799894d82a3cc29ab2a19307c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1b3565799894d82a3cc29ab2a19307c already in progress: creating tablet
I20260617 20:16:48.524744 29383 tablet_bootstrap.cc:654] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.525053 29377 tablet_replica.cc:333] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:48.525506 29377 raft_consensus.cc:2243] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.526903 29377 raft_consensus.cc:2272] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:48.527657 29377 ts_tablet_manager.cc:1916] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.535198 29377 ts_tablet_manager.cc:1929] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.536859 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e1ea1f71f399476f867e5fe2b1484c8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.537449 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1ea1f71f399476f867e5fe2b1484c8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.539161 29383 tablet_bootstrap.cc:492] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.539342 29383 ts_tablet_manager.cc:1403] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.000s
I20260617 20:16:48.540318 29383 raft_consensus.cc:359] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.540553 29383 raft_consensus.cc:385] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.540652 29383 raft_consensus.cc:740] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.540900 29383 consensus_queue.cc:260] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.547056 29383 ts_tablet_manager.cc:1434] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 20:16:48.549472 29375 log.cc:1199] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/c15392db137446b2bd84cf9f31337718
I20260617 20:16:48.549979 29375 ts_tablet_manager.cc:1950] T c15392db137446b2bd84cf9f31337718 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:48.551196 29383 tablet_bootstrap.cc:492] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.553344 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4be33993864c73ba8b4da9468a517b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:48.553610 29126 raft_consensus.cc:2468] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:48.552094 29587 raft_consensus.cc:493] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.554177 29587 raft_consensus.cc:515] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.555006 29587 leader_election.cc:290] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:48.555685 29377 log.cc:1199] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/dd2df17b35a7483b93a6e89d42ac1a62
I20260617 20:16:48.555866 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9e12c91df344ee84a586b7d4a27071" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:48.556041 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f09fba1c81844e81a218171de6721f68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:48.556221 29383 tablet_bootstrap.cc:654] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:48.556574 28925 leader_election.cc:343] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.556923 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b7880a039a497fbd0fb5d4f74e7d23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:48.556928 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f09fba1c81844e81a218171de6721f68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.557725 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f32ebd7448843b48b981d3d70a87023" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:48.557875 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce9f5deea614e6d9e02e88d3d5ff2c6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:48.557719 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4702c06d3442ac966ef2daca8d4660" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:48.558463 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9e12c91df344ee84a586b7d4a27071" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:48.558705 28925 leader_election.cc:343] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.558792 29710 tablet.cc:1724] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:16:48.558849 28925 leader_election.cc:304] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:48.559051 28925 raft_consensus.cc:2686] T 1f32ebd7448843b48b981d3d70a87023 P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260617 20:16:48.560503 29198 leader_election.cc:343] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 751bffacfaa5427784de63d51fc903dd
I20260617 20:16:48.560640 29198 leader_election.cc:304] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:48.561077 29198 leader_election.cc:304] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:48.564096 29681 raft_consensus.cc:2749] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:48.564291 29681 raft_consensus.cc:2804] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:48.564397 29681 raft_consensus.cc:493] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:48.564512 29681 raft_consensus.cc:3060] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:48.565014 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13ba94ec9e27403b974e5e6fea46e59e has no consensus state
I20260617 20:16:48.567320 29173 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:48.568120 29681 raft_consensus.cc:515] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.568322 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b50a2ea6dd054c8282ce507b0c871fb2" } modify_external_catalogs: true
I20260617 20:16:48.568665 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b50a2ea6dd054c8282ce507b0c871fb2" } modify_external_catalogs: true
I20260617 20:16:48.569559 29681 leader_election.cc:290] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:48.575007 29377 ts_tablet_manager.cc:1950] T dd2df17b35a7483b93a6e89d42ac1a62 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:48.577724 29728 raft_consensus.cc:515] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.579047 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet dd2df17b35a7483b93a6e89d42ac1a62 (table default.Table_26fbc7a31fb7435790febb8d25c7ef1e [id=32c61aa9610e428fa8d5c794b078e0a1]) successfully deleted
I20260617 20:16:48.579705 29377 tablet_replica.cc:333] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:48.580493 29377 raft_consensus.cc:2243] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.580636 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet c15392db137446b2bd84cf9f31337718 (table default.Table_f07486abff7b4958baba24d98d53df0a [id=4117392d45f54d7dab6a67372d5da4e0]) successfully deleted
I20260617 20:16:48.581418 29375 tablet_replica.cc:333] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:48.581664 29375 raft_consensus.cc:2243] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:48.581715 29377 raft_consensus.cc:2272] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:48.582136 29375 raft_consensus.cc:2272] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:48.582273 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 1fa15915b0ec44ff8b66920e4c207536 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fa15915b0ec44ff8b66920e4c207536 already in progress: creating tablet
I20260617 20:16:48.583098 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b7a63933af3e47a8a667503faf321e91" } modify_external_catalogs: true
I20260617 20:16:48.583298 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b7a63933af3e47a8a667503faf321e91" } modify_external_catalogs: true
I20260617 20:16:48.584601 29740 raft_consensus.cc:493] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.585245 29740 raft_consensus.cc:515] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.586537 29740 leader_election.cc:290] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:48.586782 29681 raft_consensus.cc:493] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.587081 29681 raft_consensus.cc:515] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.588534 29681 leader_election.cc:290] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:48.589955 29383 tablet_bootstrap.cc:492] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.590193 29383 ts_tablet_manager.cc:1403] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.001s
I20260617 20:16:48.591156 29383 raft_consensus.cc:359] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.591413 29383 raft_consensus.cc:385] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.591550 29383 raft_consensus.cc:740] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.591938 29383 consensus_queue.cc:260] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.592612 29383 ts_tablet_manager.cc:1434] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20260617 20:16:48.593160 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb has no consensus state
I20260617 20:16:48.594952 29383 tablet_bootstrap.cc:492] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.597429 29383 tablet_bootstrap.cc:654] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.598121 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet b1b3565799894d82a3cc29ab2a19307c from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:48.603101 29063 leader_election.cc:304] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:48.605850 29383 tablet_bootstrap.cc:492] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.606045 29383 ts_tablet_manager.cc:1403] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260617 20:16:48.607097 29383 raft_consensus.cc:359] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.607297 29383 raft_consensus.cc:385] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.607764 29378 tablet_bootstrap.cc:492] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:48.607852 29377 ts_tablet_manager.cc:1916] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.607939 29378 ts_tablet_manager.cc:1403] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.242s user 0.026s sys 0.038s
I20260617 20:16:48.609288 29378 raft_consensus.cc:359] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.609544 29378 raft_consensus.cc:385] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.609614 29378 raft_consensus.cc:740] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.609907 29378 consensus_queue.cc:260] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.610414 29378 ts_tablet_manager.cc:1434] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:48.610481 29376 ts_tablet_manager.cc:1929] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.610608 29376 log.cc:1199] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/137cbb87d11c450995b63f7a8a7dece5
I20260617 20:16:48.610708 29378 tablet_bootstrap.cc:492] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:48.611058 29376 ts_tablet_manager.cc:1950] T 137cbb87d11c450995b63f7a8a7dece5 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:48.611886 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 187) took 1472 ms. Trace:
I20260617 20:16:48.614178 29378 tablet_bootstrap.cc:654] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.614909 29377 ts_tablet_manager.cc:1929] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.615149 29377 log.cc:1199] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/113fbbc739d04f529e82bc1cf1074bd7
W20260617 20:16:48.604930 29062 leader_election.cc:343] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: dd2df17b35a7483b93a6e89d42ac1a62
I20260617 20:16:48.615757 29377 ts_tablet_manager.cc:1950] T 113fbbc739d04f529e82bc1cf1074bd7 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:48.607396 29383 raft_consensus.cc:740] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
W20260617 20:16:48.616297 28925 leader_election.cc:343] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.616472 28925 leader_election.cc:304] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:48.616509 29383 consensus_queue.cc:260] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.616734 29587 raft_consensus.cc:2749] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:48.615712 29486 raft_consensus.cc:2804] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:48.618105 29486 raft_consensus.cc:493] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:48.618217 29486 raft_consensus.cc:3060] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:48.605898 29375 ts_tablet_manager.cc:1916] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.621683 29383 ts_tablet_manager.cc:1434] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260617 20:16:48.624145 29486 raft_consensus.cc:515] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:48.625710 29062 leader_election.cc:343] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 7a81a3502f5d4602b65328577a668d62
I20260617 20:16:48.625898 29383 tablet_bootstrap.cc:492] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.626247 29486 leader_election.cc:290] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:48.626453 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8c70a2be0e4b406880787a57850701ca" } modify_external_catalogs: true
I20260617 20:16:48.626682 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8c70a2be0e4b406880787a57850701ca" } modify_external_catalogs: true
I20260617 20:16:48.628160 29383 tablet_bootstrap.cc:654] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.630664 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 113fbbc739d04f529e82bc1cf1074bd7 (table default.Table_a1d87ddabcbe4a0e85e6587ff00a5b4d [id=3d369e1099c944688151bb38c8da0855]) successfully deleted
W20260617 20:16:48.631464 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3e287ba95be7408b8fc75e6f0709d8f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e287ba95be7408b8fc75e6f0709d8f1 already in progress: creating tablet
W20260617 20:16:48.632170 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 569e339c17764486a65a1c3b43c92adf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 569e339c17764486a65a1c3b43c92adf already in progress: creating tablet
I20260617 20:16:48.632412 29378 tablet_bootstrap.cc:492] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:48.632543 29383 tablet_bootstrap.cc:492] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.632560 29378 ts_tablet_manager.cc:1403] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.006s
I20260617 20:16:48.632689 29383 ts_tablet_manager.cc:1403] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
W20260617 20:16:48.632885 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 0859e56b5b7a483ea5e751f0468cbab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0859e56b5b7a483ea5e751f0468cbab8 already in progress: creating tablet
I20260617 20:16:48.633437 29383 raft_consensus.cc:359] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.633656 29383 raft_consensus.cc:385] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 20:16:48.633670 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 640f53137c21443cbfc274c084ce13ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 640f53137c21443cbfc274c084ce13ef already in progress: creating tablet
I20260617 20:16:48.633733 29383 raft_consensus.cc:740] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.633967 29383 consensus_queue.cc:260] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.633466 29378 raft_consensus.cc:359] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.634196 29378 raft_consensus.cc:385] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.634290 29378 raft_consensus.cc:740] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:16:48.634342 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet af9c687fe56f42af82dd4728ca53cd32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af9c687fe56f42af82dd4728ca53cd32 already in progress: creating tablet
I20260617 20:16:48.634568 29378 consensus_queue.cc:260] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.635000 29383 ts_tablet_manager.cc:1434] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:48.635061 29378 ts_tablet_manager.cc:1434] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:48.635433 29378 tablet_bootstrap.cc:492] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:48.617884 29728 leader_election.cc:290] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:48.636334 28925 leader_election.cc:343] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.636531 28925 leader_election.cc:304] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:48.636739 28925 raft_consensus.cc:2686] T 9d4702c06d3442ac966ef2daca8d4660 P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:16:48.637990 29378 tablet_bootstrap.cc:654] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.641036 29379 tablet_bootstrap.cc:492] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
W20260617 20:16:48.644043 28925 leader_election.cc:343] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.644290 28925 leader_election.cc:304] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:48.644778 29587 raft_consensus.cc:2749] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:48.646327 29378 tablet_bootstrap.cc:492] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:48.646545 29378 ts_tablet_manager.cc:1403] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.009s
I20260617 20:16:48.647568 29378 raft_consensus.cc:359] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.647828 29378 raft_consensus.cc:385] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.647931 29378 raft_consensus.cc:740] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:16:48.648160 29197 leader_election.cc:343] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1d4be33993864c73ba8b4da9468a517b
I20260617 20:16:48.648276 29378 consensus_queue.cc:260] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:48.648733 29197 leader_election.cc:343] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c15392db137446b2bd84cf9f31337718
I20260617 20:16:48.648988 29378 ts_tablet_manager.cc:1434] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:48.648878 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d10766d3246d4cfdaa6a36d63033318a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.649030 29197 leader_election.cc:343] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d9b7880a039a497fbd0fb5d4f74e7d23
I20260617 20:16:48.649473 29378 tablet_bootstrap.cc:492] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:48.649588 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d10766d3246d4cfdaa6a36d63033318a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.651180 29378 tablet_bootstrap.cc:654] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.652457 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2df17b35a7483b93a6e89d42ac1a62" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:48.652667 29261 raft_consensus.cc:3060] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:48.655766 29261 raft_consensus.cc:2468] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:48.656649 29379 ts_tablet_manager.cc:1403] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.326s user 0.005s sys 0.008s
I20260617 20:16:48.651937 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9b7880a039a497fbd0fb5d4f74e7d23" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:48.651414 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4be33993864c73ba8b4da9468a517b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:48.657199 29127 raft_consensus.cc:3060] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:48.658649 29379 raft_consensus.cc:359] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.659474 29379 raft_consensus.cc:385] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.660454 29127 raft_consensus.cc:2468] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:48.660563 29379 raft_consensus.cc:740] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.664305 29378 tablet_bootstrap.cc:492] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:48.664592 29378 ts_tablet_manager.cc:1403] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.009s
I20260617 20:16:48.665781 29378 raft_consensus.cc:359] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.666092 29378 raft_consensus.cc:385] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.666255 29378 raft_consensus.cc:740] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.666620 29378 consensus_queue.cc:260] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.667353 29378 ts_tablet_manager.cc:1434] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:48.667840 29378 tablet_bootstrap.cc:492] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:48.670257 29378 tablet_bootstrap.cc:654] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.675452 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a81a3502f5d4602b65328577a668d62" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:48.675804 29261 raft_consensus.cc:3060] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:48.676769 29378 tablet_bootstrap.cc:492] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:48.677050 29378 ts_tablet_manager.cc:1403] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260617 20:16:48.678162 29378 raft_consensus.cc:359] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.678328 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c7b9c867be6c4fa3b58557f0b4d1876b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:48.678545 29378 raft_consensus.cc:385] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.678637 29378 raft_consensus.cc:740] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.678921 29261 raft_consensus.cc:2468] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
W20260617 20:16:48.679015 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7b9c867be6c4fa3b58557f0b4d1876b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.678952 29378 consensus_queue.cc:260] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.679646 29378 ts_tablet_manager.cc:1434] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:48.679981 29378 tablet_bootstrap.cc:492] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:48.680024 29198 leader_election.cc:343] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: c15392db137446b2bd84cf9f31337718
I20260617 20:16:48.680183 29198 leader_election.cc:304] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:48.680229 29063 leader_election.cc:304] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:48.680572 29742 raft_consensus.cc:2749] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:48.680598 29198 leader_election.cc:343] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.680927 29728 raft_consensus.cc:2804] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:48.681007 29198 leader_election.cc:304] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:48.681224 29728 raft_consensus.cc:697] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:48.681439 29198 leader_election.cc:304] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:48.681576 29728 consensus_queue.cc:237] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.681759 29740 raft_consensus.cc:2749] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:48.681942 29740 raft_consensus.cc:2804] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:48.682047 29740 raft_consensus.cc:697] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:48.682269 29740 consensus_queue.cc:237] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.683073 29378 tablet_bootstrap.cc:654] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.684128 29379 consensus_queue.cc:260] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.684780 29379 ts_tablet_manager.cc:1434] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260617 20:16:48.685117 29379 tablet_bootstrap.cc:492] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:48.686941 29379 tablet_bootstrap.cc:654] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.688207 29063 leader_election.cc:304] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:48.688490 29486 raft_consensus.cc:2804] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:48.688670 29486 raft_consensus.cc:697] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:48.688954 29486 consensus_queue.cc:237] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.612000 29376 rpcz_store.cc:276] 0617 20:16:47.139325 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.141183 (+ 1858us) service_pool.cc:224] Handling call
0617 20:16:48.275022 (+1133839us) ts_tablet_manager.cc:1151] Deleting tablet 137cbb87d11c450995b63f7a8a7dece5
0617 20:16:48.275034 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:48.560252 (+285218us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:48.610383 (+ 50131us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:48.611845 (+ 1462us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1132336}
I20260617 20:16:48.697993 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 137cbb87d11c450995b63f7a8a7dece5 (table default.Table_81c4de22d335419abd4b3910e9025510 [id=0466c781ca0e4145b9f25b606c0edc5d]) successfully deleted
I20260617 20:16:48.698693 29383 tablet_bootstrap.cc:492] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.699566 29376 tablet_replica.cc:333] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:48.699857 29376 raft_consensus.cc:2243] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.704387 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet c21b585707b146ed9c015d150d858681 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:48.705847 29376 raft_consensus.cc:2272] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:48.718245 28662 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 948e63ec09d24ead9f0861505c203992
I20260617 20:16:48.726359 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c4a8619e08d149b4a6b953b12275af99" } new_table_name: "default.Table_63aeaed1b2164cacbfd67e0ba8890880" modify_external_catalogs: true
I20260617 20:16:48.727453 29375 ts_tablet_manager.cc:1929] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:48.727577 29375 log.cc:1199] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/e0c44c3fa6f64f929d48de53f2502bfb
I20260617 20:16:48.730688 29378 tablet_bootstrap.cc:492] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:48.730872 29378 ts_tablet_manager.cc:1403] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.051s user 0.006s sys 0.019s
I20260617 20:16:48.731702 29378 raft_consensus.cc:359] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.731892 29378 raft_consensus.cc:385] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.731982 29378 raft_consensus.cc:740] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.732216 29378 consensus_queue.cc:260] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.732715 29378 ts_tablet_manager.cc:1434] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:48.732995 29378 tablet_bootstrap.cc:492] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:48.738255 29378 tablet_bootstrap.cc:654] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.747000 28667 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 60a43dd885aa4411a4177b67807b0ac4 (table default.Table_fd835dc9ea8f4041b36c069dcac9d69a [id=3a41dd53c3974256877f193219240234]). Expected version 4 got 0
I20260617 20:16:48.728087 29375 ts_tablet_manager.cc:1950] T e0c44c3fa6f64f929d48de53f2502bfb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:48.747877 29681 raft_consensus.cc:493] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.749382 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet e0c44c3fa6f64f929d48de53f2502bfb (table default.Table_648063d260534042bb01e0ae092c195b [id=2dda85266fd14be88479aa0ffec47512]) successfully deleted
I20260617 20:16:48.750358 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet a7b59053006046e98d27c694808ca34d (table default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]). Expected version 1 got 0
I20260617 20:16:48.751053 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet 9d2a38be2e8e4796a98f1ae1d011249f from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:48.750969 29375 tablet_replica.cc:333] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:48.753716 29383 tablet_bootstrap.cc:654] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.755868 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 7efe079091784d7e8035659edd442ba6 (DEFAULT_TABLE table=default.Table_d8e5051525524f83add520910c7b6236 [id=f0df4d60a326473a8fc3d040ed7324d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.756304 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efe079091784d7e8035659edd442ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.756419 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 7efe079091784d7e8035659edd442ba6 (DEFAULT_TABLE table=default.Table_d8e5051525524f83add520910c7b6236 [id=f0df4d60a326473a8fc3d040ed7324d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.757192 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efe079091784d7e8035659edd442ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.763833 29681 raft_consensus.cc:515] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.756990 29375 raft_consensus.cc:2243] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.764679 29681 leader_election.cc:290] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:16:48.764858 29198 consensus_peers.cc:597] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8c3089f552b449095eafc00da38e442. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:48.765584 29376 ts_tablet_manager.cc:1916] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:48.766326 29197 leader_election.cc:343] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3ae50375e5934acbb213379fb7c87989
W20260617 20:16:48.767467 29198 leader_election.cc:343] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 3ae50375e5934acbb213379fb7c87989
I20260617 20:16:48.767619 29198 leader_election.cc:304] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:48.767895 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 13ba94ec9e27403b974e5e6fea46e59e (DEFAULT_TABLE table=default.Table_2d3a3741a94b4e86baf5a8e1eb46ee44 [id=e495b17f9a99422e9e29cf49befb762a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.767839 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 13ba94ec9e27403b974e5e6fea46e59e (DEFAULT_TABLE table=default.Table_2d3a3741a94b4e86baf5a8e1eb46ee44 [id=e495b17f9a99422e9e29cf49befb762a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.768179 29681 raft_consensus.cc:2749] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:48.768294 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ba94ec9e27403b974e5e6fea46e59e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.768313 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ba94ec9e27403b974e5e6fea46e59e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.769002 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 7efe079091784d7e8035659edd442ba6 (DEFAULT_TABLE table=default.Table_d8e5051525524f83add520910c7b6236 [id=f0df4d60a326473a8fc3d040ed7324d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.769073 29107 tablet_service.cc:1511] Processing CreateTablet for tablet d2db0467c5e64e38961d3b0e66375544 (DEFAULT_TABLE table=default.Table_3a768181eca84e2f9d6eb43239795801 [id=d18d30df8d4644899355b7c8c2f387e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.769428 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7efe079091784d7e8035659edd442ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.769428 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2db0467c5e64e38961d3b0e66375544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.770097 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 13ba94ec9e27403b974e5e6fea46e59e (DEFAULT_TABLE table=default.Table_2d3a3741a94b4e86baf5a8e1eb46ee44 [id=e495b17f9a99422e9e29cf49befb762a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.770443 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ba94ec9e27403b974e5e6fea46e59e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.771158 28956 tablet_service.cc:1511] Processing CreateTablet for tablet d2db0467c5e64e38961d3b0e66375544 (DEFAULT_TABLE table=default.Table_3a768181eca84e2f9d6eb43239795801 [id=d18d30df8d4644899355b7c8c2f387e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.771553 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2db0467c5e64e38961d3b0e66375544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.772747 29237 tablet_service.cc:1511] Processing CreateTablet for tablet d2db0467c5e64e38961d3b0e66375544 (DEFAULT_TABLE table=default.Table_3a768181eca84e2f9d6eb43239795801 [id=d18d30df8d4644899355b7c8c2f387e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.772746 28969 tablet_service.cc:1511] Processing CreateTablet for tablet b19bce310bd24294b063b3b4f76b9f99 (DEFAULT_TABLE table=default.Table_5716b279b26c4d29a3259333d3661d7d [id=e0633fd70c974a2d8ec482e122a7cd55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.773121 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19bce310bd24294b063b3b4f76b9f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.773118 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2db0467c5e64e38961d3b0e66375544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.773607 29099 tablet_service.cc:1511] Processing CreateTablet for tablet b19bce310bd24294b063b3b4f76b9f99 (DEFAULT_TABLE table=default.Table_5716b279b26c4d29a3259333d3661d7d [id=e0633fd70c974a2d8ec482e122a7cd55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.779950 29383 tablet_bootstrap.cc:492] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.780221 29383 ts_tablet_manager.cc:1403] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.082s user 0.008s sys 0.001s
I20260617 20:16:48.781347 29383 raft_consensus.cc:359] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.781677 29383 raft_consensus.cc:385] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.781833 29383 raft_consensus.cc:740] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.782220 29383 consensus_queue.cc:260] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.784111 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19bce310bd24294b063b3b4f76b9f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.787240 28966 tablet_service.cc:1511] Processing CreateTablet for tablet f6c9d59b6b5a4dee8ca970247f613e53 (DEFAULT_TABLE table=default.Table_7412226c178b4fdfa79664f5975d834a [id=f398dc41286d4aa690f3d7b3d45015a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.787602 29383 ts_tablet_manager.cc:1434] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260617 20:16:48.787813 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c9d59b6b5a4dee8ca970247f613e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.790324 29101 tablet_service.cc:1511] Processing CreateTablet for tablet f6c9d59b6b5a4dee8ca970247f613e53 (DEFAULT_TABLE table=default.Table_7412226c178b4fdfa79664f5975d834a [id=f398dc41286d4aa690f3d7b3d45015a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.790764 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c9d59b6b5a4dee8ca970247f613e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.794029 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet fa513612e44148d7983b0db00d733888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.794209 29226 tablet_service.cc:1511] Processing CreateTablet for tablet b19bce310bd24294b063b3b4f76b9f99 (DEFAULT_TABLE table=default.Table_5716b279b26c4d29a3259333d3661d7d [id=e0633fd70c974a2d8ec482e122a7cd55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.795308 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19bce310bd24294b063b3b4f76b9f99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.798049 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet 637b0b3e9cb648deaea6e63760b83255 with delete_type TABLET_DATA_DELETED (replaced by tablet 8880f8eadaa44887a49adf0ef157965e) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.798271 28667 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_921dd6771a094e7cb638a0bcd034177e [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 2 got 0
I20260617 20:16:48.798344 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 28146a1f84aa41ee88d9aea299256a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.801287 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b67b915758d4ab0a8faa0227de08593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.801756 29377 tablet_replica.cc:333] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:48.801981 29377 raft_consensus.cc:2243] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.802160 29377 raft_consensus.cc:2272] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:48.802125 29681 raft_consensus.cc:493] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.802325 29681 raft_consensus.cc:515] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.802969 29377 ts_tablet_manager.cc:1916] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.803109 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b96c186469e4e8a8baa0dcab96d66bf with delete_type TABLET_DATA_DELETED (replaced by tablet f136e42eb9034a05a5e0c7dc3b3117d7) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.803161 29681 leader_election.cc:290] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:48.803826 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 216f91e7bda148bc9334b19e3c868910 with delete_type TABLET_DATA_DELETED (replaced by tablet b3ea76ad1ec64d22a64bdd4c97e288c6) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.805905 28667 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet a76b0744ef2a472091999681d5639fec (table default.Table_9f236274be424e44818107f2fed5331c [id=a3772e01cb314c7e88e85833d727617d]). Expected version 1 got 0
W20260617 20:16:48.806011 29197 leader_election.cc:343] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 4516e7a7fa284eaa816558b2d58cd213
I20260617 20:16:48.806393 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d2a38be2e8e4796a98f1ae1d011249f with delete_type TABLET_DATA_DELETED (replaced by tablet e58fbec4a9f14ddda42b5a4c0263972c) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.806460 29383 tablet_bootstrap.cc:492] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.806694 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 808c455e74e645aa8e2b0d08ca81d4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.806087 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_905925f76ee34413b4808ebf86465758" } new_table_name: "default.Table_a5cd3098d5b249b9a132cf32515128ed" modify_external_catalogs: true
I20260617 20:16:48.808864 29383 tablet_bootstrap.cc:654] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.809417 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fb7dcd897fa349bb9ea70a359a51453c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.810141 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb7dcd897fa349bb9ea70a359a51453c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.818013 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4516e7a7fa284eaa816558b2d58cd213" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:48.818248 29127 raft_consensus.cc:2468] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:48.820525 29228 tablet_service.cc:1511] Processing CreateTablet for tablet f6c9d59b6b5a4dee8ca970247f613e53 (DEFAULT_TABLE table=default.Table_7412226c178b4fdfa79664f5975d834a [id=f398dc41286d4aa690f3d7b3d45015a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.821022 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c9d59b6b5a4dee8ca970247f613e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.822326 28969 tablet_service.cc:1511] Processing CreateTablet for tablet ba3ad8de250a47da9c9a31dff7f495b5 (DEFAULT_TABLE table=default.Table_c4a8619e08d149b4a6b953b12275af99 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.822774 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3ad8de250a47da9c9a31dff7f495b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.825275 29099 tablet_service.cc:1511] Processing CreateTablet for tablet ba3ad8de250a47da9c9a31dff7f495b5 (DEFAULT_TABLE table=default.Table_c4a8619e08d149b4a6b953b12275af99 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.825762 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3ad8de250a47da9c9a31dff7f495b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.829594 29198 leader_election.cc:304] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:48.831583 29377 ts_tablet_manager.cc:1929] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.831794 29377 log.cc:1199] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/3b67b915758d4ab0a8faa0227de08593
I20260617 20:16:48.832499 29377 ts_tablet_manager.cc:1950] T 3b67b915758d4ab0a8faa0227de08593 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:48.833475 29681 raft_consensus.cc:2804] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:48.833608 29681 raft_consensus.cc:493] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:48.833734 29681 raft_consensus.cc:3060] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:48.834407 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 3b67b915758d4ab0a8faa0227de08593 (table default.Table_ef23aa968984448793f5605fea074d86 [id=f521ee60b1604df983bce5d5c1d0b3d1]) successfully deleted
I20260617 20:16:48.836862 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1a3b194179894c7896294d19efce6c25" } new_table_name: "default.Table_1620ccecc04e416b924e56212280c0ff" modify_external_catalogs: true
I20260617 20:16:48.837064 29681 raft_consensus.cc:515] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.766646 29375 raft_consensus.cc:2272] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:48.840217 29228 tablet_service.cc:1511] Processing CreateTablet for tablet ba3ad8de250a47da9c9a31dff7f495b5 (DEFAULT_TABLE table=default.Table_c4a8619e08d149b4a6b953b12275af99 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.840708 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3ad8de250a47da9c9a31dff7f495b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.843791 29377 tablet_replica.cc:333] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:48.847375 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 32c3a4c3bee5444697f5d53d51c62894 (DEFAULT_TABLE table=default.Table_1049746575e44a9ab370495af7e4dea9 [id=7a5ce2f1ca114a508611d15c5a7c18c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.847839 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c3a4c3bee5444697f5d53d51c62894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.851207 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 75519f97f1ce49ceb3a739ba7c7bc239 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:48.854431 29379 tablet_bootstrap.cc:492] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:48.854645 29379 ts_tablet_manager.cc:1403] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.170s user 0.004s sys 0.000s
I20260617 20:16:48.855482 29379 raft_consensus.cc:359] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.856024 29379 raft_consensus.cc:385] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.856163 29379 raft_consensus.cc:740] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.856443 29379 consensus_queue.cc:260] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.858228 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 32c3a4c3bee5444697f5d53d51c62894 (DEFAULT_TABLE table=default.Table_1049746575e44a9ab370495af7e4dea9 [id=7a5ce2f1ca114a508611d15c5a7c18c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.858275 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 89f7b878728a495f83b6584f8a6aca67 (DEFAULT_TABLE table=default.Table_a52db3bf8ffa484aace6788058b23821 [id=6fb9858b817a4575abd3b84a32027d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.858677 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f7b878728a495f83b6584f8a6aca67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.859102 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 89f7b878728a495f83b6584f8a6aca67 (DEFAULT_TABLE table=default.Table_a52db3bf8ffa484aace6788058b23821 [id=6fb9858b817a4575abd3b84a32027d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.859131 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 32c3a4c3bee5444697f5d53d51c62894 (DEFAULT_TABLE table=default.Table_1049746575e44a9ab370495af7e4dea9 [id=7a5ce2f1ca114a508611d15c5a7c18c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.859301 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c3a4c3bee5444697f5d53d51c62894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.859669 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32c3a4c3bee5444697f5d53d51c62894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.861799 29681 leader_election.cc:290] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:48.862071 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4516e7a7fa284eaa816558b2d58cd213" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:48.862243 29127 raft_consensus.cc:3060] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:48.866321 29197 leader_election.cc:343] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 4516e7a7fa284eaa816558b2d58cd213
I20260617 20:16:48.866420 29127 raft_consensus.cc:2468] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:48.867187 29198 leader_election.cc:304] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:48.867481 29379 ts_tablet_manager.cc:1434] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260617 20:16:48.867709 29377 raft_consensus.cc:2243] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:48.867792 29681 raft_consensus.cc:2804] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:48.867996 29377 raft_consensus.cc:2272] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:48.868027 29681 raft_consensus.cc:697] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:48.868314 29681 consensus_queue.cc:237] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:48.872038 29383 tablet_bootstrap.cc:492] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:48.879551 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f7b878728a495f83b6584f8a6aca67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.879856 29587 raft_consensus.cc:493] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.880007 29587 raft_consensus.cc:515] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.880666 29587 leader_election.cc:290] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:48.881311 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b59053006046e98d27c694808ca34d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:48.881819 28925 leader_election.cc:343] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:48.883754 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba3ad8de250a47da9c9a31dff7f495b5 consensus state has no leader
I20260617 20:16:48.886119 29379 tablet_bootstrap.cc:492] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:48.883486 29740 raft_consensus.cc:493] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.885710 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b59053006046e98d27c694808ca34d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:48.886788 29740 raft_consensus.cc:515] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.887813 29740 leader_election.cc:290] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:48.889408 29375 ts_tablet_manager.cc:1916] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:48.889459 28925 leader_election.cc:343] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.889621 28925 leader_election.cc:304] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:48.889955 29197 leader_election.cc:343] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 637b0b3e9cb648deaea6e63760b83255
I20260617 20:16:48.890095 29587 raft_consensus.cc:2749] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:48.890300 29383 ts_tablet_manager.cc:1403] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.084s user 0.002s sys 0.003s
I20260617 20:16:48.891152 28662 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 60a43dd885aa4411a4177b67807b0ac4 (table default.Table_fd835dc9ea8f4041b36c069dcac9d69a [id=3a41dd53c3974256877f193219240234]). Expected version 4 got 0
I20260617 20:16:48.892210 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b333834cd9d748a1b546a9026aba6d48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.893232 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b333834cd9d748a1b546a9026aba6d48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.893967 29376 ts_tablet_manager.cc:1929] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.896770 29377 ts_tablet_manager.cc:1916] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:48.900223 29376 log.cc:1199] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/cd312e8817ee4c8fb7377825a7e6122a
I20260617 20:16:48.900535 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 1a725364bb9646e6bc80fc4f67d04a16
I20260617 20:16:48.901782 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637b0b3e9cb648deaea6e63760b83255" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:48.903035 29198 leader_election.cc:343] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.903210 29198 leader_election.cc:304] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:48.903465 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a725364bb9646e6bc80fc4f67d04a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.904075 29740 raft_consensus.cc:2749] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:48.904258 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a725364bb9646e6bc80fc4f67d04a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.904397 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a725364bb9646e6bc80fc4f67d04a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.895483 29383 raft_consensus.cc:359] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.904740 29383 raft_consensus.cc:385] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.904884 29383 raft_consensus.cc:740] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.906399 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 89f7b878728a495f83b6584f8a6aca67 (DEFAULT_TABLE table=default.Table_a52db3bf8ffa484aace6788058b23821 [id=6fb9858b817a4575abd3b84a32027d90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.906436 28961 tablet_service.cc:1511] Processing CreateTablet for tablet c3014c93d6804f3896f452f041cbedc9 (DEFAULT_TABLE table=default.Table_a215554510c74346a7e3d04c99b98de2 [id=0a278273a6004aa7947a19674e45d123]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.906837 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3014c93d6804f3896f452f041cbedc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.907393 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f7b878728a495f83b6584f8a6aca67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.906847 29383 consensus_queue.cc:260] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.910132 29383 ts_tablet_manager.cc:1434] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260617 20:16:48.910562 29383 tablet_bootstrap.cc:492] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:48.912856 29383 tablet_bootstrap.cc:654] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.914862 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_be535849f7204c22b012cd569f777a9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.915498 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be535849f7204c22b012cd569f777a9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.917586 29379 tablet_bootstrap.cc:654] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.919606 29101 tablet_service.cc:1511] Processing CreateTablet for tablet c3014c93d6804f3896f452f041cbedc9 (DEFAULT_TABLE table=default.Table_a215554510c74346a7e3d04c99b98de2 [id=0a278273a6004aa7947a19674e45d123]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.920598 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3014c93d6804f3896f452f041cbedc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.922082 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 33e4407aa01642ffb03eba1b220afdba
I20260617 20:16:48.925909 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e4407aa01642ffb03eba1b220afdba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.927726 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e4407aa01642ffb03eba1b220afdba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.929540 28665 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 60a43dd885aa4411a4177b67807b0ac4 (table default.Table_fd835dc9ea8f4041b36c069dcac9d69a [id=3a41dd53c3974256877f193219240234]). Expected version 4 got 0
I20260617 20:16:48.931852 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6a12b448d59c405096e0516741c0c32f" } new_table_name: "default.Table_b8793ca9db0342aab1948326509066a8" modify_external_catalogs: true
I20260617 20:16:48.934756 29237 tablet_service.cc:1511] Processing CreateTablet for tablet c3014c93d6804f3896f452f041cbedc9 (DEFAULT_TABLE table=default.Table_a215554510c74346a7e3d04c99b98de2 [id=0a278273a6004aa7947a19674e45d123]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.935199 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3014c93d6804f3896f452f041cbedc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.935398 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e4407aa01642ffb03eba1b220afdba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.937968 29099 tablet_service.cc:1511] Processing CreateTablet for tablet fc36f62aa0bf46278cb84ec8cb7eef55 (DEFAULT_TABLE table=default.Table_486a2491b91d4d4899c49ae5065acbcd [id=fe4c16ade5a04cc5b67a89de3e4ec53d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.938351 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc36f62aa0bf46278cb84ec8cb7eef55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.939824 29378 tablet_bootstrap.cc:492] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:48.939998 29378 ts_tablet_manager.cc:1403] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.207s user 0.041s sys 0.061s
I20260617 20:16:48.940884 29378 raft_consensus.cc:359] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.941099 29378 raft_consensus.cc:385] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:48.941188 29378 raft_consensus.cc:740] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.941277 28966 tablet_service.cc:1511] Processing CreateTablet for tablet fc36f62aa0bf46278cb84ec8cb7eef55 (DEFAULT_TABLE table=default.Table_486a2491b91d4d4899c49ae5065acbcd [id=fe4c16ade5a04cc5b67a89de3e4ec53d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.941773 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc36f62aa0bf46278cb84ec8cb7eef55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.944101 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3e80e776263c4a91ae7fffa9d0f4ebd4
I20260617 20:16:48.945533 29232 tablet_service.cc:1511] Processing CreateTablet for tablet fc36f62aa0bf46278cb84ec8cb7eef55 (DEFAULT_TABLE table=default.Table_486a2491b91d4d4899c49ae5065acbcd [id=fe4c16ade5a04cc5b67a89de3e4ec53d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.945784 29378 consensus_queue.cc:260] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.946797 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc36f62aa0bf46278cb84ec8cb7eef55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.947507 29378 ts_tablet_manager.cc:1434] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260617 20:16:48.947548 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:48.948263 29378 tablet_bootstrap.cc:492] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:48.949967 29376 ts_tablet_manager.cc:1950] T cd312e8817ee4c8fb7377825a7e6122a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:48.950140 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.951232 29035 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:48.951455 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.952369 29378 tablet_bootstrap.cc:654] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.954254 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet a76b0744ef2a472091999681d5639fec (table default.Table_9f236274be424e44818107f2fed5331c [id=a3772e01cb314c7e88e85833d727617d]). Expected version 1 got 0
I20260617 20:16:48.955022 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3121147010e14b9d8075f2104b757524"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:48.955621 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3121147010e14b9d8075f2104b757524 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:48.958779 29587 raft_consensus.cc:493] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.958956 29587 raft_consensus.cc:515] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.959175 29379 tablet_bootstrap.cc:492] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:48.959239 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 192) took 1811 ms. Trace:
I20260617 20:16:48.959345 29379 ts_tablet_manager.cc:1403] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.002s
I20260617 20:16:48.959394 29376 rpcz_store.cc:276] 0617 20:16:47.142982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.143036 (+ 54us) service_pool.cc:224] Handling call
0617 20:16:48.699468 (+1556432us) ts_tablet_manager.cc:1151] Deleting tablet cd312e8817ee4c8fb7377825a7e6122a
0617 20:16:48.699477 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:48.820159 (+120682us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:48.893884 (+ 73725us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:48.954060 (+ 60176us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1556206}
I20260617 20:16:48.959682 29587 leader_election.cc:290] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:48.960049 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet cd312e8817ee4c8fb7377825a7e6122a (table default.Table_3074bd171fd54a10948acd223e1c6da7 [id=1d46529c95a44c2c91c54e5b16a5f7ed]) successfully deleted
I20260617 20:16:48.960350 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a38be2e8e4796a98f1ae1d011249f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:48.960183 29379 raft_consensus.cc:359] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.960830 29379 raft_consensus.cc:385] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 20:16:48.960914 28925 leader_election.cc:343] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.960834 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2a38be2e8e4796a98f1ae1d011249f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:48.960955 29379 raft_consensus.cc:740] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:48.961211 29379 consensus_queue.cc:260] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:48.961524 28925 leader_election.cc:343] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:48.961684 28925 leader_election.cc:304] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:48.962001 29587 raft_consensus.cc:2749] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:48.962743 29376 tablet_replica.cc:333] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:48.964797 29728 raft_consensus.cc:493] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:48.964951 29728 raft_consensus.cc:515] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:48.965582 29728 leader_election.cc:290] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:48.967743 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 39ea9cfa1c5a42359e5fa8a2c4c433a4 (DEFAULT_TABLE table=default.Table_99e2a4b9958548c38b48f359a9a50f00 [id=8cd039ca4c474501ae4578e0c815829b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.968293 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ea9cfa1c5a42359e5fa8a2c4c433a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:48.968358 29062 leader_election.cc:343] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 28146a1f84aa41ee88d9aea299256a90
I20260617 20:16:48.970208 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 39ea9cfa1c5a42359e5fa8a2c4c433a4 (DEFAULT_TABLE table=default.Table_99e2a4b9958548c38b48f359a9a50f00 [id=8cd039ca4c474501ae4578e0c815829b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.970856 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ea9cfa1c5a42359e5fa8a2c4c433a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.971578 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 70698bb6ff6f4fe0b465f2974fcc24ea
I20260617 20:16:48.974314 29379 ts_tablet_manager.cc:1434] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260617 20:16:48.975462 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 70698bb6ff6f4fe0b465f2974fcc24ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.977713 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 70698bb6ff6f4fe0b465f2974fcc24ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:48.977646 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28146a1f84aa41ee88d9aea299256a90" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:48.977946 29261 raft_consensus.cc:2468] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:48.978978 29379 tablet_bootstrap.cc:492] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:48.979478 29063 leader_election.cc:304] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:48.980139 29728 raft_consensus.cc:2804] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:48.980254 29728 raft_consensus.cc:493] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:48.980386 29728 raft_consensus.cc:3060] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:48.980423 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet a76b0744ef2a472091999681d5639fec (table default.Table_9f236274be424e44818107f2fed5331c [id=a3772e01cb314c7e88e85833d727617d]). Expected version 1 got 0
I20260617 20:16:48.980868 29379 tablet_bootstrap.cc:654] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:48.982664 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 28146a1f84aa41ee88d9aea299256a90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:48.983142 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2d3a3741a94b4e86baf5a8e1eb46ee44" } new_table_name: "default.Table_335178a88e53486dba06f29270337bb0" modify_external_catalogs: true
I20260617 20:16:48.984588 29728 raft_consensus.cc:515] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:48.986963 29062 leader_election.cc:343] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 28146a1f84aa41ee88d9aea299256a90
I20260617 20:16:48.987226 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 33a1c96212014333935ec7f7c92a306c (DEFAULT_TABLE table=default.Table_f73d839e67c548629526669e7310da0c [id=cdf84135aed8448bafc93456dd9cdfc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.987317 29728 leader_election.cc:290] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:48.987663 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a1c96212014333935ec7f7c92a306c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.988750 29377 ts_tablet_manager.cc:1929] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.988903 29377 log.cc:1199] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/9b96c186469e4e8a8baa0dcab96d66bf
I20260617 20:16:48.989331 29377 ts_tablet_manager.cc:1950] T 9b96c186469e4e8a8baa0dcab96d66bf P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:48.990633 29375 ts_tablet_manager.cc:1929] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:48.990859 29375 log.cc:1199] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/1d4be33993864c73ba8b4da9468a517b
I20260617 20:16:48.991325 29375 ts_tablet_manager.cc:1950] T 1d4be33993864c73ba8b4da9468a517b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:48.995739 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 33a1c96212014333935ec7f7c92a306c (DEFAULT_TABLE table=default.Table_f73d839e67c548629526669e7310da0c [id=cdf84135aed8448bafc93456dd9cdfc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:48.995204 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 223) took 1144 ms. Trace:
I20260617 20:16:48.996295 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a1c96212014333935ec7f7c92a306c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.997000 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 9b96c186469e4e8a8baa0dcab96d66bf (table default.Table_33168ad831b44c79a651427dd6011f2b [id=1a6ef514b9104d7d92bce17d40b5e3f9]) successfully deleted
I20260617 20:16:48.998703 29377 tablet_replica.cc:333] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:49.001080 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet 70698bb6ff6f4fe0b465f2974fcc24ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:49.001634 29377 raft_consensus.cc:2243] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.002465 29377 raft_consensus.cc:2272] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.002871 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28146a1f84aa41ee88d9aea299256a90" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:49.003067 29261 raft_consensus.cc:3060] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.006819 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c21b585707b146ed9c015d150d858681
I20260617 20:16:49.007315 28668 catalog_manager.cc:6784] ReplaceTablet: tablet c21b585707b146ed9c015d150d858681 deleted and replaced by tablet 3726e55ed36f420ab63bcfb5a81c5aab
I20260617 20:16:49.008520 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet c21b585707b146ed9c015d150d858681 with delete_type TABLET_DATA_DELETED (replaced by tablet 3726e55ed36f420ab63bcfb5a81c5aab) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:49.008757 29376 raft_consensus.cc:2243] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.011237 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet c21b585707b146ed9c015d150d858681 with delete_type TABLET_DATA_DELETED (replaced by tablet 3726e55ed36f420ab63bcfb5a81c5aab) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:49.013121 29376 raft_consensus.cc:2272] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.014268 29376 ts_tablet_manager.cc:1916] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.014532 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_350b5e38df254cc69627edec8db5af45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.015588 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_350b5e38df254cc69627edec8db5af45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.019686 29377 ts_tablet_manager.cc:1916] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.023003 28961 tablet_service.cc:1511] Processing CreateTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 (DEFAULT_TABLE table=default.Table_56731cc7022548f8a230b1f50b31109f [id=8b180a732c2a49c8a6dfd4218af43abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.023548 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e0c5d20a4548cc8124302aa38bcb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:48.996052 29375 rpcz_store.cc:276] 0617 20:16:47.848425 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.848492 (+ 67us) service_pool.cc:224] Handling call
0617 20:16:48.750378 (+901886us) ts_tablet_manager.cc:1151] Deleting tablet 1d4be33993864c73ba8b4da9468a517b
0617 20:16:48.750640 (+ 262us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:48.909882 (+159242us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:48.990551 (+ 80669us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:48.992716 (+ 2165us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":901428}
I20260617 20:16:49.032828 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 33a1c96212014333935ec7f7c92a306c (DEFAULT_TABLE table=default.Table_f73d839e67c548629526669e7310da0c [id=cdf84135aed8448bafc93456dd9cdfc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.033237 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 1d4be33993864c73ba8b4da9468a517b (table default.Table_e67bded1adac4a9194ee9f5f1131ed12 [id=6e89910c5d7a4969a79960d34eff437c]) successfully deleted
I20260617 20:16:49.033425 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a1c96212014333935ec7f7c92a306c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.033609 29375 tablet_replica.cc:333] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:49.033820 29375 raft_consensus.cc:2243] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:49.035434 29375 pending_rounds.cc:70] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:49.035564 29375 pending_rounds.cc:77] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955465994674176 op_type: NO_OP noop_request { }
I20260617 20:16:49.035841 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet c21b585707b146ed9c015d150d858681 with delete_type TABLET_DATA_DELETED (replaced by tablet 3726e55ed36f420ab63bcfb5a81c5aab) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.036202 29375 raft_consensus.cc:2889] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260617 20:16:49.036345 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b62b22ff17964ee6934023fb85e0b7ec consensus state has no leader
I20260617 20:16:49.036337 29375 raft_consensus.cc:2272] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.037159 29099 tablet_service.cc:1511] Processing CreateTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 (DEFAULT_TABLE table=default.Table_56731cc7022548f8a230b1f50b31109f [id=8b180a732c2a49c8a6dfd4218af43abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.037578 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e0c5d20a4548cc8124302aa38bcb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.039121 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_82cae984e6c341f18a7f783102a490f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.039646 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82cae984e6c341f18a7f783102a490f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.041963 29375 ts_tablet_manager.cc:1916] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.044286 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 39ea9cfa1c5a42359e5fa8a2c4c433a4 (DEFAULT_TABLE table=default.Table_99e2a4b9958548c38b48f359a9a50f00 [id=8cd039ca4c474501ae4578e0c815829b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.055907 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet 1d4be33993864c73ba8b4da9468a517b from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:49.057708 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b97bf3349f93422cbd2b08e176e4d5da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.058347 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b97bf3349f93422cbd2b08e176e4d5da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.062307 28959 tablet_service.cc:1511] Processing CreateTablet for tablet f4de5dafb1474de1911148bb3b4527cf (DEFAULT_TABLE table=default.Table_6a12b448d59c405096e0516741c0c32f [id=edd51a8755804964934adedfa19328a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.062788 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4de5dafb1474de1911148bb3b4527cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.062688 29375 ts_tablet_manager.cc:1929] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:49.063892 29375 log.cc:1199] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/7a81a3502f5d4602b65328577a668d62
I20260617 20:16:49.065976 29261 raft_consensus.cc:2468] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:49.067200 29063 leader_election.cc:304] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:49.067538 29375 ts_tablet_manager.cc:1950] T 7a81a3502f5d4602b65328577a668d62 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:49.067958 29728 raft_consensus.cc:2804] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:49.068758 29728 raft_consensus.cc:697] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:49.069224 29728 consensus_queue.cc:237] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.070478 29099 tablet_service.cc:1511] Processing CreateTablet for tablet f4de5dafb1474de1911148bb3b4527cf (DEFAULT_TABLE table=default.Table_6a12b448d59c405096e0516741c0c32f [id=edd51a8755804964934adedfa19328a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.071256 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4de5dafb1474de1911148bb3b4527cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:49.073503 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ead0291870a443d9b76ea919a45a4303 has no consensus state
I20260617 20:16:49.076135 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 8880f8eadaa44887a49adf0ef157965e from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:49.075449 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 222) took 1227 ms. Trace:
I20260617 20:16:49.076726 29375 rpcz_store.cc:276] 0617 20:16:47.848128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.850943 (+ 2815us) service_pool.cc:224] Handling call
0617 20:16:49.031941 (+1180998us) ts_tablet_manager.cc:1151] Deleting tablet 7a81a3502f5d4602b65328577a668d62
0617 20:16:49.031951 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.045411 (+ 13460us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.062099 (+ 16688us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.075164 (+ 13065us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1180719}
I20260617 20:16:49.079526 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 7a81a3502f5d4602b65328577a668d62 (table default.Table_71003cb25e6e4229aba21f7dd04b7fe4 [id=da4afdf3f60e48e78eb52d454fa4142c]) successfully deleted
I20260617 20:16:49.080523 29107 tablet_service.cc:1511] Processing CreateTablet for tablet cf8d04ef8acd4fcaa69df9253cd89462 (DEFAULT_TABLE table=default.Table_4de9b511b49b48cca1674d8532df65cd [id=7ba43f49c1924ed0acfb4c453dc8d0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.080961 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8d04ef8acd4fcaa69df9253cd89462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.081084 29227 tablet_service.cc:1511] Processing CreateTablet for tablet f4de5dafb1474de1911148bb3b4527cf (DEFAULT_TABLE table=default.Table_6a12b448d59c405096e0516741c0c32f [id=edd51a8755804964934adedfa19328a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.077800 29237 tablet_service.cc:1511] Processing CreateTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 (DEFAULT_TABLE table=default.Table_56731cc7022548f8a230b1f50b31109f [id=8b180a732c2a49c8a6dfd4218af43abf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.083916 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 75519f97f1ce49ceb3a739ba7c7bc239
I20260617 20:16:49.084378 28666 catalog_manager.cc:6784] ReplaceTablet: tablet 75519f97f1ce49ceb3a739ba7c7bc239 deleted and replaced by tablet c73bdcc1cefd48f3b99e0c059c3a7467
I20260617 20:16:49.087165 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 75519f97f1ce49ceb3a739ba7c7bc239 with delete_type TABLET_DATA_DELETED (replaced by tablet c73bdcc1cefd48f3b99e0c059c3a7467) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.087142 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 75519f97f1ce49ceb3a739ba7c7bc239 with delete_type TABLET_DATA_DELETED (replaced by tablet c73bdcc1cefd48f3b99e0c059c3a7467) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:49.087258 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8a1228ed97634cd7a2eecc5b659406c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.087841 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a1228ed97634cd7a2eecc5b659406c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.091195 29242 tablet_service.cc:1511] Processing CreateTablet for tablet cf8d04ef8acd4fcaa69df9253cd89462 (DEFAULT_TABLE table=default.Table_4de9b511b49b48cca1674d8532df65cd [id=7ba43f49c1924ed0acfb4c453dc8d0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.091145 29375 tablet_replica.cc:333] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:49.093070 29375 raft_consensus.cc:2243] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:49.095150 29375 pending_rounds.cc:70] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:49.095789 29375 pending_rounds.cc:77] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955464392540160 op_type: NO_OP noop_request { }
I20260617 20:16:49.096573 29376 ts_tablet_manager.cc:1929] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.096745 29376 log.cc:1199] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/fa513612e44148d7983b0db00d733888
I20260617 20:16:49.097072 29375 raft_consensus.cc:2889] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:49.098373 29375 raft_consensus.cc:2272] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.099511 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_160815abfba040f29bfce92cd08c5e46" } modify_external_catalogs: true
I20260617 20:16:49.099684 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_160815abfba040f29bfce92cd08c5e46" } modify_external_catalogs: true
I20260617 20:16:49.103664 29107 tablet_service.cc:1511] Processing CreateTablet for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb (DEFAULT_TABLE table=default.Table_5309bfd681fb429ca8e543eb2f52fada [id=32c61aa9610e428fa8d5c794b078e0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.104144 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.104285 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 75519f97f1ce49ceb3a739ba7c7bc239 with delete_type TABLET_DATA_DELETED (replaced by tablet c73bdcc1cefd48f3b99e0c059c3a7467) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:49.111416 28955 tablet_service.cc:1511] Processing CreateTablet for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb (DEFAULT_TABLE table=default.Table_5309bfd681fb429ca8e543eb2f52fada [id=32c61aa9610e428fa8d5c794b078e0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.112234 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.112751 29375 ts_tablet_manager.cc:1916] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.114789 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fae70178b45747a29dfd1be32d78cff6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.115466 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fae70178b45747a29dfd1be32d78cff6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.126402 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 450b08b439814915ab4371770f49f45b (DEFAULT_TABLE table=default.Table_706c0e9f917f49388f2da836758dcf8d [id=92baee89c27c4013a1a3fcc703ee1c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.126946 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450b08b439814915ab4371770f49f45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.131522 29379 tablet_bootstrap.cc:492] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.131754 29379 ts_tablet_manager.cc:1403] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.153s user 0.006s sys 0.008s
W20260617 20:16:49.131968 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4de5dafb1474de1911148bb3b4527cf consensus state has no leader
I20260617 20:16:49.133430 29379 raft_consensus.cc:359] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.133756 29379 raft_consensus.cc:385] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.133932 29379 raft_consensus.cc:740] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.134356 29379 consensus_queue.cc:260] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.135178 29379 ts_tablet_manager.cc:1434] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:49.135088 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e6f97190105641898b676e78e1d0dfea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.135699 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6f97190105641898b676e78e1d0dfea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.136088 29379 tablet_bootstrap.cc:492] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.138149 29379 tablet_bootstrap.cc:654] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.138913 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 488b06f05d9b4273a61bcb2d6e0ad796 (DEFAULT_TABLE table=default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.139304 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488b06f05d9b4273a61bcb2d6e0ad796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.139225 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 450b08b439814915ab4371770f49f45b (DEFAULT_TABLE table=default.Table_706c0e9f917f49388f2da836758dcf8d [id=92baee89c27c4013a1a3fcc703ee1c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.145442 28961 tablet_service.cc:1511] Processing CreateTablet for tablet cf8d04ef8acd4fcaa69df9253cd89462 (DEFAULT_TABLE table=default.Table_4de9b511b49b48cca1674d8532df65cd [id=7ba43f49c1924ed0acfb4c453dc8d0f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.145880 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450b08b439814915ab4371770f49f45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.149791 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8d04ef8acd4fcaa69df9253cd89462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.156002 29377 ts_tablet_manager.cc:1929] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.156242 29377 log.cc:1199] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/216f91e7bda148bc9334b19e3c868910
I20260617 20:16:49.156698 29377 ts_tablet_manager.cc:1950] T 216f91e7bda148bc9334b19e3c868910 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:49.103617 29236 tablet_service.cc:1511] Processing CreateTablet for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb (DEFAULT_TABLE table=default.Table_5309bfd681fb429ca8e543eb2f52fada [id=32c61aa9610e428fa8d5c794b078e0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.157970 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 216f91e7bda148bc9334b19e3c868910 (table default.Table_1944004da2ec4937b26d524aa808d0b3 [id=295609419d07485fa5651914ddd75ce8]) successfully deleted
I20260617 20:16:49.102432 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ea9cfa1c5a42359e5fa8a2c4c433a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.158434 29377 tablet_replica.cc:333] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:49.158649 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.158715 29377 raft_consensus.cc:2243] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.158931 29377 raft_consensus.cc:2272] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.159474 29377 ts_tablet_manager.cc:1916] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.164760 29379 tablet_bootstrap.cc:492] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.165036 29379 ts_tablet_manager.cc:1403] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.003s
I20260617 20:16:49.165989 29379 raft_consensus.cc:359] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.166361 29379 raft_consensus.cc:385] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.166585 29379 raft_consensus.cc:740] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.167017 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 488b06f05d9b4273a61bcb2d6e0ad796 (DEFAULT_TABLE table=default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.167511 29379 consensus_queue.cc:260] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.168063 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4de5dafb1474de1911148bb3b4527cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.168936 29379 ts_tablet_manager.cc:1434] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:49.171056 29379 tablet_bootstrap.cc:492] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.171864 29107 tablet_service.cc:1511] Processing CreateTablet for tablet b4240e14b48f4a43b7ce9c6512fc7ff2 (DEFAULT_TABLE table=default.Table_d3c4a4f115524492993663ad7da2da7a [id=c35dbd440308443187b41417db2068f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.172238 28955 tablet_service.cc:1511] Processing CreateTablet for tablet b4240e14b48f4a43b7ce9c6512fc7ff2 (DEFAULT_TABLE table=default.Table_d3c4a4f115524492993663ad7da2da7a [id=c35dbd440308443187b41417db2068f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.172693 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4240e14b48f4a43b7ce9c6512fc7ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.173280 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4240e14b48f4a43b7ce9c6512fc7ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.174363 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf8d04ef8acd4fcaa69df9253cd89462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.177510 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e0c5d20a4548cc8124302aa38bcb21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.177899 29375 ts_tablet_manager.cc:1929] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:49.179184 29375 log.cc:1199] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/00f16ff3bc57434592d1648c4944c157
I20260617 20:16:49.182639 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488b06f05d9b4273a61bcb2d6e0ad796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.183223 29375 ts_tablet_manager.cc:1950] T 00f16ff3bc57434592d1648c4944c157 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:49.129216 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 450b08b439814915ab4371770f49f45b (DEFAULT_TABLE table=default.Table_706c0e9f917f49388f2da836758dcf8d [id=92baee89c27c4013a1a3fcc703ee1c23]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.185945 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450b08b439814915ab4371770f49f45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.186288 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 224) took 1304 ms. Trace:
I20260617 20:16:49.186939 29379 tablet_bootstrap.cc:654] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.187090 29375 rpcz_store.cc:276] 0617 20:16:47.882010 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.882137 (+ 127us) service_pool.cc:224] Handling call
0617 20:16:49.089491 (+1207354us) ts_tablet_manager.cc:1151] Deleting tablet 00f16ff3bc57434592d1648c4944c157
0617 20:16:49.089741 (+ 250us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.151445 (+ 61704us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.177604 (+ 26159us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.185955 (+ 8351us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1206988}
I20260617 20:16:49.189145 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 00f16ff3bc57434592d1648c4944c157 (table default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]) successfully deleted
I20260617 20:16:49.146271 29742 raft_consensus.cc:493] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:49.145185 29383 tablet_bootstrap.cc:492] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.191761 29742 raft_consensus.cc:515] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.191980 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 227) took 1279 ms. Trace:
I20260617 20:16:49.193024 29742 leader_election.cc:290] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:49.194082 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65a4345552844fe9e7512105fd79877" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:49.192826 29375 rpcz_store.cc:276] 0617 20:16:47.911769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.913078 (+ 1309us) service_pool.cc:224] Handling call
0617 20:16:49.190319 (+1277241us) ts_tablet_manager.cc:1151] Deleting tablet 57e19abe093a40f6886908a8a3a0cad4
0617 20:16:49.190336 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.191427 (+ 1091us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1272547}
W20260617 20:16:49.194985 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 57e19abe093a40f6886908a8a3a0cad4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57e19abe093a40f6886908a8a3a0cad4 already in progress: creating tablet
W20260617 20:16:49.195137 29198 leader_election.cc:343] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:49.198096 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 230) took 1248 ms. Trace:
I20260617 20:16:49.198805 29375 rpcz_store.cc:276] 0617 20:16:47.948809 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.948864 (+ 55us) service_pool.cc:224] Handling call
0617 20:16:49.196683 (+1247819us) ts_tablet_manager.cc:1151] Deleting tablet 808c455e74e645aa8e2b0d08ca81d4f9
0617 20:16:49.196695 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.197730 (+ 1035us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1247370}
W20260617 20:16:49.200991 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 808c455e74e645aa8e2b0d08ca81d4f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 808c455e74e645aa8e2b0d08ca81d4f9 already in progress: creating tablet
I20260617 20:16:49.203008 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 231) took 1242 ms. Trace:
W20260617 20:16:49.204138 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13ba94ec9e27403b974e5e6fea46e59e consensus state has no leader
W20260617 20:16:49.204301 29197 leader_election.cc:343] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c65a4345552844fe9e7512105fd79877
I20260617 20:16:49.204494 29197 leader_election.cc:304] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:49.203609 29375 rpcz_store.cc:276] 0617 20:16:47.960156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.960217 (+ 61us) service_pool.cc:224] Handling call
0617 20:16:49.201948 (+1241731us) ts_tablet_manager.cc:1151] Deleting tablet 9d4702c06d3442ac966ef2daca8d4660
0617 20:16:49.202117 (+ 169us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.202714 (+ 597us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1241475}
W20260617 20:16:49.205664 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 9d4702c06d3442ac966ef2daca8d4660 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d4702c06d3442ac966ef2daca8d4660 already in progress: creating tablet
I20260617 20:16:49.205670 29742 raft_consensus.cc:2749] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:49.207587 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 233) took 1225 ms. Trace:
I20260617 20:16:49.208216 29375 rpcz_store.cc:276] 0617 20:16:47.981986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.984196 (+ 2210us) service_pool.cc:224] Handling call
0617 20:16:49.206382 (+1222186us) ts_tablet_manager.cc:1151] Deleting tablet b1b3565799894d82a3cc29ab2a19307c
0617 20:16:49.206562 (+ 180us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.207193 (+ 631us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1221882}
W20260617 20:16:49.210258 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet b1b3565799894d82a3cc29ab2a19307c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1b3565799894d82a3cc29ab2a19307c already in progress: creating tablet
I20260617 20:16:49.212172 29375 tablet_replica.cc:333] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:49.214241 29375 raft_consensus.cc:2243] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:49.216809 29375 pending_rounds.cc:70] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:49.217418 29375 pending_rounds.cc:77] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955465962921984 op_type: NO_OP noop_request { }
I20260617 20:16:49.219312 29379 tablet_bootstrap.cc:492] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.219681 29379 ts_tablet_manager.cc:1403] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.003s
I20260617 20:16:49.220122 29236 tablet_service.cc:1511] Processing CreateTablet for tablet b4240e14b48f4a43b7ce9c6512fc7ff2 (DEFAULT_TABLE table=default.Table_d3c4a4f115524492993663ad7da2da7a [id=c35dbd440308443187b41417db2068f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.220496 29379 raft_consensus.cc:359] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.220675 29379 raft_consensus.cc:385] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.220863 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4240e14b48f4a43b7ce9c6512fc7ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.220932 29379 raft_consensus.cc:740] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.221167 29379 consensus_queue.cc:260] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.221338 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet d9b7880a039a497fbd0fb5d4f74e7d23 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:49.221761 29379 ts_tablet_manager.cc:1434] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:49.222069 29379 tablet_bootstrap.cc:492] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.219214 29375 raft_consensus.cc:2889] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:49.223416 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5716b279b26c4d29a3259333d3661d7d" } modify_external_catalogs: true
I20260617 20:16:49.223627 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5716b279b26c4d29a3259333d3661d7d" } modify_external_catalogs: true
I20260617 20:16:49.223762 29375 raft_consensus.cc:2272] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.224979 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fb580c3d4089464aa53ff2360464aaae" } modify_external_catalogs: true
I20260617 20:16:49.225138 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fb580c3d4089464aa53ff2360464aaae" } modify_external_catalogs: true
I20260617 20:16:49.226540 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e1ea1f71f399476f867e5fe2b1484c8a" } new_table_name: "default.Table_726c0ba5eb5442e68a5c029d25fb209c" modify_external_catalogs: true
I20260617 20:16:49.227818 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3a768181eca84e2f9d6eb43239795801" } modify_external_catalogs: true
I20260617 20:16:49.227970 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3a768181eca84e2f9d6eb43239795801" } modify_external_catalogs: true
I20260617 20:16:49.228416 29375 ts_tablet_manager.cc:1916] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.229215 29587 raft_consensus.cc:493] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:49.229421 29587 raft_consensus.cc:515] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.230084 29383 ts_tablet_manager.cc:1403] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.280s user 0.002s sys 0.010s
I20260617 20:16:49.230193 29587 leader_election.cc:290] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:49.231014 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b162a0ef91d1447b838331ba6ef93bf4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:49.231593 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b162a0ef91d1447b838331ba6ef93bf4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:49.231961 29379 tablet_bootstrap.cc:654] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:49.232333 28925 leader_election.cc:343] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:49.232921 28925 leader_election.cc:343] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:49.233098 28925 leader_election.cc:304] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:49.233435 29587 raft_consensus.cc:2749] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:49.235896 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 488b06f05d9b4273a61bcb2d6e0ad796 (DEFAULT_TABLE table=default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.236562 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488b06f05d9b4273a61bcb2d6e0ad796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.097281 29376 ts_tablet_manager.cc:1950] T fa513612e44148d7983b0db00d733888 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:49.245913 29383 raft_consensus.cc:359] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.246274 29383 raft_consensus.cc:385] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.247730 29383 raft_consensus.cc:740] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.248178 29383 consensus_queue.cc:260] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.252187 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6f68970fea69478eba2df21752f2ea0a" } modify_external_catalogs: true
I20260617 20:16:49.252434 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6f68970fea69478eba2df21752f2ea0a" } modify_external_catalogs: true
I20260617 20:16:49.253985 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 8880f8eadaa44887a49adf0ef157965e
I20260617 20:16:49.254511 28663 catalog_manager.cc:6784] ReplaceTablet: tablet 8880f8eadaa44887a49adf0ef157965e deleted and replaced by tablet f02529cd1e764a3886de27d86e9690e3
I20260617 20:16:49.255565 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 8880f8eadaa44887a49adf0ef157965e with delete_type TABLET_DATA_DELETED (replaced by tablet f02529cd1e764a3886de27d86e9690e3) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.256618 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6072f76a9b944eda8c05a7486c823fff" } new_table_name: "default.Table_b14e233170894814b3e2708e612aaa61" modify_external_catalogs: true
I20260617 20:16:49.261677 29375 ts_tablet_manager.cc:1929] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:49.263020 29375 log.cc:1199] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/dd2df17b35a7483b93a6e89d42ac1a62
I20260617 20:16:49.264276 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 8880f8eadaa44887a49adf0ef157965e with delete_type TABLET_DATA_DELETED (replaced by tablet f02529cd1e764a3886de27d86e9690e3) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:49.268266 29375 ts_tablet_manager.cc:1950] T dd2df17b35a7483b93a6e89d42ac1a62 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:49.269497 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 8880f8eadaa44887a49adf0ef157965e with delete_type TABLET_DATA_DELETED (replaced by tablet f02529cd1e764a3886de27d86e9690e3) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:49.269377 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_43860bd130d547878e058c369421cbba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.270269 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43860bd130d547878e058c369421cbba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.280803 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 16d0360ec78844a1be3d5f51259bbcdf
I20260617 20:16:49.282773 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 16d0360ec78844a1be3d5f51259bbcdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.271147 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 234) took 1280 ms. Trace:
I20260617 20:16:49.287680 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0181eddc78fc4d47b1b0bbd67645ad04" } new_table_name: "default.Table_0f2a772bda6e4476b8b5a42f9d0fb42f" modify_external_catalogs: true
I20260617 20:16:49.287355 29375 rpcz_store.cc:276] 0617 20:16:47.990378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.990927 (+ 549us) service_pool.cc:224] Handling call
0617 20:16:49.211069 (+1220142us) ts_tablet_manager.cc:1151] Deleting tablet dd2df17b35a7483b93a6e89d42ac1a62
0617 20:16:49.211241 (+ 172us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.243087 (+ 31846us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.261154 (+ 18067us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.270844 (+ 9690us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1219853}
I20260617 20:16:49.289101 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet dd2df17b35a7483b93a6e89d42ac1a62 (table default.Table_5309bfd681fb429ca8e543eb2f52fada [id=32c61aa9610e428fa8d5c794b078e0a1]) successfully deleted
I20260617 20:16:49.298877 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 241) took 1054 ms. Trace:
I20260617 20:16:49.283026 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 16d0360ec78844a1be3d5f51259bbcdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:49.300063 29375 rpcz_store.cc:276] 0617 20:16:48.243897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.244239 (+ 342us) service_pool.cc:224] Handling call
0617 20:16:49.291757 (+1047518us) ts_tablet_manager.cc:1151] Deleting tablet 3e287ba95be7408b8fc75e6f0709d8f1
0617 20:16:49.291892 (+ 135us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.298172 (+ 6280us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1037992}
I20260617 20:16:49.302587 29379 tablet_bootstrap.cc:492] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.303364 29379 ts_tablet_manager.cc:1403] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.081s user 0.005s sys 0.007s
I20260617 20:16:49.305094 29379 raft_consensus.cc:359] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.305612 29379 raft_consensus.cc:385] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.305775 29379 raft_consensus.cc:740] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
W20260617 20:16:49.306983 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3e287ba95be7408b8fc75e6f0709d8f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e287ba95be7408b8fc75e6f0709d8f1 already in progress: creating tablet
I20260617 20:16:49.306514 29379 consensus_queue.cc:260] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.309185 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 243) took 1003 ms. Trace:
I20260617 20:16:49.310118 29375 rpcz_store.cc:276] 0617 20:16:48.321449 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.321571 (+ 122us) service_pool.cc:224] Handling call
0617 20:16:49.307836 (+986265us) ts_tablet_manager.cc:1151] Deleting tablet 569e339c17764486a65a1c3b43c92adf
0617 20:16:49.307849 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.308662 (+ 813us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":983920}
W20260617 20:16:49.312076 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 569e339c17764486a65a1c3b43c92adf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 569e339c17764486a65a1c3b43c92adf already in progress: creating tablet
I20260617 20:16:49.313058 29379 ts_tablet_manager.cc:1434] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260617 20:16:49.315148 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet d9b7880a039a497fbd0fb5d4f74e7d23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:45 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.315727 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet 8eee68618cdf462283d7fd9f098c2a0d from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:49.316256 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d2a38be2e8e4796a98f1ae1d011249f with delete_type TABLET_DATA_DELETED (replaced by tablet e58fbec4a9f14ddda42b5a4c0263972c) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.316483 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 637b0b3e9cb648deaea6e63760b83255 with delete_type TABLET_DATA_DELETED (replaced by tablet 8880f8eadaa44887a49adf0ef157965e) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.316517 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1a988e93d48746dd823e6330382ee315"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.317138 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a988e93d48746dd823e6330382ee315 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.319645 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9d86beced971472a8590a9eb66719ca2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.320266 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d86beced971472a8590a9eb66719ca2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:49.324084 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 0859e56b5b7a483ea5e751f0468cbab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0859e56b5b7a483ea5e751f0468cbab8 already in progress: creating tablet
I20260617 20:16:49.324258 29173 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:49.325565 29377 ts_tablet_manager.cc:1929] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.325716 29377 log.cc:1199] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/9d2a38be2e8e4796a98f1ae1d011249f
I20260617 20:16:49.326166 29377 ts_tablet_manager.cc:1950] T 9d2a38be2e8e4796a98f1ae1d011249f P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:16:49.326254 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 640f53137c21443cbfc274c084ce13ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 640f53137c21443cbfc274c084ce13ef already in progress: creating tablet
I20260617 20:16:49.327333 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 9d2a38be2e8e4796a98f1ae1d011249f (table default.Table_7c00b4f954c743869ac8b3236a50e532 [id=cd4abe077ee04673bad87834b3af273b]) successfully deleted
I20260617 20:16:49.328183 29379 tablet_bootstrap.cc:492] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.330017 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 16d0360ec78844a1be3d5f51259bbcdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:49.330538 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet af9c687fe56f42af82dd4728ca53cd32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af9c687fe56f42af82dd4728ca53cd32 already in progress: creating tablet
I20260617 20:16:49.332223 29375 tablet_replica.cc:333] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:49.333869 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b19bce310bd24294b063b3b4f76b9f99
I20260617 20:16:49.333665 29375 raft_consensus.cc:2243] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.334914 29375 raft_consensus.cc:2272] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.335915 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet b19bce310bd24294b063b3b4f76b9f99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:49.336143 29383 ts_tablet_manager.cc:1434] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.039s user 0.001s sys 0.001s
I20260617 20:16:49.336391 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet b19bce310bd24294b063b3b4f76b9f99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.329227 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 193) took 2102 ms. Trace:
I20260617 20:16:49.338922 28669 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_921dd6771a094e7cb638a0bcd034177e [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 2 got 0
I20260617 20:16:49.339670 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet b19bce310bd24294b063b3b4f76b9f99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:49.340134 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2243e46086a84c17ab8420d0c86112f0" } new_table_name: "default.Table_a8e9291823da48e8bb5bba46960e407d" modify_external_catalogs: true
I20260617 20:16:49.342554 29375 ts_tablet_manager.cc:1916] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.345664 29379 tablet_bootstrap.cc:654] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.351496 29383 tablet_bootstrap.cc:492] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:49.353088 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c8d373f177494f1486fcae4a67a13041
I20260617 20:16:49.353986 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d373f177494f1486fcae4a67a13041 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.354799 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d373f177494f1486fcae4a67a13041 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:49.356763 29728 raft_consensus.cc:493] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:49.356930 29728 raft_consensus.cc:515] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.358247 29728 leader_election.cc:290] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:49.360288 28664 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_921dd6771a094e7cb638a0bcd034177e [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 2 got 0
I20260617 20:16:49.362049 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet 640f53137c21443cbfc274c084ce13ef from {username='slave'} at 127.0.0.1:60552
W20260617 20:16:49.363852 29062 leader_election.cc:343] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 637b0b3e9cb648deaea6e63760b83255
I20260617 20:16:49.364614 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet 488b06f05d9b4273a61bcb2d6e0ad796 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:49.366468 29379 tablet_bootstrap.cc:492] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.366631 29379 ts_tablet_manager.cc:1403] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.001s
I20260617 20:16:49.367358 29379 raft_consensus.cc:359] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.367555 29379 raft_consensus.cc:385] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 20:16:49.367604 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fed593a3fa7742a18ccc2124c3ee0fb9 has no consensus state
I20260617 20:16:49.367651 29379 raft_consensus.cc:740] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.367820 29378 tablet_bootstrap.cc:492] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:49.367871 29379 consensus_queue.cc:260] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.368218 29378 ts_tablet_manager.cc:1403] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.420s user 0.154s sys 0.197s
I20260617 20:16:49.368391 29379 ts_tablet_manager.cc:1434] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:16:49.368958 29378 raft_consensus.cc:359] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.369119 29378 raft_consensus.cc:385] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.369190 29378 raft_consensus.cc:740] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.369400 29378 consensus_queue.cc:260] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.369843 29378 ts_tablet_manager.cc:1434] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:49.370157 29378 tablet_bootstrap.cc:492] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:49.373709 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:49.373960 29378 tablet_bootstrap.cc:654] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.375934 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b96c186469e4e8a8baa0dcab96d66bf with delete_type TABLET_DATA_DELETED (replaced by tablet f136e42eb9034a05a5e0c7dc3b3117d7) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.378993 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637b0b3e9cb648deaea6e63760b83255" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:49.379192 29261 raft_consensus.cc:2468] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:49.380024 29063 leader_election.cc:304] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:49.380424 29728 raft_consensus.cc:2804] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:49.380441 29376 rpcz_store.cc:276] 0617 20:16:47.144327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.144384 (+ 57us) service_pool.cc:224] Handling call
0617 20:16:48.960405 (+1816021us) ts_tablet_manager.cc:1151] Deleting tablet fa513612e44148d7983b0db00d733888
0617 20:16:48.960420 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.009226 (+ 48806us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x616000131b54. stack: 00007f5f5963e496 00007f5f5963e250 00007f5f586693ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f5f656e47e0 00007f5f66a30933 00007f5f695f3ae7 00007f5f69626bb4 00007f5f696075d0 00007f5f6960735d 0000000000aa681c 00007f5f596849ff 00007f5f59687d1b 00007f5f59687b98
0617 20:16:49.084987 (+ 75761us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.096461 (+ 11474us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.246876 (+150415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62717824,"tablet-delete.queue_time_us":1815263}
I20260617 20:16:49.380640 29728 raft_consensus.cc:493] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:49.380818 29728 raft_consensus.cc:3060] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.381196 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet fa513612e44148d7983b0db00d733888 (table default.Table_e07e30476d764b83aabfde1a21b2d5a6 [id=8ff99ac5540d43c7aebd37573a0c6790]) successfully deleted
I20260617 20:16:49.382030 29376 tablet_replica.cc:333] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:49.382503 29376 raft_consensus.cc:2243] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.382725 29376 raft_consensus.cc:2272] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.383635 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d373f177494f1486fcae4a67a13041 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:49.383870 29379 tablet_bootstrap.cc:492] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.386536 29376 ts_tablet_manager.cc:1916] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.389034 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d2db0467c5e64e38961d3b0e66375544
I20260617 20:16:49.389809 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet d2db0467c5e64e38961d3b0e66375544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.390027 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet d2db0467c5e64e38961d3b0e66375544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:49.390856 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet d2db0467c5e64e38961d3b0e66375544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:49.392366 29377 tablet_replica.cc:333] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:49.392633 29377 raft_consensus.cc:2243] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.393812 29728 raft_consensus.cc:515] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.397064 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 7b00437fb76c4000ad89c99ab2da2261
I20260617 20:16:49.397136 29379 tablet_bootstrap.cc:654] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.398128 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b00437fb76c4000ad89c99ab2da2261 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:49.400341 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637b0b3e9cb648deaea6e63760b83255" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:49.400593 29261 raft_consensus.cc:3060] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.400290 29728 leader_election.cc:290] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:49.401695 29062 leader_election.cc:343] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 637b0b3e9cb648deaea6e63760b83255
I20260617 20:16:49.401749 29375 ts_tablet_manager.cc:1929] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.402458 29375 log.cc:1199] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/4516e7a7fa284eaa816558b2d58cd213
I20260617 20:16:49.404671 29375 ts_tablet_manager.cc:1950] T 4516e7a7fa284eaa816558b2d58cd213 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:49.406606 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b00437fb76c4000ad89c99ab2da2261 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:49.406798 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4f05d3ae468a4e5c83b7566458bc52a4" } new_table_name: "default.Table_6245e1c087524bddb73075d1437dae2d" modify_external_catalogs: true
I20260617 20:16:49.408077 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 4516e7a7fa284eaa816558b2d58cd213 (table default.Table_2243e46086a84c17ab8420d0c86112f0 [id=c02a5e81598b47b9830a236256da4bba]) successfully deleted
I20260617 20:16:49.408258 29375 tablet_replica.cc:333] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:49.408260 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_afafb0c05ae94a57a881021813c028a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.409132 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afafb0c05ae94a57a881021813c028a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.409034 29375 raft_consensus.cc:2243] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.409691 29375 raft_consensus.cc:2272] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.398206 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b00437fb76c4000ad89c99ab2da2261 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:49.410202 29728 raft_consensus.cc:493] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:49.410395 29377 raft_consensus.cc:2272] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.410497 29728 raft_consensus.cc:515] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.411042 29377 ts_tablet_manager.cc:1916] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.411667 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a43dd885aa4411a4177b67807b0ac4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:49.411695 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a43dd885aa4411a4177b67807b0ac4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:49.411912 28988 raft_consensus.cc:2468] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:49.411954 29262 raft_consensus.cc:2468] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:49.413136 29728 leader_election.cc:290] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:49.413465 29063 leader_election.cc:304] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:49.414860 29383 tablet_bootstrap.cc:654] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.415300 29375 ts_tablet_manager.cc:1916] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.424158 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0f19dbb676e84b58a20d056d5e812e71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:49.424333 29379 tablet_bootstrap.cc:492] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.424499 29379 ts_tablet_manager.cc:1403] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.005s
I20260617 20:16:49.425338 29379 raft_consensus.cc:359] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.425546 29379 raft_consensus.cc:385] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.425652 29379 raft_consensus.cc:740] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.425890 29379 consensus_queue.cc:260] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.426378 29379 ts_tablet_manager.cc:1434] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:49.426568 29261 raft_consensus.cc:2468] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:49.426949 29728 raft_consensus.cc:2804] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:49.427091 29728 raft_consensus.cc:493] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:49.427181 29728 raft_consensus.cc:3060] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.428412 29379 tablet_bootstrap.cc:492] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:49.428975 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8eefc4f3c7d4f468c0adca837b73bb2 consensus state has no leader
I20260617 20:16:49.430004 29728 raft_consensus.cc:515] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.430155 29063 leader_election.cc:304] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:49.430711 29728 leader_election.cc:290] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:49.430903 29728 raft_consensus.cc:2804] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:49.431031 29728 raft_consensus.cc:697] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:49.431511 29376 ts_tablet_manager.cc:1929] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.431679 29376 log.cc:1199] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/cc945cdd482f4a5593d4874e5303ecd2
I20260617 20:16:49.432076 29376 ts_tablet_manager.cc:1950] T cc945cdd482f4a5593d4874e5303ecd2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:49.432906 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 186) took 2294 ms. Trace:
I20260617 20:16:49.433009 29376 rpcz_store.cc:276] 0617 20:16:47.138313 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.150389 (+ 12076us) service_pool.cc:224] Handling call
0617 20:16:49.381962 (+2231573us) ts_tablet_manager.cc:1151] Deleting tablet cc945cdd482f4a5593d4874e5303ecd2
0617 20:16:49.381972 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.394129 (+ 12157us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.426624 (+ 32495us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.432843 (+ 6219us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2231303}
I20260617 20:16:49.433418 29376 tablet_replica.cc:333] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:49.433629 29376 raft_consensus.cc:2243] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.433817 29376 raft_consensus.cc:2272] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.434413 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4dc5fdaaee2d4b54bb54160933394175"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:49.434595 29376 ts_tablet_manager.cc:1916] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.434441 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet cc945cdd482f4a5593d4874e5303ecd2 (table default.Table_1d8cf3e5102141cc9d4f9c93d77d385e [id=1222eab9683a43c681e8147c9ff67987]) successfully deleted
W20260617 20:16:49.435606 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4dc5fdaaee2d4b54bb54160933394175 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.436170 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a43dd885aa4411a4177b67807b0ac4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:49.436434 29261 raft_consensus.cc:3060] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.439327 29261 raft_consensus.cc:2468] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:49.441375 29376 ts_tablet_manager.cc:1929] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.441576 29376 log.cc:1199] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/d66923e12e1843bcbcb3da93cf838b65
I20260617 20:16:49.441533 29063 leader_election.cc:304] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:16:49.442163 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f19dbb676e84b58a20d056d5e812e71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.442755 29376 ts_tablet_manager.cc:1950] T d66923e12e1843bcbcb3da93cf838b65 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:49.443614 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 191) took 2301 ms. Trace:
I20260617 20:16:49.443769 29376 rpcz_store.cc:276] 0617 20:16:47.142359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.142416 (+ 57us) service_pool.cc:224] Handling call
0617 20:16:49.433322 (+2290906us) ts_tablet_manager.cc:1151] Deleting tablet d66923e12e1843bcbcb3da93cf838b65
0617 20:16:49.433332 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.437982 (+ 4650us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.441256 (+ 3274us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.443573 (+ 2317us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2280687}
I20260617 20:16:49.444283 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 194) took 2259 ms. Trace:
I20260617 20:16:49.444293 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet d66923e12e1843bcbcb3da93cf838b65 (table default.Table_6e5629496f81401d8671eaa061393d1f [id=b2d788fe99dd43689f8fa1f9fcea06a5]) successfully deleted
I20260617 20:16:49.444456 29376 rpcz_store.cc:276] 0617 20:16:47.185182 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.185269 (+ 87us) service_pool.cc:224] Handling call
0617 20:16:49.444105 (+2258836us) ts_tablet_manager.cc:1151] Deleting tablet 113fbbc739d04f529e82bc1cf1074bd7
0617 20:16:49.444114 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.444251 (+ 137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2258554}
I20260617 20:16:49.444590 29379 tablet_bootstrap.cc:654] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.444916 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 195) took 2252 ms. Trace:
W20260617 20:16:49.445010 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 113fbbc739d04f529e82bc1cf1074bd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 113fbbc739d04f529e82bc1cf1074bd7 already in progress: creating tablet
I20260617 20:16:49.445194 29376 rpcz_store.cc:276] 0617 20:16:47.192871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.194235 (+ 1364us) service_pool.cc:224] Handling call
0617 20:16:49.444784 (+2250549us) ts_tablet_manager.cc:1151] Deleting tablet 17917ffc3e8f43afb2a8bc413159137c
0617 20:16:49.444794 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.444884 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2250219}
I20260617 20:16:49.445590 29376 tablet_replica.cc:333] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:16:49.445843 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 17917ffc3e8f43afb2a8bc413159137c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17917ffc3e8f43afb2a8bc413159137c already in progress: creating tablet
I20260617 20:16:49.446139 29376 raft_consensus.cc:2243] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.446352 29376 raft_consensus.cc:2272] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.447039 29376 ts_tablet_manager.cc:1916] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.448268 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60a43dd885aa4411a4177b67807b0ac4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:49.448562 28988 raft_consensus.cc:3060] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.451076 29486 raft_consensus.cc:2804] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
W20260617 20:16:49.452037 29198 consensus_peers.cc:597] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d4be33993864c73ba8b4da9468a517b. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:49.452056 28988 raft_consensus.cc:2468] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:49.451220 29728 consensus_queue.cc:237] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.452586 29383 tablet_bootstrap.cc:492] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.453352 29378 tablet_bootstrap.cc:492] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:49.453398 29486 raft_consensus.cc:697] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:49.453567 29378 ts_tablet_manager.cc:1403] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.083s user 0.007s sys 0.023s
I20260617 20:16:49.453758 29486 consensus_queue.cc:237] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.454399 29378 raft_consensus.cc:359] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.454602 29378 raft_consensus.cc:385] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.454670 29378 raft_consensus.cc:740] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.454909 29378 consensus_queue.cc:260] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.455420 29383 ts_tablet_manager.cc:1403] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.101s user 0.004s sys 0.000s
I20260617 20:16:49.455493 29378 ts_tablet_manager.cc:1434] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:49.455899 29378 tablet_bootstrap.cc:492] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:49.457894 29383 raft_consensus.cc:359] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.458138 29383 raft_consensus.cc:385] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.458216 29383 raft_consensus.cc:740] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.458463 29383 consensus_queue.cc:260] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.458655 29378 tablet_bootstrap.cc:654] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.459127 29383 ts_tablet_manager.cc:1434] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:49.459290 29379 tablet_bootstrap.cc:492] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.459555 29379 ts_tablet_manager.cc:1403] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.004s
I20260617 20:16:49.460592 29383 tablet_bootstrap.cc:492] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:49.460805 29379 raft_consensus.cc:359] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.461058 29379 raft_consensus.cc:385] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.461184 29379 raft_consensus.cc:740] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.461601 29379 consensus_queue.cc:260] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:49.462833 28655 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet fed593a3fa7742a18ccc2124c3ee0fb9 (table default.Table_726c0ba5eb5442e68a5c029d25fb209c [id=dcdfecb6a9634f42b1b11a02b9dd7ec2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fed593a3fa7742a18ccc2124c3ee0fb9 has no consensus state
I20260617 20:16:49.463162 29375 ts_tablet_manager.cc:1929] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.464150 29375 log.cc:1199] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/fa513612e44148d7983b0db00d733888
I20260617 20:16:49.465147 29379 ts_tablet_manager.cc:1434] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:16:49.466677 29379 tablet_bootstrap.cc:492] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.466753 29375 ts_tablet_manager.cc:1950] T fa513612e44148d7983b0db00d733888 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:49.472929 29383 tablet_bootstrap.cc:654] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.476656 29587 raft_consensus.cc:493] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:49.476847 29587 raft_consensus.cc:515] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:49.477687 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 379ef43e02ec4bbbb03f2d6a53a66403 consensus state has no leader
I20260617 20:16:49.478089 29587 leader_election.cc:290] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:49.479090 29308 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:49.481834 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet fa513612e44148d7983b0db00d733888 (table default.Table_e07e30476d764b83aabfde1a21b2d5a6 [id=8ff99ac5540d43c7aebd37573a0c6790]) successfully deleted
I20260617 20:16:49.484061 29378 tablet_bootstrap.cc:492] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:49.484225 29378 ts_tablet_manager.cc:1403] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260617 20:16:49.485087 29378 raft_consensus.cc:359] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.485266 29378 raft_consensus.cc:385] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.485387 29378 raft_consensus.cc:740] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.485613 29378 consensus_queue.cc:260] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.486125 29378 ts_tablet_manager.cc:1434] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:49.487247 29378 tablet_bootstrap.cc:492] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:49.489435 29378 tablet_bootstrap.cc:654] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.490960 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76b0744ef2a472091999681d5639fec" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:49.491178 29261 raft_consensus.cc:2468] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:49.491319 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ec97bbef66184088b7799dfed7bb04b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.491961 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec97bbef66184088b7799dfed7bb04b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.491992 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:49.492559 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 1a725364bb9646e6bc80fc4f67d04a16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a725364bb9646e6bc80fc4f67d04a16 already in progress: creating tablet
I20260617 20:16:49.492861 28925 leader_election.cc:304] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:49.493662 29587 raft_consensus.cc:2804] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:49.493781 29587 raft_consensus.cc:493] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:49.493858 29587 raft_consensus.cc:3060] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:49.496402 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 33e4407aa01642ffb03eba1b220afdba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33e4407aa01642ffb03eba1b220afdba already in progress: creating tablet
I20260617 20:16:49.497854 29587 raft_consensus.cc:515] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.499154 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76b0744ef2a472091999681d5639fec" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:49.499384 29261 raft_consensus.cc:3060] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.500574 29377 ts_tablet_manager.cc:1929] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.500715 29377 log.cc:1199] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/808c455e74e645aa8e2b0d08ca81d4f9
I20260617 20:16:49.500712 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76b0744ef2a472091999681d5639fec" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:49.500857 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 already in progress: creating tablet
I20260617 20:16:49.501078 29377 ts_tablet_manager.cc:1950] T 808c455e74e645aa8e2b0d08ca81d4f9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:49.502161 29261 raft_consensus.cc:2468] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
W20260617 20:16:49.503121 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 70698bb6ff6f4fe0b465f2974fcc24ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70698bb6ff6f4fe0b465f2974fcc24ea already in progress: creating tablet
I20260617 20:16:49.503518 29376 ts_tablet_manager.cc:1929] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.503671 29376 log.cc:1199] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/faa73e73cc9b4fb28cdc87d259f5e7bb
I20260617 20:16:49.504045 29376 ts_tablet_manager.cc:1950] T faa73e73cc9b4fb28cdc87d259f5e7bb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:49.504814 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 196) took 2235 ms. Trace:
I20260617 20:16:49.504928 29376 rpcz_store.cc:276] 0617 20:16:47.269770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.269843 (+ 73us) service_pool.cc:224] Handling call
0617 20:16:49.445521 (+2175678us) ts_tablet_manager.cc:1151] Deleting tablet faa73e73cc9b4fb28cdc87d259f5e7bb
0617 20:16:49.445531 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.492227 (+ 46696us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.503444 (+ 11217us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.504760 (+ 1316us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2175435}
I20260617 20:16:49.505388 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet faa73e73cc9b4fb28cdc87d259f5e7bb (table default.Table_e0e8f7e180d64ca690dfea9446c257a1 [id=6ac70796ad20486d8777f6d8518ee784]) successfully deleted
I20260617 20:16:49.505661 29375 tablet_replica.cc:333] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:49.507263 29375 raft_consensus.cc:2243] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:49.508415 29383 tablet_bootstrap.cc:492] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.508558 29383 ts_tablet_manager.cc:1403] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.002s
I20260617 20:16:49.509275 29383 raft_consensus.cc:359] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.509518 29375 pending_rounds.cc:70] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:49.509541 29383 raft_consensus.cc:385] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.509634 29383 raft_consensus.cc:740] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.509613 29375 pending_rounds.cc:77] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955467551580160 op_type: NO_OP noop_request { }
I20260617 20:16:49.509745 29375 raft_consensus.cc:2889] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:49.509867 29375 raft_consensus.cc:2272] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.509872 29383 consensus_queue.cc:260] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.510380 29383 ts_tablet_manager.cc:1434] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:49.511354 29379 tablet_bootstrap.cc:654] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.511475 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d9c37095429e4a2c8300865cb8711a27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:49.511699 29383 tablet_bootstrap.cc:492] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:49.515096 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9c37095429e4a2c8300865cb8711a27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.526042 29375 ts_tablet_manager.cc:1916] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.531569 29376 tablet_replica.cc:333] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:49.532433 29376 raft_consensus.cc:2243] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:49.532898 29376 pending_rounds.cc:70] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:49.533061 29376 pending_rounds.cc:77] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7297955461668249600 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "55e4ef1f493c4f1289cfa192ce38161d" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 3 new_table_name: "default.Table_2b054c3c845f4657a3339cf535372c22" dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" new_extra_config { } }
W20260617 20:16:49.533555 29376 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41028: Aborted: Op aborted
W20260617 20:16:49.533596 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08911643f3ca451d80e2471b1b5b2342 consensus state has no leader
I20260617 20:16:49.533874 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41028 (request call id 207) took 2091 ms. Trace:
I20260617 20:16:49.534056 29376 rpcz_store.cc:276] 0617 20:16:47.442216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.460189 (+ 17973us) service_pool.cc:224] Handling call
0617 20:16:49.533840 (+2073651us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:16:47.633571 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0617 20:16:47.633847 (+ 276us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0617 20:16:47.633857 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0617 20:16:47.633867 (+ 10us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0617 20:16:47.633909 (+ 42us) alter_schema_op.cc:128] START. Timestamp: 1781727407633850
0617 20:16:47.633913 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:16:47.634170 (+ 257us) log.cc:844] Serialized 173 byte log entry
0617 20:16:49.533449 (+1899279us) op_driver.cc:464] REPLICATION: finished
0617 20:16:49.533478 (+ 29us) op_driver.cc:389] HandleFailure(Aborted: Op aborted)
0617 20:16:49.533484 (+ 6us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":172511,"prepare.run_cpu_time_us":610,"prepare.run_wall_time_us":2661,"raft.queue_time_us":34,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":171,"replication_time_us":1899477,"thread_start_us":175364,"threads_started":1}]]}
W20260617 20:16:49.539450 28656 catalog_manager.cc:5106] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): alter failed for tablet 55e4ef1f493c4f1289cfa192ce38161d (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]): Aborted: Op aborted
I20260617 20:16:49.539902 29376 raft_consensus.cc:2272] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:49.540122 29669 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41028: Illegal state: RaftConsensus is not running: State = Stopped
I20260617 20:16:49.540403 29669 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41028 (request call id 211) took 2026 ms. Trace:
I20260617 20:16:49.540572 29669 rpcz_store.cc:276] 0617 20:16:47.513760 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.513867 (+ 107us) service_pool.cc:224] Handling call
0617 20:16:49.540376 (+2026509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:16:47.636273 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0617 20:16:47.636368 (+ 95us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0617 20:16:49.539858 (+1903490us) alter_schema_op.cc:66] Acquired schema lock
0617 20:16:49.539871 (+ 13us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0617 20:16:49.539921 (+ 50us) alter_schema_op.cc:128] START. Timestamp: 1781727409539876
0617 20:16:49.539924 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:16:49.540053 (+ 129us) op_driver.cc:389] HandleFailure(Illegal state: RaftConsensus is not running: State = Stopped)
0617 20:16:49.540060 (+ 7us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":121965,"spinlock_wait_cycles":153344}]]}
I20260617 20:16:49.532199 29383 tablet_bootstrap.cc:654] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:49.545454 29669 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41028: Illegal state: RaftConsensus is not running: State = Stopped
I20260617 20:16:49.557332 29379 tablet_bootstrap.cc:492] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.558545 29379 ts_tablet_manager.cc:1403] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.092s user 0.009s sys 0.004s
I20260617 20:16:49.559544 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_726c0ba5eb5442e68a5c029d25fb209c" } modify_external_catalogs: true
I20260617 20:16:49.559798 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_726c0ba5eb5442e68a5c029d25fb209c" } modify_external_catalogs: true
I20260617 20:16:49.560869 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 113fbbc739d04f529e82bc1cf1074bd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 75519f97f1ce49ceb3a739ba7c7bc239) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:49.561331 29379 raft_consensus.cc:359] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.561969 29379 raft_consensus.cc:385] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.563004 29379 raft_consensus.cc:740] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.564527 29379 consensus_queue.cc:260] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.562849 29375 ts_tablet_manager.cc:1929] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:49.565050 29375 log.cc:1199] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/28146a1f84aa41ee88d9aea299256a90
I20260617 20:16:49.565665 29375 ts_tablet_manager.cc:1950] T 28146a1f84aa41ee88d9aea299256a90 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:49.566466 29376 ts_tablet_manager.cc:1916] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:49.569285 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e53946c85ab4a8286a6e174cc411c5e consensus state has no leader
I20260617 20:16:49.569794 29379 ts_tablet_manager.cc:1434] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260617 20:16:49.571725 29379 tablet_bootstrap.cc:492] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.573251 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fb9bfca9839e45eab65f1350e50faa16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.574096 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb9bfca9839e45eab65f1350e50faa16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.576664 29375 tablet_replica.cc:333] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:49.576895 29375 raft_consensus.cc:2243] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.577092 29375 raft_consensus.cc:2272] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.577533 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 28146a1f84aa41ee88d9aea299256a90 (table default.Table_6ed5c9767b364748ae14ecead288e68c [id=eeb28ad64e5f425988b6e1667865134d]) successfully deleted
W20260617 20:16:49.577837 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet c21b585707b146ed9c015d150d858681 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c21b585707b146ed9c015d150d858681 already in progress: creating tablet
W20260617 20:16:49.578063 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 75519f97f1ce49ceb3a739ba7c7bc239 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75519f97f1ce49ceb3a739ba7c7bc239 already in progress: creating tablet
W20260617 20:16:49.578270 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 8880f8eadaa44887a49adf0ef157965e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8880f8eadaa44887a49adf0ef157965e already in progress: creating tablet
W20260617 20:16:49.578504 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 16d0360ec78844a1be3d5f51259bbcdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16d0360ec78844a1be3d5f51259bbcdf already in progress: creating tablet
I20260617 20:16:49.578871 29379 tablet_bootstrap.cc:654] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.580407 29375 ts_tablet_manager.cc:1916] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.586061 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a53260b7e2f34a0f9eadcfc43812a67c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:49.587489 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a53260b7e2f34a0f9eadcfc43812a67c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:49.589071 29375 ts_tablet_manager.cc:1929] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.589241 29375 log.cc:1199] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/d9b7880a039a497fbd0fb5d4f74e7d23
I20260617 20:16:49.502729 28925 leader_election.cc:304] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:49.503226 29587 leader_election.cc:290] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:49.563927 29378 tablet_bootstrap.cc:492] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:49.570200 29788 raft_consensus.cc:493] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:49.592069 29587 raft_consensus.cc:2804] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:49.592087 29378 ts_tablet_manager.cc:1403] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.105s user 0.001s sys 0.012s
I20260617 20:16:49.592258 29587 raft_consensus.cc:697] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:49.592608 29587 consensus_queue.cc:237] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.593076 29378 raft_consensus.cc:359] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.593261 29378 raft_consensus.cc:385] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.593395 29378 raft_consensus.cc:740] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.593616 29378 consensus_queue.cc:260] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.594029 29788 raft_consensus.cc:515] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.594578 29376 ts_tablet_manager.cc:1929] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:49.594869 29788 leader_election.cc:290] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:49.597051 29376 log.cc:1199] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/55e4ef1f493c4f1289cfa192ce38161d
I20260617 20:16:49.597484 29376 ts_tablet_manager.cc:1950] T 55e4ef1f493c4f1289cfa192ce38161d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:49.598332 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 197) took 2328 ms. Trace:
I20260617 20:16:49.598443 29376 rpcz_store.cc:276] 0617 20:16:47.269977 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.270042 (+ 65us) service_pool.cc:224] Handling call
0617 20:16:49.531468 (+2261426us) ts_tablet_manager.cc:1151] Deleting tablet 55e4ef1f493c4f1289cfa192ce38161d
0617 20:16:49.531480 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.582520 (+ 51040us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.594464 (+ 11944us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.598268 (+ 3804us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2261069}
I20260617 20:16:49.596843 29383 tablet_bootstrap.cc:492] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.599169 29383 ts_tablet_manager.cc:1403] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.088s user 0.007s sys 0.003s
I20260617 20:16:49.599339 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 55e4ef1f493c4f1289cfa192ce38161d (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]) successfully deleted
I20260617 20:16:49.599932 29383 raft_consensus.cc:359] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.600157 29383 raft_consensus.cc:385] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.600250 29383 raft_consensus.cc:740] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.600555 29383 consensus_queue.cc:260] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.603734 29383 ts_tablet_manager.cc:1434] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:16:49.604132 29383 tablet_bootstrap.cc:492] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:49.605913 29378 ts_tablet_manager.cc:1434] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.014s user 0.005s sys 0.003s
I20260617 20:16:49.606016 29383 tablet_bootstrap.cc:654] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.606261 29378 tablet_bootstrap.cc:492] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:49.607751 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 105057us
I20260617 20:16:49.607936 29378 tablet_bootstrap.cc:654] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.608150 29376 tablet_replica.cc:333] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:49.608347 29376 raft_consensus.cc:2243] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 20:16:49.608498 28925 leader_election.cc:343] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:49.609329 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62b22ff17964ee6934023fb85e0b7ec" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:49.609593 29125 raft_consensus.cc:2468] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:49.609349 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a76b0744ef2a472091999681d5639fec" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:49.610128 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62b22ff17964ee6934023fb85e0b7ec" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:49.610461 28925 leader_election.cc:304] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
W20260617 20:16:49.610985 28925 leader_election.cc:343] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:49.611315 28925 leader_election.cc:343] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:49.611609 29587 raft_consensus.cc:2804] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:49.611716 29587 raft_consensus.cc:493] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:49.611800 29587 raft_consensus.cc:3060] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.614830 29587 raft_consensus.cc:515] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.616216 29587 leader_election.cc:290] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:49.616402 29376 raft_consensus.cc:2272] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.616433 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62b22ff17964ee6934023fb85e0b7ec" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:49.616698 29127 raft_consensus.cc:3060] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.616745 29379 tablet_bootstrap.cc:492] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.616902 29379 ts_tablet_manager.cc:1403] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.003s
I20260617 20:16:49.617825 29379 raft_consensus.cc:359] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.618046 29379 raft_consensus.cc:385] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.618158 29379 raft_consensus.cc:740] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.618453 29379 consensus_queue.cc:260] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.619490 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 808c455e74e645aa8e2b0d08ca81d4f9 (table default.Table_0ba339c37163434e8c628ef515624fe1 [id=8696ed2b09fd4e06a0f2746537370766]) successfully deleted
I20260617 20:16:49.619946 29127 raft_consensus.cc:2468] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:49.620229 29376 ts_tablet_manager.cc:1916] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.620527 29379 ts_tablet_manager.cc:1434] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:49.620839 29379 tablet_bootstrap.cc:492] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.622691 29379 tablet_bootstrap.cc:654] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.623301 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62b22ff17964ee6934023fb85e0b7ec" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
W20260617 20:16:49.624241 28925 leader_election.cc:343] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:49.625734 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 1a725364bb9646e6bc80fc4f67d04a16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a725364bb9646e6bc80fc4f67d04a16 already in progress: creating tablet
I20260617 20:16:49.626850 29379 tablet_bootstrap.cc:492] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.627025 29379 ts_tablet_manager.cc:1403] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260617 20:16:49.627912 29379 raft_consensus.cc:359] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.628131 29379 raft_consensus.cc:385] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.628212 29379 raft_consensus.cc:740] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.630312 29375 ts_tablet_manager.cc:1950] T d9b7880a039a497fbd0fb5d4f74e7d23 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:49.631184 29377 tablet_replica.cc:333] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:49.631464 29377 raft_consensus.cc:2243] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.631697 29377 raft_consensus.cc:2272] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.631942 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet d9b7880a039a497fbd0fb5d4f74e7d23 (table default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]) successfully deleted
I20260617 20:16:49.633713 29378 tablet_bootstrap.cc:492] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:49.633953 29378 ts_tablet_manager.cc:1403] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.002s
I20260617 20:16:49.635414 29378 raft_consensus.cc:359] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.635700 29378 raft_consensus.cc:385] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.635850 29378 raft_consensus.cc:740] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.636188 29378 consensus_queue.cc:260] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.637238 29378 ts_tablet_manager.cc:1434] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:49.639616 29378 tablet_bootstrap.cc:492] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:49.641817 29375 tablet_replica.cc:333] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:49.641914 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 2a9e12c91df344ee84a586b7d4a27071 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:49.643641 28925 leader_election.cc:304] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:49.644811 29587 raft_consensus.cc:2804] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:49.642031 29379 consensus_queue.cc:260] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.645117 29587 raft_consensus.cc:697] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:49.645503 29587 consensus_queue.cc:237] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.645706 29383 tablet_bootstrap.cc:492] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.645890 29383 ts_tablet_manager.cc:1403] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.014s
I20260617 20:16:49.646852 29375 raft_consensus.cc:2243] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.646867 29383 raft_consensus.cc:359] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.647060 29383 raft_consensus.cc:385] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.647078 29375 raft_consensus.cc:2272] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.647157 29383 raft_consensus.cc:740] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.649469 29379 ts_tablet_manager.cc:1434] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260617 20:16:49.650537 29035 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:49.650610 29383 consensus_queue.cc:260] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.651335 29383 ts_tablet_manager.cc:1434] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260617 20:16:49.651739 29383 tablet_bootstrap.cc:492] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:49.653517 29379 tablet_bootstrap.cc:492] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.654840 29383 tablet_bootstrap.cc:654] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.655848 29379 tablet_bootstrap.cc:654] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.656870 29378 tablet_bootstrap.cc:654] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.658819 29375 ts_tablet_manager.cc:1916] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.663322 29377 ts_tablet_manager.cc:1916] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.664659 29379 tablet_bootstrap.cc:492] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.664827 29379 ts_tablet_manager.cc:1403] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260617 20:16:49.666994 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b299a2d2bb2d43c0a27ba56bfd754a14" } modify_external_catalogs: true
I20260617 20:16:49.667193 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b299a2d2bb2d43c0a27ba56bfd754a14" } modify_external_catalogs: true
I20260617 20:16:49.667642 29379 raft_consensus.cc:359] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.668009 29379 raft_consensus.cc:385] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.668128 29379 raft_consensus.cc:740] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.672955 29383 tablet_bootstrap.cc:492] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.673219 29383 ts_tablet_manager.cc:1403] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.006s
I20260617 20:16:49.673238 29375 ts_tablet_manager.cc:1929] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.673480 29375 log.cc:1199] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/9d2a38be2e8e4796a98f1ae1d011249f
I20260617 20:16:49.673925 29375 ts_tablet_manager.cc:1950] T 9d2a38be2e8e4796a98f1ae1d011249f P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:49.674363 29383 raft_consensus.cc:359] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.674602 29383 raft_consensus.cc:385] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.674695 29383 raft_consensus.cc:740] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.670873 29379 consensus_queue.cc:260] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.675062 29383 consensus_queue.cc:260] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.675347 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 9d2a38be2e8e4796a98f1ae1d011249f (table default.Table_7c00b4f954c743869ac8b3236a50e532 [id=cd4abe077ee04673bad87834b3af273b]) successfully deleted
I20260617 20:16:49.676954 29383 ts_tablet_manager.cc:1434] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260617 20:16:49.678784 29383 tablet_bootstrap.cc:492] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:49.679446 29173 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:49.681737 29379 ts_tablet_manager.cc:1434] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260617 20:16:49.682070 29379 tablet_bootstrap.cc:492] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.691928 29379 tablet_bootstrap.cc:654] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.691761 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet fa513612e44148d7983b0db00d733888 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:49.694041 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b96c186469e4e8a8baa0dcab96d66bf with delete_type TABLET_DATA_DELETED (replaced by tablet f136e42eb9034a05a5e0c7dc3b3117d7) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:49.694063 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f73d839e67c548629526669e7310da0c" } modify_external_catalogs: true
I20260617 20:16:49.694236 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f73d839e67c548629526669e7310da0c" } modify_external_catalogs: true
I20260617 20:16:49.695144 29375 tablet_replica.cc:333] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:49.695546 29375 raft_consensus.cc:2243] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:49.695883 29375 pending_rounds.cc:70] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:49.696018 29375 pending_rounds.cc:77] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955469160443904 op_type: NO_OP noop_request { }
I20260617 20:16:49.696216 29375 raft_consensus.cc:2889] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:49.696378 29375 raft_consensus.cc:2272] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.696455 29383 tablet_bootstrap.cc:654] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.697518 29375 ts_tablet_manager.cc:1916] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.703241 29378 tablet_bootstrap.cc:492] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:49.703445 29378 ts_tablet_manager.cc:1403] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.064s user 0.016s sys 0.000s
I20260617 20:16:49.704336 29378 raft_consensus.cc:359] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.704571 29378 raft_consensus.cc:385] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.704656 29378 raft_consensus.cc:740] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.705677 29383 tablet_bootstrap.cc:492] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.705888 29383 ts_tablet_manager.cc:1403] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.001s
I20260617 20:16:49.706694 29383 raft_consensus.cc:359] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.706939 29383 raft_consensus.cc:385] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.707090 29383 raft_consensus.cc:740] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.707396 29383 consensus_queue.cc:260] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.708022 29383 ts_tablet_manager.cc:1434] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:49.710253 29375 ts_tablet_manager.cc:1929] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:49.710713 29383 tablet_bootstrap.cc:492] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:49.711515 29733 lock_manager.cc:585] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 13511633290479094806) tablet 00000000000000000000000000000000 cur holder 0x617000041380
I20260617 20:16:49.712795 29383 tablet_bootstrap.cc:654] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.714079 29375 log.cc:1199] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/637b0b3e9cb648deaea6e63760b83255
I20260617 20:16:49.714718 29375 ts_tablet_manager.cc:1950] T 637b0b3e9cb648deaea6e63760b83255 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:49.715870 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 637b0b3e9cb648deaea6e63760b83255 (table default.Table_e45ba70d8b294bf99ddca3f80857df76 [id=7a4a3c7360114f72b54f5dd645215114]) successfully deleted
W20260617 20:16:49.716325 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet b19bce310bd24294b063b3b4f76b9f99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b19bce310bd24294b063b3b4f76b9f99 already in progress: creating tablet
W20260617 20:16:49.717227 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet c8d373f177494f1486fcae4a67a13041 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8d373f177494f1486fcae4a67a13041 already in progress: creating tablet
I20260617 20:16:49.717635 29375 tablet_replica.cc:333] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:49.717900 29375 raft_consensus.cc:2243] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.718168 29375 raft_consensus.cc:2272] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.718994 29375 ts_tablet_manager.cc:1916] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.720652 29378 consensus_queue.cc:260] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.722649 29378 ts_tablet_manager.cc:1434] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.019s user 0.002s sys 0.001s
I20260617 20:16:49.725847 29378 tablet_bootstrap.cc:492] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:49.727623 29378 tablet_bootstrap.cc:654] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.733361 29375 ts_tablet_manager.cc:1929] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.734022 29375 log.cc:1199] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/9b96c186469e4e8a8baa0dcab96d66bf
I20260617 20:16:49.735083 29383 tablet_bootstrap.cc:492] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.735955 29383 ts_tablet_manager.cc:1403] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.002s
I20260617 20:16:49.737023 29383 raft_consensus.cc:359] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.737387 29383 raft_consensus.cc:385] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.737555 29383 raft_consensus.cc:740] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.737982 29383 consensus_queue.cc:260] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.738734 29383 ts_tablet_manager.cc:1434] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:16:49.739140 29375 ts_tablet_manager.cc:1950] T 9b96c186469e4e8a8baa0dcab96d66bf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:49.739562 29383 tablet_bootstrap.cc:492] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:49.742183 29383 tablet_bootstrap.cc:654] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.743779 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 9b96c186469e4e8a8baa0dcab96d66bf (table default.Table_33168ad831b44c79a651427dd6011f2b [id=1a6ef514b9104d7d92bce17d40b5e3f9]) successfully deleted
W20260617 20:16:49.745373 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d2db0467c5e64e38961d3b0e66375544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2db0467c5e64e38961d3b0e66375544 already in progress: creating tablet
W20260617 20:16:49.746053 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 7b00437fb76c4000ad89c99ab2da2261 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b00437fb76c4000ad89c99ab2da2261 already in progress: creating tablet
I20260617 20:16:49.743719 29376 ts_tablet_manager.cc:1929] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.746455 29376 log.cc:1199] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/689121cc9ca647cda1899cdd569da8f6
I20260617 20:16:49.746910 29376 ts_tablet_manager.cc:1950] T 689121cc9ca647cda1899cdd569da8f6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:49.750200 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 204) took 2337 ms. Trace:
I20260617 20:16:49.751817 29376 rpcz_store.cc:276] 0617 20:16:47.413080 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.413174 (+ 94us) service_pool.cc:224] Handling call
0617 20:16:49.607554 (+2194380us) ts_tablet_manager.cc:1151] Deleting tablet 689121cc9ca647cda1899cdd569da8f6
0617 20:16:49.607567 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.623559 (+ 15992us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.743623 (+120064us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.750152 (+ 6529us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2182159}
I20260617 20:16:49.753065 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 689121cc9ca647cda1899cdd569da8f6 (table default.Table_81f4fb86b1a8470db7f74e35dc15a3fa [id=229a4fa545c84500af515f5992b547c7]) successfully deleted
I20260617 20:16:49.753669 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 205) took 2324 ms. Trace:
I20260617 20:16:49.754767 29376 rpcz_store.cc:276] 0617 20:16:47.429026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.429748 (+ 722us) service_pool.cc:224] Handling call
0617 20:16:49.753480 (+2323732us) ts_tablet_manager.cc:1151] Deleting tablet 1f85271eeb854194a968215ebc08f47a
0617 20:16:49.753493 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.753624 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2305680}
I20260617 20:16:49.754634 29383 tablet_bootstrap.cc:492] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.755229 29383 ts_tablet_manager.cc:1403] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.001s
I20260617 20:16:49.756209 29383 raft_consensus.cc:359] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.756479 29383 raft_consensus.cc:385] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.756619 29383 raft_consensus.cc:740] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.756908 29383 consensus_queue.cc:260] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.757591 29383 ts_tablet_manager.cc:1434] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260617 20:16:49.758122 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 1f85271eeb854194a968215ebc08f47a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f85271eeb854194a968215ebc08f47a already in progress: creating tablet
I20260617 20:16:49.758315 29308 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:49.759289 29107 tablet_service.cc:1511] Processing CreateTablet for tablet dd8a7096a09147789ac203c150a19419 (DEFAULT_TABLE table=default.Table_3121147010e14b9d8075f2104b757524 [id=7c9e551df8084f139824eadb433b077a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.759747 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8a7096a09147789ac203c150a19419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.762132 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 33e4407aa01642ffb03eba1b220afdba from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:49.766745 29236 tablet_service.cc:1511] Processing CreateTablet for tablet dd8a7096a09147789ac203c150a19419 (DEFAULT_TABLE table=default.Table_3121147010e14b9d8075f2104b757524 [id=7c9e551df8084f139824eadb433b077a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.767194 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8a7096a09147789ac203c150a19419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.768136 28956 tablet_service.cc:1511] Processing CreateTablet for tablet dd8a7096a09147789ac203c150a19419 (DEFAULT_TABLE table=default.Table_3121147010e14b9d8075f2104b757524 [id=7c9e551df8084f139824eadb433b077a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.768657 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 24e4b91def8642b7a8a063c06f43e060 (DEFAULT_TABLE table=default.Table_be535849f7204c22b012cd569f777a9f [id=e290bb3d06a24182916980d122e5454c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.769135 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 090b8720e5df447aa0da147bd8dfaa8c (DEFAULT_TABLE table=default.Table_b333834cd9d748a1b546a9026aba6d48 [id=4f255a0a35b74f0784ca51e2186485f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.769625 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 24e4b91def8642b7a8a063c06f43e060 (DEFAULT_TABLE table=default.Table_be535849f7204c22b012cd569f777a9f [id=e290bb3d06a24182916980d122e5454c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.769625 28961 tablet_service.cc:1511] Processing CreateTablet for tablet b5241ab75a034ee3b57c07185835a858 (DEFAULT_TABLE table=default.Table_fb7dcd897fa349bb9ea70a359a51453c [id=83f9dade4df942c1b12e41fa46385fe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.769704 29378 tablet_bootstrap.cc:492] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:49.769853 29378 ts_tablet_manager.cc:1403] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.002s
I20260617 20:16:49.769985 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24e4b91def8642b7a8a063c06f43e060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.771931 29228 tablet_service.cc:1511] Processing CreateTablet for tablet b5241ab75a034ee3b57c07185835a858 (DEFAULT_TABLE table=default.Table_fb7dcd897fa349bb9ea70a359a51453c [id=83f9dade4df942c1b12e41fa46385fe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.773413 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5241ab75a034ee3b57c07185835a858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.773897 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 090b8720e5df447aa0da147bd8dfaa8c (DEFAULT_TABLE table=default.Table_b333834cd9d748a1b546a9026aba6d48 [id=4f255a0a35b74f0784ca51e2186485f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.774271 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090b8720e5df447aa0da147bd8dfaa8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.778144 29378 raft_consensus.cc:359] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.778407 29378 raft_consensus.cc:385] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.778509 29378 raft_consensus.cc:740] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.778741 29378 consensus_queue.cc:260] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.779301 29378 ts_tablet_manager.cc:1434] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260617 20:16:49.779628 29378 tablet_bootstrap.cc:492] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:49.779580 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 (DEFAULT_TABLE table=default.Table_c7b9c867be6c4fa3b58557f0b4d1876b [id=4ed00f8c66674fc99d8742599241bb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.779888 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 24e4b91def8642b7a8a063c06f43e060 (DEFAULT_TABLE table=default.Table_be535849f7204c22b012cd569f777a9f [id=e290bb3d06a24182916980d122e5454c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.780040 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18440a4a5c254a25b87f8632de9c92b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.780246 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24e4b91def8642b7a8a063c06f43e060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.786146 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 090b8720e5df447aa0da147bd8dfaa8c (DEFAULT_TABLE table=default.Table_b333834cd9d748a1b546a9026aba6d48 [id=4f255a0a35b74f0784ca51e2186485f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.787083 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090b8720e5df447aa0da147bd8dfaa8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.789649 29106 tablet_service.cc:1511] Processing CreateTablet for tablet b5241ab75a034ee3b57c07185835a858 (DEFAULT_TABLE table=default.Table_fb7dcd897fa349bb9ea70a359a51453c [id=83f9dade4df942c1b12e41fa46385fe0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.790416 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5241ab75a034ee3b57c07185835a858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.795107 29378 tablet_bootstrap.cc:654] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.803278 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 (DEFAULT_TABLE table=default.Table_c7b9c867be6c4fa3b58557f0b4d1876b [id=4ed00f8c66674fc99d8742599241bb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.804559 29378 tablet_bootstrap.cc:492] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:49.804731 29378 ts_tablet_manager.cc:1403] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20260617 20:16:49.806185 29378 raft_consensus.cc:359] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.806459 29378 raft_consensus.cc:385] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.806528 29378 raft_consensus.cc:740] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:16:49.807921 29198 consensus_peers.cc:597] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4516e7a7fa284eaa816558b2d58cd213. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:49.810751 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 5faea831376646c1bdfcaf8fbbc7ca6d (DEFAULT_TABLE table=default.Table_f1d4ead31fe746b3ac30b939a8d7885d [id=aa54066da9fc4f3db61a51b59db1afb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.813695 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5d9677bc184c30be1a11bfa85a97c8 (DEFAULT_TABLE table=default.Table_2cc66b9f491541379d5bb95e9d64b6db [id=bc7497631072430ca5571972468880f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.813655 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5d9677bc184c30be1a11bfa85a97c8 (DEFAULT_TABLE table=default.Table_2cc66b9f491541379d5bb95e9d64b6db [id=bc7497631072430ca5571972468880f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.814637 29378 consensus_queue.cc:260] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.815184 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5d9677bc184c30be1a11bfa85a97c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.815171 29378 ts_tablet_manager.cc:1434] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260617 20:16:49.815119 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 8a5d9677bc184c30be1a11bfa85a97c8 (DEFAULT_TABLE table=default.Table_2cc66b9f491541379d5bb95e9d64b6db [id=bc7497631072430ca5571972468880f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.815541 29378 tablet_bootstrap.cc:492] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:49.815565 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5d9677bc184c30be1a11bfa85a97c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.817313 29378 tablet_bootstrap.cc:654] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.817895 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 5faea831376646c1bdfcaf8fbbc7ca6d (DEFAULT_TABLE table=default.Table_f1d4ead31fe746b3ac30b939a8d7885d [id=aa54066da9fc4f3db61a51b59db1afb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.821333 29728 raft_consensus.cc:493] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:49.822448 29728 raft_consensus.cc:515] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.823189 29728 leader_election.cc:290] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:49.824205 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b162a0ef91d1447b838331ba6ef93bf4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:49.824551 28989 raft_consensus.cc:2468] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:49.824590 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b162a0ef91d1447b838331ba6ef93bf4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:49.825214 29197 consensus_peers.cc:597] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4516e7a7fa284eaa816558b2d58cd213. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:49.826042 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5faea831376646c1bdfcaf8fbbc7ca6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.827203 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 (DEFAULT_TABLE table=default.Table_c7b9c867be6c4fa3b58557f0b4d1876b [id=4ed00f8c66674fc99d8742599241bb77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.827615 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18440a4a5c254a25b87f8632de9c92b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.828238 29062 leader_election.cc:304] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
W20260617 20:16:49.828845 29063 leader_election.cc:343] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:49.829834 29728 raft_consensus.cc:2804] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:49.829937 29728 raft_consensus.cc:493] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:49.829639 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 5faea831376646c1bdfcaf8fbbc7ca6d (DEFAULT_TABLE table=default.Table_f1d4ead31fe746b3ac30b939a8d7885d [id=aa54066da9fc4f3db61a51b59db1afb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.830040 29728 raft_consensus.cc:3060] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.830338 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5faea831376646c1bdfcaf8fbbc7ca6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.834484 29383 tablet_bootstrap.cc:492] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:49.836814 29728 raft_consensus.cc:515] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.837152 28968 tablet_service.cc:1511] Processing CreateTablet for tablet f24954093a45411a9cbe39415fb1adb7 (DEFAULT_TABLE table=default.Table_7ccf01ded0f84e49b3d9791d7ba4096a [id=28985cea8424471d86e5a1c33ee903d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.837980 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b162a0ef91d1447b838331ba6ef93bf4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:49.838200 28989 raft_consensus.cc:3060] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.840049 28953 tablet_service.cc:1511] Processing CreateTablet for tablet d673bc9892c94725b270ef3b9dc768f4 (DEFAULT_TABLE table=default.Table_d10766d3246d4cfdaa6a36d63033318a [id=4c35d4143aa84654a48adab9624a7330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.841073 28989 raft_consensus.cc:2468] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:49.842155 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab (DEFAULT_TABLE table=default.Table_577f6b872d804b24ae25b7c1469442d8 [id=cd2fab71637e4b968e9957070c30c936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.842639 29062 leader_election.cc:304] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:49.843387 28960 tablet_service.cc:1511] Processing CreateTablet for tablet e59430dd630b4ca6b573ea4230212abf (DEFAULT_TABLE table=default.Table_f09fba1c81844e81a218171de6721f68 [id=e9b35265c9c245e5a2d81e9f8b81a92c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.844384 28964 tablet_service.cc:1511] Processing CreateTablet for tablet fed593a3fa7742a18ccc2124c3ee0fb9 (DEFAULT_TABLE table=default.Table_726c0ba5eb5442e68a5c029d25fb209c [id=dcdfecb6a9634f42b1b11a02b9dd7ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.846215 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a1d87ddabcbe4a0e85e6587ff00a5b4d" } new_table_name: "default.Table_3481e499412e4b75ba8ad01b04b448a4" modify_external_catalogs: true
I20260617 20:16:49.847463 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 206) took 2405 ms. Trace:
I20260617 20:16:49.847903 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8a7096a09147789ac203c150a19419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.848496 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d673bc9892c94725b270ef3b9dc768f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.848968 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59430dd630b4ca6b573ea4230212abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.849450 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3726e55ed36f420ab63bcfb5a81c5aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.849475 28666 catalog_manager.cc:5696] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } }
I20260617 20:16:49.849865 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24e4b91def8642b7a8a063c06f43e060. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.849849 28666 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet b62b22ff17964ee6934023fb85e0b7ec (table default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886]). Expected version 2 got 0
I20260617 20:16:49.850299 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed593a3fa7742a18ccc2124c3ee0fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.850723 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090b8720e5df447aa0da147bd8dfaa8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.857443 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5241ab75a034ee3b57c07185835a858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.861449 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a5d9677bc184c30be1a11bfa85a97c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.841367 29242 tablet_service.cc:1511] Processing CreateTablet for tablet d673bc9892c94725b270ef3b9dc768f4 (DEFAULT_TABLE table=default.Table_d10766d3246d4cfdaa6a36d63033318a [id=4c35d4143aa84654a48adab9624a7330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.861405 29376 rpcz_store.cc:276] 0617 20:16:47.441897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.444471 (+ 2574us) service_pool.cc:224] Handling call
0617 20:16:49.847288 (+2402817us) ts_tablet_manager.cc:1151] Deleting tablet 9d2a38be2e8e4796a98f1ae1d011249f
0617 20:16:49.847298 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.847420 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2389753}
I20260617 20:16:49.861979 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d673bc9892c94725b270ef3b9dc768f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.862118 29376 tablet_replica.cc:333] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:49.862342 29376 raft_consensus.cc:2243] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:49.862689 29376 pending_rounds.cc:70] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:49.862785 29376 pending_rounds.cc:77] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955461300482048 op_type: NO_OP noop_request { }
I20260617 20:16:49.863281 29376 raft_consensus.cc:2889] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:49.863430 29376 raft_consensus.cc:2272] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.864025 29376 ts_tablet_manager.cc:1916] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.865681 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5faea831376646c1bdfcaf8fbbc7ca6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.845510 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab (DEFAULT_TABLE table=default.Table_577f6b872d804b24ae25b7c1469442d8 [id=cd2fab71637e4b968e9957070c30c936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.859604 29383 tablet_bootstrap.cc:654] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.866789 28666 catalog_manager.cc:5696] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } }
W20260617 20:16:49.869695 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 9d2a38be2e8e4796a98f1ae1d011249f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d2a38be2e8e4796a98f1ae1d011249f already in progress: creating tablet
I20260617 20:16:49.869772 28666 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet a76b0744ef2a472091999681d5639fec (table default.Table_9f236274be424e44818107f2fed5331c [id=a3772e01cb314c7e88e85833d727617d]). Expected version 1 got 0
I20260617 20:16:49.871670 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3726e55ed36f420ab63bcfb5a81c5aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.872761 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18440a4a5c254a25b87f8632de9c92b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.874946 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24954093a45411a9cbe39415fb1adb7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:49.880556 29197 consensus_peers.cc:597] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d4be33993864c73ba8b4da9468a517b. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:49.893460 29383 tablet_bootstrap.cc:492] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.893703 29383 ts_tablet_manager.cc:1403] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.059s user 0.005s sys 0.000s
I20260617 20:16:49.894753 29383 raft_consensus.cc:359] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.894991 29383 raft_consensus.cc:385] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.895061 29383 raft_consensus.cc:740] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.895207 29377 ts_tablet_manager.cc:1929] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.895324 29383 consensus_queue.cc:260] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.895861 29383 ts_tablet_manager.cc:1434] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:49.840092 29237 tablet_service.cc:1511] Processing CreateTablet for tablet f24954093a45411a9cbe39415fb1adb7 (DEFAULT_TABLE table=default.Table_7ccf01ded0f84e49b3d9791d7ba4096a [id=28985cea8424471d86e5a1c33ee903d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.897682 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24954093a45411a9cbe39415fb1adb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.898056 29376 ts_tablet_manager.cc:1929] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:49.898177 29376 log.cc:1199] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/c8c3089f552b449095eafc00da38e442
I20260617 20:16:49.898691 29376 ts_tablet_manager.cc:1950] T c8c3089f552b449095eafc00da38e442 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:49.908847 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 208) took 2448 ms. Trace:
I20260617 20:16:49.909090 29376 rpcz_store.cc:276] 0617 20:16:47.460682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.460733 (+ 51us) service_pool.cc:224] Handling call
0617 20:16:49.862039 (+2401306us) ts_tablet_manager.cc:1151] Deleting tablet c8c3089f552b449095eafc00da38e442
0617 20:16:49.862051 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.884696 (+ 22645us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.897969 (+ 13273us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.908787 (+ 10818us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2401064}
I20260617 20:16:49.909801 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet c8c3089f552b449095eafc00da38e442 (table default.Table_2ef3a206c3e747ada8461a0af6a75a51 [id=9ad5766f74b54846be83c212929b3ecb]) successfully deleted
I20260617 20:16:49.910460 29740 raft_consensus.cc:493] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:49.910672 29740 raft_consensus.cc:515] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.911566 29740 leader_election.cc:290] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:49.910280 29376 tablet_replica.cc:333] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:49.912220 29377 log.cc:1199] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/33e4407aa01642ffb03eba1b220afdba
I20260617 20:16:49.912318 29376 raft_consensus.cc:2243] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:49.912638 29376 raft_consensus.cc:2272] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:49.913394 29376 ts_tablet_manager.cc:1916] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:49.914031 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4332e33d60964bd6a0c7e7caaa6bdc76" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:49.914239 28989 raft_consensus.cc:2468] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:49.914651 29197 leader_election.cc:304] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:49.915033 29740 raft_consensus.cc:2804] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:49.915128 29740 raft_consensus.cc:493] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:49.915264 29740 raft_consensus.cc:3060] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.919112 29740 raft_consensus.cc:515] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.920382 29740 leader_election.cc:290] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:49.924459 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4332e33d60964bd6a0c7e7caaa6bdc76" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:49.924687 28989 raft_consensus.cc:3060] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:49.933609 29383 tablet_bootstrap.cc:492] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:49.936009 29383 tablet_bootstrap.cc:654] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.944293 29376 ts_tablet_manager.cc:1929] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:49.944891 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b162a0ef91d1447b838331ba6ef93bf4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:49.945885 29383 tablet_bootstrap.cc:492] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:49.946646 29383 ts_tablet_manager.cc:1403] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20260617 20:16:49.948006 29383 raft_consensus.cc:359] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.948311 29383 raft_consensus.cc:385] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.948462 29383 raft_consensus.cc:740] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.948827 29383 consensus_queue.cc:260] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:49.950819 29377 ts_tablet_manager.cc:1950] T 33e4407aa01642ffb03eba1b220afdba P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:49.951653 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 273) took 1026 ms. Trace:
I20260617 20:16:49.952566 29728 leader_election.cc:290] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:49.951936 29377 rpcz_store.cc:276] 0617 20:16:48.925479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.925778 (+ 299us) service_pool.cc:224] Handling call
0617 20:16:49.630713 (+704935us) ts_tablet_manager.cc:1151] Deleting tablet 33e4407aa01642ffb03eba1b220afdba
0617 20:16:49.630726 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.859721 (+228995us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.879808 (+ 20087us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.951619 (+ 71811us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":704601}
I20260617 20:16:49.953146 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 33e4407aa01642ffb03eba1b220afdba (table default.Table_befd7af4f63843d9bf259896e10ce0f5 [id=257569c30deb403b8d3925a0925308be]) successfully deleted
I20260617 20:16:49.953631 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 275) took 1008 ms. Trace:
I20260617 20:16:49.954954 29096 tablet_service.cc:1511] Processing CreateTablet for tablet fed593a3fa7742a18ccc2124c3ee0fb9 (DEFAULT_TABLE table=default.Table_726c0ba5eb5442e68a5c029d25fb209c [id=dcdfecb6a9634f42b1b11a02b9dd7ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.955631 29783 raft_consensus.cc:2804] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:49.955814 29783 raft_consensus.cc:697] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:49.959846 29379 tablet_bootstrap.cc:492] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:49.961968 29228 tablet_service.cc:1511] Processing CreateTablet for tablet e59430dd630b4ca6b573ea4230212abf (DEFAULT_TABLE table=default.Table_f09fba1c81844e81a218171de6721f68 [id=e9b35265c9c245e5a2d81e9f8b81a92c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.962498 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59430dd630b4ca6b573ea4230212abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.963848 29383 ts_tablet_manager.cc:1434] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260617 20:16:49.964138 29376 log.cc:1199] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/c65a4345552844fe9e7512105fd79877
I20260617 20:16:49.969565 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4332e33d60964bd6a0c7e7caaa6bdc76" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:49.969755 29063 leader_election.cc:343] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:49.969990 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4332e33d60964bd6a0c7e7caaa6bdc76" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:49.970741 29104 tablet_service.cc:1511] Processing CreateTablet for tablet e59430dd630b4ca6b573ea4230212abf (DEFAULT_TABLE table=default.Table_f09fba1c81844e81a218171de6721f68 [id=e9b35265c9c245e5a2d81e9f8b81a92c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.971097 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed593a3fa7742a18ccc2124c3ee0fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.972988 29377 rpcz_store.cc:276] 0617 20:16:48.945454 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.951369 (+ 5915us) service_pool.cc:224] Handling call
0617 20:16:49.953464 (+1002095us) ts_tablet_manager.cc:1151] Deleting tablet 3e80e776263c4a91ae7fffa9d0f4ebd4
0617 20:16:49.953474 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.953595 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1001896}
I20260617 20:16:49.973434 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab (DEFAULT_TABLE table=default.Table_577f6b872d804b24ae25b7c1469442d8 [id=cd2fab71637e4b968e9957070c30c936]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.973850 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3726e55ed36f420ab63bcfb5a81c5aab. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:49.974000 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 already in progress: creating tablet
W20260617 20:16:49.974823 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 70698bb6ff6f4fe0b465f2974fcc24ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70698bb6ff6f4fe0b465f2974fcc24ea already in progress: creating tablet
W20260617 20:16:49.975471 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet c21b585707b146ed9c015d150d858681 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c21b585707b146ed9c015d150d858681 already in progress: creating tablet
W20260617 20:16:49.976140 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 75519f97f1ce49ceb3a739ba7c7bc239 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75519f97f1ce49ceb3a739ba7c7bc239 already in progress: creating tablet
W20260617 20:16:49.976765 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 16d0360ec78844a1be3d5f51259bbcdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16d0360ec78844a1be3d5f51259bbcdf already in progress: creating tablet
I20260617 20:16:49.977545 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e59430dd630b4ca6b573ea4230212abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.979780 28989 raft_consensus.cc:2468] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:16:49.971266 29198 leader_election.cc:343] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:49.980387 29197 leader_election.cc:304] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:49.981567 29379 ts_tablet_manager.cc:1403] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.278s user 0.051s sys 0.054s
I20260617 20:16:49.981781 29740 raft_consensus.cc:2804] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:49.981535 29783 consensus_queue.cc:237] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:49.982080 29198 leader_election.cc:343] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:49.982656 29379 raft_consensus.cc:359] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.982926 29379 raft_consensus.cc:385] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:49.983021 29379 raft_consensus.cc:740] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:49.983525 29379 consensus_queue.cc:260] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:49.984252 29379 ts_tablet_manager.cc:1434] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:49.984676 29379 tablet_bootstrap.cc:492] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:49.987286 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet b4240e14b48f4a43b7ce9c6512fc7ff2 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:49.988847 29379 tablet_bootstrap.cc:654] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:49.989022 29376 ts_tablet_manager.cc:1950] T c65a4345552844fe9e7512105fd79877 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:49.989534 29383 tablet_bootstrap.cc:492] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:49.992852 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 210) took 2490 ms. Trace:
I20260617 20:16:49.994731 29376 rpcz_store.cc:276] 0617 20:16:47.501873 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.501928 (+ 55us) service_pool.cc:224] Handling call
0617 20:16:49.910171 (+2408243us) ts_tablet_manager.cc:1151] Deleting tablet c65a4345552844fe9e7512105fd79877
0617 20:16:49.910184 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.940350 (+ 30166us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.944202 (+ 3852us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:49.992770 (+ 48568us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2408011}
I20260617 20:16:49.996564 29105 tablet_service.cc:1511] Processing CreateTablet for tablet f24954093a45411a9cbe39415fb1adb7 (DEFAULT_TABLE table=default.Table_7ccf01ded0f84e49b3d9791d7ba4096a [id=28985cea8424471d86e5a1c33ee903d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.996678 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet c65a4345552844fe9e7512105fd79877 (table default.Table_cd9432cef0ba46d9a560d5ba59f1d58d [id=6c1d98916a69411393b9f32eeb861bd7]) successfully deleted
I20260617 20:16:49.997428 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f24954093a45411a9cbe39415fb1adb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.970564 29099 tablet_service.cc:1511] Processing CreateTablet for tablet d673bc9892c94725b270ef3b9dc768f4 (DEFAULT_TABLE table=default.Table_d10766d3246d4cfdaa6a36d63033318a [id=4c35d4143aa84654a48adab9624a7330]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:49.999172 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d673bc9892c94725b270ef3b9dc768f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:49.999445 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 214) took 2424 ms. Trace:
I20260617 20:16:49.999828 29376 rpcz_store.cc:276] 0617 20:16:47.574214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.581522 (+ 7308us) service_pool.cc:224] Handling call
0617 20:16:49.998815 (+2417293us) ts_tablet_manager.cc:1151] Deleting tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9
0617 20:16:49.998826 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:49.998956 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2417017}
I20260617 20:16:50.000701 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 2a9e12c91df344ee84a586b7d4a27071
I20260617 20:16:50.001247 28663 catalog_manager.cc:6784] ReplaceTablet: tablet 2a9e12c91df344ee84a586b7d4a27071 deleted and replaced by tablet 87d0e2ecc16e4285a1d8337a5336caf2
I20260617 20:16:50.001941 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a9e12c91df344ee84a586b7d4a27071 with delete_type TABLET_DATA_DELETED (replaced by tablet 87d0e2ecc16e4285a1d8337a5336caf2) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:50.003010 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 2a9e12c91df344ee84a586b7d4a27071 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2a9e12c91df344ee84a586b7d4a27071 already in progress: creating tablet
I20260617 20:16:50.003558 29740 raft_consensus.cc:697] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
W20260617 20:16:50.003911 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 already in progress: creating tablet
I20260617 20:16:50.004134 29740 consensus_queue.cc:237] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.006399 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a9e12c91df344ee84a586b7d4a27071 with delete_type TABLET_DATA_DELETED (replaced by tablet 87d0e2ecc16e4285a1d8337a5336caf2) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:49.996138 29383 tablet_bootstrap.cc:654] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.008152 29376 tablet_replica.cc:333] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:50.008479 29376 raft_consensus.cc:2243] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.008764 29376 raft_consensus.cc:2272] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.009513 29376 ts_tablet_manager.cc:1916] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:50.011201 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 8880f8eadaa44887a49adf0ef157965e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8880f8eadaa44887a49adf0ef157965e already in progress: creating tablet
W20260617 20:16:50.012028 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet b19bce310bd24294b063b3b4f76b9f99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b19bce310bd24294b063b3b4f76b9f99 already in progress: creating tablet
I20260617 20:16:50.009773 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a9e12c91df344ee84a586b7d4a27071 with delete_type TABLET_DATA_DELETED (replaced by tablet 87d0e2ecc16e4285a1d8337a5336caf2) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.011576 29810 raft_consensus.cc:493] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:16:50.013495 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet c8d373f177494f1486fcae4a67a13041 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8d373f177494f1486fcae4a67a13041 already in progress: creating tablet
I20260617 20:16:50.013654 29810 raft_consensus.cc:515] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.014045 29377 tablet_replica.cc:333] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:50.014380 29377 raft_consensus.cc:2243] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.015064 29377 raft_consensus.cc:2272] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.015545 29810 leader_election.cc:290] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.015506 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f32ebd7448843b48b981d3d70a87023" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:50.016115 29198 leader_election.cc:343] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:50.016390 29197 leader_election.cc:343] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1f32ebd7448843b48b981d3d70a87023
I20260617 20:16:50.016625 29197 leader_election.cc:304] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:50.016764 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_81cf092bd1634c3a82380616f225e4d6" } modify_external_catalogs: true
I20260617 20:16:50.016969 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_81cf092bd1634c3a82380616f225e4d6" } modify_external_catalogs: true
I20260617 20:16:50.017975 29810 raft_consensus.cc:2749] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:50.018455 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8ca126699bab4f66b23ce38c90e050bb" } modify_external_catalogs: true
I20260617 20:16:50.018671 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8ca126699bab4f66b23ce38c90e050bb" } modify_external_catalogs: true
I20260617 20:16:50.022877 29383 tablet_bootstrap.cc:492] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:50.023073 29383 ts_tablet_manager.cc:1403] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.002s
I20260617 20:16:50.024031 29383 raft_consensus.cc:359] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.024274 29383 raft_consensus.cc:385] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.024350 29383 raft_consensus.cc:740] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.028919 29379 tablet_bootstrap.cc:492] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:50.029076 29379 ts_tablet_manager.cc:1403] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.014s
I20260617 20:16:50.029985 29379 raft_consensus.cc:359] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.030190 29379 raft_consensus.cc:385] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.030311 29379 raft_consensus.cc:740] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.030649 29379 consensus_queue.cc:260] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.031293 29379 ts_tablet_manager.cc:1434] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260617 20:16:50.031596 29379 tablet_bootstrap.cc:492] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:50.032395 29237 tablet_service.cc:1511] Processing CreateTablet for tablet fed593a3fa7742a18ccc2124c3ee0fb9 (DEFAULT_TABLE table=default.Table_726c0ba5eb5442e68a5c029d25fb209c [id=dcdfecb6a9634f42b1b11a02b9dd7ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.032856 29383 consensus_queue.cc:260] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.033363 29379 tablet_bootstrap.cc:654] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.033707 29383 ts_tablet_manager.cc:1434] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260617 20:16:50.034446 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 58213ec0a9364a91a15fc0329f28605b (DEFAULT_TABLE table=default.Table_d4f8ff9bb47c440b96251b7d063e73f6 [id=b267380ca82144ebbc909227070c204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.034993 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58213ec0a9364a91a15fc0329f28605b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.035027 29376 ts_tablet_manager.cc:1929] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:50.035295 29376 log.cc:1199] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/c15392db137446b2bd84cf9f31337718
I20260617 20:16:50.035813 29376 ts_tablet_manager.cc:1950] T c15392db137446b2bd84cf9f31337718 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:50.037285 29379 tablet_bootstrap.cc:492] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:50.037513 29379 ts_tablet_manager.cc:1403] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260617 20:16:50.038178 29377 ts_tablet_manager.cc:1916] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.038319 29379 raft_consensus.cc:359] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.038532 29379 raft_consensus.cc:385] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.038620 29379 raft_consensus.cc:740] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.038898 29379 consensus_queue.cc:260] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.041772 29379 ts_tablet_manager.cc:1434] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:50.042111 29379 tablet_bootstrap.cc:492] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:50.045207 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 488b06f05d9b4273a61bcb2d6e0ad796
I20260617 20:16:50.046402 29379 tablet_bootstrap.cc:654] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.049029 29587 raft_consensus.cc:493] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.048996 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 58213ec0a9364a91a15fc0329f28605b (DEFAULT_TABLE table=default.Table_d4f8ff9bb47c440b96251b7d063e73f6 [id=b267380ca82144ebbc909227070c204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.049197 29587 raft_consensus.cc:515] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.049482 29242 tablet_service.cc:1511] Processing CreateTablet for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe (DEFAULT_TABLE table=default.Table_82cae984e6c341f18a7f783102a490f8 [id=c0e83fb2a91448d7937ba0ba68a48fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.050160 29587 leader_election.cc:290] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:50.051808 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eee68618cdf462283d7fd9f098c2a0d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:50.053033 29096 tablet_service.cc:1511] Processing CreateTablet for tablet b427ba6320be4f2a929eaf18a56b4309 (DEFAULT_TABLE table=default.Table_62c85e3d42be4e9ca7183846e7d67145 [id=7563af483989440d91cf7f444a68d2ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.053485 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b427ba6320be4f2a929eaf18a56b4309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.055562 29379 tablet_bootstrap.cc:492] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:50.055609 29105 tablet_service.cc:1511] Processing CreateTablet for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe (DEFAULT_TABLE table=default.Table_82cae984e6c341f18a7f783102a490f8 [id=c0e83fb2a91448d7937ba0ba68a48fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.055734 29379 ts_tablet_manager.cc:1403] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.001s
I20260617 20:16:50.056028 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.056581 29379 raft_consensus.cc:359] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.056794 29379 raft_consensus.cc:385] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.056896 29379 raft_consensus.cc:740] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.057154 29379 consensus_queue.cc:260] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.058250 28956 tablet_service.cc:1511] Processing CreateTablet for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe (DEFAULT_TABLE table=default.Table_82cae984e6c341f18a7f783102a490f8 [id=c0e83fb2a91448d7937ba0ba68a48fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.058772 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.062970 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eee68618cdf462283d7fd9f098c2a0d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:50.063459 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58213ec0a9364a91a15fc0329f28605b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.064208 28664 catalog_manager.cc:6784] ReplaceTablet: tablet 488b06f05d9b4273a61bcb2d6e0ad796 deleted and replaced by tablet 0f3032155e4e4ea8a23984f547d78752
I20260617 20:16:50.068156 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 216) took 2452 ms. Trace:
I20260617 20:16:50.068284 29376 rpcz_store.cc:276] 0617 20:16:47.615792 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.615862 (+ 70us) service_pool.cc:224] Handling call
0617 20:16:50.007831 (+2391969us) ts_tablet_manager.cc:1151] Deleting tablet c15392db137446b2bd84cf9f31337718
0617 20:16:50.007842 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.029647 (+ 21805us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.034887 (+ 5240us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.068117 (+ 33230us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2391739}
I20260617 20:16:50.068468 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 488b06f05d9b4273a61bcb2d6e0ad796 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f3032155e4e4ea8a23984f547d78752) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.068732 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 221) took 2349 ms. Trace:
I20260617 20:16:50.068846 29376 rpcz_store.cc:276] 0617 20:16:47.719039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.720065 (+ 1026us) service_pool.cc:224] Handling call
0617 20:16:50.068566 (+2348501us) ts_tablet_manager.cc:1151] Deleting tablet 1fa15915b0ec44ff8b66920e4c207536
0617 20:16:50.068575 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.068700 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2348229}
I20260617 20:16:50.069132 29376 tablet_replica.cc:333] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:50.069978 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 98467525f81f4a48878eae17e3a9c982
I20260617 20:16:50.070087 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.070113 29383 tablet_bootstrap.cc:492] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:50.070750 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ba7486cf24e2468aba2d211a8431a444" } new_table_name: "default.Table_f427fc2304b34f1eb97b537b8239504f" modify_external_catalogs: true
I20260617 20:16:50.072575 29383 tablet_bootstrap.cc:654] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.073352 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fed593a3fa7742a18ccc2124c3ee0fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.074882 29383 tablet_bootstrap.cc:492] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:50.075039 29383 ts_tablet_manager.cc:1403] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20260617 20:16:50.075893 29383 raft_consensus.cc:359] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.076083 29383 raft_consensus.cc:385] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.076184 29383 raft_consensus.cc:740] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.076401 29383 consensus_queue.cc:260] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.076997 29383 ts_tablet_manager.cc:1434] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:50.077310 29383 tablet_bootstrap.cc:492] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:50.077699 28968 tablet_service.cc:1511] Processing CreateTablet for tablet b427ba6320be4f2a929eaf18a56b4309 (DEFAULT_TABLE table=default.Table_62c85e3d42be4e9ca7183846e7d67145 [id=7563af483989440d91cf7f444a68d2ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.078119 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b427ba6320be4f2a929eaf18a56b4309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.078759 28961 tablet_service.cc:1511] Processing CreateTablet for tablet cc8fa9f4c40b4ce9baa27a8837d3575c (DEFAULT_TABLE table=default.Table_350b5e38df254cc69627edec8db5af45 [id=3463908997e94c288a7ac6ba26de9451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.079137 29383 tablet_bootstrap.cc:654] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.079177 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8fa9f4c40b4ce9baa27a8837d3575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.081449 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 98467525f81f4a48878eae17e3a9c982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.082526 29376 raft_consensus.cc:2243] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.084651 29376 raft_consensus.cc:2272] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:50.085881 28925 leader_election.cc:343] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:50.086135 28925 leader_election.cc:343] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:50.086279 28925 leader_election.cc:304] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:50.087663 29376 ts_tablet_manager.cc:1916] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.089995 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet c15392db137446b2bd84cf9f31337718 (table default.Table_f07486abff7b4958baba24d98d53df0a [id=4117392d45f54d7dab6a67372d5da4e0]) successfully deleted
W20260617 20:16:50.090276 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 1fa15915b0ec44ff8b66920e4c207536 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1fa15915b0ec44ff8b66920e4c207536 already in progress: creating tablet
I20260617 20:16:50.091305 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 98467525f81f4a48878eae17e3a9c982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.091601 29587 raft_consensus.cc:2749] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:50.091821 29232 tablet_service.cc:1511] Processing CreateTablet for tablet b427ba6320be4f2a929eaf18a56b4309 (DEFAULT_TABLE table=default.Table_62c85e3d42be4e9ca7183846e7d67145 [id=7563af483989440d91cf7f444a68d2ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.092398 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b427ba6320be4f2a929eaf18a56b4309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.099668 29378 tablet_bootstrap.cc:492] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:50.099843 29378 ts_tablet_manager.cc:1403] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.284s user 0.041s sys 0.088s
I20260617 20:16:50.100359 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet fed593a3fa7742a18ccc2124c3ee0fb9
I20260617 20:16:50.100837 29378 raft_consensus.cc:359] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.101052 29378 raft_consensus.cc:385] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.101179 29378 raft_consensus.cc:740] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.101503 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet fed593a3fa7742a18ccc2124c3ee0fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.101553 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 33a1c96212014333935ec7f7c92a306c
I20260617 20:16:50.101490 29378 consensus_queue.cc:260] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.105350 29242 tablet_service.cc:1511] Processing CreateTablet for tablet ead0291870a443d9b76ea919a45a4303 (DEFAULT_TABLE table=default.Table_1620ccecc04e416b924e56212280c0ff [id=0ef22e22306747b28d49d58d0fa45620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.106012 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead0291870a443d9b76ea919a45a4303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.108355 29226 tablet_service.cc:1511] Processing CreateTablet for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (DEFAULT_TABLE table=default.Table_a1d87ddabcbe4a0e85e6587ff00a5b4d [id=3d369e1099c944688151bb38c8da0855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.108881 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c73bdcc1cefd48f3b99e0c059c3a7467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.109609 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 7f239f81c40743b2aaa70a361997db77 (DEFAULT_TABLE table=default.Table_fad470e9ef3042889cc803e1d6df2218 [id=0ea926c7d87a4670902ad04acbe1cfef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.109988 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f239f81c40743b2aaa70a361997db77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.112514 29379 ts_tablet_manager.cc:1434] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:50.114297 29379 tablet_bootstrap.cc:492] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:50.115724 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a1c96212014333935ec7f7c92a306c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.116415 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1620ccecc04e416b924e56212280c0ff" } new_table_name: "default.Table_dee4e7a09180402da49e21d594f587a8" modify_external_catalogs: true
I20260617 20:16:50.118453 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b312ecd37cf2447c864d075d578c23e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:50.118965 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 488b06f05d9b4273a61bcb2d6e0ad796 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f3032155e4e4ea8a23984f547d78752) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:50.119042 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b312ecd37cf2447c864d075d578c23e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.120867 29232 tablet_service.cc:1511] Processing CreateTablet for tablet cc8fa9f4c40b4ce9baa27a8837d3575c (DEFAULT_TABLE table=default.Table_350b5e38df254cc69627edec8db5af45 [id=3463908997e94c288a7ac6ba26de9451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.121438 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8fa9f4c40b4ce9baa27a8837d3575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.122189 29740 raft_consensus.cc:493] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.122253 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 58213ec0a9364a91a15fc0329f28605b (DEFAULT_TABLE table=default.Table_d4f8ff9bb47c440b96251b7d063e73f6 [id=b267380ca82144ebbc909227070c204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.122328 29740 raft_consensus.cc:515] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:50.122808 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c73bdcc1cefd48f3b99e0c059c3a7467 consensus state has no leader
I20260617 20:16:50.123013 29740 leader_election.cc:290] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.123245 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1c209b8f8876488a874cdef8f86e4a15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.123805 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c209b8f8876488a874cdef8f86e4a15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.123867 29100 tablet_service.cc:1511] Processing CreateTablet for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (DEFAULT_TABLE table=default.Table_a1d87ddabcbe4a0e85e6587ff00a5b4d [id=3d369e1099c944688151bb38c8da0855]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.124207 29740 raft_consensus.cc:493] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.124325 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet fed593a3fa7742a18ccc2124c3ee0fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.124403 29740 raft_consensus.cc:515] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.124549 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a1c96212014333935ec7f7c92a306c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.125026 29740 leader_election.cc:290] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.125085 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 7f239f81c40743b2aaa70a361997db77 (DEFAULT_TABLE table=default.Table_fad470e9ef3042889cc803e1d6df2218 [id=0ea926c7d87a4670902ad04acbe1cfef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.126549 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2b68c9711d6147e88a1aba5ea0a8f2bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:50.126710 29783 raft_consensus.cc:493] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:16:50.127370 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b68c9711d6147e88a1aba5ea0a8f2bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.128158 29383 tablet_bootstrap.cc:492] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:50.128331 29383 ts_tablet_manager.cc:1403] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.051s user 0.015s sys 0.015s
I20260617 20:16:50.128772 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet a7b59053006046e98d27c694808ca34d (table default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]). Expected version 1 got 0
W20260617 20:16:50.128819 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 488b06f05d9b4273a61bcb2d6e0ad796 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 488b06f05d9b4273a61bcb2d6e0ad796 already in progress: creating tablet
I20260617 20:16:50.129146 29383 raft_consensus.cc:359] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.129374 29383 raft_consensus.cc:385] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.129477 29740 raft_consensus.cc:493] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.129626 29740 raft_consensus.cc:515] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.129948 29104 tablet_service.cc:1511] Processing CreateTablet for tablet cc8fa9f4c40b4ce9baa27a8837d3575c (DEFAULT_TABLE table=default.Table_350b5e38df254cc69627edec8db5af45 [id=3463908997e94c288a7ac6ba26de9451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.130287 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c73bdcc1cefd48f3b99e0c059c3a7467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.130295 29740 leader_election.cc:290] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.129077 28668 catalog_manager.cc:5696] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194). New cstate: current_term: 1 leader_uuid: "6d4ce30e1fce4591b64c398747f8d37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:50.130719 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 60a43dd885aa4411a4177b67807b0ac4 (table default.Table_fd835dc9ea8f4041b36c069dcac9d69a [id=3a41dd53c3974256877f193219240234]). Expected version 4 got 0
I20260617 20:16:50.130972 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b62b22ff17964ee6934023fb85e0b7ec (table default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886]). Expected version 2 got 0
I20260617 20:16:50.129477 29383 raft_consensus.cc:740] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.133249 29383 consensus_queue.cc:260] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.133396 29101 tablet_service.cc:1511] Processing CreateTablet for tablet ead0291870a443d9b76ea919a45a4303 (DEFAULT_TABLE table=default.Table_1620ccecc04e416b924e56212280c0ff [id=0ef22e22306747b28d49d58d0fa45620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.133621 29376 ts_tablet_manager.cc:1929] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:50.133756 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead0291870a443d9b76ea919a45a4303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.133757 29376 log.cc:1199] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/1f32ebd7448843b48b981d3d70a87023
I20260617 20:16:50.134040 29728 raft_consensus.cc:493] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.134155 29376 ts_tablet_manager.cc:1950] T 1f32ebd7448843b48b981d3d70a87023 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:50.134228 29728 raft_consensus.cc:515] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.134747 29383 ts_tablet_manager.cc:1434] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260617 20:16:50.134953 29728 leader_election.cc:290] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.137596 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 98467525f81f4a48878eae17e3a9c982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:50.138710 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet fed593a3fa7742a18ccc2124c3ee0fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fed593a3fa7742a18ccc2124c3ee0fb9 already in progress: creating tablet
I20260617 20:16:50.139328 29783 raft_consensus.cc:515] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.140515 29379 tablet_bootstrap.cc:654] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.140540 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4f190a1005433ebcfbfe3a86aa9e70" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:50.141259 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4f190a1005433ebcfbfe3a86aa9e70" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:50.141772 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 33a1c96212014333935ec7f7c92a306c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33a1c96212014333935ec7f7c92a306c already in progress: creating tablet
W20260617 20:16:50.142046 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 98467525f81f4a48878eae17e3a9c982 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98467525f81f4a48878eae17e3a9c982 already in progress: creating tablet
W20260617 20:16:50.142230 29197 leader_election.cc:343] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 113fbbc739d04f529e82bc1cf1074bd7
W20260617 20:16:50.142504 29197 leader_election.cc:343] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 9b96c186469e4e8a8baa0dcab96d66bf
I20260617 20:16:50.144537 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f239f81c40743b2aaa70a361997db77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:50.144626 29198 leader_election.cc:343] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:50.144866 29198 leader_election.cc:343] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 9b96c186469e4e8a8baa0dcab96d66bf
I20260617 20:16:50.144979 29198 leader_election.cc:304] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:50.145151 29378 ts_tablet_manager.cc:1434] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260617 20:16:50.145223 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a1c96212014333935ec7f7c92a306c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.145437 29740 raft_consensus.cc:2749] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:50.145948 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8fa9f4c40b4ce9baa27a8837d3575c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.146066 28989 raft_consensus.cc:2468] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:50.144344 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113fbbc739d04f529e82bc1cf1074bd7" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:50.146508 29197 leader_election.cc:304] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:50.146893 29740 raft_consensus.cc:2804] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:50.146987 29740 raft_consensus.cc:493] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:50.147079 29740 raft_consensus.cc:3060] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.144308 29783 leader_election.cc:290] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.148952 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 488b06f05d9b4273a61bcb2d6e0ad796 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f3032155e4e4ea8a23984f547d78752) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.149407 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9e12c91df344ee84a586b7d4a27071" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:50.149609 29260 raft_consensus.cc:2468] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:50.149814 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet fed593a3fa7742a18ccc2124c3ee0fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.149952 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b59053006046e98d27c694808ca34d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:50.150475 29383 tablet_bootstrap.cc:492] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:50.154146 29378 tablet_bootstrap.cc:492] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:50.155107 29383 tablet_bootstrap.cc:654] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.156437 29063 leader_election.cc:304] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:50.156901 29740 raft_consensus.cc:515] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:50.157058 29063 leader_election.cc:343] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:50.157356 29783 raft_consensus.cc:2804] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:50.156414 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58213ec0a9364a91a15fc0329f28605b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.157471 29783 raft_consensus.cc:493] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:50.157635 29783 raft_consensus.cc:3060] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.157950 29587 raft_consensus.cc:493] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.159047 28955 tablet_service.cc:1511] Processing CreateTablet for tablet ead0291870a443d9b76ea919a45a4303 (DEFAULT_TABLE table=default.Table_1620ccecc04e416b924e56212280c0ff [id=0ef22e22306747b28d49d58d0fa45620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.159484 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead0291870a443d9b76ea919a45a4303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.159758 29587 raft_consensus.cc:515] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.160380 29587 leader_election.cc:290] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:50.166234 29740 leader_election.cc:290] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.167740 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 7f239f81c40743b2aaa70a361997db77 (DEFAULT_TABLE table=default.Table_fad470e9ef3042889cc803e1d6df2218 [id=0ea926c7d87a4670902ad04acbe1cfef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.168366 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b4240e14b48f4a43b7ce9c6512fc7ff2
I20260617 20:16:50.168867 28667 catalog_manager.cc:6784] ReplaceTablet: tablet b4240e14b48f4a43b7ce9c6512fc7ff2 deleted and replaced by tablet cb8f218e9f2d44bfbfd843ac8517a152
I20260617 20:16:50.169723 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 0e6cee209a5a44d6b35eb50e9c33228f
I20260617 20:16:50.170064 29740 raft_consensus.cc:493] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.170277 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f239f81c40743b2aaa70a361997db77. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:50.170684 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97541af7c02d46b98106692d92778741 consensus state has no leader
I20260617 20:16:50.170608 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b59053006046e98d27c694808ca34d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:50.168928 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e4407aa01642ffb03eba1b220afdba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.171471 28989 raft_consensus.cc:2468] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:50.172619 29127 raft_consensus.cc:2468] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:50.174229 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9e12c91df344ee84a586b7d4a27071" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:50.176803 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e6cee209a5a44d6b35eb50e9c33228f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.177026 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet b4240e14b48f4a43b7ce9c6512fc7ff2 with delete_type TABLET_DATA_DELETED (replaced by tablet cb8f218e9f2d44bfbfd843ac8517a152) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.177142 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86dd216fa0ab46f5bb16e1b7bf1ca4f9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:50.176111 29740 raft_consensus.cc:515] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.177698 29728 raft_consensus.cc:493] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.177785 29198 leader_election.cc:304] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:50.177856 29728 raft_consensus.cc:515] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.178280 29062 leader_election.cc:304] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:50.178514 29728 leader_election.cc:290] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:50.178654 29810 raft_consensus.cc:2804] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:50.178700 29728 raft_consensus.cc:2804] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:50.178768 29810 raft_consensus.cc:493] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:50.178810 29728 raft_consensus.cc:493] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:50.178882 29810 raft_consensus.cc:3060] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.178915 29728 raft_consensus.cc:3060] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.179172 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4f190a1005433ebcfbfe3a86aa9e70" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:16:50.179941 29198 leader_election.cc:343] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:50.183185 29810 raft_consensus.cc:515] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.184218 29810 leader_election.cc:290] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.184510 29740 leader_election.cc:290] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:50.185007 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 223) took 2460 ms. Trace:
I20260617 20:16:50.185094 29376 rpcz_store.cc:276] 0617 20:16:47.724263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.726408 (+ 2145us) service_pool.cc:224] Handling call
0617 20:16:50.069075 (+2342667us) ts_tablet_manager.cc:1151] Deleting tablet 1f32ebd7448843b48b981d3d70a87023
0617 20:16:50.069084 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.092513 (+ 23429us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.096556 (+ 4043us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.184955 (+ 88399us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2342414}
I20260617 20:16:50.185508 29376 tablet_replica.cc:333] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:50.185676 29376 raft_consensus.cc:2243] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.185882 29376 raft_consensus.cc:2272] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.186419 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86dd216fa0ab46f5bb16e1b7bf1ca4f9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:50.187544 29376 ts_tablet_manager.cc:1916] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.191901 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4332e33d60964bd6a0c7e7caaa6bdc76" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:50.192418 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113fbbc739d04f529e82bc1cf1074bd7" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:50.192631 29126 raft_consensus.cc:3060] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.196030 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet b4240e14b48f4a43b7ce9c6512fc7ff2 with delete_type TABLET_DATA_DELETED (replaced by tablet cb8f218e9f2d44bfbfd843ac8517a152) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.198931 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b162a0ef91d1447b838331ba6ef93bf4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:50.200347 29783 raft_consensus.cc:515] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:50.203228 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet b4240e14b48f4a43b7ce9c6512fc7ff2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4240e14b48f4a43b7ce9c6512fc7ff2 already in progress: creating tablet
I20260617 20:16:50.204137 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9e12c91df344ee84a586b7d4a27071" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:50.204383 29262 raft_consensus.cc:3060] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.207638 29262 raft_consensus.cc:2468] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:50.208388 29783 leader_election.cc:290] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.213330 29063 leader_election.cc:304] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:50.213708 29783 raft_consensus.cc:2804] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:50.214339 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f85271eeb854194a968215ebc08f47a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.214393 29728 raft_consensus.cc:515] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.215502 29377 ts_tablet_manager.cc:1929] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:50.215564 29383 tablet_bootstrap.cc:492] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:50.215740 29383 ts_tablet_manager.cc:1403] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.065s user 0.012s sys 0.011s
I20260617 20:16:50.215823 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eee68618cdf462283d7fd9f098c2a0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.218003 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e6cee209a5a44d6b35eb50e9c33228f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.218640 29783 raft_consensus.cc:697] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:50.218952 29783 consensus_queue.cc:237] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.220708 28952 tablet_service.cc:1511] Processing CreateTablet for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (DEFAULT_TABLE table=default.Table_a1d87ddabcbe4a0e85e6587ff00a5b4d [id=3d369e1099c944688151bb38c8da0855]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:50.221463 29197 leader_election.cc:343] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 113fbbc739d04f529e82bc1cf1074bd7
W20260617 20:16:50.221642 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 0e6cee209a5a44d6b35eb50e9c33228f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e6cee209a5a44d6b35eb50e9c33228f already in progress: creating tablet
I20260617 20:16:50.221724 29377 log.cc:1199] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/4332e33d60964bd6a0c7e7caaa6bdc76
I20260617 20:16:50.221773 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet b4240e14b48f4a43b7ce9c6512fc7ff2 with delete_type TABLET_DATA_DELETED (replaced by tablet cb8f218e9f2d44bfbfd843ac8517a152) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.222054 28990 raft_consensus.cc:2468] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:50.222250 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b162a0ef91d1447b838331ba6ef93bf4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:50.216739 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4f190a1005433ebcfbfe3a86aa9e70" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:50.224462 28988 raft_consensus.cc:2393] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 6d4ce30e1fce4591b64c398747f8d37a in this term.
I20260617 20:16:50.225596 29197 leader_election.cc:304] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:50.226233 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b59053006046e98d27c694808ca34d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:50.226774 29740 raft_consensus.cc:3060] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:50.228427 29063 leader_election.cc:343] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:50.228729 29728 leader_election.cc:290] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:50.229617 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ead0291870a443d9b76ea919a45a4303 consensus state has no leader
I20260617 20:16:50.230604 29740 raft_consensus.cc:2749] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:50.231480 28925 leader_election.cc:343] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:50.231904 29379 tablet_bootstrap.cc:492] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:50.224341 29383 raft_consensus.cc:359] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.232270 29383 raft_consensus.cc:385] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.232380 29383 raft_consensus.cc:740] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.232666 29383 consensus_queue.cc:260] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.234465 29308 heartbeater.cc:344] Connected to a master server at 127.27.245.252:46059
I20260617 20:16:50.236435 29383 ts_tablet_manager.cc:1434] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260617 20:16:50.236749 29383 tablet_bootstrap.cc:492] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:50.237102 29379 ts_tablet_manager.cc:1403] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.119s user 0.003s sys 0.002s
I20260617 20:16:50.238449 29379 raft_consensus.cc:359] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.239136 29379 raft_consensus.cc:385] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.239231 29379 raft_consensus.cc:740] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.239876 29383 tablet_bootstrap.cc:654] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.240015 29379 consensus_queue.cc:260] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.240546 29379 ts_tablet_manager.cc:1434] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:50.241510 29379 tablet_bootstrap.cc:492] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:50.243240 29376 ts_tablet_manager.cc:1929] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:50.246031 29376 log.cc:1199] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/e0c44c3fa6f64f929d48de53f2502bfb
I20260617 20:16:50.246584 29376 ts_tablet_manager.cc:1950] T e0c44c3fa6f64f929d48de53f2502bfb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:50.249475 29126 raft_consensus.cc:2468] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:50.250892 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 224) took 2425 ms. Trace:
I20260617 20:16:50.251123 29376 rpcz_store.cc:276] 0617 20:16:47.825878 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.828073 (+ 2195us) service_pool.cc:224] Handling call
0617 20:16:50.185420 (+2357347us) ts_tablet_manager.cc:1151] Deleting tablet e0c44c3fa6f64f929d48de53f2502bfb
0617 20:16:50.185432 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.193233 (+ 7801us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.243143 (+ 49910us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.250843 (+ 7700us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2357062}
I20260617 20:16:50.251703 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet e0c44c3fa6f64f929d48de53f2502bfb (table default.Table_648063d260534042bb01e0ae092c195b [id=2dda85266fd14be88479aa0ffec47512]) successfully deleted
I20260617 20:16:50.253173 29721 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 590225c8ea36448093b77385d238a34a. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:50.253479 29721 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:16:50.253919 29761 raft_consensus.cc:493] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590225c8ea36448093b77385d238a34a)
I20260617 20:16:50.254146 29761 raft_consensus.cc:515] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:16:50.255843 29623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35908 (request call id 0) took 2021 ms. Trace:
I20260617 20:16:50.262454 29761 leader_election.cc:290] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), 87437cd320a4470fa0dedd43aa7ea3eb (127.27.245.253:38361)
I20260617 20:16:50.262717 29379 tablet_bootstrap.cc:654] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.268724 29198 leader_election.cc:304] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:50.270080 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e6cee209a5a44d6b35eb50e9c33228f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.270876 29810 raft_consensus.cc:2804] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:50.274761 28989 raft_consensus.cc:3060] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:50.280808 29062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 102558us
I20260617 20:16:50.280808 29575 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" instance_seqno: 1781727403200426) as {username='slave'} at 127.27.245.195:45687; Asking this server to re-register.
I20260617 20:16:50.283780 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a52db3bf8ffa484aace6788058b23821" } new_table_name: "default.Table_4d29aa3f94294bdebf2c330bd7c3c063" modify_external_catalogs: true
I20260617 20:16:50.289021 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9d86beced971472a8590a9eb66719ca2" } new_table_name: "default.Table_8cd5575879f54274afa3ecac3cc58ea7" modify_external_catalogs: true
I20260617 20:16:50.290539 29308 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:50.290869 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0c3573fbceb84376afbe284979c815a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.291450 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c3573fbceb84376afbe284979c815a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.294253 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f2c4f9d463814ae2883f800f27c5d14d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.294806 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2c4f9d463814ae2883f800f27c5d14d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.296983 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_69cc8ac4971244b09b6fec4788813e2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.297627 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69cc8ac4971244b09b6fec4788813e2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.298410 29376 tablet_replica.cc:333] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:50.298693 29376 raft_consensus.cc:2243] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.299642 29376 raft_consensus.cc:2272] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.299726 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_725310d538304427bfe704881702f3a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.300328 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_725310d538304427bfe704881702f3a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.300383 29376 ts_tablet_manager.cc:1916] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.302380 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c2b342d694454abb90a737a7dcb4e957"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.302956 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2b342d694454abb90a737a7dcb4e957 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:50.307507 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89f7b878728a495f83b6584f8a6aca67 consensus state has no leader
I20260617 20:16:50.307797 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 57e19abe093a40f6886908a8a3a0cad4 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:50.308396 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_608970ae0a3443c5937e3180a495bc33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.308943 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_608970ae0a3443c5937e3180a495bc33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.311503 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c73bdcc1cefd48f3b99e0c059c3a7467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.311779 29587 raft_consensus.cc:493] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.311929 29587 raft_consensus.cc:515] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.320840 29379 tablet_bootstrap.cc:492] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:50.321071 29379 ts_tablet_manager.cc:1403] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.012s
I20260617 20:16:50.322995 29379 raft_consensus.cc:359] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.323271 29379 raft_consensus.cc:385] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.323376 29379 raft_consensus.cc:740] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.323704 29379 consensus_queue.cc:260] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.324520 29379 ts_tablet_manager.cc:1434] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 20:16:50.324904 29379 tablet_bootstrap.cc:492] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:50.324913 29810 raft_consensus.cc:697] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:50.327533 29379 tablet_bootstrap.cc:654] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.327950 29810 consensus_queue.cc:237] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.336069 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 57e19abe093a40f6886908a8a3a0cad4 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:50.336827 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet a7b59053006046e98d27c694808ca34d from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:50.337929 29377 ts_tablet_manager.cc:1950] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:16:50.338317 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 593d9de6a2fb47e18d86649e45ba80b9 has no consensus state
I20260617 20:16:50.343015 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a9e12c91df344ee84a586b7d4a27071" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:50.343334 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.344249 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4332e33d60964bd6a0c7e7caaa6bdc76" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:50.344444 29379 tablet_bootstrap.cc:492] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:50.344621 29379 ts_tablet_manager.cc:1403] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.007s
I20260617 20:16:50.345054 29587 leader_election.cc:290] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:50.346022 29379 raft_consensus.cc:359] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.346243 29379 raft_consensus.cc:385] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.346338 29379 raft_consensus.cc:740] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.346614 29379 consensus_queue.cc:260] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.347347 29379 ts_tablet_manager.cc:1434] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 20:16:50.347926 29379 tablet_bootstrap.cc:492] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:50.348754 28925 leader_election.cc:343] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:50.348956 28925 leader_election.cc:304] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:50.350368 29062 leader_election.cc:343] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Illegal state: Tablet not RUNNING: SHUTDOWN
I20260617 20:16:50.350512 29062 leader_election.cc:304] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:50.350957 29827 raft_consensus.cc:2749] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:50.351375 29379 tablet_bootstrap.cc:654] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.353191 29575 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" instance_seqno: 1781727402721499) as {username='slave'} at 127.27.245.194:52589; Asking this server to re-register.
I20260617 20:16:50.357679 28990 raft_consensus.cc:3060] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.358230 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 4332e33d60964bd6a0c7e7caaa6bdc76 (table default.Table_81f4fb86b1a8470db7f74e35dc15a3fa [id=229a4fa545c84500af515f5992b547c7]) successfully deleted
W20260617 20:16:50.358533 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 117560us
I20260617 20:16:50.359529 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e704d08c0da484a986c9d882a42e6f1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:50.360374 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e704d08c0da484a986c9d882a42e6f1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:50.361469 29378 tablet_bootstrap.cc:654] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.361949 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b59053006046e98d27c694808ca34d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:50.362210 28987 raft_consensus.cc:3060] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.362854 29376 ts_tablet_manager.cc:1929] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:50.363006 29376 log.cc:1199] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/808c455e74e645aa8e2b0d08ca81d4f9
I20260617 20:16:50.363356 29376 ts_tablet_manager.cc:1950] T 808c455e74e645aa8e2b0d08ca81d4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:50.364100 29575 ts_manager.cc:194] Registered new tserver with Master: a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:50.364161 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 229) took 2412 ms. Trace:
I20260617 20:16:50.364248 29376 rpcz_store.cc:276] 0617 20:16:47.951457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.953140 (+ 1683us) service_pool.cc:224] Handling call
0617 20:16:50.252042 (+2298902us) ts_tablet_manager.cc:1151] Deleting tablet 808c455e74e645aa8e2b0d08ca81d4f9
0617 20:16:50.298154 (+ 46112us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.326963 (+ 28809us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.362773 (+ 35810us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.364108 (+ 1335us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2294907}
I20260617 20:16:50.364696 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 808c455e74e645aa8e2b0d08ca81d4f9 (table default.Table_0ba339c37163434e8c628ef515624fe1 [id=8696ed2b09fd4e06a0f2746537370766]) successfully deleted
I20260617 20:16:50.366099 29587 raft_consensus.cc:2749] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:50.367898 28989 raft_consensus.cc:2468] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:50.368294 29827 raft_consensus.cc:493] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.368989 29827 raft_consensus.cc:515] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.369671 28990 raft_consensus.cc:2468] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:50.370056 29827 leader_election.cc:290] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:50.370918 28925 leader_election.cc:343] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:50.371435 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce9f5deea614e6d9e02e88d3d5ff2c6" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:50.371695 29262 raft_consensus.cc:2468] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:50.372475 29063 leader_election.cc:304] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:50.373009 29827 raft_consensus.cc:2804] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:50.373126 29827 raft_consensus.cc:493] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:50.373224 29827 raft_consensus.cc:3060] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.379391 29173 heartbeater.cc:461] Registering TS with master...
I20260617 20:16:50.379513 29197 leader_election.cc:304] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:50.380962 29783 consensus_queue.cc:1048] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260617 20:16:50.381749 28925 leader_election.cc:343] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:50.381889 28925 leader_election.cc:304] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:50.380573 29810 raft_consensus.cc:2804] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:50.382579 29810 raft_consensus.cc:697] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:50.383952 29827 raft_consensus.cc:515] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:50.384531 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d2db0467c5e64e38961d3b0e66375544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2db0467c5e64e38961d3b0e66375544 already in progress: creating tablet
I20260617 20:16:50.385098 29810 consensus_queue.cc:237] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.385731 29126 raft_consensus.cc:3060] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.386029 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce9f5deea614e6d9e02e88d3d5ff2c6" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:50.386255 29262 raft_consensus.cc:3060] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.390811 29262 raft_consensus.cc:2468] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:50.391577 29063 leader_election.cc:304] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:50.392104 29783 raft_consensus.cc:2804] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:50.392345 29783 raft_consensus.cc:697] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:50.392784 29783 consensus_queue.cc:237] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.393448 29827 leader_election.cc:290] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.398231 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6
I20260617 20:16:50.399122 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet 3726e55ed36f420ab63bcfb5a81c5aab from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:50.400018 29587 raft_consensus.cc:2749] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:50.401023 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 294) took 1002 ms. Trace:
I20260617 20:16:50.401172 29377 rpcz_store.cc:276] 0617 20:16:49.398018 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.398081 (+ 63us) service_pool.cc:224] Handling call
0617 20:16:50.381351 (+983270us) ts_tablet_manager.cc:1151] Deleting tablet 7b00437fb76c4000ad89c99ab2da2261
0617 20:16:50.381360 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.400609 (+ 19249us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":971015}
I20260617 20:16:50.405905 29578 ts_manager.cc:194] Registered new tserver with Master: 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:50.409490 29837 raft_consensus.cc:493] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.409797 29837 raft_consensus.cc:515] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:50.410650 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 7b00437fb76c4000ad89c99ab2da2261 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b00437fb76c4000ad89c99ab2da2261 already in progress: creating tablet
I20260617 20:16:50.411927 29837 leader_election.cc:290] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.414294 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b67b915758d4ab0a8faa0227de08593" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:50.414454 29377 tablet_replica.cc:333] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:50.414366 29822 consensus_queue.cc:1048] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260617 20:16:50.414570 29126 raft_consensus.cc:2468] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:50.414791 29377 raft_consensus.cc:2243] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.415014 29377 raft_consensus.cc:2272] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.414983 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce9f5deea614e6d9e02e88d3d5ff2c6" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:50.415191 28990 raft_consensus.cc:2468] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:50.415755 29377 ts_tablet_manager.cc:1916] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.416962 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce9f5deea614e6d9e02e88d3d5ff2c6" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:50.417207 28989 raft_consensus.cc:3060] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.418294 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.418578 29375 tablet_replica.cc:333] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:50.419286 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.419476 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 216f91e7bda148bc9334b19e3c868910 with delete_type TABLET_DATA_DELETED (replaced by tablet b3ea76ad1ec64d22a64bdd4c97e288c6) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.419775 29198 leader_election.cc:304] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:50.414400 28987 raft_consensus.cc:2468] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:50.421020 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d4702c06d3442ac966ef2daca8d4660 with delete_type TABLET_DATA_DELETED (replaced by tablet 488b06f05d9b4273a61bcb2d6e0ad796) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.421689 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b67b915758d4ab0a8faa0227de08593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.421816 28989 raft_consensus.cc:2468] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:50.422597 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b67b915758d4ab0a8faa0227de08593 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.422958 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 216f91e7bda148bc9334b19e3c868910 with delete_type TABLET_DATA_DELETED (replaced by tablet b3ea76ad1ec64d22a64bdd4c97e288c6) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.422991 29062 leader_election.cc:304] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:50.423161 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 808c455e74e645aa8e2b0d08ca81d4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.423372 29827 raft_consensus.cc:2804] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:50.423544 29827 raft_consensus.cc:697] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
W20260617 20:16:50.423568 29197 leader_election.cc:343] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3b67b915758d4ab0a8faa0227de08593
I20260617 20:16:50.423758 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.423796 29827 consensus_queue.cc:237] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.424218 29837 raft_consensus.cc:2804] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:50.424351 29837 raft_consensus.cc:493] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:50.424474 29837 raft_consensus.cc:3060] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.428442 29837 raft_consensus.cc:515] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.429814 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b67b915758d4ab0a8faa0227de08593" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:50.430047 29127 raft_consensus.cc:3060] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.434697 29127 raft_consensus.cc:2468] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:50.436460 29262 raft_consensus.cc:3060] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.440124 29822 consensus_queue.cc:1048] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:50.441442 29198 leader_election.cc:304] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:50.442655 29740 raft_consensus.cc:2804] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:50.442711 29575 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" instance_seqno: 1781727402242368) as {username='slave'} at 127.27.245.193:45373; Asking this server to re-register.
I20260617 20:16:50.443121 29740 raft_consensus.cc:697] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:50.443610 29740 consensus_queue.cc:237] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.447947 29837 leader_election.cc:290] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.448520 29035 heartbeater.cc:461] Registering TS with master...
W20260617 20:16:50.448504 29197 leader_election.cc:343] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3b67b915758d4ab0a8faa0227de08593
I20260617 20:16:50.452926 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ec97bbef66184088b7799dfed7bb04b5" } new_table_name: "default.Table_4b6a1b4f97184d0eb8200cf926039a32" modify_external_catalogs: true
I20260617 20:16:50.454689 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_56731cc7022548f8a230b1f50b31109f" } modify_external_catalogs: true
I20260617 20:16:50.454891 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_56731cc7022548f8a230b1f50b31109f" } modify_external_catalogs: true
I20260617 20:16:50.457199 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d3c4a4f115524492993663ad7da2da7a" } modify_external_catalogs: true
I20260617 20:16:50.457419 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d3c4a4f115524492993663ad7da2da7a" } modify_external_catalogs: true
I20260617 20:16:50.457917 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f09fba1c81844e81a218171de6721f68" } modify_external_catalogs: true
I20260617 20:16:50.458104 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f09fba1c81844e81a218171de6721f68" } modify_external_catalogs: true
I20260617 20:16:50.459026 29377 ts_tablet_manager.cc:1929] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:50.459146 29377 log.cc:1199] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/2a9e12c91df344ee84a586b7d4a27071
I20260617 20:16:50.459527 29377 ts_tablet_manager.cc:1950] T 2a9e12c91df344ee84a586b7d4a27071 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:50.460654 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 2a9e12c91df344ee84a586b7d4a27071 (table default.Table_2420afe282984f72ab42715fbc33380a [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]) successfully deleted
I20260617 20:16:50.460623 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d3381a68eac743b28435e4756ba0cb2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.461217 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3381a68eac743b28435e4756ba0cb2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.464586 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c7a5b7a15b93440a82590a995e13b32c" } modify_external_catalogs: true
I20260617 20:16:50.464761 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c7a5b7a15b93440a82590a995e13b32c" } modify_external_catalogs: true
I20260617 20:16:50.465554 29575 ts_manager.cc:194] Registered new tserver with Master: 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.471756 28662 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet cb8f218e9f2d44bfbfd843ac8517a152
W20260617 20:16:50.471843 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 203666e6127b49ed92731bc87ce01798 has no consensus state
I20260617 20:16:50.472533 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b97c17b55aa74ddc8b66886867dbdd40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.473539 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b97c17b55aa74ddc8b66886867dbdd40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.472610 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_577f6b872d804b24ae25b7c1469442d8" } new_table_name: "default.Table_fbaeb71321364cca9f5c971ee3419519" modify_external_catalogs: true
I20260617 20:16:50.478008 29127 raft_consensus.cc:1275] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Refusing update from remote peer 5ca3d93189744132bbf55ac01f3a8254: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:50.478670 29822 consensus_queue.cc:1048] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:50.482630 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0f19dbb676e84b58a20d056d5e812e71" } new_table_name: "default.Table_6cb2486917764383bc50fe8b80d84a07" modify_external_catalogs: true
W20260617 20:16:50.490926 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3726e55ed36f420ab63bcfb5a81c5aab consensus state has no leader
I20260617 20:16:50.491225 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_40053ed1f4264c3993f829af0bea9f13"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:50.491437 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_00ae029b2f81402188ceedb8535a9652"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:50.491611 29587 raft_consensus.cc:493] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.491786 29587 raft_consensus.cc:515] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:50.492358 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00ae029b2f81402188ceedb8535a9652 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.492583 29587 leader_election.cc:290] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:50.494011 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7cafcade995b407f84f56b8cd3ab6892 has no consensus state
I20260617 20:16:50.494199 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85271eeb854194a968215ebc08f47a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:50.494383 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet a76b0744ef2a472091999681d5639fec from {username='slave'} at 127.0.0.1:60552
W20260617 20:16:50.491899 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40053ed1f4264c3993f829af0bea9f13 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:50.494870 28925 leader_election.cc:343] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:50.496305 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85271eeb854194a968215ebc08f47a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:50.496941 28925 leader_election.cc:343] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:50.497167 28925 leader_election.cc:304] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:50.497573 29587 raft_consensus.cc:2749] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:50.509457 29375 raft_consensus.cc:2243] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:50.509943 29375 pending_rounds.cc:70] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:50.510046 29375 pending_rounds.cc:77] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955472974995456 op_type: NO_OP noop_request { }
I20260617 20:16:50.510157 29375 raft_consensus.cc:2889] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:50.510298 29375 raft_consensus.cc:2272] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.512521 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 321 } } ignore_live_leader: false dest_uuid: "590225c8ea36448093b77385d238a34a" is_pre_election: true
I20260617 20:16:50.515547 29378 tablet_bootstrap.cc:492] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:50.515753 29378 ts_tablet_manager.cc:1403] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.369s user 0.001s sys 0.014s
I20260617 20:16:50.517333 29375 ts_tablet_manager.cc:1916] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.523516 29375 ts_tablet_manager.cc:1929] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:50.523677 29375 log.cc:1199] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/1ce9f5deea614e6d9e02e88d3d5ff2c6
W20260617 20:16:50.523900 28656 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 89f7b878728a495f83b6584f8a6aca67 (table default.Table_4d29aa3f94294bdebf2c330bd7c3c063 [id=6fb9858b817a4575abd3b84a32027d90], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 89f7b878728a495f83b6584f8a6aca67 consensus state has no leader
I20260617 20:16:50.524237 29375 ts_tablet_manager.cc:1950] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:50.524816 29375 tablet_replica.cc:333] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:50.525070 29375 raft_consensus.cc:2243] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.525281 29375 raft_consensus.cc:2272] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.525823 29375 ts_tablet_manager.cc:1916] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:50.529821 29198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 88421.3us
I20260617 20:16:50.530464 29852 raft_consensus.cc:493] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.530758 29852 raft_consensus.cc:515] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.538519 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 (table default.Table_8ca126699bab4f66b23ce38c90e050bb [id=f119f85b0a244e149caec77aab7063ad]) successfully deleted
I20260617 20:16:50.539244 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_132f26049e6b4fea9ea1c5a5f5525931" } new_table_name: "default.Table_0b2903f0c1204e4eacd6a8987e8b688a" modify_external_catalogs: true
I20260617 20:16:50.516628 29378 raft_consensus.cc:359] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.540197 29378 raft_consensus.cc:385] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.540304 29378 raft_consensus.cc:740] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.540648 29378 consensus_queue.cc:260] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.546241 29852 leader_election.cc:290] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.546594 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4702c06d3442ac966ef2daca8d4660" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:50.546833 29125 raft_consensus.cc:2468] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:50.547334 29833 catalog_manager.cc:1294] Loaded cluster ID: 46a5ac7d37d748d69d2d5bbcb74d8c61
I20260617 20:16:50.547428 29833 catalog_manager.cc:1587] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: loading cluster ID for follower catalog manager: success
W20260617 20:16:50.547425 29197 leader_election.cc:343] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 9d4702c06d3442ac966ef2daca8d4660
I20260617 20:16:50.547626 29197 leader_election.cc:304] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
W20260617 20:16:50.555347 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 488b06f05d9b4273a61bcb2d6e0ad796 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 488b06f05d9b4273a61bcb2d6e0ad796 already in progress: creating tablet
W20260617 20:16:50.556131 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 98467525f81f4a48878eae17e3a9c982 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98467525f81f4a48878eae17e3a9c982 already in progress: creating tablet
I20260617 20:16:50.556470 29833 catalog_manager.cc:1609] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: acquiring CA information for follower catalog manager: success
W20260617 20:16:50.556924 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 33a1c96212014333935ec7f7c92a306c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33a1c96212014333935ec7f7c92a306c already in progress: creating tablet
W20260617 20:16:50.560818 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 consensus state has no leader
I20260617 20:16:50.561471 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fbc7dc910d9b4eda962ff4b9328e00a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.562269 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbc7dc910d9b4eda962ff4b9328e00a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.564785 29852 raft_consensus.cc:2804] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:50.565050 29852 raft_consensus.cc:493] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:50.565230 29852 raft_consensus.cc:3060] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:50.567705 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet fed593a3fa7742a18ccc2124c3ee0fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fed593a3fa7742a18ccc2124c3ee0fb9 already in progress: creating tablet
W20260617 20:16:50.569945 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 33e4407aa01642ffb03eba1b220afdba because the tablet was not found. No further retry: Not found: Tablet not found: 33e4407aa01642ffb03eba1b220afdba
I20260617 20:16:50.575237 28751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 321 } } ignore_live_leader: false dest_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" is_pre_election: true
I20260617 20:16:50.575961 29377 tablet_replica.cc:333] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:50.577827 29377 raft_consensus.cc:2243] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.578100 29377 raft_consensus.cc:2272] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.583742 29859 consensus_queue.cc:1048] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:50.585613 29377 ts_tablet_manager.cc:1916] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.585880 29527 leader_election.cc:304] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5ea3f9265d84474ab3bced8dd5aecc5; no voters: 590225c8ea36448093b77385d238a34a, 87437cd320a4470fa0dedd43aa7ea3eb
I20260617 20:16:50.586488 29761 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:16:50.591312 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 226) took 2640 ms. Trace:
I20260617 20:16:50.591552 29376 rpcz_store.cc:276] 0617 20:16:47.951076 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.953074 (+ 1998us) service_pool.cc:224] Handling call
0617 20:16:50.525006 (+2571932us) ts_tablet_manager.cc:1151] Deleting tablet 57e19abe093a40f6886908a8a3a0cad4
0617 20:16:50.579138 (+ 54132us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.591217 (+ 12079us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2567572}
I20260617 20:16:50.592469 29376 tablet_replica.cc:333] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:50.592657 29375 ts_tablet_manager.cc:1929] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:50.592849 29375 log.cc:1199] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/216f91e7bda148bc9334b19e3c868910
I20260617 20:16:50.594833 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5420a15e4fa749039b1bce59b563517d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:50.595114 29383 tablet_bootstrap.cc:492] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:50.595293 29383 ts_tablet_manager.cc:1403] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.359s user 0.014s sys 0.085s
I20260617 20:16:50.596097 29383 raft_consensus.cc:359] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.596273 29383 raft_consensus.cc:385] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 20:16:50.597105 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5420a15e4fa749039b1bce59b563517d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:50.596071 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 57e19abe093a40f6886908a8a3a0cad4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57e19abe093a40f6886908a8a3a0cad4 already in progress: creating tablet
I20260617 20:16:50.611202 29378 ts_tablet_manager.cc:1434] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.060s user 0.002s sys 0.002s
I20260617 20:16:50.596340 29383 raft_consensus.cc:740] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.614476 29383 consensus_queue.cc:260] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.614979 29379 tablet_bootstrap.cc:492] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:50.615144 29379 ts_tablet_manager.cc:1403] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.267s user 0.035s sys 0.111s
I20260617 20:16:50.615137 29383 ts_tablet_manager.cc:1434] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260617 20:16:50.615496 29383 tablet_bootstrap.cc:492] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:50.616163 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_64a54638a38b4d8cab417ecd62e3d04a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:50.619181 29852 raft_consensus.cc:515] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:50.620489 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64a54638a38b4d8cab417ecd62e3d04a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.620609 29376 raft_consensus.cc:2243] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.621063 29376 raft_consensus.cc:2272] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.621688 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d4702c06d3442ac966ef2daca8d4660" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:50.621938 29127 raft_consensus.cc:3060] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:50.622177 29379 raft_consensus.cc:359] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.622349 29379 raft_consensus.cc:385] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.622437 29379 raft_consensus.cc:740] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.623250 29379 consensus_queue.cc:260] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.625377 29127 raft_consensus.cc:2468] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:50.625983 29379 ts_tablet_manager.cc:1434] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260617 20:16:50.625974 29198 leader_election.cc:304] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:16:50.626250 29198 raft_consensus.cc:2686] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:16:50.632246 29852 leader_election.cc:290] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.633031 29376 ts_tablet_manager.cc:1916] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.639417 29379 tablet_bootstrap.cc:492] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:50.593272 29375 ts_tablet_manager.cc:1950] T 216f91e7bda148bc9334b19e3c868910 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:50.641844 29379 tablet_bootstrap.cc:654] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.628535 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3726e55ed36f420ab63bcfb5a81c5aab
I20260617 20:16:50.640648 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 46ea43994a0a42fe9e16d7bc6a2118e6
I20260617 20:16:50.642405 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 216f91e7bda148bc9334b19e3c868910 (table default.Table_1944004da2ec4937b26d524aa808d0b3 [id=295609419d07485fa5651914ddd75ce8]) successfully deleted
I20260617 20:16:50.643955 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.644383 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6245e1c087524bddb73075d1437dae2d" } new_table_name: "default.Table_2ca839bde234444b97808d82d7974e3c" modify_external_catalogs: true
I20260617 20:16:50.644970 29378 tablet_bootstrap.cc:492] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:50.646368 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.647145 28661 catalog_manager.cc:6784] ReplaceTablet: tablet 3726e55ed36f420ab63bcfb5a81c5aab deleted and replaced by tablet b4dbefbe5234458cb299410ddb2c73a3
I20260617 20:16:50.647388 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab with delete_type TABLET_DATA_DELETED (replaced by tablet b4dbefbe5234458cb299410ddb2c73a3) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.647518 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_81b3bfff6b3f4cf98596b01d7f988a71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.648211 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81b3bfff6b3f4cf98596b01d7f988a71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.650514 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab with delete_type TABLET_DATA_DELETED (replaced by tablet b4dbefbe5234458cb299410ddb2c73a3) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.651713 29383 tablet_bootstrap.cc:654] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.652547 29375 tablet_replica.cc:333] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:50.655570 29379 tablet_bootstrap.cc:492] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
W20260617 20:16:50.656351 29197 leader_election.cc:343] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 9d4702c06d3442ac966ef2daca8d4660
I20260617 20:16:50.658324 29379 ts_tablet_manager.cc:1403] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.000s
I20260617 20:16:50.659206 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0f470f9601d84ae29158e563c73bce2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.659945 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f470f9601d84ae29158e563c73bce2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.664084 28666 catalog_manager.cc:5696] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:50.665761 28666 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_921dd6771a094e7cb638a0bcd034177e [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 2 got 0
I20260617 20:16:50.666186 28666 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet b62b22ff17964ee6934023fb85e0b7ec (table default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886]). Expected version 2 got 0
I20260617 20:16:50.666868 29375 raft_consensus.cc:2243] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.667445 29379 raft_consensus.cc:359] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.668033 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 203666e6127b49ed92731bc87ce01798 (DEFAULT_TABLE table=default.Table_4b6a1b4f97184d0eb8200cf926039a32 [id=37131dec7c6a44cb9c9aed3a27a5028a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.668555 29379 raft_consensus.cc:385] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.668644 29379 raft_consensus.cc:740] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.668908 29379 consensus_queue.cc:260] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.669497 29379 ts_tablet_manager.cc:1434] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260617 20:16:50.669829 29379 tablet_bootstrap.cc:492] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:50.671959 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 203666e6127b49ed92731bc87ce01798 (DEFAULT_TABLE table=default.Table_4b6a1b4f97184d0eb8200cf926039a32 [id=37131dec7c6a44cb9c9aed3a27a5028a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:50.672181 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e53946c85ab4a8286a6e174cc411c5e consensus state has no leader
I20260617 20:16:50.672483 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203666e6127b49ed92731bc87ce01798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.672472 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet f4de5dafb1474de1911148bb3b4527cf from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:50.672583 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203666e6127b49ed92731bc87ce01798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.673995 29376 ts_tablet_manager.cc:1929] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:50.674125 29376 log.cc:1199] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/9d4702c06d3442ac966ef2daca8d4660
I20260617 20:16:50.674476 29376 ts_tablet_manager.cc:1950] T 9d4702c06d3442ac966ef2daca8d4660 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:50.675696 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 231) took 2714 ms. Trace:
I20260617 20:16:50.675827 29376 rpcz_store.cc:276] 0617 20:16:47.961474 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.961521 (+ 47us) service_pool.cc:224] Handling call
0617 20:16:50.592325 (+2630804us) ts_tablet_manager.cc:1151] Deleting tablet 9d4702c06d3442ac966ef2daca8d4660
0617 20:16:50.592340 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.620898 (+ 28558us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x616000143854. stack: 00007f5f5963e496 00007f5f5963e250 00007f5f586693ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f5f656e47e0 00007f5f66a30933 00007f5f695f3ae7 00007f5f69626bb4 00007f5f696075d0 00007f5f6960735d 0000000000aa681c 00007f5f596849ff 00007f5f59687d1b 00007f5f59687b98
0617 20:16:50.636699 (+ 15801us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.673891 (+ 37192us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.675657 (+ 1766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63658752,"tablet-delete.queue_time_us":2630614}
I20260617 20:16:50.676328 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 232) took 2692 ms. Trace:
I20260617 20:16:50.676450 29376 rpcz_store.cc:276] 0617 20:16:47.983481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.983548 (+ 67us) service_pool.cc:224] Handling call
0617 20:16:50.676179 (+2692631us) ts_tablet_manager.cc:1151] Deleting tablet b1b3565799894d82a3cc29ab2a19307c
0617 20:16:50.676189 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.676296 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2663233}
I20260617 20:16:50.676726 29376 tablet_replica.cc:333] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:50.676954 29376 raft_consensus.cc:2243] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.677131 29376 raft_consensus.cc:2272] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.677706 29376 ts_tablet_manager.cc:1916] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.681108 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6d8d8942e21d4268b530c31639fc4d09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.681804 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d8d8942e21d4268b530c31639fc4d09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.681962 29379 tablet_bootstrap.cc:654] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.682955 29375 raft_consensus.cc:2272] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.683522 29375 ts_tablet_manager.cc:1916] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.690122 29852 raft_consensus.cc:493] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.690306 29852 raft_consensus.cc:515] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.691087 29852 leader_election.cc:290] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.691385 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fd835dc9ea8f4041b36c069dcac9d69a" } modify_external_catalogs: true
I20260617 20:16:50.691591 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fd835dc9ea8f4041b36c069dcac9d69a" } modify_external_catalogs: true
W20260617 20:16:50.692610 29198 leader_election.cc:343] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 216f91e7bda148bc9334b19e3c868910
I20260617 20:16:50.694020 29383 tablet_bootstrap.cc:492] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:50.695111 29383 ts_tablet_manager.cc:1403] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.080s user 0.001s sys 0.005s
I20260617 20:16:50.696116 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 9d4702c06d3442ac966ef2daca8d4660 (table default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]) successfully deleted
W20260617 20:16:50.696456 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet b1b3565799894d82a3cc29ab2a19307c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1b3565799894d82a3cc29ab2a19307c already in progress: creating tablet
I20260617 20:16:50.696914 29383 raft_consensus.cc:359] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.697124 29383 raft_consensus.cc:385] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.697220 29383 raft_consensus.cc:740] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.701522 29383 consensus_queue.cc:260] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.703173 29383 ts_tablet_manager.cc:1434] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 20:16:50.703655 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:50.705263 29197 leader_election.cc:343] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 216f91e7bda148bc9334b19e3c868910
I20260617 20:16:50.705394 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab with delete_type TABLET_DATA_DELETED (replaced by tablet b4dbefbe5234458cb299410ddb2c73a3) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.705482 29197 leader_election.cc:304] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:50.705928 29852 raft_consensus.cc:2749] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:50.709671 29383 tablet_bootstrap.cc:492] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:50.709674 28961 tablet_service.cc:1511] Processing CreateTablet for tablet f02529cd1e764a3886de27d86e9690e3 (DEFAULT_TABLE table=default.Table_e45ba70d8b294bf99ddca3f80857df76 [id=7a4a3c7360114f72b54f5dd645215114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.710390 29099 tablet_service.cc:1511] Processing CreateTablet for tablet f02529cd1e764a3886de27d86e9690e3 (DEFAULT_TABLE table=default.Table_e45ba70d8b294bf99ddca3f80857df76 [id=7a4a3c7360114f72b54f5dd645215114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.711541 29383 tablet_bootstrap.cc:654] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.718221 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 203666e6127b49ed92731bc87ce01798 (DEFAULT_TABLE table=default.Table_4b6a1b4f97184d0eb8200cf926039a32 [id=37131dec7c6a44cb9c9aed3a27a5028a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.718653 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203666e6127b49ed92731bc87ce01798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.725128 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02529cd1e764a3886de27d86e9690e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.725240 29232 tablet_service.cc:1511] Processing CreateTablet for tablet f02529cd1e764a3886de27d86e9690e3 (DEFAULT_TABLE table=default.Table_e45ba70d8b294bf99ddca3f80857df76 [id=7a4a3c7360114f72b54f5dd645215114]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.725741 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02529cd1e764a3886de27d86e9690e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.728562 29376 ts_tablet_manager.cc:1929] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:50.728770 29376 log.cc:1199] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/dd2df17b35a7483b93a6e89d42ac1a62
I20260617 20:16:50.729259 29376 ts_tablet_manager.cc:1950] T dd2df17b35a7483b93a6e89d42ac1a62 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:50.730273 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 233) took 2739 ms. Trace:
I20260617 20:16:50.730715 29376 rpcz_store.cc:276] 0617 20:16:47.990723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:47.990791 (+ 68us) service_pool.cc:224] Handling call
0617 20:16:50.676673 (+2685882us) ts_tablet_manager.cc:1151] Deleting tablet dd2df17b35a7483b93a6e89d42ac1a62
0617 20:16:50.676681 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.706596 (+ 29915us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.728488 (+ 21892us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.730215 (+ 1727us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2663386}
I20260617 20:16:50.731266 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet e59430dd630b4ca6b573ea4230212abf
I20260617 20:16:50.731350 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet dd2df17b35a7483b93a6e89d42ac1a62 (table default.Table_5309bfd681fb429ca8e543eb2f52fada [id=32c61aa9610e428fa8d5c794b078e0a1]) successfully deleted
I20260617 20:16:50.732059 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40" } modify_external_catalogs: true
I20260617 20:16:50.732262 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40" } modify_external_catalogs: true
I20260617 20:16:50.732923 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a7b59053006046e98d27c694808ca34d
I20260617 20:16:50.732993 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 240) took 2582 ms. Trace:
I20260617 20:16:50.733084 29376 rpcz_store.cc:276] 0617 20:16:48.150323 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.150384 (+ 61us) service_pool.cc:224] Handling call
0617 20:16:50.732798 (+2582414us) ts_tablet_manager.cc:1151] Deleting tablet 3e287ba95be7408b8fc75e6f0709d8f1
0617 20:16:50.732809 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.732941 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2581459}
I20260617 20:16:50.733471 28669 catalog_manager.cc:6784] ReplaceTablet: tablet a7b59053006046e98d27c694808ca34d deleted and replaced by tablet 5eaddd6519dc490c8358be629b21a2d9
I20260617 20:16:50.733451 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet e59430dd630b4ca6b573ea4230212abf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.733572 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a76b0744ef2a472091999681d5639fec
I20260617 20:16:50.733762 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b97c17b55aa74ddc8b66886867dbdd40" } new_table_name: "default.Table_beb2513cd34e4d5ebfadfcf15dfb3ad9" modify_external_catalogs: true
I20260617 20:16:50.734088 28667 catalog_manager.cc:6784] ReplaceTablet: tablet a76b0744ef2a472091999681d5639fec deleted and replaced by tablet a3e20a1092b746a8b8ddd4386a682229
I20260617 20:16:50.734508 29383 tablet_bootstrap.cc:492] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:50.734459 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6e3a4cd286c74acca399a55d5202d4ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:50.734673 29383 ts_tablet_manager.cc:1403] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.001s
W20260617 20:16:50.735028 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e3a4cd286c74acca399a55d5202d4ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.735476 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9c108f2be5f14aa3a1a939e8c6bb18ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:50.735680 29383 raft_consensus.cc:359] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.735953 29383 raft_consensus.cc:385] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 20:16:50.736001 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c108f2be5f14aa3a1a939e8c6bb18ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.736042 29383 raft_consensus.cc:740] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.736326 29383 consensus_queue.cc:260] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.736717 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_12d399d17f9f409981bfd90c85d8b012" } new_table_name: "default.Table_1bde48f5ad7a4a8194df9687d8971c33" modify_external_catalogs: true
I20260617 20:16:50.736827 29383 ts_tablet_manager.cc:1434] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:50.737172 29740 raft_consensus.cc:493] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.737334 29740 raft_consensus.cc:515] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.737994 29740 leader_election.cc:290] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.740176 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet e59430dd630b4ca6b573ea4230212abf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:50.741796 29198 leader_election.cc:343] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 9d2a38be2e8e4796a98f1ae1d011249f
I20260617 20:16:50.737574 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f4de5dafb1474de1911148bb3b4527cf
I20260617 20:16:50.745214 28664 catalog_manager.cc:6784] ReplaceTablet: tablet f4de5dafb1474de1911148bb3b4527cf deleted and replaced by tablet e7eb77c619e04c448a084638668dbb6a
I20260617 20:16:50.747115 29383 tablet_bootstrap.cc:492] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:50.739506 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:50.748975 28668 catalog_manager.cc:5696] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194). New cstate: current_term: 1 leader_uuid: "6d4ce30e1fce4591b64c398747f8d37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:50.735028 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f8e0c5d20a4548cc8124302aa38bcb21
I20260617 20:16:50.749610 29383 tablet_bootstrap.cc:654] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.749840 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet f4de5dafb1474de1911148bb3b4527cf with delete_type TABLET_DATA_DELETED (replaced by tablet e7eb77c619e04c448a084638668dbb6a) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.750082 28964 tablet_service.cc:1558] Processing DeleteTablet for tablet e59430dd630b4ca6b573ea4230212abf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.750118 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a8e9291823da48e8bb5bba46960e407d" } new_table_name: "default.Table_1ce996ccf50542bfb287108b493eb4cc" modify_external_catalogs: true
I20260617 20:16:50.750231 29376 tablet_replica.cc:333] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:50.750432 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet a7b59053006046e98d27c694808ca34d with delete_type TABLET_DATA_DELETED (replaced by tablet 5eaddd6519dc490c8358be629b21a2d9) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.750525 29376 raft_consensus.cc:2243] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.750720 29376 raft_consensus.cc:2272] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.751093 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet a76b0744ef2a472091999681d5639fec with delete_type TABLET_DATA_DELETED (replaced by tablet a3e20a1092b746a8b8ddd4386a682229) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.751286 29376 ts_tablet_manager.cc:1916] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.751327 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet a76b0744ef2a472091999681d5639fec with delete_type TABLET_DATA_DELETED (replaced by tablet a3e20a1092b746a8b8ddd4386a682229) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.751515 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet a7b59053006046e98d27c694808ca34d with delete_type TABLET_DATA_DELETED (replaced by tablet 5eaddd6519dc490c8358be629b21a2d9) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:50.752339 29197 leader_election.cc:343] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 9d2a38be2e8e4796a98f1ae1d011249f
I20260617 20:16:50.752511 29197 leader_election.cc:304] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:50.752635 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.752933 29852 raft_consensus.cc:2749] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:50.753129 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_921dd6771a094e7cb638a0bcd034177e [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 2 got 0
I20260617 20:16:50.753224 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 9d2a38be2e8e4796a98f1ae1d011249f with delete_type TABLET_DATA_DELETED (replaced by tablet e58fbec4a9f14ddda42b5a4c0263972c) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.753901 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet f4de5dafb1474de1911148bb3b4527cf with delete_type TABLET_DATA_DELETED (replaced by tablet e7eb77c619e04c448a084638668dbb6a) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.758412 29376 ts_tablet_manager.cc:1929] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:16:50.758637 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74c73ae1007d44ce958ad02fa5787651 has no consensus state
I20260617 20:16:50.759392 29376 log.cc:1199] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/00f16ff3bc57434592d1648c4944c157
I20260617 20:16:50.760015 29376 ts_tablet_manager.cc:1950] T 00f16ff3bc57434592d1648c4944c157 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:50.761322 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 242) took 2548 ms. Trace:
I20260617 20:16:50.761276 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_429e918201e84c0ab85d77c4cef3f02a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.761919 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_429e918201e84c0ab85d77c4cef3f02a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.762507 29376 rpcz_store.cc:276] 0617 20:16:48.212359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.212478 (+ 119us) service_pool.cc:224] Handling call
0617 20:16:50.750148 (+2537670us) ts_tablet_manager.cc:1151] Deleting tablet 00f16ff3bc57434592d1648c4944c157
0617 20:16:50.750160 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.754596 (+ 4436us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.758322 (+ 3726us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.761266 (+ 2944us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2534399}
I20260617 20:16:50.763310 29833 catalog_manager.cc:1637] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260617 20:16:50.763411 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 243) took 2531 ms. Trace:
I20260617 20:16:50.763952 29376 rpcz_store.cc:276] 0617 20:16:48.231665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.231862 (+ 197us) service_pool.cc:224] Handling call
0617 20:16:50.763259 (+2531397us) ts_tablet_manager.cc:1151] Deleting tablet 569e339c17764486a65a1c3b43c92adf
0617 20:16:50.763268 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.763380 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2531129}
I20260617 20:16:50.764918 29376 tablet_replica.cc:333] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:50.765282 29376 raft_consensus.cc:2243] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:50.765826 29376 raft_consensus.cc:2272] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:50.766633 29376 ts_tablet_manager.cc:1916] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:50.766644 28968 tablet_service.cc:1511] Processing CreateTablet for tablet cbeae97639fd4e6290768dae12f6a4ce (DEFAULT_TABLE table=default.Table_afafb0c05ae94a57a881021813c028a4 [id=95a0bdbc8666443dbd27f9572c6ecb8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.767083 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbeae97639fd4e6290768dae12f6a4ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.769989 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e0ae686c2b804b42b8468bcc50fc9a61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.771193 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0ae686c2b804b42b8468bcc50fc9a61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.771234 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 87d0e2ecc16e4285a1d8337a5336caf2 (DEFAULT_TABLE table=default.Table_2420afe282984f72ab42715fbc33380a [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.772025 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d0e2ecc16e4285a1d8337a5336caf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.772883 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:50.773193 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3e287ba95be7408b8fc75e6f0709d8f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e287ba95be7408b8fc75e6f0709d8f1 already in progress: creating tablet
I20260617 20:16:50.773445 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 00f16ff3bc57434592d1648c4944c157 (table default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]) successfully deleted
I20260617 20:16:50.773545 28964 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3032155e4e4ea8a23984f547d78752 (DEFAULT_TABLE table=default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:50.773666 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 569e339c17764486a65a1c3b43c92adf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 569e339c17764486a65a1c3b43c92adf already in progress: creating tablet
I20260617 20:16:50.774384 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3032155e4e4ea8a23984f547d78752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.776240 29242 tablet_service.cc:1511] Processing CreateTablet for tablet cbeae97639fd4e6290768dae12f6a4ce (DEFAULT_TABLE table=default.Table_afafb0c05ae94a57a881021813c028a4 [id=95a0bdbc8666443dbd27f9572c6ecb8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.776875 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbeae97639fd4e6290768dae12f6a4ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.778121 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3032155e4e4ea8a23984f547d78752 (DEFAULT_TABLE table=default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.778502 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3032155e4e4ea8a23984f547d78752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.779266 29107 tablet_service.cc:1511] Processing CreateTablet for tablet adbc3219639748d9a0d71d45ae22ab36 (DEFAULT_TABLE table=default.Table_fb9bfca9839e45eab65f1350e50faa16 [id=b041ea39e57947919cb6744251af1ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.781612 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 87d0e2ecc16e4285a1d8337a5336caf2 (DEFAULT_TABLE table=default.Table_2420afe282984f72ab42715fbc33380a [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.781677 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3032155e4e4ea8a23984f547d78752 (DEFAULT_TABLE table=default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.782002 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d0e2ecc16e4285a1d8337a5336caf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.786163 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e45ba70d8b294bf99ddca3f80857df76" } new_table_name: "default.Table_fcf0d313e34c4117a4d36e5638a1a4b4" modify_external_catalogs: true
W20260617 20:16:50.790107 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d738ab2f8c784c76947a3a76bd040219 consensus state has no leader
W20260617 20:16:50.799784 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08911643f3ca451d80e2471b1b5b2342 consensus state has no leader
I20260617 20:16:50.800477 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1666eb767add47a487e4c3dc5f691a35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.801038 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1666eb767add47a487e4c3dc5f691a35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.801556 29879 tablet.cc:1724] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:16:50.802227 29236 tablet_service.cc:1511] Processing CreateTablet for tablet adbc3219639748d9a0d71d45ae22ab36 (DEFAULT_TABLE table=default.Table_fb9bfca9839e45eab65f1350e50faa16 [id=b041ea39e57947919cb6744251af1ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.804814 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbc3219639748d9a0d71d45ae22ab36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.802896 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.810794 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet b62b22ff17964ee6934023fb85e0b7ec (table default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886]). Expected version 2 got 0
I20260617 20:16:50.811116 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:50.811873 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 65af976b808d42d4aeded71a00cf7252
I20260617 20:16:50.813432 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 60a43dd885aa4411a4177b67807b0ac4
I20260617 20:16:50.815337 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 113fbbc739d04f529e82bc1cf1074bd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 75519f97f1ce49ceb3a739ba7c7bc239) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.815694 29098 tablet_service.cc:1558] Processing DeleteTablet for tablet 4332e33d60964bd6a0c7e7caaa6bdc76 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.815900 29103 tablet_service.cc:1558] Processing DeleteTablet for tablet 65af976b808d42d4aeded71a00cf7252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.815908 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 60a43dd885aa4411a4177b67807b0ac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.816989 28956 tablet_service.cc:1511] Processing CreateTablet for tablet adbc3219639748d9a0d71d45ae22ab36 (DEFAULT_TABLE table=default.Table_fb9bfca9839e45eab65f1350e50faa16 [id=b041ea39e57947919cb6744251af1ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.817507 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbc3219639748d9a0d71d45ae22ab36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.817550 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 65af976b808d42d4aeded71a00cf7252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.818209 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f85271eeb854194a968215ebc08f47a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.814652 28966 tablet_service.cc:1511] Processing CreateTablet for tablet c17aa7f99fc74838b9975c3e9289ccfd (DEFAULT_TABLE table=default.Table_43860bd130d547878e058c369421cbba [id=f62d71842e284523bbca857af62a367a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.820230 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 60a43dd885aa4411a4177b67807b0ac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.822300 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 65af976b808d42d4aeded71a00cf7252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.822880 29232 tablet_service.cc:1511] Processing CreateTablet for tablet c17aa7f99fc74838b9975c3e9289ccfd (DEFAULT_TABLE table=default.Table_43860bd130d547878e058c369421cbba [id=f62d71842e284523bbca857af62a367a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.823815 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17aa7f99fc74838b9975c3e9289ccfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.825089 28664 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b62b22ff17964ee6934023fb85e0b7ec (table default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886]). Expected version 2 got 0
I20260617 20:16:50.826467 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17aa7f99fc74838b9975c3e9289ccfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.826781 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_430bbaa8b17349048f8c2e456ddc650f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.827463 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_430bbaa8b17349048f8c2e456ddc650f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.828670 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 219d85e4fd9b4ba3baf1e08d2b18a32c (DEFAULT_TABLE table=default.Table_fae70178b45747a29dfd1be32d78cff6 [id=cbe52ba840694bfea51b5f0e1fe56cfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.828816 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet b62b22ff17964ee6934023fb85e0b7ec (table default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886]). Expected version 2 got 0
I20260617 20:16:50.829023 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219d85e4fd9b4ba3baf1e08d2b18a32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.829347 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 98467525f81f4a48878eae17e3a9c982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.830698 28953 tablet_service.cc:1511] Processing CreateTablet for tablet fa123fc62a594dd19f20b520760fe6c4 (DEFAULT_TABLE table=default.Table_d9c37095429e4a2c8300865cb8711a27 [id=dad13ba825d74009ad1899b403ab5745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.831560 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa123fc62a594dd19f20b520760fe6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.833451 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 370db89a92a6455190edaf80e5a56205 (DEFAULT_TABLE table=default.Table_a53260b7e2f34a0f9eadcfc43812a67c [id=1b48b6816fff4837bb9acf6a14bcd898]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.835984 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370db89a92a6455190edaf80e5a56205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.836784 29226 tablet_service.cc:1511] Processing CreateTablet for tablet fa123fc62a594dd19f20b520760fe6c4 (DEFAULT_TABLE table=default.Table_d9c37095429e4a2c8300865cb8711a27 [id=dad13ba825d74009ad1899b403ab5745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.837191 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa123fc62a594dd19f20b520760fe6c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:50.842554 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f02529cd1e764a3886de27d86e9690e3 consensus state has no leader
I20260617 20:16:50.844830 29376 ts_tablet_manager.cc:1929] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:50.845172 29376 log.cc:1199] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/751bffacfaa5427784de63d51fc903dd
I20260617 20:16:50.846805 29376 ts_tablet_manager.cc:1950] T 751bffacfaa5427784de63d51fc903dd P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:50.846868 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 370db89a92a6455190edaf80e5a56205 (DEFAULT_TABLE table=default.Table_a53260b7e2f34a0f9eadcfc43812a67c [id=1b48b6816fff4837bb9acf6a14bcd898]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.848716 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_270b09836c954e6c94328615b8059bb0" } modify_external_catalogs: true
I20260617 20:16:50.848951 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_270b09836c954e6c94328615b8059bb0" } modify_external_catalogs: true
I20260617 20:16:50.850800 29378 tablet_bootstrap.cc:654] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:50.853152 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 27c20f436b9b4a8cb659215f9579af04 (DEFAULT_TABLE table=default.Table_4dc5fdaaee2d4b54bb54160933394175 [id=f8657da5fd504f17aa1f82c1dba56187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.855916 29852 raft_consensus.cc:493] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.857827 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 7cafcade995b407f84f56b8cd3ab6892 (DEFAULT_TABLE table=default.Table_6cb2486917764383bc50fe8b80d84a07 [id=28482c1294b7476d96b490f73d8b9d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.859894 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 27c20f436b9b4a8cb659215f9579af04 (DEFAULT_TABLE table=default.Table_4dc5fdaaee2d4b54bb54160933394175 [id=f8657da5fd504f17aa1f82c1dba56187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.860743 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cafcade995b407f84f56b8cd3ab6892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.861794 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c20f436b9b4a8cb659215f9579af04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.864176 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 8e704d08c0da484a986c9d882a42e6f1
I20260617 20:16:50.867592 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e704d08c0da484a986c9d882a42e6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:50.873247 28957 tablet_service.cc:1511] Processing CreateTablet for tablet dee426100bb645f391be123aeb52e412 (DEFAULT_TABLE table=default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.874125 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee426100bb645f391be123aeb52e412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.876931 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 0eaa60028a1647e580a987c3a0836a24 (DEFAULT_TABLE table=default.Table_8a1228ed97634cd7a2eecc5b659406c3 [id=65896b3e02a240159d5500963dde03e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.878006 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eaa60028a1647e580a987c3a0836a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.880724 29852 raft_consensus.cc:515] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.881388 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 7cafcade995b407f84f56b8cd3ab6892 (DEFAULT_TABLE table=default.Table_6cb2486917764383bc50fe8b80d84a07 [id=28482c1294b7476d96b490f73d8b9d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.886183 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370db89a92a6455190edaf80e5a56205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.888386 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c0988a73d547d08d0924784bff9222" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:50.895924 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_be535849f7204c22b012cd569f777a9f" } new_table_name: "default.Table_e7c9eac3b94540da98ec3d751dbd0e66" modify_external_catalogs: true
W20260617 20:16:50.898784 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 195315us
I20260617 20:16:50.898954 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cd10b4e7345244ee8825544af6b6add1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:50.899010 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_80559e5b402d45f3965620a4955011f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.899458 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd10b4e7345244ee8825544af6b6add1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:50.899570 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80559e5b402d45f3965620a4955011f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.901149 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 27c20f436b9b4a8cb659215f9579af04 (DEFAULT_TABLE table=default.Table_4dc5fdaaee2d4b54bb54160933394175 [id=f8657da5fd504f17aa1f82c1dba56187]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.902777 29227 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e704d08c0da484a986c9d882a42e6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:50.906493 29852 leader_election.cc:290] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.907274 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cafcade995b407f84f56b8cd3ab6892. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:50.907362 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24e4b91def8642b7a8a063c06f43e060 consensus state has no leader
I20260617 20:16:50.908353 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 0eaa60028a1647e580a987c3a0836a24 (DEFAULT_TABLE table=default.Table_8a1228ed97634cd7a2eecc5b659406c3 [id=65896b3e02a240159d5500963dde03e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.916556 29233 tablet_service.cc:1511] Processing CreateTablet for tablet f14113dd9098456599d7b72626bedcd6 (DEFAULT_TABLE table=default.Table_b97bf3349f93422cbd2b08e176e4d5da [id=d50a3264b4d349dea980a3ad95ac87f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.924505 28665 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b62b22ff17964ee6934023fb85e0b7ec (table default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886]). Expected version 2 got 0
I20260617 20:16:50.925058 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 30f6dcc384154d41866cf8060cf05837 (DEFAULT_TABLE table=default.Table_1a988e93d48746dd823e6330382ee315 [id=9c7d75a5ae9147a2850f090b0c67ea33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.925324 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c20f436b9b4a8cb659215f9579af04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.926936 29225 tablet_service.cc:1511] Processing CreateTablet for tablet dee426100bb645f391be123aeb52e412 (DEFAULT_TABLE table=default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.927171 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14113dd9098456599d7b72626bedcd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.927596 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 245) took 2640 ms. Trace:
I20260617 20:16:50.933210 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eaa60028a1647e580a987c3a0836a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.933094 29879 tablet.cc:1724] T b62b22ff17964ee6934023fb85e0b7ec P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:50.935779 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fbaeb71321364cca9f5c971ee3419519" } modify_external_catalogs: true
I20260617 20:16:50.936008 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fbaeb71321364cca9f5c971ee3419519" } modify_external_catalogs: true
I20260617 20:16:50.938172 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 593d9de6a2fb47e18d86649e45ba80b9 (DEFAULT_TABLE table=default.Table_8cd5575879f54274afa3ecac3cc58ea7 [id=a7cecb2081fb4a37a1814fa7324f24a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.940711 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet b62b22ff17964ee6934023fb85e0b7ec (table default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886]). Expected version 2 got 0
I20260617 20:16:50.940939 29376 rpcz_store.cc:276] 0617 20:16:48.253368 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.253436 (+ 68us) service_pool.cc:224] Handling call
0617 20:16:50.764644 (+2511208us) ts_tablet_manager.cc:1151] Deleting tablet 751bffacfaa5427784de63d51fc903dd
0617 20:16:50.764655 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.774099 (+ 9444us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.826387 (+ 52288us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:50.893580 (+ 67193us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2510952}
I20260617 20:16:50.941577 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee426100bb645f391be123aeb52e412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.942973 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 751bffacfaa5427784de63d51fc903dd (table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]) successfully deleted
I20260617 20:16:50.942984 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet a76b0744ef2a472091999681d5639fec with delete_type TABLET_DATA_DELETED (replaced by tablet a3e20a1092b746a8b8ddd4386a682229) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.943115 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4187f9cfd1ac4fd0b4043202908b2c0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:50.943572 29104 tablet_service.cc:1511] Processing CreateTablet for tablet f14113dd9098456599d7b72626bedcd6 (DEFAULT_TABLE table=default.Table_b97bf3349f93422cbd2b08e176e4d5da [id=d50a3264b4d349dea980a3ad95ac87f8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:50.943714 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4187f9cfd1ac4fd0b4043202908b2c0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.944010 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet a7b59053006046e98d27c694808ca34d with delete_type TABLET_DATA_DELETED (replaced by tablet 5eaddd6519dc490c8358be629b21a2d9) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.944238 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e704d08c0da484a986c9d882a42e6f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.944641 29093 tablet_service.cc:1511] Processing CreateTablet for tablet dee426100bb645f391be123aeb52e412 (DEFAULT_TABLE table=default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.945063 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet f4de5dafb1474de1911148bb3b4527cf with delete_type TABLET_DATA_DELETED (replaced by tablet e7eb77c619e04c448a084638668dbb6a) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.945487 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 0eaa60028a1647e580a987c3a0836a24 (DEFAULT_TABLE table=default.Table_8a1228ed97634cd7a2eecc5b659406c3 [id=65896b3e02a240159d5500963dde03e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.945838 29101 tablet_service.cc:1511] Processing CreateTablet for tablet cbeae97639fd4e6290768dae12f6a4ce (DEFAULT_TABLE table=default.Table_afafb0c05ae94a57a881021813c028a4 [id=95a0bdbc8666443dbd27f9572c6ecb8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.946173 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 87d0e2ecc16e4285a1d8337a5336caf2 (DEFAULT_TABLE table=default.Table_2420afe282984f72ab42715fbc33380a [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.946285 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 593d9de6a2fb47e18d86649e45ba80b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.946883 29878 tablet.cc:1724] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:16:50.947261 29106 tablet_service.cc:1511] Processing CreateTablet for tablet c17aa7f99fc74838b9975c3e9289ccfd (DEFAULT_TABLE table=default.Table_43860bd130d547878e058c369421cbba [id=f62d71842e284523bbca857af62a367a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.947645 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet c65a4345552844fe9e7512105fd79877 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.947706 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.948004 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 30f6dcc384154d41866cf8060cf05837 (DEFAULT_TABLE table=default.Table_1a988e93d48746dd823e6330382ee315 [id=9c7d75a5ae9147a2850f090b0c67ea33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.948123 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 593d9de6a2fb47e18d86649e45ba80b9 (DEFAULT_TABLE table=default.Table_8cd5575879f54274afa3ecac3cc58ea7 [id=a7cecb2081fb4a37a1814fa7324f24a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.948302 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f6dcc384154d41866cf8060cf05837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.948333 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f32ebd7448843b48b981d3d70a87023 with delete_type TABLET_DATA_DELETED (replaced by tablet 44b9b042412f4b219c1dbbe4ed5cde1a) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.948508 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a9e12c91df344ee84a586b7d4a27071 with delete_type TABLET_DATA_DELETED (replaced by tablet 87d0e2ecc16e4285a1d8337a5336caf2) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.948669 29103 tablet_service.cc:1558] Processing DeleteTablet for tablet 60a43dd885aa4411a4177b67807b0ac4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.948830 29098 tablet_service.cc:1511] Processing CreateTablet for tablet 219d85e4fd9b4ba3baf1e08d2b18a32c (DEFAULT_TABLE table=default.Table_fae70178b45747a29dfd1be32d78cff6 [id=cbe52ba840694bfea51b5f0e1fe56cfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.949170 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 370db89a92a6455190edaf80e5a56205 (DEFAULT_TABLE table=default.Table_a53260b7e2f34a0f9eadcfc43812a67c [id=1b48b6816fff4837bb9acf6a14bcd898]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.949906 29884 tablet.cc:1724] T b62b22ff17964ee6934023fb85e0b7ec P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:50.949986 29783 consensus_queue.cc:1048] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260617 20:16:50.949666 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 7cafcade995b407f84f56b8cd3ab6892 (DEFAULT_TABLE table=default.Table_6cb2486917764383bc50fe8b80d84a07 [id=28482c1294b7476d96b490f73d8b9d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.949712 29728 raft_consensus.cc:493] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:50.950635 29728 raft_consensus.cc:515] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:50.949599 29089 tablet_service.cc:1511] Processing CreateTablet for tablet fa123fc62a594dd19f20b520760fe6c4 (DEFAULT_TABLE table=default.Table_d9c37095429e4a2c8300865cb8711a27 [id=dad13ba825d74009ad1899b403ab5745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.949869 29127 raft_consensus.cc:2468] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:50.949555 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet cc945cdd482f4a5593d4874e5303ecd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.951417 29728 leader_election.cc:290] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:50.953519 29198 leader_election.cc:304] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:50.949468 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f02529cd1e764a3886de27d86e9690e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.956859 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4f190a1005433ebcfbfe3a86aa9e70" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:50.957669 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1e0e98bdedab480c9d07bc266771250e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.958313 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e0e98bdedab480c9d07bc266771250e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.958384 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27c20f436b9b4a8cb659215f9579af04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.958745 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14113dd9098456599d7b72626bedcd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.959143 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 370db89a92a6455190edaf80e5a56205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.961436 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d0e2ecc16e4285a1d8337a5336caf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.961796 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbeae97639fd4e6290768dae12f6a4ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.965430 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cafcade995b407f84f56b8cd3ab6892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.965654 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219d85e4fd9b4ba3baf1e08d2b18a32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.949806 29379 tablet_bootstrap.cc:492] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:50.966192 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c17aa7f99fc74838b9975c3e9289ccfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.966499 28665 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet b4dbefbe5234458cb299410ddb2c73a3
I20260617 20:16:50.256155 29623 rpcz_store.cc:276] 0617 20:16:48.234109 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.234167 (+ 58us) service_pool.cc:224] Handling call
0617 20:16:48.242251 (+ 8084us) raft_consensus.cc:1471] Updating replica for 316 ops
0617 20:16:48.326276 (+ 84025us) raft_consensus.cc:1534] Early marking committed up to index 0
0617 20:16:48.326284 (+ 8us) raft_consensus.cc:1539] Triggering prepare for 316 ops
0617 20:16:48.388296 (+ 62012us) write_op.cc:270] Start()
0617 20:16:48.388364 (+ 68us) write_op.cc:276] Timestamp: P: 1781727403317089 usec, L: 0
0617 20:16:48.687898 (+299534us) write_op.cc:270] Start()
0617 20:16:48.687943 (+ 45us) write_op.cc:276] Timestamp: P: 1781727403317913 usec, L: 0
0617 20:16:48.688209 (+ 266us) write_op.cc:270] Start()
0617 20:16:48.688252 (+ 43us) write_op.cc:276] Timestamp: P: 1781727403318596 usec, L: 0
0617 20:16:48.688490 (+ 238us) write_op.cc:270] Start()
0617 20:16:48.688518 (+ 28us) write_op.cc:276] Timestamp: P: 1781727403319237 usec, L: 0
0617 20:16:48.688737 (+ 219us) write_op.cc:270] Start()
0617 20:16:48.688764 (+ 27us) write_op.cc:276] Timestamp: P: 1781727403319873 usec, L: 0
0617 20:16:48.688929 (+ 165us) write_op.cc:270] Start()
0617 20:16:48.688956 (+ 27us) write_op.cc:276] Timestamp: P: 1781727403320487 usec, L: 0
0617 20:16:48.689120 (+ 164us) write_op.cc:270] Start()
0617 20:16:48.689175 (+ 55us) write_op.cc:276] Timestamp: P: 1781727403321136 usec, L: 0
0617 20:16:48.689396 (+ 221us) write_op.cc:270] Start()
0617 20:16:48.689427 (+ 31us) write_op.cc:276] Timestamp: P: 1781727403321801 usec, L: 0
0617 20:16:48.689601 (+ 174us) write_op.cc:270] Start()
0617 20:16:48.689625 (+ 24us) write_op.cc:276] Timestamp: P: 1781727403322465 usec, L: 0
0617 20:16:48.689764 (+ 139us) write_op.cc:270] Start()
0617 20:16:48.689786 (+ 22us) write_op.cc:276] Timestamp: P: 1781727403386470 usec, L: 0
0617 20:16:48.689969 (+ 183us) write_op.cc:270] Start()
0617 20:16:48.689992 (+ 23us) write_op.cc:276] Timestamp: P: 1781727403387343 usec, L: 0
0617 20:16:48.690151 (+ 159us) write_op.cc:270] Start()
0617 20:16:48.690174 (+ 23us) write_op.cc:276] Timestamp: P: 1781727403391536 usec, L: 0
0617 20:16:48.690363 (+ 189us) write_op.cc:270] Start()
0617 20:16:48.690394 (+ 31us) write_op.cc:276] Timestamp: P: 1781727403392112 usec, L: 0
0617 20:16:48.690593 (+ 199us) write_op.cc:270] Start()
0617 20:16:48.690626 (+ 33us) write_op.cc:276] Timestamp: P: 1781727403392621 usec, L: 0
0617 20:16:48.690812 (+ 186us) write_op.cc:270] Start()
0617 20:16:48.690831 (+ 19us) write_op.cc:276] Timestamp: P: 1781727403393636 usec, L: 0
0617 20:16:48.691008 (+ 177us) write_op.cc:270] Start()
0617 20:16:48.691035 (+ 27us) write_op.cc:276] Timestamp: P: 1781727403408755 usec, L: 0
0617 20:16:48.691216 (+ 181us) write_op.cc:270] Start()
0617 20:16:48.691253 (+ 37us) write_op.cc:276] Timestamp: P: 1781727403409514 usec, L: 0
0617 20:16:48.691449 (+ 196us) write_op.cc:270] Start()
0617 20:16:48.691475 (+ 26us) write_op.cc:276] Timestamp: P: 1781727403410108 usec, L: 0
0617 20:16:48.691657 (+ 182us) write_op.cc:270] Start()
0617 20:16:48.691684 (+ 27us) write_op.cc:276] Timestamp: P: 1781727403410633 usec, L: 0
0617 20:16:48.691870 (+ 186us) write_op.cc:270] Start()
0617 20:16:48.691897 (+ 27us) write_op.cc:276] Timestamp: P: 1781727403412112 usec, L: 0
0617 20:16:48.692063 (+ 166us) write_op.cc:270] Start()
0617 20:16:48.692088 (+ 25us) write_op.cc:276] Timestamp: P: 1781727403571443 usec, L: 0
0617 20:16:48.711262 (+ 19174us) write_op.cc:270] Start()
0617 20:16:48.711300 (+ 38us) write_op.cc:276] Timestamp: P: 1781727403572228 usec, L: 0
0617 20:16:48.711546 (+ 246us) write_op.cc:270] Start()
0617 20:16:48.711572 (+ 26us) write_op.cc:276] Timestamp: P: 1781727403582127 usec, L: 0
0617 20:16:48.711724 (+ 152us) write_op.cc:270] Start()
0617 20:16:48.711745 (+ 21us) write_op.cc:276] Timestamp: P: 1781727403587942 usec, L: 0
0617 20:16:48.711967 (+ 222us) write_op.cc:270] Start()
0617 20:16:48.711991 (+ 24us) write_op.cc:276] Timestamp: P: 1781727403633628 usec, L: 0
0617 20:16:48.712142 (+ 151us) write_op.cc:270] Start()
0617 20:16:48.712169 (+ 27us) write_op.cc:276] Timestamp: P: 1781727403634702 usec, L: 0
0617 20:16:48.712296 (+ 127us) write_op.cc:270] Start()
0617 20:16:48.712316 (+ 20us) write_op.cc:276] Timestamp: P: 1781727403635556 usec, L: 0
0617 20:16:48.712497 (+ 181us) write_op.cc:270] Start()
0617 20:16:48.712519 (+ 22us) write_op.cc:276] Timestamp: P: 1781727403636297 usec, L: 0
0617 20:16:48.731163 (+ 18644us) write_op.cc:270] Start()
0617 20:16:48.731202 (+ 39us) write_op.cc:276] Timestamp: P: 1781727403637225 usec, L: 0
0617 20:16:48.731441 (+ 239us) write_op.cc:270] Start()
0617 20:16:48.731468 (+ 27us) write_op.cc:276] Timestamp: P: 1781727403637937 usec, L: 0
0617 20:16:48.731647 (+ 179us) write_op.cc:270] Start()
0617 20:16:48.731669 (+ 22us) write_op.cc:276] Timestamp: P: 1781727403641223 usec, L: 0
0617 20:16:48.731799 (+ 130us) write_op.cc:270] Start()
0617 20:16:48.731819 (+ 20us) write_op.cc:276] Timestamp: P: 1781727403646658 usec, L: 0
0617 20:16:48.813992 (+ 82173us) write_op.cc:270] Start()
0617 20:16:48.814052 (+ 60us) write_op.cc:276] Timestamp: P: 1781727403655034 usec, L: 0
0617 20:16:48.814590 (+ 538us) write_op.cc:270] Start()
0617 20:16:48.820498 (+ 5908us) write_op.cc:276] Timestamp: P: 1781727403655605 usec, L: 0
0617 20:16:48.820806 (+ 308us) write_op.cc:270] Start()
0617 20:16:48.820833 (+ 27us) write_op.cc:276] Timestamp: P: 1781727403689786 usec, L: 0
0617 20:16:48.820999 (+ 166us) write_op.cc:270] Start()
0617 20:16:48.821021 (+ 22us) write_op.cc:276] Timestamp: P: 1781727403701464 usec, L: 0
0617 20:16:48.821169 (+ 148us) write_op.cc:270] Start()
0617 20:16:48.821203 (+ 34us) write_op.cc:276] Timestamp: P: 1781727403702206 usec, L: 0
0617 20:16:48.845963 (+ 24760us) write_op.cc:270] Start()
0617 20:16:48.846006 (+ 43us) write_op.cc:276] Timestamp: P: 1781727403702961 usec, L: 0
0617 20:16:48.872197 (+ 26191us) write_op.cc:270] Start()
0617 20:16:48.872250 (+ 53us) write_op.cc:276] Timestamp: P: 1781727403722122 usec, L: 0
0617 20:16:48.873589 (+ 1339us) write_op.cc:270] Start()
0617 20:16:48.873620 (+ 31us) write_op.cc:276] Timestamp: P: 1781727403728896 usec, L: 0
0617 20:16:48.873787 (+ 167us) write_op.cc:270] Start()
0617 20:16:48.873809 (+ 22us) write_op.cc:276] Timestamp: P: 1781727403733817 usec, L: 0
0617 20:16:48.873955 (+ 146us) write_op.cc:270] Start()
0617 20:16:48.873977 (+ 22us) write_op.cc:276] Timestamp: P: 1781727403753547 usec, L: 0
0617 20:16:48.874132 (+ 155us) write_op.cc:270] Start()
0617 20:16:48.874154 (+ 22us) write_op.cc:276] Timestamp: P: 1781727403760974 usec, L: 0
0617 20:16:48.874301 (+ 147us) write_op.cc:270] Start()
0617 20:16:48.874322 (+ 21us) write_op.cc:276] Timestamp: P: 1781727403766441 usec, L: 0
0617 20:16:48.874450 (+ 128us) write_op.cc:270] Start()
0617 20:16:48.874470 (+ 20us) write_op.cc:276] Timestamp: P: 1781727403791647 usec, L: 0
0617 20:16:48.874610 (+ 140us) write_op.cc:270] Start()
0617 20:16:48.874633 (+ 23us) write_op.cc:276] Timestamp: P: 1781727403805329 usec, L: 0
0617 20:16:48.874809 (+ 176us) write_op.cc:270] Start()
0617 20:16:48.874827 (+ 18us) write_op.cc:276] Timestamp: P: 1781727403813541 usec, L: 0
0617 20:16:48.874938 (+ 111us) write_op.cc:270] Start()
0617 20:16:48.874958 (+ 20us) write_op.cc:276] Timestamp: P: 1781727403869008 usec, L: 0
0617 20:16:48.875089 (+ 131us) write_op.cc:270] Start()
0617 20:16:48.875107 (+ 18us) write_op.cc:276] Timestamp: P: 1781727403869839 usec, L: 0
0617 20:16:48.875224 (+ 117us) write_op.cc:270] Start()
0617 20:16:48.875247 (+ 23us) write_op.cc:276] Timestamp: P: 1781727403883801 usec, L: 0
0617 20:16:48.875464 (+ 217us) write_op.cc:270] Start()
0617 20:16:48.875509 (+ 45us) write_op.cc:276] Timestamp: P: 1781727403884478 usec, L: 0
0617 20:16:48.875665 (+ 156us) write_op.cc:270] Start()
0617 20:16:48.875686 (+ 21us) write_op.cc:276] Timestamp: P: 1781727403885045 usec, L: 0
0617 20:16:48.875821 (+ 135us) write_op.cc:270] Start()
0617 20:16:48.875839 (+ 18us) write_op.cc:276] Timestamp: P: 1781727403885630 usec, L: 0
0617 20:16:48.875966 (+ 127us) write_op.cc:270] Start()
0617 20:16:48.875986 (+ 20us) write_op.cc:276] Timestamp: P: 1781727403886223 usec, L: 0
0617 20:16:48.876146 (+ 160us) write_op.cc:270] Start()
0617 20:16:48.876168 (+ 22us) write_op.cc:276] Timestamp: P: 1781727403886745 usec, L: 0
0617 20:16:48.876313 (+ 145us) write_op.cc:270] Start()
0617 20:16:48.876331 (+ 18us) write_op.cc:276] Timestamp: P: 1781727403891912 usec, L: 0
0617 20:16:48.876453 (+ 122us) write_op.cc:270] Start()
0617 20:16:48.876471 (+ 18us) write_op.cc:276] Timestamp: P: 1781727403979445 usec, L: 0
0617 20:16:48.876605 (+ 134us) write_op.cc:270] Start()
0617 20:16:48.876635 (+ 30us) write_op.cc:276] Timestamp: P: 1781727403991056 usec, L: 0
0617 20:16:48.876763 (+ 128us) write_op.cc:270] Start()
0617 20:16:48.876782 (+ 19us) write_op.cc:276] Timestamp: P: 1781727404000067 usec, L: 0
0617 20:16:48.876912 (+ 130us) write_op.cc:270] Start()
0617 20:16:48.876948 (+ 36us) write_op.cc:276] Timestamp: P: 1781727404003477 usec, L: 0
0617 20:16:48.877121 (+ 173us) write_op.cc:270] Start()
0617 20:16:48.877144 (+ 23us) write_op.cc:276] Timestamp: P: 1781727404010064 usec, L: 0
0617 20:16:48.963801 (+ 86657us) write_op.cc:270] Start()
0617 20:16:48.963856 (+ 55us) write_op.cc:276] Timestamp: P: 1781727404061633 usec, L: 0
0617 20:16:48.964123 (+ 267us) write_op.cc:270] Start()
0617 20:16:48.964151 (+ 28us) write_op.cc:276] Timestamp: P: 1781727404090037 usec, L: 0
0617 20:16:48.964327 (+ 176us) write_op.cc:270] Start()
0617 20:16:48.964364 (+ 37us) write_op.cc:276] Timestamp: P: 1781727404090759 usec, L: 0
0617 20:16:48.965771 (+ 1407us) write_op.cc:270] Start()
0617 20:16:48.965799 (+ 28us) write_op.cc:276] Timestamp: P: 1781727404091341 usec, L: 0
0617 20:16:48.966031 (+ 232us) write_op.cc:270] Start()
0617 20:16:48.966056 (+ 25us) write_op.cc:276] Timestamp: P: 1781727404091902 usec, L: 0
0617 20:16:48.966214 (+ 158us) write_op.cc:270] Start()
0617 20:16:48.966237 (+ 23us) write_op.cc:276] Timestamp: P: 1781727404092447 usec, L: 0
0617 20:16:48.966395 (+ 158us) write_op.cc:270] Start()
0617 20:16:48.966416 (+ 21us) write_op.cc:276] Timestamp: P: 1781727404119705 usec, L: 0
0617 20:16:48.966550 (+ 134us) write_op.cc:270] Start()
0617 20:16:48.966569 (+ 19us) write_op.cc:276] Timestamp: P: 1781727404121065 usec, L: 0
0617 20:16:48.966695 (+ 126us) write_op.cc:270] Start()
0617 20:16:48.966730 (+ 35us) write_op.cc:276] Timestamp: P: 1781727404139841 usec, L: 0
0617 20:16:48.966864 (+ 134us) write_op.cc:270] Start()
0617 20:16:48.966888 (+ 24us) write_op.cc:276] Timestamp: P: 1781727404143092 usec, L: 0
0617 20:16:48.967036 (+ 148us) write_op.cc:270] Start()
0617 20:16:48.967055 (+ 19us) write_op.cc:276] Timestamp: P: 1781727404144359 usec, L: 0
0617 20:16:48.967179 (+ 124us) write_op.cc:270] Start()
0617 20:16:48.967198 (+ 19us) write_op.cc:276] Timestamp: P: 1781727404168732 usec, L: 0
0617 20:16:48.967305 (+ 107us) write_op.cc:270] Start()
0617 20:16:48.967323 (+ 18us) write_op.cc:276] Timestamp: P: 1781727404197687 usec, L: 0
0617 20:16:48.967463 (+ 140us) write_op.cc:270] Start()
0617 20:16:48.967485 (+ 22us) write_op.cc:276] Timestamp: P: 1781727404213705 usec, L: 0
0617 20:16:48.967637 (+ 152us) write_op.cc:270] Start()
0617 20:16:48.967658 (+ 21us) write_op.cc:276] Timestamp: P: 1781727404223326 usec, L: 0
0617 20:16:49.045573 (+ 77915us) write_op.cc:270] Start()
0617 20:16:49.045615 (+ 42us) write_op.cc:276] Timestamp: P: 1781727404233789 usec, L: 0
0617 20:16:49.045833 (+ 218us) write_op.cc:270] Start()
0617 20:16:49.045860 (+ 27us) write_op.cc:276] Timestamp: P: 1781727404252520 usec, L: 0
0617 20:16:49.046009 (+ 149us) write_op.cc:270] Start()
0617 20:16:49.046054 (+ 45us) write_op.cc:276] Timestamp: P: 1781727404261223 usec, L: 0
0617 20:16:49.062149 (+ 16095us) write_op.cc:270] Start()
0617 20:16:49.062186 (+ 37us) write_op.cc:276] Timestamp: P: 1781727404277034 usec, L: 0
0617 20:16:49.062417 (+ 231us) write_op.cc:270] Start()
0617 20:16:49.062437 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404285649 usec, L: 0
0617 20:16:49.062594 (+ 157us) write_op.cc:270] Start()
0617 20:16:49.062616 (+ 22us) write_op.cc:276] Timestamp: P: 1781727404304981 usec, L: 0
0617 20:16:49.062764 (+ 148us) write_op.cc:270] Start()
0617 20:16:49.062783 (+ 19us) write_op.cc:276] Timestamp: P: 1781727404324646 usec, L: 0
0617 20:16:49.062943 (+ 160us) write_op.cc:270] Start()
0617 20:16:49.062963 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404334720 usec, L: 0
0617 20:16:49.063095 (+ 132us) write_op.cc:270] Start()
0617 20:16:49.063112 (+ 17us) write_op.cc:276] Timestamp: P: 1781727404353371 usec, L: 0
0617 20:16:49.063243 (+ 131us) write_op.cc:270] Start()
0617 20:16:49.063260 (+ 17us) write_op.cc:276] Timestamp: P: 1781727404365947 usec, L: 0
0617 20:16:49.063387 (+ 127us) write_op.cc:270] Start()
0617 20:16:49.063410 (+ 23us) write_op.cc:276] Timestamp: P: 1781727404383042 usec, L: 0
0617 20:16:49.063554 (+ 144us) write_op.cc:270] Start()
0617 20:16:49.063573 (+ 19us) write_op.cc:276] Timestamp: P: 1781727404401386 usec, L: 0
0617 20:16:49.063713 (+ 140us) write_op.cc:270] Start()
0617 20:16:49.063736 (+ 23us) write_op.cc:276] Timestamp: P: 1781727404407577 usec, L: 0
0617 20:16:49.063889 (+ 153us) write_op.cc:270] Start()
0617 20:16:49.063910 (+ 21us) write_op.cc:276] Timestamp: P: 1781727404423326 usec, L: 0
0617 20:16:49.064045 (+ 135us) write_op.cc:270] Start()
0617 20:16:49.064065 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404441109 usec, L: 0
0617 20:16:49.064214 (+ 149us) write_op.cc:270] Start()
0617 20:16:49.064234 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404451246 usec, L: 0
0617 20:16:49.064380 (+ 146us) write_op.cc:270] Start()
0617 20:16:49.064402 (+ 22us) write_op.cc:276] Timestamp: P: 1781727404469750 usec, L: 0
0617 20:16:49.064544 (+ 142us) write_op.cc:270] Start()
0617 20:16:49.064570 (+ 26us) write_op.cc:276] Timestamp: P: 1781727404483748 usec, L: 0
0617 20:16:49.064727 (+ 157us) write_op.cc:270] Start()
0617 20:16:49.064751 (+ 24us) write_op.cc:276] Timestamp: P: 1781727404504272 usec, L: 0
0617 20:16:49.064922 (+ 171us) write_op.cc:270] Start()
0617 20:16:49.064946 (+ 24us) write_op.cc:276] Timestamp: P: 1781727404519404 usec, L: 0
0617 20:16:49.065076 (+ 130us) write_op.cc:270] Start()
0617 20:16:49.065093 (+ 17us) write_op.cc:276] Timestamp: P: 1781727404525571 usec, L: 0
0617 20:16:49.065226 (+ 133us) write_op.cc:270] Start()
0617 20:16:49.065246 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404542275 usec, L: 0
0617 20:16:49.117603 (+ 52357us) write_op.cc:270] Start()
0617 20:16:49.117645 (+ 42us) write_op.cc:276] Timestamp: P: 1781727404568152 usec, L: 0
0617 20:16:49.117842 (+ 197us) write_op.cc:270] Start()
0617 20:16:49.117866 (+ 24us) write_op.cc:276] Timestamp: P: 1781727404579888 usec, L: 0
0617 20:16:49.118030 (+ 164us) write_op.cc:270] Start()
0617 20:16:49.118050 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404593209 usec, L: 0
0617 20:16:49.118177 (+ 127us) write_op.cc:270] Start()
0617 20:16:49.118197 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404594507 usec, L: 0
0617 20:16:49.118327 (+ 130us) write_op.cc:270] Start()
0617 20:16:49.118346 (+ 19us) write_op.cc:276] Timestamp: P: 1781727404597018 usec, L: 0
0617 20:16:49.118493 (+ 147us) write_op.cc:270] Start()
0617 20:16:49.118516 (+ 23us) write_op.cc:276] Timestamp: P: 1781727404598515 usec, L: 0
0617 20:16:49.118643 (+ 127us) write_op.cc:270] Start()
0617 20:16:49.118663 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404601400 usec, L: 0
0617 20:16:49.118794 (+ 131us) write_op.cc:270] Start()
0617 20:16:49.118814 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404605427 usec, L: 0
0617 20:16:49.118956 (+ 142us) write_op.cc:270] Start()
0617 20:16:49.118977 (+ 21us) write_op.cc:276] Timestamp: P: 1781727404606230 usec, L: 0
0617 20:16:49.119114 (+ 137us) write_op.cc:270] Start()
0617 20:16:49.119134 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404607045 usec, L: 0
0617 20:16:49.119283 (+ 149us) write_op.cc:270] Start()
0617 20:16:49.119305 (+ 22us) write_op.cc:276] Timestamp: P: 1781727404637377 usec, L: 0
0617 20:16:49.119430 (+ 125us) write_op.cc:270] Start()
0617 20:16:49.119450 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404638754 usec, L: 0
0617 20:16:49.119601 (+ 151us) write_op.cc:270] Start()
0617 20:16:49.119620 (+ 19us) write_op.cc:276] Timestamp: P: 1781727404653339 usec, L: 0
0617 20:16:49.119745 (+ 125us) write_op.cc:270] Start()
0617 20:16:49.119769 (+ 24us) write_op.cc:276] Timestamp: P: 1781727404654576 usec, L: 0
0617 20:16:49.119938 (+ 169us) write_op.cc:270] Start()
0617 20:16:49.119958 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404674192 usec, L: 0
0617 20:16:49.120134 (+ 176us) write_op.cc:270] Start()
0617 20:16:49.120154 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404679649 usec, L: 0
0617 20:16:49.120280 (+ 126us) write_op.cc:270] Start()
0617 20:16:49.120298 (+ 18us) write_op.cc:276] Timestamp: P: 1781727404681392 usec, L: 0
0617 20:16:49.120421 (+ 123us) write_op.cc:270] Start()
0617 20:16:49.120442 (+ 21us) write_op.cc:276] Timestamp: P: 1781727404684265 usec, L: 0
0617 20:16:49.120584 (+ 142us) write_op.cc:270] Start()
0617 20:16:49.120603 (+ 19us) write_op.cc:276] Timestamp: P: 1781727404713558 usec, L: 0
0617 20:16:49.120729 (+ 126us) write_op.cc:270] Start()
0617 20:16:49.120749 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404719703 usec, L: 0
0617 20:16:49.120876 (+ 127us) write_op.cc:270] Start()
0617 20:16:49.120899 (+ 23us) write_op.cc:276] Timestamp: P: 1781727404778172 usec, L: 0
0617 20:16:49.121035 (+ 136us) write_op.cc:270] Start()
0617 20:16:49.121056 (+ 21us) write_op.cc:276] Timestamp: P: 1781727404786726 usec, L: 0
0617 20:16:49.121179 (+ 123us) write_op.cc:270] Start()
0617 20:16:49.121197 (+ 18us) write_op.cc:276] Timestamp: P: 1781727404801888 usec, L: 0
0617 20:16:49.121341 (+ 144us) write_op.cc:270] Start()
0617 20:16:49.121361 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404802577 usec, L: 0
0617 20:16:49.121496 (+ 135us) write_op.cc:270] Start()
0617 20:16:49.121520 (+ 24us) write_op.cc:276] Timestamp: P: 1781727404803457 usec, L: 0
0617 20:16:49.121657 (+ 137us) write_op.cc:270] Start()
0617 20:16:49.121680 (+ 23us) write_op.cc:276] Timestamp: P: 1781727404821109 usec, L: 0
0617 20:16:49.121871 (+ 191us) write_op.cc:270] Start()
0617 20:16:49.121901 (+ 30us) write_op.cc:276] Timestamp: P: 1781727404824244 usec, L: 0
0617 20:16:49.122035 (+ 134us) write_op.cc:270] Start()
0617 20:16:49.122056 (+ 21us) write_op.cc:276] Timestamp: P: 1781727404892576 usec, L: 0
0617 20:16:49.122192 (+ 136us) write_op.cc:270] Start()
0617 20:16:49.122208 (+ 16us) write_op.cc:276] Timestamp: P: 1781727404893407 usec, L: 0
0617 20:16:49.122317 (+ 109us) write_op.cc:270] Start()
0617 20:16:49.122336 (+ 19us) write_op.cc:276] Timestamp: P: 1781727404894084 usec, L: 0
0617 20:16:49.122509 (+ 173us) write_op.cc:270] Start()
0617 20:16:49.122530 (+ 21us) write_op.cc:276] Timestamp: P: 1781727404894670 usec, L: 0
0617 20:16:49.122671 (+ 141us) write_op.cc:270] Start()
0617 20:16:49.122691 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404895238 usec, L: 0
0617 20:16:49.122815 (+ 124us) write_op.cc:270] Start()
0617 20:16:49.122857 (+ 42us) write_op.cc:276] Timestamp: P: 1781727404895849 usec, L: 0
0617 20:16:49.123000 (+ 143us) write_op.cc:270] Start()
0617 20:16:49.123020 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404896502 usec, L: 0
0617 20:16:49.123149 (+ 129us) write_op.cc:270] Start()
0617 20:16:49.123170 (+ 21us) write_op.cc:276] Timestamp: P: 1781727404920642 usec, L: 0
0617 20:16:49.123300 (+ 130us) write_op.cc:270] Start()
0617 20:16:49.123318 (+ 18us) write_op.cc:276] Timestamp: P: 1781727404944756 usec, L: 0
0617 20:16:49.123487 (+ 169us) write_op.cc:270] Start()
0617 20:16:49.123507 (+ 20us) write_op.cc:276] Timestamp: P: 1781727404969071 usec, L: 0
0617 20:16:49.123646 (+ 139us) write_op.cc:270] Start()
0617 20:16:49.123668 (+ 22us) write_op.cc:276] Timestamp: P: 1781727404995253 usec, L: 0
0617 20:16:49.123789 (+ 121us) write_op.cc:270] Start()
0617 20:16:49.123813 (+ 24us) write_op.cc:276] Timestamp: P: 1781727404995951 usec, L: 0
0617 20:16:49.123951 (+ 138us) write_op.cc:270] Start()
0617 20:16:49.123970 (+ 19us) write_op.cc:276] Timestamp: P: 1781727405017113 usec, L: 0
0617 20:16:49.124099 (+ 129us) write_op.cc:270] Start()
0617 20:16:49.124117 (+ 18us) write_op.cc:276] Timestamp: P: 1781727405021884 usec, L: 0
0617 20:16:49.124256 (+ 139us) write_op.cc:270] Start()
0617 20:16:49.124275 (+ 19us) write_op.cc:276] Timestamp: P: 1781727405034290 usec, L: 0
0617 20:16:49.124415 (+ 140us) write_op.cc:270] Start()
0617 20:16:49.124432 (+ 17us) write_op.cc:276] Timestamp: P: 1781727405041335 usec, L: 0
0617 20:16:49.124586 (+ 154us) write_op.cc:270] Start()
0617 20:16:49.124607 (+ 21us) write_op.cc:276] Timestamp: P: 1781727405057132 usec, L: 0
0617 20:16:49.124733 (+ 126us) write_op.cc:270] Start()
0617 20:16:49.124752 (+ 19us) write_op.cc:276] Timestamp: P: 1781727405073608 usec, L: 0
0617 20:16:49.124871 (+ 119us) write_op.cc:270] Start()
0617 20:16:49.124889 (+ 18us) write_op.cc:276] Timestamp: P: 1781727405085995 usec, L: 0
0617 20:16:49.125001 (+ 112us) write_op.cc:270] Start()
0617 20:16:49.125019 (+ 18us) write_op.cc:276] Timestamp: P: 1781727405088106 usec, L: 0
0617 20:16:49.125133 (+ 114us) write_op.cc:270] Start()
0617 20:16:49.125148 (+ 15us) write_op.cc:276] Timestamp: P: 1781727405091633 usec, L: 0
0617 20:16:49.125272 (+ 124us) write_op.cc:270] Start()
0617 20:16:49.290900 (+165628us) write_op.cc:276] Timestamp: P: 1781727405092238 usec, L: 0
0617 20:16:49.291237 (+ 337us) write_op.cc:270] Start()
0617 20:16:49.291296 (+ 59us) write_op.cc:276] Timestamp: P: 1781727405109817 usec, L: 0
0617 20:16:49.291491 (+ 195us) write_op.cc:270] Start()
0617 20:16:49.291528 (+ 37us) write_op.cc:276] Timestamp: P: 1781727405142450 usec, L: 0
0617 20:16:49.291679 (+ 151us) write_op.cc:270] Start()
0617 20:16:49.291700 (+ 21us) write_op.cc:276] Timestamp: P: 1781727405160966 usec, L: 0
0617 20:16:49.291862 (+ 162us) write_op.cc:270] Start()
0617 20:16:49.291887 (+ 25us) write_op.cc:276] Timestamp: P: 1781727405164434 usec, L: 0
0617 20:16:49.292083 (+ 196us) write_op.cc:270] Start()
0617 20:16:49.292106 (+ 23us) write_op.cc:276] Timestamp: P: 1781727405165097 usec, L: 0
0617 20:16:49.292254 (+ 148us) write_op.cc:270] Start()
0617 20:16:49.292296 (+ 42us) write_op.cc:276] Timestamp: P: 1781727405167942 usec, L: 0
0617 20:16:49.292465 (+ 169us) write_op.cc:270] Start()
0617 20:16:49.292492 (+ 27us) write_op.cc:276] Timestamp: P: 1781727405171561 usec, L: 0
0617 20:16:49.292636 (+ 144us) write_op.cc:270] Start()
0617 20:16:49.292666 (+ 30us) write_op.cc:276] Timestamp: P: 1781727405174842 usec, L: 0
0617 20:16:49.292843 (+ 177us) write_op.cc:270] Start()
0617 20:16:49.292866 (+ 23us) write_op.cc:276] Timestamp: P: 1781727405200771 usec, L: 0
0617 20:16:49.293021 (+ 155us) write_op.cc:270] Start()
0617 20:16:49.293043 (+ 22us) write_op.cc:276] Timestamp: P: 1781727405202195 usec, L: 0
0617 20:16:49.293193 (+ 150us) write_op.cc:270] Start()
0617 20:16:49.293217 (+ 24us) write_op.cc:276] Timestamp: P: 1781727405225821 usec, L: 0
0617 20:16:49.327739 (+ 34522us) write_op.cc:270] Start()
0617 20:16:49.327781 (+ 42us) write_op.cc:276] Timestamp: P: 1781727405227099 usec, L: 0
0617 20:16:49.327996 (+ 215us) write_op.cc:270] Start()
0617 20:16:49.328022 (+ 26us) write_op.cc:276] Timestamp: P: 1781727405287132 usec, L: 0
0617 20:16:49.328188 (+ 166us) write_op.cc:270] Start()
0617 20:16:49.328214 (+ 26us) write_op.cc:276] Timestamp: P: 1781727405293185 usec, L: 0
0617 20:16:49.328391 (+ 177us) write_op.cc:270] Start()
0617 20:16:49.328415 (+ 24us) write_op.cc:276] Timestamp: P: 1781727405294445 usec, L: 0
0617 20:16:49.346227 (+ 17812us) write_op.cc:270] Start()
0617 20:16:49.346264 (+ 37us) write_op.cc:276] Timestamp: P: 1781727405295501 usec, L: 0
0617 20:16:49.346484 (+ 220us) write_op.cc:270] Start()
0617 20:16:49.346510 (+ 26us) write_op.cc:276] Timestamp: P: 1781727405297011 usec, L: 0
0617 20:16:49.346664 (+ 154us) write_op.cc:270] Start()
0617 20:16:49.346688 (+ 24us) write_op.cc:276] Timestamp: P: 1781727405343157 usec, L: 0
0617 20:16:49.346823 (+ 135us) write_op.cc:270] Start()
0617 20:16:49.346843 (+ 20us) write_op.cc:276] Timestamp: P: 1781727405345205 usec, L: 0
0617 20:16:49.347018 (+ 175us) write_op.cc:270] Start()
0617 20:16:49.347093 (+ 75us) write_op.cc:276] Timestamp: P: 1781727405346241 usec, L: 0
0617 20:16:49.347297 (+ 204us) write_op.cc:270] Start()
0617 20:16:49.347320 (+ 23us) write_op.cc:276] Timestamp: P: 1781727405388959 usec, L: 0
0617 20:16:49.347453 (+ 133us) write_op.cc:270] Start()
0617 20:16:49.347475 (+ 22us) write_op.cc:276] Timestamp: P: 1781727405399137 usec, L: 0
0617 20:16:49.347628 (+ 153us) write_op.cc:270] Start()
0617 20:16:49.347648 (+ 20us) write_op.cc:276] Timestamp: P: 1781727405414192 usec, L: 0
0617 20:16:49.347807 (+ 159us) write_op.cc:270] Start()
0617 20:16:49.347826 (+ 19us) write_op.cc:276] Timestamp: P: 1781727405415888 usec, L: 0
0617 20:16:49.347971 (+ 145us) write_op.cc:270] Start()
0617 20:16:49.348001 (+ 30us) write_op.cc:276] Timestamp: P: 1781727405469234 usec, L: 0
0617 20:16:49.348128 (+ 127us) write_op.cc:270] Start()
0617 20:16:49.348157 (+ 29us) write_op.cc:276] Timestamp: P: 1781727405478091 usec, L: 0
0617 20:16:49.348286 (+ 129us) write_op.cc:270] Start()
0617 20:16:49.348304 (+ 18us) write_op.cc:276] Timestamp: P: 1781727405479033 usec, L: 0
0617 20:16:49.348430 (+ 126us) write_op.cc:270] Start()
0617 20:16:49.348447 (+ 17us) write_op.cc:276] Timestamp: P: 1781727405486059 usec, L: 0
0617 20:16:49.348579 (+ 132us) write_op.cc:270] Start()
0617 20:16:49.348599 (+ 20us) write_op.cc:276] Timestamp: P: 1781727405499662 usec, L: 0
0617 20:16:49.348744 (+ 145us) write_op.cc:270] Start()
0617 20:16:49.348763 (+ 19us) write_op.cc:276] Timestamp: P: 1781727405510967 usec, L: 0
0617 20:16:49.348935 (+ 172us) write_op.cc:270] Start()
0617 20:16:49.348955 (+ 20us) write_op.cc:276] Timestamp: P: 1781727405513727 usec, L: 0
0617 20:16:49.349104 (+ 149us) write_op.cc:270] Start()
0617 20:16:49.349124 (+ 20us) write_op.cc:276] Timestamp: P: 1781727405524248 usec, L: 0
0617 20:16:49.349257 (+ 133us) write_op.cc:270] Start()
0617 20:16:49.349277 (+ 20us) write_op.cc:276] Timestamp: P: 1781727405552285 usec, L: 0
0617 20:16:49.417256 (+ 67979us) write_op.cc:270] Start()
0617 20:16:49.417314 (+ 58us) write_op.cc:276] Timestamp: P: 1781727405562291 usec, L: 0
0617 20:16:49.417509 (+ 195us) write_op.cc:270] Start()
0617 20:16:49.417534 (+ 25us) write_op.cc:276] Timestamp: P: 1781727405574313 usec, L: 0
0617 20:16:49.417677 (+ 143us) write_op.cc:270] Start()
0617 20:16:49.417700 (+ 23us) write_op.cc:276] Timestamp: P: 1781727405582832 usec, L: 0
0617 20:16:49.417843 (+ 143us) write_op.cc:270] Start()
0617 20:16:49.417871 (+ 28us) write_op.cc:276] Timestamp: P: 1781727405642204 usec, L: 0
0617 20:16:49.417994 (+ 123us) write_op.cc:270] Start()
0617 20:16:49.418011 (+ 17us) write_op.cc:276] Timestamp: P: 1781727405642932 usec, L: 0
0617 20:16:49.418166 (+ 155us) write_op.cc:270] Start()
0617 20:16:49.418184 (+ 18us) write_op.cc:276] Timestamp: P: 1781727405643598 usec, L: 0
0617 20:16:49.418315 (+ 131us) write_op.cc:270] Start()
0617 20:16:49.418335 (+ 20us) write_op.cc:276] Timestamp: P: 1781727405699798 usec, L: 0
0617 20:16:49.418510 (+ 175us) write_op.cc:270] Start()
0617 20:16:49.418532 (+ 22us) write_op.cc:276] Timestamp: P: 1781727405705545 usec, L: 0
0617 20:16:49.418669 (+ 137us) write_op.cc:270] Start()
0617 20:16:49.418692 (+ 23us) write_op.cc:276] Timestamp: P: 1781727405744811 usec, L: 0
0617 20:16:49.418829 (+ 137us) write_op.cc:270] Start()
0617 20:16:49.418846 (+ 17us) write_op.cc:276] Timestamp: P: 1781727405746334 usec, L: 0
0617 20:16:49.418976 (+ 130us) write_op.cc:270] Start()
0617 20:16:49.418993 (+ 17us) write_op.cc:276] Timestamp: P: 1781727405747328 usec, L: 0
0617 20:16:49.419129 (+ 136us) write_op.cc:270] Start()
0617 20:16:49.419149 (+ 20us) write_op.cc:276] Timestamp: P: 1781727405782367 usec, L: 0
0617 20:16:49.419296 (+ 147us) write_op.cc:270] Start()
0617 20:16:49.419319 (+ 23us) write_op.cc:276] Timestamp: P: 1781727405798634 usec, L: 0
0617 20:16:49.419446 (+ 127us) write_op.cc:270] Start()
0617 20:16:49.419468 (+ 22us) write_op.cc:276] Timestamp: P: 1781727405823797 usec, L: 0
0617 20:16:49.419621 (+ 153us) write_op.cc:270] Start()
0617 20:16:49.419639 (+ 18us) write_op.cc:276] Timestamp: P: 1781727406010731 usec, L: 0
0617 20:16:49.419766 (+ 127us) write_op.cc:270] Start()
0617 20:16:49.419783 (+ 17us) write_op.cc:276] Timestamp: P: 1781727406031003 usec, L: 0
0617 20:16:49.419925 (+ 142us) write_op.cc:270] Start()
0617 20:16:49.419945 (+ 20us) write_op.cc:276] Timestamp: P: 17817274
I20260617 20:16:50.966288 29379 ts_tablet_manager.cc:1403] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.297s user 0.007s sys 0.003s
I20260617 20:16:50.976125 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_486a2491b91d4d4899c49ae5065acbcd" } modify_external_catalogs: true
I20260617 20:16:50.976235 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4b6a1b4f97184d0eb8200cf926039a32" } new_table_name: "default.Table_976e062ae33e43fc8ce7604f7bf3ad69" modify_external_catalogs: true
I20260617 20:16:50.976333 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_486a2491b91d4d4899c49ae5065acbcd" } modify_external_catalogs: true
I20260617 20:16:50.973026 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 219d85e4fd9b4ba3baf1e08d2b18a32c (DEFAULT_TABLE table=default.Table_fae70178b45747a29dfd1be32d78cff6 [id=cbe52ba840694bfea51b5f0e1fe56cfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:50.982303 29375 ts_tablet_manager.cc:1929] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:16:50.982724 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 203666e6127b49ed92731bc87ce01798 consensus state has no leader
I20260617 20:16:50.983723 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9b9ef0f3fc184c1d86b33196c9b9ae9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:50.984311 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b9ef0f3fc184c1d86b33196c9b9ae9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.984732 29379 raft_consensus.cc:359] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.984933 29379 raft_consensus.cc:385] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:50.985028 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa123fc62a594dd19f20b520760fe6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:50.986023 29379 raft_consensus.cc:740] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:50.986354 29379 consensus_queue.cc:260] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:50.987156 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet fc36f62aa0bf46278cb84ec8cb7eef55
I20260617 20:16:50.989305 29379 ts_tablet_manager.cc:1434] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260617 20:16:50.990144 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet fc36f62aa0bf46278cb84ec8cb7eef55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:50.990621 29852 raft_consensus.cc:2804] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:50.990761 29852 raft_consensus.cc:493] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:50.990864 29852 raft_consensus.cc:3060] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:51.000088 29507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:51.000312 29507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: This master's current role is: LEADER
I20260617 20:16:51.001433 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7c00b4f954c743869ac8b3236a50e532" } new_table_name: "default.Table_9585e9187e064dee8087250873279e50" modify_external_catalogs: true
I20260617 20:16:50.990537 29375 log.cc:1199] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/9d4702c06d3442ac966ef2daca8d4660
I20260617 20:16:51.006084 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3f75a4b3577e427ba1b39fa83075b1c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.006940 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f75a4b3577e427ba1b39fa83075b1c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:50.990677 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 593d9de6a2fb47e18d86649e45ba80b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.012794 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219d85e4fd9b4ba3baf1e08d2b18a32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.013273 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_81b3bfff6b3f4cf98596b01d7f988a71" } new_table_name: "default.Table_cdbdfa69a2ce497ea08811de10403d4a" modify_external_catalogs: true
I20260617 20:16:51.014348 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7c4828773d3f4868b2cd864f1d246a27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.015035 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c4828773d3f4868b2cd864f1d246a27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.011427 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd4f190a1005433ebcfbfe3a86aa9e70" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:51.017364 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet fc36f62aa0bf46278cb84ec8cb7eef55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:51.054677 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 30f6dcc384154d41866cf8060cf05837 (DEFAULT_TABLE table=default.Table_1a988e93d48746dd823e6330382ee315 [id=9c7d75a5ae9147a2850f090b0c67ea33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.055415 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f6dcc384154d41866cf8060cf05837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.056313 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee426100bb645f391be123aeb52e412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.058305 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eaa60028a1647e580a987c3a0836a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.059000 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3032155e4e4ea8a23984f547d78752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.059136 29375 ts_tablet_manager.cc:1950] T 9d4702c06d3442ac966ef2daca8d4660 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:51.060880 29379 tablet_bootstrap.cc:492] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:51.063194 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adbc3219639748d9a0d71d45ae22ab36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.069814 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 9d4702c06d3442ac966ef2daca8d4660 (table default.Table_57173259c5b84c00b2a539220a0634b8 [id=39ea53bdb6784c0d82a82077cc6210ca]) successfully deleted
I20260617 20:16:51.076396 29379 tablet_bootstrap.cc:654] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:51.079425 29376 tablet_replica.cc:333] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:51.082150 29383 tablet_bootstrap.cc:492] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:51.088032 28952 tablet_service.cc:1511] Processing CreateTablet for tablet f14113dd9098456599d7b72626bedcd6 (DEFAULT_TABLE table=default.Table_b97bf3349f93422cbd2b08e176e4d5da [id=d50a3264b4d349dea980a3ad95ac87f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.089020 29375 tablet_replica.cc:333] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:51.090253 29376 raft_consensus.cc:2243] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:51.092854 29376 pending_rounds.cc:70] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:51.092958 29376 pending_rounds.cc:77] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955465964773376 op_type: NO_OP noop_request { }
I20260617 20:16:51.094120 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_df31bee3761040b9973aa917f8f1e0a0" } modify_external_catalogs: true
I20260617 20:16:51.094336 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_df31bee3761040b9973aa917f8f1e0a0" } modify_external_catalogs: true
I20260617 20:16:51.095584 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5ea3587ee60a4b799967af4ad882af8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.096253 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ea3587ee60a4b799967af4ad882af8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:51.098249 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e58fbec4a9f14ddda42b5a4c0263972c consensus state has no leader
I20260617 20:16:51.109865 29376 raft_consensus.cc:2889] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:51.110023 29376 raft_consensus.cc:2272] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:51.110678 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_78df0b7688e5419a8ae514d3c4e5399e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.111403 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78df0b7688e5419a8ae514d3c4e5399e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:51.111687 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 938b61a0f6dc4d178971034fd18c1674 has no consensus state
I20260617 20:16:51.112077 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_00ae029b2f81402188ceedb8535a9652" } modify_external_catalogs: true
I20260617 20:16:51.112255 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_00ae029b2f81402188ceedb8535a9652" } modify_external_catalogs: true
I20260617 20:16:51.112308 29376 ts_tablet_manager.cc:1916] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:51.113065 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet 379ef43e02ec4bbbb03f2d6a53a66403 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:51.113565 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e0ae686c2b804b42b8468bcc50fc9a61" } new_table_name: "default.Table_c410bd335d1b42b09ad898a66eae6438" modify_external_catalogs: true
I20260617 20:16:51.117085 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a53260b7e2f34a0f9eadcfc43812a67c" } modify_external_catalogs: true
I20260617 20:16:51.117311 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a53260b7e2f34a0f9eadcfc43812a67c" } modify_external_catalogs: true
I20260617 20:16:51.111413 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8965f5e6c4ae469dac6a88b85b1bf4c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.118732 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8965f5e6c4ae469dac6a88b85b1bf4c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.126870 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_921dd6771a094e7cb638a0bcd034177e [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 2 got 0
I20260617 20:16:51.127686 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8fba56a5136b4fbdadd7d783aaf1e9e9" } new_table_name: "default.Table_e01af13e5b514cca8b4cfc05a15a949d" modify_external_catalogs: true
I20260617 20:16:51.129145 29852 raft_consensus.cc:515] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.129319 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ca6c225acdee4376bbd9af7f2f727176"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:51.129803 28667 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886] alter complete (version 2)
W20260617 20:16:51.129871 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca6c225acdee4376bbd9af7f2f727176 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.137833 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1b2e51959bad407996ecd0596aa27cf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.138423 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b2e51959bad407996ecd0596aa27cf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:51.146095 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f43549813e294796baca2a1a64dbcfb9 has no consensus state
I20260617 20:16:51.147109 29852 leader_election.cc:290] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:51.167526 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0bbef4cc28ef46288cfc7d1933c71710 consensus state has no leader
I20260617 20:16:51.169085 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_976e062ae33e43fc8ce7604f7bf3ad69" } modify_external_catalogs: true
I20260617 20:16:51.169267 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_976e062ae33e43fc8ce7604f7bf3ad69" } modify_external_catalogs: true
I20260617 20:16:51.180548 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_dd4d087b046a40bbbb48af81d2074752"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:51.181181 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 2d0c245563fe44b59d32616bd35d3dae
I20260617 20:16:51.182536 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 8b6f05ae7d624efba571d059ce2f1c91
I20260617 20:16:51.182735 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 370db89a92a6455190edaf80e5a56205
I20260617 20:16:51.183169 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 (DEFAULT_TABLE table=default.Table_cd10b4e7345244ee8825544af6b6add1 [id=475aa0d2f8044cd8b52cf31085dda15d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.183553 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 379ef43e02ec4bbbb03f2d6a53a66403
I20260617 20:16:51.183632 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.184042 28661 catalog_manager.cc:6784] ReplaceTablet: tablet 379ef43e02ec4bbbb03f2d6a53a66403 deleted and replaced by tablet 80d778641c354c679ee9e7d7b3eae3b5
W20260617 20:16:51.191184 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd4d087b046a40bbbb48af81d2074752 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.191885 29376 ts_tablet_manager.cc:1929] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:51.192840 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 203666e6127b49ed92731bc87ce01798
I20260617 20:16:51.198650 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9a7ec2d038854bc8a0dc81693ad4c0d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.199258 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a7ec2d038854bc8a0dc81693ad4c0d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.202121 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7e16fff91c254edc8becd81ac1de334f" } modify_external_catalogs: true
I20260617 20:16:51.202314 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7e16fff91c254edc8becd81ac1de334f" } modify_external_catalogs: true
I20260617 20:16:51.203603 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_25c67ca49ed44c2d84e1262214bd184c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.204149 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25c67ca49ed44c2d84e1262214bd184c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.205500 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9585e9187e064dee8087250873279e50" } new_table_name: "default.Table_6bd15ccc82e94f2a9d16a99288ae6d3c" modify_external_catalogs: true
I20260617 20:16:51.213778 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 9e1dc756edd5473183afc75eef7112d6
W20260617 20:16:51.215070 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e58fbec4a9f14ddda42b5a4c0263972c consensus state has no leader
I20260617 20:16:51.236145 29375 raft_consensus.cc:2243] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:51.250767 29859 raft_consensus.cc:493] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:51.251173 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c0988a73d547d08d0924784bff9222" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:51.252123 29859 raft_consensus.cc:515] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.252728 29859 leader_election.cc:290] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:51.253631 29783 raft_consensus.cc:493] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:51.255321 29783 raft_consensus.cc:515] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.255877 29783 leader_election.cc:290] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:51.256623 29375 raft_consensus.cc:2272] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:51.258373 29375 ts_tablet_manager.cc:1916] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:51.259558 29127 raft_consensus.cc:3060] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:51.262465 29127 raft_consensus.cc:2468] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:51.264707 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d0c245563fe44b59d32616bd35d3dae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:51.278524 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 203666e6127b49ed92731bc87ce01798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:51.278574 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 370db89a92a6455190edaf80e5a56205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:51.279930 29103 tablet_service.cc:1511] Processing CreateTablet for tablet cde88371f4454a4bb3053c6cd1afb801 (DEFAULT_TABLE table=default.Table_1666eb767add47a487e4c3dc5f691a35 [id=c61e770b1f9f46fdb7f01a71c80724b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.280443 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 379ef43e02ec4bbbb03f2d6a53a66403 with delete_type TABLET_DATA_DELETED (replaced by tablet 80d778641c354c679ee9e7d7b3eae3b5) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:51.281939 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde88371f4454a4bb3053c6cd1afb801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.177655 29880 tablet.cc:1724] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:16:51.288206 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 (DEFAULT_TABLE table=default.Table_cd10b4e7345244ee8825544af6b6add1 [id=475aa0d2f8044cd8b52cf31085dda15d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.288596 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:51.290297 29063 leader_election.cc:343] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: c65a4345552844fe9e7512105fd79877
I20260617 20:16:51.292079 29822 raft_consensus.cc:493] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:51.292637 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 593d9de6a2fb47e18d86649e45ba80b9 (DEFAULT_TABLE table=default.Table_8cd5575879f54274afa3ecac3cc58ea7 [id=a7cecb2081fb4a37a1814fa7324f24a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.295019 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c0988a73d547d08d0924784bff9222" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:51.295493 28986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c0988a73d547d08d0924784bff9222" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:51.295588 29866 consensus_queue.cc:1048] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.366s
I20260617 20:16:51.287137 29783 consensus_queue.cc:1048] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260617 20:16:51.295909 28989 raft_consensus.cc:2393] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:16:51.296115 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet fc36f62aa0bf46278cb84ec8cb7eef55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:51.296298 29861 raft_consensus.cc:493] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:51.296437 29861 raft_consensus.cc:515] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:51.297247 29861 leader_election.cc:290] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:51.297766 29063 leader_election.cc:343] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 1f32ebd7448843b48b981d3d70a87023
W20260617 20:16:51.297976 28990 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.571s user 0.014s sys 0.012s
W20260617 20:16:51.298069 28990 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.571s user 0.014s sys 0.012s
I20260617 20:16:51.298517 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30f6dcc384154d41866cf8060cf05837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.298494 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6f05ae7d624efba571d059ce2f1c91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:51.192150 29852 raft_consensus.cc:493] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:51.306159 29852 raft_consensus.cc:515] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:51.306838 29852 leader_election.cc:290] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:51.197235 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 203666e6127b49ed92731bc87ce01798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:51.199518 29228 tablet_service.cc:1511] Processing CreateTablet for tablet cde88371f4454a4bb3053c6cd1afb801 (DEFAULT_TABLE table=default.Table_1666eb767add47a487e4c3dc5f691a35 [id=c61e770b1f9f46fdb7f01a71c80724b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.307451 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde88371f4454a4bb3053c6cd1afb801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.315655 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 (DEFAULT_TABLE table=default.Table_cd10b4e7345244ee8825544af6b6add1 [id=475aa0d2f8044cd8b52cf31085dda15d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.317422 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6f05ae7d624efba571d059ce2f1c91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:51.199767 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet 370db89a92a6455190edaf80e5a56205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:51.199959 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 379ef43e02ec4bbbb03f2d6a53a66403 with delete_type TABLET_DATA_DELETED (replaced by tablet 80d778641c354c679ee9e7d7b3eae3b5) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:51.200114 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d0c245563fe44b59d32616bd35d3dae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:51.200244 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6f05ae7d624efba571d059ce2f1c91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:51.238755 29740 consensus_queue.cc:1048] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:16:51.318610 28964 consensus_meta.cc:287] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254: Time spent flushing consensus metadata: real 0.505s user 0.004s sys 0.000s
I20260617 20:16:51.264472 29198 leader_election.cc:304] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:51.318813 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d0c245563fe44b59d32616bd35d3dae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:51.318950 29198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 54505.5us
I20260617 20:16:51.319446 29740 raft_consensus.cc:2804] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:51.319620 29740 raft_consensus.cc:697] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:51.319620 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 370db89a92a6455190edaf80e5a56205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:51.319875 29740 consensus_queue.cc:237] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.281160 29383 ts_tablet_manager.cc:1403] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.338s user 0.013s sys 0.010s
I20260617 20:16:51.321660 29383 raft_consensus.cc:359] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.321950 29383 raft_consensus.cc:385] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:51.322045 29383 raft_consensus.cc:740] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:51.322337 29383 consensus_queue.cc:260] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.323097 29383 ts_tablet_manager.cc:1434] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:51.323161 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 379ef43e02ec4bbbb03f2d6a53a66403 with delete_type TABLET_DATA_DELETED (replaced by tablet 80d778641c354c679ee9e7d7b3eae3b5) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:51.323506 29383 tablet_bootstrap.cc:492] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:51.284893 29197 consensus_peers.cc:597] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4332e33d60964bd6a0c7e7caaa6bdc76. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:51.328011 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e1dc756edd5473183afc75eef7112d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:51.328202 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 938b61a0f6dc4d178971034fd18c1674 (DEFAULT_TABLE table=default.Table_cdbdfa69a2ce497ea08811de10403d4a [id=a2424a096b1c4a8fa97b06acfdd7f1b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.327908 29880 tablet.cc:1724] T b62b22ff17964ee6934023fb85e0b7ec P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:51.328150 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 75c59cf5f5e8486baf1e038a44657f33 (DEFAULT_TABLE table=default.Table_0f470f9601d84ae29158e563c73bce2d [id=eb66a2f606534252b7a20de365947ee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.329495 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85271eeb854194a968215ebc08f47a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:51.330225 28970 tablet_service.cc:1511] Processing CreateTablet for tablet f823290351d542179b8bcc683d7acf6a (DEFAULT_TABLE table=default.Table_40053ed1f4264c3993f829af0bea9f13 [id=a5d095adc0744ee49bba7dca6126d33f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.330511 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f14113dd9098456599d7b72626bedcd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.335580 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 593d9de6a2fb47e18d86649e45ba80b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.342633 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 269d2bb9f1fd45f89ab765b33a502baf (DEFAULT_TABLE table=default.Table_fbc7dc910d9b4eda962ff4b9328e00a3 [id=1efcb5e6de134a54bc4250ae502080e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.347322 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65af976b808d42d4aeded71a00cf7252" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:51.348289 29197 leader_election.cc:343] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Illegal state: Tablet not RUNNING: STOPPED
W20260617 20:16:51.349175 29197 consensus_peers.cc:597] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 113fbbc739d04f529e82bc1cf1074bd7. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:51.349431 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 203666e6127b49ed92731bc87ce01798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:51.349903 28968 tablet_service.cc:1511] Processing CreateTablet for tablet e3897179e7724fdeb87a979ae4ef2091 (DEFAULT_TABLE table=default.Table_b312ecd37cf2447c864d075d578c23e8 [id=4d5a074de7654d559782d637dc23f129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.350157 28987 raft_consensus.cc:3060] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:51.352880 28987 raft_consensus.cc:2468] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:51.353183 28957 tablet_service.cc:1511] Processing CreateTablet for tablet cde88371f4454a4bb3053c6cd1afb801 (DEFAULT_TABLE table=default.Table_1666eb767add47a487e4c3dc5f691a35 [id=c61e770b1f9f46fdb7f01a71c80724b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.353765 29383 tablet_bootstrap.cc:654] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:51.354187 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 14a5e5917a414c99b25ea2efeab4063d (DEFAULT_TABLE table=default.Table_d3381a68eac743b28435e4756ba0cb2e [id=d714bd16d06041a2a930d45e8409ab88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.354702 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 75c59cf5f5e8486baf1e038a44657f33 (DEFAULT_TABLE table=default.Table_0f470f9601d84ae29158e563c73bce2d [id=eb66a2f606534252b7a20de365947ee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.355280 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c59cf5f5e8486baf1e038a44657f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.354075 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6f05ae7d624efba571d059ce2f1c91 (DEFAULT_TABLE table=default.Table_00ae029b2f81402188ceedb8535a9652 [id=4ad941b11d7c4a47b5f13c8504c0ac28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.360383 28963 tablet_service.cc:1511] Processing CreateTablet for tablet eb408723f7a346c3b5ea13cad237b44e (DEFAULT_TABLE table=default.Table_608970ae0a3443c5937e3180a495bc33 [id=59b139b44cd940b491c7f17e82e6995d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:51.362542 28925 leader_election.cc:343] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:51.363539 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 64538fdf51f94e8e985fec6202baac22 (DEFAULT_TABLE table=default.Table_429e918201e84c0ab85d77c4cef3f02a [id=6cc7087e31da411db5d0ef5f7b376ade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.356860 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 99a3d9ae347845dfa9357010819ebc58 (DEFAULT_TABLE table=default.Table_64a54638a38b4d8cab417ecd62e3d04a [id=a599d15f588a4d18961e0ec9529b5053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.364961 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 64538fdf51f94e8e985fec6202baac22 (DEFAULT_TABLE table=default.Table_429e918201e84c0ab85d77c4cef3f02a [id=6cc7087e31da411db5d0ef5f7b376ade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.365674 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64538fdf51f94e8e985fec6202baac22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.365886 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2797384f7845969ee9744b444f1acc (DEFAULT_TABLE table=default.Table_2b68c9711d6147e88a1aba5ea0a8f2bd [id=4cb0ef24b723455aacc2dc61526886d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.367529 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.325021 29376 log.cc:1199] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/1d4be33993864c73ba8b4da9468a517b
I20260617 20:16:51.370746 29376 ts_tablet_manager.cc:1950] T 1d4be33993864c73ba8b4da9468a517b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:51.371686 29062 leader_election.cc:304] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:51.372287 29783 raft_consensus.cc:3060] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:51.373224 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 244) took 3120 ms. Trace:
I20260617 20:16:51.373433 29376 rpcz_store.cc:276] 0617 20:16:48.253177 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.253739 (+ 562us) service_pool.cc:224] Handling call
0617 20:16:50.941365 (+2687626us) ts_tablet_manager.cc:1151] Deleting tablet 1d4be33993864c73ba8b4da9468a517b
0617 20:16:50.941375 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:51.176205 (+234830us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:51.191811 (+ 15606us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:51.373163 (+181352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4389,"tablet-delete.queue_time_us":2687388}
I20260617 20:16:51.374035 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 252) took 3003 ms. Trace:
I20260617 20:16:51.377395 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3897179e7724fdeb87a979ae4ef2091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.377656 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f823290351d542179b8bcc683d7acf6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.384547 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a3d9ae347845dfa9357010819ebc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.388180 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 99a3d9ae347845dfa9357010819ebc58 (DEFAULT_TABLE table=default.Table_64a54638a38b4d8cab417ecd62e3d04a [id=a599d15f588a4d18961e0ec9529b5053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.389801 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet b3278efaad07403ca0a2baecad46d0f1 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:51.394852 28954 tablet_service.cc:1511] Processing CreateTablet for tablet a3e20a1092b746a8b8ddd4386a682229 (DEFAULT_TABLE table=default.Table_9f236274be424e44818107f2fed5331c [id=a3772e01cb314c7e88e85833d727617d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.395452 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 64538fdf51f94e8e985fec6202baac22 (DEFAULT_TABLE table=default.Table_429e918201e84c0ab85d77c4cef3f02a [id=6cc7087e31da411db5d0ef5f7b376ade]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.396054 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 75c59cf5f5e8486baf1e038a44657f33 (DEFAULT_TABLE table=default.Table_0f470f9601d84ae29158e563c73bce2d [id=eb66a2f606534252b7a20de365947ee4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.397962 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b3278efaad07403ca0a2baecad46d0f1
I20260617 20:16:51.398072 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 39ca961cfea54a7187cc7ea8d16a627f (DEFAULT_TABLE table=default.Table_6e3a4cd286c74acca399a55d5202d4ac [id=9eceb2e355c940f1854894b7fc8a92dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.398514 28670 catalog_manager.cc:6784] ReplaceTablet: tablet b3278efaad07403ca0a2baecad46d0f1 deleted and replaced by tablet 08290c23fff5449481789b29d15c4781
I20260617 20:16:51.405527 29126 raft_consensus.cc:3060] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:51.410570 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65af976b808d42d4aeded71a00cf7252" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:51.376881 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 99a3d9ae347845dfa9357010819ebc58 (DEFAULT_TABLE table=default.Table_64a54638a38b4d8cab417ecd62e3d04a [id=a599d15f588a4d18961e0ec9529b5053]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.412065 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a3d9ae347845dfa9357010819ebc58. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:51.412350 28959 consensus_meta.cc:287] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254: Time spent flushing consensus metadata: real 0.506s user 0.004s sys 0.000s
I20260617 20:16:51.383023 29232 tablet_service.cc:1511] Processing CreateTablet for tablet f823290351d542179b8bcc683d7acf6a (DEFAULT_TABLE table=default.Table_40053ed1f4264c3993f829af0bea9f13 [id=a5d095adc0744ee49bba7dca6126d33f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.412828 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f823290351d542179b8bcc683d7acf6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.413111 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 74c73ae1007d44ce958ad02fa5787651 (DEFAULT_TABLE table=default.Table_beb2513cd34e4d5ebfadfcf15dfb3ad9 [id=0586dbd68a634d83ab9b00d2ba7f38af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.413965 29383 tablet_bootstrap.cc:492] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:51.414127 29383 ts_tablet_manager.cc:1403] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.091s user 0.008s sys 0.002s
I20260617 20:16:51.414958 29383 raft_consensus.cc:359] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.415154 29383 raft_consensus.cc:385] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:51.415237 29383 raft_consensus.cc:740] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:51.415544 29383 consensus_queue.cc:260] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.416052 29383 ts_tablet_manager.cc:1434] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:51.416359 29383 tablet_bootstrap.cc:492] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:51.384443 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 14a5e5917a414c99b25ea2efeab4063d (DEFAULT_TABLE table=default.Table_d3381a68eac743b28435e4756ba0cb2e [id=d714bd16d06041a2a930d45e8409ab88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.385181 29233 tablet_service.cc:1511] Processing CreateTablet for tablet eb408723f7a346c3b5ea13cad237b44e (DEFAULT_TABLE table=default.Table_608970ae0a3443c5937e3180a495bc33 [id=59b139b44cd940b491c7f17e82e6995d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.419078 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb408723f7a346c3b5ea13cad237b44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.421729 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a5e5917a414c99b25ea2efeab4063d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.385341 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 938b61a0f6dc4d178971034fd18c1674 (DEFAULT_TABLE table=default.Table_cdbdfa69a2ce497ea08811de10403d4a [id=a2424a096b1c4a8fa97b06acfdd7f1b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.385821 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2797384f7845969ee9744b444f1acc (DEFAULT_TABLE table=default.Table_2b68c9711d6147e88a1aba5ea0a8f2bd [id=4cb0ef24b723455aacc2dc61526886d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.386387 29236 tablet_service.cc:1511] Processing CreateTablet for tablet e3897179e7724fdeb87a979ae4ef2091 (DEFAULT_TABLE table=default.Table_b312ecd37cf2447c864d075d578c23e8 [id=4d5a074de7654d559782d637dc23f129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.386907 29243 tablet_service.cc:1511] Processing CreateTablet for tablet 5df6af49cb484f59ad1f32235753e1db (DEFAULT_TABLE table=default.Table_0c3573fbceb84376afbe284979c815a2 [id=8ebd35bd7b464cd489f6a15d0e70800e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.387435 29234 tablet_service.cc:1511] Processing CreateTablet for tablet b6bc2304de37441bb78cd12cab5ca3c3 (DEFAULT_TABLE table=default.Table_f2c4f9d463814ae2883f800f27c5d14d [id=2e23848d3d274b3b950f282dc2e7b767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.387977 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 39ca961cfea54a7187cc7ea8d16a627f (DEFAULT_TABLE table=default.Table_6e3a4cd286c74acca399a55d5202d4ac [id=9eceb2e355c940f1854894b7fc8a92dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.388481 29241 tablet_service.cc:1511] Processing CreateTablet for tablet a3e20a1092b746a8b8ddd4386a682229 (DEFAULT_TABLE table=default.Table_9f236274be424e44818107f2fed5331c [id=a3772e01cb314c7e88e85833d727617d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.389530 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 74c73ae1007d44ce958ad02fa5787651 (DEFAULT_TABLE table=default.Table_beb2513cd34e4d5ebfadfcf15dfb3ad9 [id=0586dbd68a634d83ab9b00d2ba7f38af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.390053 29239 tablet_service.cc:1511] Processing CreateTablet for tablet e7eb77c619e04c448a084638668dbb6a (DEFAULT_TABLE table=default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.390619 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 26ebcfc80ca64129a7ab939bfd853998 (DEFAULT_TABLE table=default.Table_80559e5b402d45f3965620a4955011f7 [id=245d91c02e934103bc0e7b095fe1c9e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.391166 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 5eaddd6519dc490c8358be629b21a2d9 (DEFAULT_TABLE table=default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.424551 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a3d9ae347845dfa9357010819ebc58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.394359 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e1dc756edd5473183afc75eef7112d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:51.411492 29242 tablet_service.cc:1511] Processing CreateTablet for tablet ebd98889d08f4683ba4b2ee98a74254d (DEFAULT_TABLE table=default.Table_1c209b8f8876488a874cdef8f86e4a15 [id=b03839b3c5ba4a13a7e5a8b3be1796f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.377789 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 269d2bb9f1fd45f89ab765b33a502baf (DEFAULT_TABLE table=default.Table_fbc7dc910d9b4eda962ff4b9328e00a3 [id=1efcb5e6de134a54bc4250ae502080e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.383612 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6f05ae7d624efba571d059ce2f1c91 (DEFAULT_TABLE table=default.Table_00ae029b2f81402188ceedb8535a9652 [id=4ad941b11d7c4a47b5f13c8504c0ac28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.429669 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 6efb29f2e56c4838b0efd0171229088a (DEFAULT_TABLE table=default.Table_69cc8ac4971244b09b6fec4788813e2c [id=bf54a099a679476485430b505a037ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.431511 28964 tablet_service.cc:1511] Processing CreateTablet for tablet 5df6af49cb484f59ad1f32235753e1db (DEFAULT_TABLE table=default.Table_0c3573fbceb84376afbe284979c815a2 [id=8ebd35bd7b464cd489f6a15d0e70800e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.431769 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938b61a0f6dc4d178971034fd18c1674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.432103 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df6af49cb484f59ad1f32235753e1db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.432432 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eaddd6519dc490c8358be629b21a2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.432574 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a5e5917a414c99b25ea2efeab4063d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.432647 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c73ae1007d44ce958ad02fa5787651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.432821 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ca961cfea54a7187cc7ea8d16a627f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.432843 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df6af49cb484f59ad1f32235753e1db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.432993 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7eb77c619e04c448a084638668dbb6a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:51.432981 28925 leader_election.cc:343] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:51.433267 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ebcfc80ca64129a7ab939bfd853998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.432463 28969 tablet_service.cc:1511] Processing CreateTablet for tablet b6bc2304de37441bb78cd12cab5ca3c3 (DEFAULT_TABLE table=default.Table_f2c4f9d463814ae2883f800f27c5d14d [id=2e23848d3d274b3b950f282dc2e7b767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.434182 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6bc2304de37441bb78cd12cab5ca3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.434652 28925 leader_election.cc:304] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:51.435129 29866 raft_consensus.cc:2749] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:51.437559 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938b61a0f6dc4d178971034fd18c1674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.437758 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e20a1092b746a8b8ddd4386a682229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.437795 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde88371f4454a4bb3053c6cd1afb801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.438380 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64538fdf51f94e8e985fec6202baac22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.438577 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2797384f7845969ee9744b444f1acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.441519 29822 raft_consensus.cc:515] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.443039 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb408723f7a346c3b5ea13cad237b44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.444389 29383 tablet_bootstrap.cc:654] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:51.450403 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c59cf5f5e8486baf1e038a44657f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.450278 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85271eeb854194a968215ebc08f47a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:51.451529 29062 leader_election.cc:343] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1f32ebd7448843b48b981d3d70a87023
W20260617 20:16:51.452118 29198 leader_election.cc:343] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:51.452279 29198 leader_election.cc:304] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:51.456895 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 26ebcfc80ca64129a7ab939bfd853998 (DEFAULT_TABLE table=default.Table_80559e5b402d45f3965620a4955011f7 [id=245d91c02e934103bc0e7b095fe1c9e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.457144 29740 raft_consensus.cc:2749] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:51.457722 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6f05ae7d624efba571d059ce2f1c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.459391 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fad470e9ef3042889cc803e1d6df2218" } new_table_name: "default.Table_4a7f7c881fa94dccb545ca3370f59ec9" modify_external_catalogs: true
I20260617 20:16:51.459887 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 938b61a0f6dc4d178971034fd18c1674 (DEFAULT_TABLE table=default.Table_cdbdfa69a2ce497ea08811de10403d4a [id=a2424a096b1c4a8fa97b06acfdd7f1b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.460652 28664 catalog_manager.cc:5696] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:51.461153 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:51.461233 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_114940544693456c815446c3d3ec85bd" } new_table_name: "default.Table_f1bd0e3c31144e44a9480f046b282290" modify_external_catalogs: true
I20260617 20:16:51.461336 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0c03983bb7554bf081b91ed5c44c8f56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.461930 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c03983bb7554bf081b91ed5c44c8f56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.461957 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_af28a00e98914b0ab585c8d9ee784ed5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:51.462011 29062 leader_election.cc:304] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:51.460965 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c73ae1007d44ce958ad02fa5787651. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:51.462419 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af28a00e98914b0ab585c8d9ee784ed5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.463405 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a215554510c74346a7e3d04c99b98de2" } new_table_name: "default.Table_9511f5b57e564dab852577b8b6dd172a" modify_external_catalogs: true
I20260617 20:16:51.463522 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5b91f4d24aeb4208b2b9082d421fd325"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.463992 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b91f4d24aeb4208b2b9082d421fd325 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.465063 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8fe57f69092a42f585d9f8c5abeb30f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:51.465168 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 1d4be33993864c73ba8b4da9468a517b (table default.Table_e67bded1adac4a9194ee9f5f1131ed12 [id=6e89910c5d7a4969a79960d34eff437c]) successfully deleted
W20260617 20:16:51.465523 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fe57f69092a42f585d9f8c5abeb30f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.466362 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c59cf5f5e8486baf1e038a44657f33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.466624 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_636eb4922f27475dacee040515cd1500"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.467048 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_636eb4922f27475dacee040515cd1500 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.468022 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ca961cfea54a7187cc7ea8d16a627f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.468159 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1f88ccaa637f4d0dbbe47f2096bb5456"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:51.468375 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 269d2bb9f1fd45f89ab765b33a502baf (DEFAULT_TABLE table=default.Table_fbc7dc910d9b4eda962ff4b9328e00a3 [id=1efcb5e6de134a54bc4250ae502080e6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:51.468576 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f88ccaa637f4d0dbbe47f2096bb5456 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.469265 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6f05ae7d624efba571d059ce2f1c91 (DEFAULT_TABLE table=default.Table_00ae029b2f81402188ceedb8535a9652 [id=4ad941b11d7c4a47b5f13c8504c0ac28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.479400 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 14a5e5917a414c99b25ea2efeab4063d (DEFAULT_TABLE table=default.Table_d3381a68eac743b28435e4756ba0cb2e [id=d714bd16d06041a2a930d45e8409ab88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.479768 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64538fdf51f94e8e985fec6202baac22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.480227 29094 tablet_service.cc:1511] Processing CreateTablet for tablet f823290351d542179b8bcc683d7acf6a (DEFAULT_TABLE table=default.Table_40053ed1f4264c3993f829af0bea9f13 [id=a5d095adc0744ee49bba7dca6126d33f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.480767 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e20a1092b746a8b8ddd4386a682229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.483595 29099 tablet_service.cc:1511] Processing CreateTablet for tablet eb408723f7a346c3b5ea13cad237b44e (DEFAULT_TABLE table=default.Table_608970ae0a3443c5937e3180a495bc33 [id=59b139b44cd940b491c7f17e82e6995d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:51.484858 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f239f81c40743b2aaa70a361997db77 consensus state has no leader
I20260617 20:16:51.485319 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_335178a88e53486dba06f29270337bb0" } new_table_name: "default.Table_6791b989125046d893a9c24ae1e65c12" modify_external_catalogs: true
I20260617 20:16:51.486544 29098 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e1dc756edd5473183afc75eef7112d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:51.486790 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91c99389d24d4a8d8c934f0a9b9c2825 consensus state has no leader
I20260617 20:16:51.486933 29098 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2797384f7845969ee9744b444f1acc (DEFAULT_TABLE table=default.Table_2b68c9711d6147e88a1aba5ea0a8f2bd [id=4cb0ef24b723455aacc2dc61526886d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.487185 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4bafc10932fd4cc79175b416a102af18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.487744 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4bafc10932fd4cc79175b416a102af18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.488147 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 5eaddd6519dc490c8358be629b21a2d9 (DEFAULT_TABLE table=default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.490532 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2b054c3c845f4657a3339cf535372c22" } modify_external_catalogs: true
I20260617 20:16:51.490733 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2b054c3c845f4657a3339cf535372c22" } modify_external_catalogs: true
I20260617 20:16:51.491896 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269d2bb9f1fd45f89ab765b33a502baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.497110 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1d839677a1834e13914e3c77a8f38f01" } modify_external_catalogs: true
I20260617 20:16:51.497347 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1d839677a1834e13914e3c77a8f38f01" } modify_external_catalogs: true
I20260617 20:16:51.499567 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6bc2304de37441bb78cd12cab5ca3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.500116 29892 raft_consensus.cc:2749] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:51.490842 29062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 90179.2us
I20260617 20:16:51.505966 29096 tablet_service.cc:1511] Processing CreateTablet for tablet b6bc2304de37441bb78cd12cab5ca3c3 (DEFAULT_TABLE table=default.Table_f2c4f9d463814ae2883f800f27c5d14d [id=2e23848d3d274b3b950f282dc2e7b767]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.507675 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6f05ae7d624efba571d059ce2f1c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.508898 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ebcfc80ca64129a7ab939bfd853998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.509763 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eaddd6519dc490c8358be629b21a2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.510878 29100 tablet_service.cc:1511] Processing CreateTablet for tablet e3897179e7724fdeb87a979ae4ef2091 (DEFAULT_TABLE table=default.Table_b312ecd37cf2447c864d075d578c23e8 [id=4d5a074de7654d559782d637dc23f129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.512684 29892 raft_consensus.cc:493] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:51.513094 29379 tablet_bootstrap.cc:492] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:51.513186 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 39ca961cfea54a7187cc7ea8d16a627f (DEFAULT_TABLE table=default.Table_6e3a4cd286c74acca399a55d5202d4ac [id=9eceb2e355c940f1854894b7fc8a92dc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:51.516065 29062 consensus_peers.cc:597] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a9e12c91df344ee84a586b7d4a27071. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:51.518711 28960 tablet_service.cc:1511] Processing CreateTablet for tablet ebd98889d08f4683ba4b2ee98a74254d (DEFAULT_TABLE table=default.Table_1c209b8f8876488a874cdef8f86e4a15 [id=b03839b3c5ba4a13a7e5a8b3be1796f1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:51.519500 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c3014c93d6804f3896f452f041cbedc9 consensus state has no leader
I20260617 20:16:51.521530 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_40053ed1f4264c3993f829af0bea9f13" } modify_external_catalogs: true
I20260617 20:16:51.521724 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_40053ed1f4264c3993f829af0bea9f13" } modify_external_catalogs: true
I20260617 20:16:51.523227 28667 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_921dd6771a094e7cb638a0bcd034177e [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 2 got 0
I20260617 20:16:51.524243 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a5e5917a414c99b25ea2efeab4063d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.523247 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_64a54638a38b4d8cab417ecd62e3d04a" } modify_external_catalogs: true
I20260617 20:16:51.524657 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_64a54638a38b4d8cab417ecd62e3d04a" } modify_external_catalogs: true
W20260617 20:16:51.527079 28655 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_f1bd0e3c31144e44a9480f046b282290 [id=6a948594185b42128136770dbe3f0ffb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 91c99389d24d4a8d8c934f0a9b9c2825 consensus state has no leader
I20260617 20:16:51.528561 29379 ts_tablet_manager.cc:1403] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.452s user 0.017s sys 0.026s
I20260617 20:16:51.528707 29089 tablet_service.cc:1511] Processing CreateTablet for tablet a3e20a1092b746a8b8ddd4386a682229 (DEFAULT_TABLE table=default.Table_9f236274be424e44818107f2fed5331c [id=a3772e01cb314c7e88e85833d727617d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:51.529001 29062 leader_election.cc:343] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c65a4345552844fe9e7512105fd79877
I20260617 20:16:51.529152 29062 leader_election.cc:304] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:51.529434 29855 raft_consensus.cc:2749] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:51.529533 29379 raft_consensus.cc:359] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.529742 29379 raft_consensus.cc:385] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:51.529835 29379 raft_consensus.cc:740] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:51.530081 29379 consensus_queue.cc:260] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.530623 29379 ts_tablet_manager.cc:1434] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:51.531395 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 5df6af49cb484f59ad1f32235753e1db (DEFAULT_TABLE table=default.Table_0c3573fbceb84376afbe284979c815a2 [id=8ebd35bd7b464cd489f6a15d0e70800e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.531886 29783 raft_consensus.cc:2749] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:51.533829 29377 ts_tablet_manager.cc:1929] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:51.534768 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 938b61a0f6dc4d178971034fd18c1674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.526222 29892 raft_consensus.cc:515] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.536291 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6a6c1b531b834b7394845c8421570068"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.536859 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a6c1b531b834b7394845c8421570068 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.537900 29892 leader_election.cc:290] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:51.538086 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1f88ccaa637f4d0dbbe47f2096bb5456" } modify_external_catalogs: true
I20260617 20:16:51.538259 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1f88ccaa637f4d0dbbe47f2096bb5456" } modify_external_catalogs: true
I20260617 20:16:51.539407 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0e5594d587744a97a20c6887115d761f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.539882 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e5594d587744a97a20c6887115d761f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.541725 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_941592c8a96145e3bd446c7c631f2018"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.542239 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_941592c8a96145e3bd446c7c631f2018 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:51.546698 29062 leader_election.cc:343] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: cc945cdd482f4a5593d4874e5303ecd2
I20260617 20:16:51.547390 29894 consensus_queue.cc:1048] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:51.547857 29894 raft_consensus.cc:493] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:51.548022 29894 raft_consensus.cc:515] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.548527 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269d2bb9f1fd45f89ab765b33a502baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.548664 29894 leader_election.cc:290] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:51.555964 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98467525f81f4a48878eae17e3a9c982" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:51.556679 28925 leader_election.cc:343] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:51.557610 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 6efb29f2e56c4838b0efd0171229088a (DEFAULT_TABLE table=default.Table_69cc8ac4971244b09b6fec4788813e2c [id=bf54a099a679476485430b505a037ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.558570 28953 tablet_service.cc:1511] Processing CreateTablet for tablet a17684c0e6b545d1a22801071b6a72ac (DEFAULT_TABLE table=default.Table_430bbaa8b17349048f8c2e456ddc650f [id=3b2c339d6e9542b4ac564c99abae1946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.560046 29892 consensus_queue.cc:1048] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260617 20:16:51.560595 29379 tablet_bootstrap.cc:492] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:51.563069 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2797384f7845969ee9744b444f1acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.557924 29822 leader_election.cc:290] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:51.573451 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b59053006046e98d27c694808ca34d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:51.574079 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd98889d08f4683ba4b2ee98a74254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.574105 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb408723f7a346c3b5ea13cad237b44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.575920 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3897179e7724fdeb87a979ae4ef2091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.577250 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 839ae2f924494679a1389ad61be65259 (DEFAULT_TABLE table=default.Table_c2b342d694454abb90a737a7dcb4e957 [id=151b6dafa03949f5a089baff4544f16d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.577852 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e20a1092b746a8b8ddd4386a682229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.578244 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 2d00c493a5624569b8f47242fc55b6fb (DEFAULT_TABLE table=default.Table_9c108f2be5f14aa3a1a939e8c6bb18ae [id=4e979fc0459843cd95a5268458cd5175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.578675 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f823290351d542179b8bcc683d7acf6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.578934 29377 log.cc:1199] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/1f85271eeb854194a968215ebc08f47a
I20260617 20:16:51.588821 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6f05ae7d624efba571d059ce2f1c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.589188 29239 tablet_service.cc:1511] Processing CreateTablet for tablet b6ba8b7d18af44b58800e588279e2e0b (DEFAULT_TABLE table=default.Table_725310d538304427bfe704881702f3a2 [id=489b6871a12b4a68b7f600556cfc5b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.589946 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ba8b7d18af44b58800e588279e2e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.593567 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 74c73ae1007d44ce958ad02fa5787651 (DEFAULT_TABLE table=default.Table_beb2513cd34e4d5ebfadfcf15dfb3ad9 [id=0586dbd68a634d83ab9b00d2ba7f38af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.597790 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d1654ae96ce041fa9b9b881af7dd342e
I20260617 20:16:51.599638 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 2d00c493a5624569b8f47242fc55b6fb (DEFAULT_TABLE table=default.Table_9c108f2be5f14aa3a1a939e8c6bb18ae [id=4e979fc0459843cd95a5268458cd5175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.599647 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_21d9cb8cc88843d286f599edcee65360" } new_table_name: "default.Table_7ea99b304a684f3c96d69b2c2457bbd2" modify_external_catalogs: true
I20260617 20:16:51.600037 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d00c493a5624569b8f47242fc55b6fb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:51.601091 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 13ba94ec9e27403b974e5e6fea46e59e consensus state has no leader
I20260617 20:16:51.605613 29740 consensus_queue.cc:1048] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:51.430692 29376 rpcz_store.cc:276] 0617 20:16:48.370837 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.372028 (+ 1191us) service_pool.cc:224] Handling call
0617 20:16:51.373859 (+3001831us) ts_tablet_manager.cc:1151] Deleting tablet 640f53137c21443cbfc274c084ce13ef
0617 20:16:51.373868 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:51.373978 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2997843}
I20260617 20:16:51.610066 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2797384f7845969ee9744b444f1acc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.617741 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f823290351d542179b8bcc683d7acf6a
I20260617 20:16:51.625566 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6bc2304de37441bb78cd12cab5ca3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.625856 28956 tablet_service.cc:1511] Processing CreateTablet for tablet e7eb77c619e04c448a084638668dbb6a (DEFAULT_TABLE table=default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.628548 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df6af49cb484f59ad1f32235753e1db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.633016 28968 tablet_service.cc:1511] Processing CreateTablet for tablet d2089215acdf478ca725c9d26b94d692 (DEFAULT_TABLE table=default.Table_5420a15e4fa749039b1bce59b563517d [id=395d6bc9360549c69d616b8ccf8d01cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.637181 29880 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55834 (request call id 324) took 1319 ms. Trace:
I20260617 20:16:51.637954 29378 tablet_bootstrap.cc:492] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:51.638128 29378 ts_tablet_manager.cc:1403] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 1.025s user 0.005s sys 0.022s
I20260617 20:16:51.639937 29377 ts_tablet_manager.cc:1950] T 1f85271eeb854194a968215ebc08f47a P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:51.640868 29378 raft_consensus.cc:359] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.641079 29378 raft_consensus.cc:385] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:51.641867 29378 raft_consensus.cc:740] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:51.642128 29378 consensus_queue.cc:260] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.643368 28951 tablet_service.cc:1511] Processing CreateTablet for tablet b6ba8b7d18af44b58800e588279e2e0b (DEFAULT_TABLE table=default.Table_725310d538304427bfe704881702f3a2 [id=489b6871a12b4a68b7f600556cfc5b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.644244 29097 tablet_service.cc:1511] Processing CreateTablet for tablet e7eb77c619e04c448a084638668dbb6a (DEFAULT_TABLE table=default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.649108 28957 tablet_service.cc:1511] Processing CreateTablet for tablet f43549813e294796baca2a1a64dbcfb9 (DEFAULT_TABLE table=default.Table_c410bd335d1b42b09ad898a66eae6438 [id=8015a245e8574c7580068edea8104f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.649618 28964 tablet_service.cc:1511] Processing CreateTablet for tablet dd89c8452c444af99d8bce0c7cbf8ce1 (DEFAULT_TABLE table=default.Table_25c67ca49ed44c2d84e1262214bd184c [id=4161f881b7d4474985de4581a75fcd11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.650177 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17684c0e6b545d1a22801071b6a72ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.653820 29378 ts_tablet_manager.cc:1434] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260617 20:16:51.654217 29378 tablet_bootstrap.cc:492] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:51.656399 29378 tablet_bootstrap.cc:654] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:51.657397 29233 tablet_service.cc:1511] Processing CreateTablet for tablet a17684c0e6b545d1a22801071b6a72ac (DEFAULT_TABLE table=default.Table_430bbaa8b17349048f8c2e456ddc650f [id=3b2c339d6e9542b4ac564c99abae1946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.657778 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7eb77c619e04c448a084638668dbb6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.657979 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3897179e7724fdeb87a979ae4ef2091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.658356 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17684c0e6b545d1a22801071b6a72ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.663447 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd89c8452c444af99d8bce0c7cbf8ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.665551 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43549813e294796baca2a1a64dbcfb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.669550 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2089215acdf478ca725c9d26b94d692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.677446 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 839ae2f924494679a1389ad61be65259 (DEFAULT_TABLE table=default.Table_c2b342d694454abb90a737a7dcb4e957 [id=151b6dafa03949f5a089baff4544f16d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.678031 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ba8b7d18af44b58800e588279e2e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.678900 29232 tablet_service.cc:1511] Processing CreateTablet for tablet dd89c8452c444af99d8bce0c7cbf8ce1 (DEFAULT_TABLE table=default.Table_25c67ca49ed44c2d84e1262214bd184c [id=4161f881b7d4474985de4581a75fcd11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.681080 29238 tablet_service.cc:1511] Processing CreateTablet for tablet f43549813e294796baca2a1a64dbcfb9 (DEFAULT_TABLE table=default.Table_c410bd335d1b42b09ad898a66eae6438 [id=8015a245e8574c7580068edea8104f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.683598 28661 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 7e242b4b85e24f6f97230444051dfda7
I20260617 20:16:51.686311 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 320) took 1475 ms. Trace:
I20260617 20:16:51.687081 29243 tablet_service.cc:1511] Processing CreateTablet for tablet 29c65bb7c45e40a081de91d4c1c5cf56 (DEFAULT_TABLE table=default.Table_6d8d8942e21d4268b530c31639fc4d09 [id=5a93fe98a75a43b1b652a98ee5e8d313]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.687279 29237 tablet_service.cc:1511] Processing CreateTablet for tablet eba86bae9e91404185d248dfd722a413 (DEFAULT_TABLE table=default.Table_5ea3587ee60a4b799967af4ad882af8d [id=0072f27fabf34bed8d6db874ffa929b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.687489 29241 tablet_service.cc:1511] Processing CreateTablet for tablet d2089215acdf478ca725c9d26b94d692 (DEFAULT_TABLE table=default.Table_5420a15e4fa749039b1bce59b563517d [id=395d6bc9360549c69d616b8ccf8d01cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.688843 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 90ae9c63c8c541bc91ecedd798a7d60f (DEFAULT_TABLE table=default.Table_ca6c225acdee4376bbd9af7f2f727176 [id=f6760a72c7454b1995a28b66f3a04e60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.693874 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d8e5051525524f83add520910c7b6236" } new_table_name: "default.Table_6bb71611d01f469a95325bc9bbcd5251" modify_external_catalogs: true
I20260617 20:16:51.695147 28961 tablet_service.cc:1511] Processing CreateTablet for tablet f31bf7ed828f44b398f5bdac6b9b63e7 (DEFAULT_TABLE table=default.Table_1b2e51959bad407996ecd0596aa27cf9 [id=4d5e3cf1f56e46a299375bc04e969c98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.695392 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4187f9cfd1ac4fd0b4043202908b2c0d" } new_table_name: "default.Table_8000cf41d95f4152983d7fe1d74cbdb8" modify_external_catalogs: true
I20260617 20:16:51.696374 29377 rpcz_store.cc:276] 0617 20:16:50.168462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.171091 (+ 2629us) service_pool.cc:224] Handling call
0617 20:16:50.570497 (+399406us) ts_tablet_manager.cc:1151] Deleting tablet 1f85271eeb854194a968215ebc08f47a
0617 20:16:50.570509 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:50.727624 (+157115us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:51.518052 (+790428us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:51.644205 (+126153us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":355993}
I20260617 20:16:51.699402 29377 tablet_replica.cc:333] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:51.699632 29377 raft_consensus.cc:2243] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:51.699872 29377 raft_consensus.cc:2272] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:51.700513 29377 ts_tablet_manager.cc:1916] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:51.701045 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_00e6d18efea641ec906c6dc4d4d2b1c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.701709 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00e6d18efea641ec906c6dc4d4d2b1c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.702744 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 1f85271eeb854194a968215ebc08f47a (table default.Table_8278dd326f2d440e9b3823471e55dff7 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]) successfully deleted
I20260617 20:16:51.707388 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 71342100c8f746d384b4cef73086afd2 (DEFAULT_TABLE table=default.Table_78df0b7688e5419a8ae514d3c4e5399e [id=62448d1c0fe54010b3b491e6c5b47bfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.708545 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90ae9c63c8c541bc91ecedd798a7d60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.709515 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 07ec778da4c9467d90c7151f36ffaa79 (DEFAULT_TABLE table=default.Table_9a7ec2d038854bc8a0dc81693ad4c0d7 [id=1d82dfca17c74fc5a145191440d60830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.723513 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ec778da4c9467d90c7151f36ffaa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.711539 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 4d81457d71a34657b43c8ebe7efb0a35 (DEFAULT_TABLE table=default.Table_8965f5e6c4ae469dac6a88b85b1bf4c8 [id=2227f7b95a09462191318944bd063156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.724584 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d81457d71a34657b43c8ebe7efb0a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.714095 28958 tablet_service.cc:1511] Processing CreateTablet for tablet eba86bae9e91404185d248dfd722a413 (DEFAULT_TABLE table=default.Table_5ea3587ee60a4b799967af4ad882af8d [id=0072f27fabf34bed8d6db874ffa929b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.725445 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba86bae9e91404185d248dfd722a413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.716048 28962 tablet_service.cc:1511] Processing CreateTablet for tablet e79c6804fbb34f5baebdb366f2e0b1bf (DEFAULT_TABLE table=default.Table_7c4828773d3f4868b2cd864f1d246a27 [id=dccd13aa95b94b70882f6a59e71d2bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.726814 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79c6804fbb34f5baebdb366f2e0b1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.728186 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ae2f924494679a1389ad61be65259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.729164 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71342100c8f746d384b4cef73086afd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.647673 29880 rpcz_store.cc:276] 0617 20:16:50.226117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.226404 (+ 287us) service_pool.cc:224] Handling call
0617 20:16:51.545889 (+1319485us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:16:50.464641 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0617 20:16:50.464985 (+ 344us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0617 20:16:50.464993 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
0617 20:16:50.465000 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0617 20:16:50.465049 (+ 49us) alter_schema_op.cc:128] START. Timestamp: 1781727410465014
0617 20:16:50.465053 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:16:50.476535 (+ 11482us) log.cc:844] Serialized 173 byte log entry
0617 20:16:50.899525 (+422990us) op_driver.cc:464] REPLICATION: finished
0617 20:16:51.315270 (+415745us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0617 20:16:51.336516 (+ 21246us) log.cc:844] Serialized 5 byte log entry
0617 20:16:51.545577 (+209061us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:51.545801 (+ 224us) log.cc:844] Serialized 14 byte log entry
0617 20:16:51.545848 (+ 47us) alter_schema_op.cc:73] Released schema lock
0617 20:16:51.545852 (+ 4us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":415701,"prepare.queue_time_us":215459,"prepare.run_cpu_time_us":718,"prepare.run_wall_time_us":39714,"raft.queue_time_us":40,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":211,"replication_time_us":434440,"thread_start_us":677345,"threads_started":2}]]}
I20260617 20:16:51.731194 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31bf7ed828f44b398f5bdac6b9b63e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.731748 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 90ae9c63c8c541bc91ecedd798a7d60f (DEFAULT_TABLE table=default.Table_ca6c225acdee4376bbd9af7f2f727176 [id=f6760a72c7454b1995a28b66f3a04e60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.734277 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd98889d08f4683ba4b2ee98a74254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.745440 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6efb29f2e56c4838b0efd0171229088a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.757956 29240 tablet_service.cc:1511] Processing CreateTablet for tablet f31bf7ed828f44b398f5bdac6b9b63e7 (DEFAULT_TABLE table=default.Table_1b2e51959bad407996ecd0596aa27cf9 [id=4d5e3cf1f56e46a299375bc04e969c98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.731436 29226 tablet_service.cc:1511] Processing CreateTablet for tablet e79c6804fbb34f5baebdb366f2e0b1bf (DEFAULT_TABLE table=default.Table_7c4828773d3f4868b2cd864f1d246a27 [id=dccd13aa95b94b70882f6a59e71d2bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.759498 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 07ec778da4c9467d90c7151f36ffaa79 (DEFAULT_TABLE table=default.Table_9a7ec2d038854bc8a0dc81693ad4c0d7 [id=1d82dfca17c74fc5a145191440d60830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.760741 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 20d0b861d48e4baf94387f4ff9d9f778 (DEFAULT_TABLE table=default.Table_3f75a4b3577e427ba1b39fa83075b1c2 [id=7c94e39032fa4cf39a1187691bff2739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.762626 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 71342100c8f746d384b4cef73086afd2 (DEFAULT_TABLE table=default.Table_78df0b7688e5419a8ae514d3c4e5399e [id=62448d1c0fe54010b3b491e6c5b47bfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.763406 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 4d81457d71a34657b43c8ebe7efb0a35 (DEFAULT_TABLE table=default.Table_8965f5e6c4ae469dac6a88b85b1bf4c8 [id=2227f7b95a09462191318944bd063156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.764026 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 250) took 3301 ms. Trace:
I20260617 20:16:51.764176 29376 rpcz_store.cc:276] 0617 20:16:48.370390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.372166 (+ 1776us) service_pool.cc:224] Handling call
0617 20:16:51.611784 (+3239618us) ts_tablet_manager.cc:1151] Deleting tablet 0859e56b5b7a483ea5e751f0468cbab8
0617 20:16:51.612066 (+ 282us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:51.672307 (+ 60241us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3230068}
I20260617 20:16:51.768144 29376 tablet_replica.cc:333] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:51.768349 29376 raft_consensus.cc:2243] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:51.758204 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 29c65bb7c45e40a081de91d4c1c5cf56 (DEFAULT_TABLE table=default.Table_6d8d8942e21d4268b530c31639fc4d09 [id=5a93fe98a75a43b1b652a98ee5e8d313]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.770562 29376 raft_consensus.cc:2272] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:51.771222 29376 ts_tablet_manager.cc:1916] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:51.771584 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43549813e294796baca2a1a64dbcfb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.771869 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79c6804fbb34f5baebdb366f2e0b1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.772043 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d81457d71a34657b43c8ebe7efb0a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.772208 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31bf7ed828f44b398f5bdac6b9b63e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.772452 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2089215acdf478ca725c9d26b94d692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.772720 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ae2f924494679a1389ad61be65259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.772642 29233 tablet_service.cc:1511] Processing CreateTablet for tablet a6522ae212784b7ebd47cc3403aa3477 (DEFAULT_TABLE table=default.Table_9b9ef0f3fc184c1d86b33196c9b9ae9d [id=a63c4334ac2d4313b19978ee3b4eeff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.773214 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7c4828773d3f4868b2cd864f1d246a27" } new_table_name: "default.Table_c31a6d3cec584680a4f793abe57f6d24" modify_external_catalogs: true
I20260617 20:16:51.774156 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_977eca2b43be413ea87a6f080ea27de0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.774746 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_977eca2b43be413ea87a6f080ea27de0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.778507 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d00c493a5624569b8f47242fc55b6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.780983 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c65bb7c45e40a081de91d4c1c5cf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.781574 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 20d0b861d48e4baf94387f4ff9d9f778 (DEFAULT_TABLE table=default.Table_3f75a4b3577e427ba1b39fa83075b1c2 [id=7c94e39032fa4cf39a1187691bff2739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.785755 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d0b861d48e4baf94387f4ff9d9f778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.772946 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c65bb7c45e40a081de91d4c1c5cf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.792542 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ec778da4c9467d90c7151f36ffaa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.793190 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6efb29f2e56c4838b0efd0171229088a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.796316 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ca961cfea54a7187cc7ea8d16a627f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.799996 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_db50db05c3ad4692b84d8d9154f77369"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.800542 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db50db05c3ad4692b84d8d9154f77369 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:51.804989 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 640f53137c21443cbfc274c084ce13ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 640f53137c21443cbfc274c084ce13ef already in progress: creating tablet
I20260617 20:16:51.808583 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_05e9fa4b726a482ea4de0b4b6e982624"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.809165 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05e9fa4b726a482ea4de0b4b6e982624 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:51.810526 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dcd999d88d954e50810cc01b297a27a9 consensus state has no leader
I20260617 20:16:51.810886 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6ff346c8167a49878fc3900007fa2904"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.811383 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ff346c8167a49878fc3900007fa2904 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.833469 29375 ts_tablet_manager.cc:1929] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:16:51.848542 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7efe079091784d7e8035659edd442ba6 consensus state has no leader
I20260617 20:16:51.848515 29892 raft_consensus.cc:493] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:51.849922 28661 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_921dd6771a094e7cb638a0bcd034177e [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 2 got 0
I20260617 20:16:51.850749 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_bd9c906c4e4d4dab8971c902645a444e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.851439 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd9c906c4e4d4dab8971c902645a444e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:51.852125 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 326eb1cffb9a47078320e6fcba0743ce consensus state has no leader
I20260617 20:16:51.852448 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cdbdfa69a2ce497ea08811de10403d4a" } modify_external_catalogs: true
I20260617 20:16:51.852591 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cdbdfa69a2ce497ea08811de10403d4a" } modify_external_catalogs: true
I20260617 20:16:51.852813 29103 tablet_service.cc:1511] Processing CreateTablet for tablet ebd98889d08f4683ba4b2ee98a74254d (DEFAULT_TABLE table=default.Table_1c209b8f8876488a874cdef8f86e4a15 [id=b03839b3c5ba4a13a7e5a8b3be1796f1]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:51.854044 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e79c6804fbb34f5baebdb366f2e0b1bf consensus state has no leader
I20260617 20:16:51.854387 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_de0e4c82e4f54440a70e579ac74c0edd" } new_table_name: "default.Table_60d477681d1a4083b05f1e0d08fcfdd8" modify_external_catalogs: true
I20260617 20:16:51.856086 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8d26d11366614614982fcb5b40bb6620"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.856566 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d26d11366614614982fcb5b40bb6620 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.858516 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_dd4d087b046a40bbbb48af81d2074752" } modify_external_catalogs: true
I20260617 20:16:51.858680 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_dd4d087b046a40bbbb48af81d2074752" } modify_external_catalogs: true
I20260617 20:16:51.859792 29379 tablet_bootstrap.cc:654] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:51.863718 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8388a2681a87463b92758e227df2b510"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:51.864279 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8388a2681a87463b92758e227df2b510 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:51.867033 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 99a3d9ae347845dfa9357010819ebc58
W20260617 20:16:51.882277 29107 consensus_meta.cc:287] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent flushing consensus metadata: real 0.578s user 0.002s sys 0.000s
I20260617 20:16:51.887167 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4de9b511b49b48cca1674d8532df65cd" } modify_external_catalogs: true
I20260617 20:16:51.887428 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4de9b511b49b48cca1674d8532df65cd" } modify_external_catalogs: true
I20260617 20:16:51.902843 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b59053006046e98d27c694808ca34d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:51.912742 29378 tablet_bootstrap.cc:492] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:51.913050 29378 ts_tablet_manager.cc:1403] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.259s user 0.007s sys 0.002s
I20260617 20:16:51.914124 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 6efb29f2e56c4838b0efd0171229088a (DEFAULT_TABLE table=default.Table_69cc8ac4971244b09b6fec4788813e2c [id=bf54a099a679476485430b505a037ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.918601 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 26ebcfc80ca64129a7ab939bfd853998 (DEFAULT_TABLE table=default.Table_80559e5b402d45f3965620a4955011f7 [id=245d91c02e934103bc0e7b095fe1c9e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.922806 29375 log.cc:1199] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/3b67b915758d4ab0a8faa0227de08593
I20260617 20:16:51.922851 29892 raft_consensus.cc:515] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:51.923275 29375 ts_tablet_manager.cc:1950] T 3b67b915758d4ab0a8faa0227de08593 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:51.923660 29892 leader_election.cc:290] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:51.924131 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7eb77c619e04c448a084638668dbb6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.924181 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d0b861d48e4baf94387f4ff9d9f778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.923666 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 323) took 1502 ms. Trace:
I20260617 20:16:51.930559 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 5eaddd6519dc490c8358be629b21a2d9 (DEFAULT_TABLE table=default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.936458 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ebcfc80ca64129a7ab939bfd853998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.941375 29105 tablet_service.cc:1511] Processing CreateTablet for tablet b6ba8b7d18af44b58800e588279e2e0b (DEFAULT_TABLE table=default.Table_725310d538304427bfe704881702f3a2 [id=489b6871a12b4a68b7f600556cfc5b8e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:51.942772 29062 leader_election.cc:343] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 808c455e74e645aa8e2b0d08ca81d4f9
I20260617 20:16:51.942981 29107 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 337) took 1104 ms. Trace:
I20260617 20:16:51.943101 29107 rpcz_store.cc:276] 0617 20:16:50.778130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.779066 (+ 936us) service_pool.cc:224] Handling call
0617 20:16:50.779440 (+ 374us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:50.779461 (+ 21us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:51.298406 (+518945us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:51.882465 (+584059us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:51.882645 (+ 180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:51.939651 29375 rpcz_store.cc:276] 0617 20:16:50.421528 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.421586 (+ 58us) service_pool.cc:224] Handling call
0617 20:16:51.070152 (+648566us) ts_tablet_manager.cc:1151] Deleting tablet 3b67b915758d4ab0a8faa0227de08593
0617 20:16:51.070163 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:51.486011 (+415848us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:51.833395 (+347384us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:51.923605 (+ 90210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":648309}
I20260617 20:16:51.955789 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eaddd6519dc490c8358be629b21a2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.956897 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 3b67b915758d4ab0a8faa0227de08593 (table default.Table_ef23aa968984448793f5605fea074d86 [id=f521ee60b1604df983bce5d5c1d0b3d1]) successfully deleted
I20260617 20:16:51.965211 28952 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55834 (request call id 350) took 1085 ms. Trace:
I20260617 20:16:51.965816 29852 raft_consensus.cc:493] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:16:51.966205 29198 consensus_peers.cc:597] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:51.972148 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba86bae9e91404185d248dfd722a413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.972079 29852 raft_consensus.cc:515] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.975332 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 67a3124306094c72ad78e5473aa35bdb
I20260617 20:16:51.979161 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98467525f81f4a48878eae17e3a9c982" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:51.981498 29894 raft_consensus.cc:493] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:51.981712 29894 raft_consensus.cc:515] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:51.981884 29260 raft_consensus.cc:2468] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:51.981503 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6522ae212784b7ebd47cc3403aa3477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.982728 28956 tablet_service.cc:1511] Processing CreateTablet for tablet a6522ae212784b7ebd47cc3403aa3477 (DEFAULT_TABLE table=default.Table_9b9ef0f3fc184c1d86b33196c9b9ae9d [id=a63c4334ac2d4313b19978ee3b4eeff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.985332 28958 tablet_service.cc:1511] Processing CreateTablet for tablet da50400f49e24ca589519e6ec823957d (DEFAULT_TABLE table=default.Table_dd4d087b046a40bbbb48af81d2074752 [id=aa96a291aaef4872b81313bb635ebba0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.985380 28964 tablet_service.cc:1511] Processing CreateTablet for tablet 326eb1cffb9a47078320e6fcba0743ce (DEFAULT_TABLE table=default.Table_4187f9cfd1ac4fd0b4043202908b2c0d [id=42f2f56c7b0f4ac4bddd9a9eea89a7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.987604 29852 leader_election.cc:290] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:51.987749 29261 raft_consensus.cc:3060] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:51.989070 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 0859e56b5b7a483ea5e751f0468cbab8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0859e56b5b7a483ea5e751f0468cbab8 already in progress: creating tablet
I20260617 20:16:51.989624 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 80d778641c354c679ee9e7d7b3eae3b5 (DEFAULT_TABLE table=default.Table_0f2a772bda6e4476b8b5a42f9d0fb42f [id=de3384ef7984460abc15ca893a9f8c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:51.984443 29378 raft_consensus.cc:359] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:51.986383 28952 rpcz_store.cc:276] 0617 20:16:50.872707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.882494 (+ 9787us) service_pool.cc:224] Handling call
0617 20:16:51.285051 (+402557us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.285340 (+ 289us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:51.717928 (+432588us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:51.898889 (+180961us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:51.958111 (+ 59222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:51.992312 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6522ae212784b7ebd47cc3403aa3477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.993284 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet b3278efaad07403ca0a2baecad46d0f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 08290c23fff5449481789b29d15c4781) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.002336 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet f823290351d542179b8bcc683d7acf6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.002622 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet 99a3d9ae347845dfa9357010819ebc58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.003367 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326eb1cffb9a47078320e6fcba0743ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:51.985280 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 49e7a29b7fdd411e9957d23861a996db (DEFAULT_TABLE table=default.Table_1e0e98bdedab480c9d07bc266771250e [id=55e2fa74a9a4405886cfb7982e27eb5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.007478 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8bd2d33a2bb845f6879b462750ebe59c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.008113 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bd2d33a2bb845f6879b462750ebe59c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.012755 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2d169273aef9434c86e36818639e3879"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.013321 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d169273aef9434c86e36818639e3879 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.013460 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 49e7a29b7fdd411e9957d23861a996db (DEFAULT_TABLE table=default.Table_1e0e98bdedab480c9d07bc266771250e [id=55e2fa74a9a4405886cfb7982e27eb5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.013906 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet 569e339c17764486a65a1c3b43c92adf with delete_type TABLET_DATA_DELETED (replaced by tablet f4de5dafb1474de1911148bb3b4527cf) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.014159 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3124306094c72ad78e5473aa35bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.014437 29378 raft_consensus.cc:385] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:52.014551 29378 raft_consensus.cc:740] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:52.014895 29378 consensus_queue.cc:260] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.015585 29378 ts_tablet_manager.cc:1434] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.102s user 0.002s sys 0.000s
I20260617 20:16:52.015602 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98467525f81f4a48878eae17e3a9c982" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:52.015944 29378 tablet_bootstrap.cc:492] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:52.016014 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 324) took 1341 ms. Trace:
I20260617 20:16:52.016137 29375 rpcz_store.cc:276] 0617 20:16:50.643686 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.643850 (+ 164us) service_pool.cc:224] Handling call
0617 20:16:51.956568 (+1312718us) ts_tablet_manager.cc:1151] Deleting tablet 46ea43994a0a42fe9e16d7bc6a2118e6
0617 20:16:51.956578 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:51.985029 (+ 28451us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1312462}
I20260617 20:16:52.016362 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 08290c23fff5449481789b29d15c4781 (DEFAULT_TABLE table=default.Table_8ffb0a0b802f41e386bc73ae7574b693 [id=35f8afdc04fb4a1ebb52996f33d62d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.016592 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 325) took 1369 ms. Trace:
I20260617 20:16:52.016724 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet d1654ae96ce041fa9b9b881af7dd342e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.016680 29375 rpcz_store.cc:276] 0617 20:16:50.647234 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.647292 (+ 58us) service_pool.cc:224] Handling call
0617 20:16:52.016409 (+1369117us) ts_tablet_manager.cc:1151] Deleting tablet 3726e55ed36f420ab63bcfb5a81c5aab
0617 20:16:52.016422 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.016534 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1368844}
I20260617 20:16:52.017067 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 328) took 1278 ms. Trace:
I20260617 20:16:52.017146 29375 rpcz_store.cc:276] 0617 20:16:50.738321 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.740081 (+ 1760us) service_pool.cc:224] Handling call
0617 20:16:52.016907 (+1276826us) ts_tablet_manager.cc:1151] Deleting tablet e59430dd630b4ca6b573ea4230212abf
0617 20:16:52.016916 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.017015 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1276583}
I20260617 20:16:52.017539 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 332) took 1244 ms. Trace:
I20260617 20:16:52.017627 29375 rpcz_store.cc:276] 0617 20:16:50.772737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.772795 (+ 58us) service_pool.cc:224] Handling call
0617 20:16:52.017365 (+1244570us) ts_tablet_manager.cc:1151] Deleting tablet f8e0c5d20a4548cc8124302aa38bcb21
0617 20:16:52.017373 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.017492 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1244328}
I20260617 20:16:52.017926 29375 tablet_replica.cc:333] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
W20260617 20:16:52.018622 29063 leader_election.cc:343] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: cc945cdd482f4a5593d4874e5303ecd2
I20260617 20:16:52.018779 29063 leader_election.cc:304] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:52.019730 29783 raft_consensus.cc:2749] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:52.019959 29783 consensus_queue.cc:1048] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:52.020893 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eee68618cdf462283d7fd9f098c2a0d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:52.021801 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c73ae1007d44ce958ad02fa5787651. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.024789 29099 tablet_service.cc:1511] Processing CreateTablet for tablet a17684c0e6b545d1a22801071b6a72ac (DEFAULT_TABLE table=default.Table_430bbaa8b17349048f8c2e456ddc650f [id=3b2c339d6e9542b4ac564c99abae1946]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.025228 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17684c0e6b545d1a22801071b6a72ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:52.026510 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46ea43994a0a42fe9e16d7bc6a2118e6 already in progress: creating tablet
I20260617 20:16:52.026714 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_db50db05c3ad4692b84d8d9154f77369" } new_table_name: "default.Table_bce9de9998f24268b102dad1f0842744" modify_external_catalogs: true
W20260617 20:16:52.026904 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet e59430dd630b4ca6b573ea4230212abf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e59430dd630b4ca6b573ea4230212abf already in progress: creating tablet
W20260617 20:16:52.027127 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet f8e0c5d20a4548cc8124302aa38bcb21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8e0c5d20a4548cc8124302aa38bcb21 already in progress: creating tablet
I20260617 20:16:52.029857 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269d2bb9f1fd45f89ab765b33a502baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.033435 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71342100c8f746d384b4cef73086afd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.033488 29239 tablet_service.cc:1511] Processing CreateTablet for tablet 326eb1cffb9a47078320e6fcba0743ce (DEFAULT_TABLE table=default.Table_4187f9cfd1ac4fd0b4043202908b2c0d [id=42f2f56c7b0f4ac4bddd9a9eea89a7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.035292 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 2d00c493a5624569b8f47242fc55b6fb (DEFAULT_TABLE table=default.Table_9c108f2be5f14aa3a1a939e8c6bb18ae [id=4e979fc0459843cd95a5268458cd5175]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.036588 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98467525f81f4a48878eae17e3a9c982" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:52.036983 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90ae9c63c8c541bc91ecedd798a7d60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.037375 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326eb1cffb9a47078320e6fcba0743ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.038637 29098 tablet_service.cc:1511] Processing CreateTablet for tablet f43549813e294796baca2a1a64dbcfb9 (DEFAULT_TABLE table=default.Table_c410bd335d1b42b09ad898a66eae6438 [id=8015a245e8574c7580068edea8104f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.040035 29894 leader_election.cc:290] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:52.041353 29230 tablet_service.cc:1511] Processing CreateTablet for tablet da50400f49e24ca589519e6ec823957d (DEFAULT_TABLE table=default.Table_dd4d087b046a40bbbb48af81d2074752 [id=aa96a291aaef4872b81313bb635ebba0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.042665 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d778641c354c679ee9e7d7b3eae3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.044198 28989 raft_consensus.cc:2468] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:52.048017 29092 tablet_service.cc:1511] Processing CreateTablet for tablet d2089215acdf478ca725c9d26b94d692 (DEFAULT_TABLE table=default.Table_5420a15e4fa749039b1bce59b563517d [id=395d6bc9360549c69d616b8ccf8d01cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.050113 29892 raft_consensus.cc:493] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:52.050264 29892 raft_consensus.cc:515] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.050899 29892 leader_election.cc:290] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:52.051992 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 29c65bb7c45e40a081de91d4c1c5cf56 (DEFAULT_TABLE table=default.Table_6d8d8942e21d4268b530c31639fc4d09 [id=5a93fe98a75a43b1b652a98ee5e8d313]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:52.035961 29197 consensus_peers.cc:597] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b67b915758d4ab0a8faa0227de08593. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:16:52.056249 29198 leader_election.cc:343] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:52.056244 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 66326.2us
W20260617 20:16:52.056597 29198 leader_election.cc:343] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:52.056996 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 80d778641c354c679ee9e7d7b3eae3b5 (DEFAULT_TABLE table=default.Table_0f2a772bda6e4476b8b5a42f9d0fb42f [id=de3384ef7984460abc15ca893a9f8c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.030965 28925 leader_election.cc:304] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:16:52.069985 29062 leader_election.cc:343] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 33e4407aa01642ffb03eba1b220afdba
I20260617 20:16:52.071902 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 839ae2f924494679a1389ad61be65259 (DEFAULT_TABLE table=default.Table_c2b342d694454abb90a737a7dcb4e957 [id=151b6dafa03949f5a089baff4544f16d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.073560 29197 leader_election.cc:304] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:52.075831 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49e7a29b7fdd411e9957d23861a996db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.077498 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6efb29f2e56c4838b0efd0171229088a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.083272 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d00c493a5624569b8f47242fc55b6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.094739 29822 raft_consensus.cc:2804] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:52.094892 29822 raft_consensus.cc:493] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:52.095933 29822 raft_consensus.cc:3060] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:52.098716 29383 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.575s user 0.057s sys 0.107s
W20260617 20:16:52.098853 29383 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.652s user 0.057s sys 0.107s
I20260617 20:16:52.099228 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08290c23fff5449481789b29d15c4781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.101670 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da50400f49e24ca589519e6ec823957d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.104617 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet 808c455e74e645aa8e2b0d08ca81d4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.106786 29094 tablet_service.cc:1511] Processing CreateTablet for tablet dd89c8452c444af99d8bce0c7cbf8ce1 (DEFAULT_TABLE table=default.Table_25c67ca49ed44c2d84e1262214bd184c [id=4161f881b7d4474985de4581a75fcd11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.110255 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 938b61a0f6dc4d178971034fd18c1674
I20260617 20:16:52.113701 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 90ae9c63c8c541bc91ecedd798a7d60f (DEFAULT_TABLE table=default.Table_ca6c225acdee4376bbd9af7f2f727176 [id=f6760a72c7454b1995a28b66f3a04e60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.113193 29104 tablet_service.cc:1511] Processing CreateTablet for tablet f31bf7ed828f44b398f5bdac6b9b63e7 (DEFAULT_TABLE table=default.Table_1b2e51959bad407996ecd0596aa27cf9 [id=4d5e3cf1f56e46a299375bc04e969c98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.117235 29852 raft_consensus.cc:493] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:52.117643 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd89c8452c444af99d8bce0c7cbf8ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.119297 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c65bb7c45e40a081de91d4c1c5cf56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.121328 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90ae9c63c8c541bc91ecedd798a7d60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.121212 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4d29aa3f94294bdebf2c330bd7c3c063" } new_table_name: "default.Table_bb7f63dd419f420bb7bed4cf3bd9042e" modify_external_catalogs: true
I20260617 20:16:52.122884 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31bf7ed828f44b398f5bdac6b9b63e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.125691 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2089215acdf478ca725c9d26b94d692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.128716 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43549813e294796baca2a1a64dbcfb9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:52.131999 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d076991ad9fb4498a11fd22fa8339889 consensus state has no leader
I20260617 20:16:52.137284 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e67bded1adac4a9194ee9f5f1131ed12" } new_table_name: "default.Table_12cb16608a854819a7e0834654f128bb" modify_external_catalogs: true
I20260617 20:16:52.137414 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 71342100c8f746d384b4cef73086afd2 (DEFAULT_TABLE table=default.Table_78df0b7688e5419a8ae514d3c4e5399e [id=62448d1c0fe54010b3b491e6c5b47bfc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.140319 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd89c8452c444af99d8bce0c7cbf8ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.174202 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet 938b61a0f6dc4d178971034fd18c1674 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.175459 29894 raft_consensus.cc:2749] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:52.176740 28656 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 107028us
I20260617 20:16:52.177402 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e19abe093a40f6886908a8a3a0cad4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.178614 29084 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43328 (request call id 100) took 1182 ms. Trace:
I20260617 20:16:52.178727 29084 rpcz_store.cc:276] 0617 20:16:50.957455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.957532 (+ 77us) service_pool.cc:224] Handling call
0617 20:16:51.283099 (+325567us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x6160001b4054. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.139878 (+856779us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512719232}
I20260617 20:16:52.178968 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da50400f49e24ca589519e6ec823957d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.180172 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71342100c8f746d384b4cef73086afd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.183200 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 07ec778da4c9467d90c7151f36ffaa79 (DEFAULT_TABLE table=default.Table_9a7ec2d038854bc8a0dc81693ad4c0d7 [id=1d82dfca17c74fc5a145191440d60830]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.184284 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 4d81457d71a34657b43c8ebe7efb0a35 (DEFAULT_TABLE table=default.Table_8965f5e6c4ae469dac6a88b85b1bf4c8 [id=2227f7b95a09462191318944bd063156]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.186673 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 839ae2f924494679a1389ad61be65259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.188136 29852 raft_consensus.cc:515] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.189265 29852 leader_election.cc:290] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:16:52.201532 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 173356us
I20260617 20:16:52.203622 29102 tablet_service.cc:1511] Processing CreateTablet for tablet eba86bae9e91404185d248dfd722a413 (DEFAULT_TABLE table=default.Table_5ea3587ee60a4b799967af4ad882af8d [id=0072f27fabf34bed8d6db874ffa929b6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:52.219012 29912 log.cc:927] Time spent T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260617 20:16:52.220640 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d7edab01c4d54274953659f1ad4a4969" } new_table_name: "default.Table_66a0a3f036494df49e2add5e3fd4b44b" modify_external_catalogs: true
I20260617 20:16:52.236549 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet d1654ae96ce041fa9b9b881af7dd342e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.238775 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49e7a29b7fdd411e9957d23861a996db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.240451 29240 tablet_service.cc:1558] Processing DeleteTablet for tablet b3278efaad07403ca0a2baecad46d0f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 08290c23fff5449481789b29d15c4781) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.242627 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet da50400f49e24ca589519e6ec823957d
I20260617 20:16:52.254491 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_09c8c95fbef548a5a674578b0f83917a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.255313 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09c8c95fbef548a5a674578b0f83917a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.255699 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebd98889d08f4683ba4b2ee98a74254d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.260131 29383 tablet_bootstrap.cc:492] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:52.260358 29383 ts_tablet_manager.cc:1403] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.844s user 0.061s sys 0.107s
I20260617 20:16:52.265220 29378 tablet_bootstrap.cc:654] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:52.275259 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ba8b7d18af44b58800e588279e2e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.285102 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet f823290351d542179b8bcc683d7acf6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.285744 29240 tablet_service.cc:1558] Processing DeleteTablet for tablet 99a3d9ae347845dfa9357010819ebc58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.289989 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d778641c354c679ee9e7d7b3eae3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.292244 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eee68618cdf462283d7fd9f098c2a0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.293049 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 08290c23fff5449481789b29d15c4781 (DEFAULT_TABLE table=default.Table_8ffb0a0b802f41e386bc73ae7574b693 [id=35f8afdc04fb4a1ebb52996f33d62d43]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:52.301173 29198 leader_election.cc:343] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: d9b7880a039a497fbd0fb5d4f74e7d23
W20260617 20:16:52.301427 29198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 103900us
I20260617 20:16:52.307885 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6608950ce63c4189ba3fd0cca3a42bd9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.308849 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6608950ce63c4189ba3fd0cca3a42bd9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:52.307715 29124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s user 0.011s sys 0.016s
I20260617 20:16:52.322715 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ec778da4c9467d90c7151f36ffaa79. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:52.318063 29915 log.cc:927] Time spent T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
I20260617 20:16:52.327455 29377 ts_tablet_manager.cc:1929] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:52.329020 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d45c5dfa81904202b64c8dee6eb00b24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.329670 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d45c5dfa81904202b64c8dee6eb00b24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.334399 29377 log.cc:1199] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/8eee68618cdf462283d7fd9f098c2a0d
I20260617 20:16:52.338644 29822 raft_consensus.cc:515] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:52.339498 29124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s user 0.011s sys 0.016s
I20260617 20:16:52.340306 29383 raft_consensus.cc:359] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.340533 29383 raft_consensus.cc:385] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:52.340617 29383 raft_consensus.cc:740] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:52.340854 29383 consensus_queue.cc:260] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.341470 29383 ts_tablet_manager.cc:1434] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.081s user 0.001s sys 0.001s
I20260617 20:16:52.345932 29822 leader_election.cc:290] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:52.348940 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08290c23fff5449481789b29d15c4781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.349463 29377 ts_tablet_manager.cc:1950] T 8eee68618cdf462283d7fd9f098c2a0d P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:52.352758 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 321) took 2183 ms. Trace:
I20260617 20:16:52.353394 29377 rpcz_store.cc:276] 0617 20:16:50.169675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.172281 (+ 2606us) service_pool.cc:224] Handling call
0617 20:16:51.699304 (+1527023us) ts_tablet_manager.cc:1151] Deleting tablet 8eee68618cdf462283d7fd9f098c2a0d
0617 20:16:51.699316 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:51.993860 (+294544us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.276544 (+282684us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.352715 (+ 76171us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1483368}
I20260617 20:16:52.353832 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 322) took 2141 ms. Trace:
I20260617 20:16:52.354249 29377 rpcz_store.cc:276] 0617 20:16:50.214774 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.214824 (+ 50us) service_pool.cc:224] Handling call
0617 20:16:52.353677 (+2138853us) ts_tablet_manager.cc:1151] Deleting tablet b4240e14b48f4a43b7ce9c6512fc7ff2
0617 20:16:52.353686 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.353801 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2131768}
I20260617 20:16:52.354650 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 323) took 2133 ms. Trace:
I20260617 20:16:52.355136 29377 rpcz_store.cc:276] 0617 20:16:50.220916 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.221021 (+ 105us) service_pool.cc:224] Handling call
0617 20:16:52.354515 (+2133494us) ts_tablet_manager.cc:1151] Deleting tablet 0e6cee209a5a44d6b35eb50e9c33228f
0617 20:16:52.354525 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.354619 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2084223}
I20260617 20:16:52.355599 29377 tablet_replica.cc:333] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:52.356297 29383 tablet_bootstrap.cc:492] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:52.368598 29107 tablet_service.cc:1511] Processing CreateTablet for tablet e79c6804fbb34f5baebdb366f2e0b1bf (DEFAULT_TABLE table=default.Table_7c4828773d3f4868b2cd864f1d246a27 [id=dccd13aa95b94b70882f6a59e71d2bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.369565 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eba86bae9e91404185d248dfd722a413. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:52.369351 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 308606us
I20260617 20:16:52.369721 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98467525f81f4a48878eae17e3a9c982" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:16:52.370802 28925 leader_election.cc:343] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:52.373584 29923 raft_consensus.cc:493] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:52.373884 29923 raft_consensus.cc:515] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.374966 29923 leader_election.cc:290] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:52.376036 29375 raft_consensus.cc:2243] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:52.376613 29378 tablet_bootstrap.cc:492] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:52.376817 29378 ts_tablet_manager.cc:1403] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.361s user 0.005s sys 0.012s
I20260617 20:16:52.377723 29378 raft_consensus.cc:359] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.378089 29378 raft_consensus.cc:385] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:52.378320 29378 raft_consensus.cc:740] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:52.378583 29378 consensus_queue.cc:260] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.379223 29378 ts_tablet_manager.cc:1434] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:52.380121 29379 tablet_bootstrap.cc:492] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:52.382704 29378 tablet_bootstrap.cc:492] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:52.383265 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79c6804fbb34f5baebdb366f2e0b1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.384859 29378 tablet_bootstrap.cc:654] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:52.386497 29379 ts_tablet_manager.cc:1403] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.823s user 0.003s sys 0.014s
I20260617 20:16:52.387111 29375 pending_rounds.cc:70] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:52.387184 29375 pending_rounds.cc:77] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955472707088384 op_type: NO_OP noop_request { }
I20260617 20:16:52.387328 29375 raft_consensus.cc:2889] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:52.387452 29375 raft_consensus.cc:2272] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:52.388381 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e19abe093a40f6886908a8a3a0cad4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:52.388999 28925 leader_election.cc:343] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:52.393783 28631 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRePpQS/build/asan/bin/kudu pid 28707
I20260617 20:16:52.394971 28771 generic_service.cc:196] Checking for leaks (request via RPC)
I20260617 20:16:52.395157 29377 raft_consensus.cc:2243] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:52.395335 29377 raft_consensus.cc:2272] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:52.395921 29377 ts_tablet_manager.cc:1916] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:52.398787 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet cf8d04ef8acd4fcaa69df9253cd89462
I20260617 20:16:52.403462 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d81457d71a34657b43c8ebe7efb0a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.422202 29237 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 407) took 1028 ms. Trace:
I20260617 20:16:52.422516 29236 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 403) took 1029 ms. Trace:
I20260617 20:16:52.422992 29232 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 395) took 1030 ms. Trace:
I20260617 20:16:52.423190 29376 ts_tablet_manager.cc:1929] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:52.423300 29376 log.cc:1199] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/7a81a3502f5d4602b65328577a668d62
I20260617 20:16:52.423677 29376 ts_tablet_manager.cc:1950] T 7a81a3502f5d4602b65328577a668d62 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:52.403695 29375 ts_tablet_manager.cc:1916] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:52.424440 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 258) took 4027 ms. Trace:
I20260617 20:16:52.424546 29376 rpcz_store.cc:276] 0617 20:16:48.396676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.396729 (+ 53us) service_pool.cc:224] Handling call
0617 20:16:51.764476 (+3367747us) ts_tablet_manager.cc:1151] Deleting tablet 7a81a3502f5d4602b65328577a668d62
0617 20:16:51.764485 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.127786 (+363301us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.375578 (+247792us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.424404 (+ 48826us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3367513}
I20260617 20:16:52.424985 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 259) took 4012 ms. Trace:
I20260617 20:16:52.425060 29378 tablet_bootstrap.cc:492] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:52.425089 29376 rpcz_store.cc:276] 0617 20:16:48.412219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.423434 (+ 11215us) service_pool.cc:224] Handling call
0617 20:16:52.424798 (+4001364us) ts_tablet_manager.cc:1151] Deleting tablet af9c687fe56f42af82dd4728ca53cd32
0617 20:16:52.424810 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.424930 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4001086}
I20260617 20:16:52.425236 29378 ts_tablet_manager.cc:1403] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.001s
I20260617 20:16:52.425401 29376 tablet_replica.cc:333] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:52.425683 29376 raft_consensus.cc:2243] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:52.426062 29376 pending_rounds.cc:70] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:52.426142 29376 pending_rounds.cc:77] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955466727804928 op_type: NO_OP noop_request { }
I20260617 20:16:52.426265 29376 raft_consensus.cc:2889] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:52.426390 29376 raft_consensus.cc:2272] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:52.427028 29376 ts_tablet_manager.cc:1916] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:52.428196 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 20d0b861d48e4baf94387f4ff9d9f778 (DEFAULT_TABLE table=default.Table_3f75a4b3577e427ba1b39fa83075b1c2 [id=7c94e39032fa4cf39a1187691bff2739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.429478 29383 tablet_bootstrap.cc:654] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:52.430689 29226 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 402) took 1028 ms. Trace:
I20260617 20:16:52.430841 29226 rpcz_store.cc:276] 0617 20:16:51.393169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.690941 (+297772us) service_pool.cc:224] Handling call
0617 20:16:51.758460 (+ 67519us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.758477 (+ 17us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.398498 (+640021us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.420965 (+ 22467us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.421129 (+ 164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.431195 29229 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 396) took 1029 ms. Trace:
I20260617 20:16:52.431308 29229 rpcz_store.cc:276] 0617 20:16:51.392575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.674366 (+281791us) service_pool.cc:224] Handling call
0617 20:16:51.731961 (+ 57595us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.731985 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.402741 (+670756us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.421233 (+ 18492us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.421604 (+ 371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15946}
I20260617 20:16:52.431625 29740 consensus_queue.cc:1048] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260617 20:16:52.431806 29085 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43328 (request call id 101) took 1447 ms. Trace:
I20260617 20:16:52.432205 29237 rpcz_store.cc:276] 0617 20:16:51.393705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.013191 (+619486us) service_pool.cc:224] Handling call
0617 20:16:52.013675 (+ 484us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.013704 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.380797 (+367093us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.422074 (+ 41277us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.422167 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9734}
I20260617 20:16:52.432045 29085 rpcz_store.cc:276] 0617 20:16:50.983888 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.983944 (+ 56us) service_pool.cc:224] Handling call
0617 20:16:51.281982 (+298038us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x6160001b4054. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:51.299369 (+ 17387us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x6160000b1b30. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedcbacc673 00007fedce5f6d28 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.430094 (+1130725us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x616000182554. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.431747 (+ 1653us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258608000}
I20260617 20:16:52.432628 29236 rpcz_store.cc:276] 0617 20:16:51.393264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.760451 (+367187us) service_pool.cc:224] Handling call
0617 20:16:51.760923 (+ 472us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.760945 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.324982 (+564037us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.422389 (+ 97407us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.422485 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7899}
I20260617 20:16:52.432940 29230 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 406) took 1029 ms. Trace:
I20260617 20:16:52.433080 29230 rpcz_store.cc:276] 0617 20:16:51.393612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.997494 (+603882us) service_pool.cc:224] Handling call
0617 20:16:52.055490 (+ 57996us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.055544 (+ 54us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.407316 (+351772us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.422717 (+ 15401us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.422816 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7292}
I20260617 20:16:52.433403 29232 rpcz_store.cc:276] 0617 20:16:51.392477 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.621986 (+229509us) service_pool.cc:224] Handling call
0617 20:16:51.681355 (+ 59369us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.681815 (+ 460us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.366295 (+684480us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.422876 (+ 56581us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.422965 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1973}
I20260617 20:16:52.434123 29197 leader_election.cc:304] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:52.434671 29919 raft_consensus.cc:2804] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:52.434758 29919 raft_consensus.cc:493] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:52.434854 29919 raft_consensus.cc:3060] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:52.440428 29377 ts_tablet_manager.cc:1929] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:52.440603 29377 log.cc:1199] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/86dd216fa0ab46f5bb16e1b7bf1ca4f9
I20260617 20:16:52.441007 29377 ts_tablet_manager.cc:1950] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:52.441550 29919 raft_consensus.cc:515] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.442001 29233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 404) took 1048 ms. Trace:
I20260617 20:16:52.442101 29233 rpcz_store.cc:276] 0617 20:16:51.393392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.767756 (+374364us) service_pool.cc:224] Handling call
0617 20:16:51.773143 (+ 5387us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.773362 (+ 219us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.416877 (+643515us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.441798 (+ 24921us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.441936 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.442301 29919 leader_election.cc:290] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:52.442678 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 69420.2us
W20260617 20:16:52.442957 29123 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s user 0.002s sys 0.003s
W20260617 20:16:52.443097 29123 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.511s user 0.002s sys 0.004s
I20260617 20:16:52.442044 29378 raft_consensus.cc:359] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.443966 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98467525f81f4a48878eae17e3a9c982" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:52.444396 29378 raft_consensus.cc:385] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:52.445627 29378 raft_consensus.cc:740] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:52.445668 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet cf8d04ef8acd4fcaa69df9253cd89462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.446012 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 938b61a0f6dc4d178971034fd18c1674 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.446373 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet da50400f49e24ca589519e6ec823957d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:52.447046 29063 leader_election.cc:343] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 808c455e74e645aa8e2b0d08ca81d4f9
I20260617 20:16:52.447190 29063 leader_election.cc:304] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:52.447273 29378 consensus_queue.cc:260] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.443747 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 325) took 2106 ms. Trace:
I20260617 20:16:52.447780 29859 raft_consensus.cc:2749] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:52.447993 29859 consensus_queue.cc:1048] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:52.446590 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98467525f81f4a48878eae17e3a9c982" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:52.449342 28989 raft_consensus.cc:2393] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 5ca3d93189744132bbf55ac01f3a8254 in this term.
I20260617 20:16:52.452014 29378 ts_tablet_manager.cc:1434] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260617 20:16:52.453874 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_651121ed4f3b4491ac90435c5b0c3b1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.454766 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_651121ed4f3b4491ac90435c5b0c3b1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.455857 29243 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 393) took 1063 ms. Trace:
I20260617 20:16:52.455987 29243 rpcz_store.cc:276] 0617 20:16:51.392269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.621341 (+229072us) service_pool.cc:224] Handling call
0617 20:16:51.687317 (+ 65976us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.687339 (+ 22us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.387124 (+699785us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.455640 (+ 68516us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.455820 (+ 180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.456583 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_56f5d206c3934a59a6ef16d7c15e3de6" } modify_external_catalogs: true
W20260617 20:16:52.456627 29198 leader_election.cc:343] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:52.456750 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_56f5d206c3934a59a6ef16d7c15e3de6" } modify_external_catalogs: true
I20260617 20:16:52.457752 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98467525f81f4a48878eae17e3a9c982" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:52.458032 29260 raft_consensus.cc:2393] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ca3d93189744132bbf55ac01f3a8254 in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:16:52.458415 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e19abe093a40f6886908a8a3a0cad4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:52.458827 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3124306094c72ad78e5473aa35bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.459812 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e4407aa01642ffb03eba1b220afdba" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:52.465533 29378 tablet_bootstrap.cc:492] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:52.468006 29917 raft_consensus.cc:493] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:52.468381 29917 raft_consensus.cc:515] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.470160 29917 leader_election.cc:290] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:52.470742 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65af976b808d42d4aeded71a00cf7252" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:52.470966 29378 tablet_bootstrap.cc:654] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:52.447775 29377 rpcz_store.cc:276] 0617 20:16:50.337602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.337695 (+ 93us) service_pool.cc:224] Handling call
0617 20:16:52.355530 (+2017835us) ts_tablet_manager.cc:1151] Deleting tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9
0617 20:16:52.355539 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.409574 (+ 54035us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.440128 (+ 30554us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.443685 (+ 3557us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39284,"tablet-delete.queue_time_us":2012000}
I20260617 20:16:52.471735 29377 tablet_replica.cc:333] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:52.471973 29377 raft_consensus.cc:2243] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:52.472173 29377 raft_consensus.cc:2272] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:52.471545 29198 leader_election.cc:343] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:52.472523 29198 consensus_peers.cc:597] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:16:52.475364 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89f7b878728a495f83b6584f8a6aca67 consensus state has no leader
I20260617 20:16:52.475792 28925 leader_election.cc:304] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:52.476257 29916 raft_consensus.cc:2749] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260617 20:16:52.476686 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64bb6d176a4845eca312848ae5104647 consensus state has no leader
W20260617 20:16:52.476903 28925 leader_election.cc:343] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:52.477057 28925 leader_election.cc:304] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:52.477648 29916 raft_consensus.cc:2749] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:52.478739 29197 leader_election.cc:343] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 8eee68618cdf462283d7fd9f098c2a0d
W20260617 20:16:52.479079 29063 leader_election.cc:343] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:52.479246 29063 leader_election.cc:304] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:52.479514 29783 raft_consensus.cc:2749] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:52.480232 29197 leader_election.cc:304] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:52.480480 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65af976b808d42d4aeded71a00cf7252" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
W20260617 20:16:52.480675 29197 leader_election.cc:343] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d9b7880a039a497fbd0fb5d4f74e7d23
I20260617 20:16:52.480743 28989 raft_consensus.cc:2468] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:52.480788 29197 leader_election.cc:304] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:52.481204 29740 raft_consensus.cc:2749] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:52.481469 29917 raft_consensus.cc:2749] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:52.484752 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29a176d1f3b0446984af141e02bac329 has no consensus state
I20260617 20:16:52.485116 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet f4de5dafb1474de1911148bb3b4527cf from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:52.472751 29377 ts_tablet_manager.cc:1916] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:52.487784 29383 tablet_bootstrap.cc:492] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:52.487958 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 7a81a3502f5d4602b65328577a668d62 (table default.Table_71003cb25e6e4229aba21f7dd04b7fe4 [id=da4afdf3f60e48e78eb52d454fa4142c]) successfully deleted
W20260617 20:16:52.488235 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet af9c687fe56f42af82dd4728ca53cd32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet af9c687fe56f42af82dd4728ca53cd32 already in progress: creating tablet
I20260617 20:16:52.490648 29740 consensus_queue.cc:1048] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260617 20:16:52.491187 29383 ts_tablet_manager.cc:1403] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.134s user 0.006s sys 0.007s
I20260617 20:16:52.491312 29197 leader_election.cc:304] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:52.493031 29740 raft_consensus.cc:2749] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:16:52.493891 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 8eee68618cdf462283d7fd9f098c2a0d (table default.Table_d064dca2cbed4024b9214ed6bccc811e [id=b8a30f476ef24c6b8b533d15499492fd]) successfully deleted
I20260617 20:16:52.494068 29383 raft_consensus.cc:359] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.494191 29916 raft_consensus.cc:493] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:16:52.494232 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 0e6cee209a5a44d6b35eb50e9c33228f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e6cee209a5a44d6b35eb50e9c33228f already in progress: creating tablet
I20260617 20:16:52.494275 29383 raft_consensus.cc:385] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:52.494349 29383 raft_consensus.cc:740] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:52.494359 29916 raft_consensus.cc:515] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.495527 29916 leader_election.cc:290] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:52.496158 29197 leader_election.cc:304] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:52.496132 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569e339c17764486a65a1c3b43c92adf" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:52.496433 29740 raft_consensus.cc:2804] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260617 20:16:52.496929 28925 leader_election.cc:343] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:52.497138 29740 raft_consensus.cc:493] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:52.497337 29740 raft_consensus.cc:3060] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:52.497819 29918 consensus_queue.cc:1048] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:52.500133 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet da50400f49e24ca589519e6ec823957d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.500285 29740 raft_consensus.cc:515] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.500413 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet cf8d04ef8acd4fcaa69df9253cd89462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.500847 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 (table default.Table_baac68c808f240b481611d52f21d428e [id=e6d0b31f8a8c40e8a9c5bf4ee11ea293]) successfully deleted
I20260617 20:16:52.500989 29740 leader_election.cc:290] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:52.502298 29383 consensus_queue.cc:260] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.503115 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c7b9c867be6c4fa3b58557f0b4d1876b" } modify_external_catalogs: true
I20260617 20:16:52.502607 29376 ts_tablet_manager.cc:1929] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:52.503302 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c7b9c867be6c4fa3b58557f0b4d1876b" } modify_external_catalogs: true
I20260617 20:16:52.503221 29383 ts_tablet_manager.cc:1434] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260617 20:16:52.506325 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_813114f7354f4c1b9a3976e27bb3ef59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.506906 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_813114f7354f4c1b9a3976e27bb3ef59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.508021 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet 1a725364bb9646e6bc80fc4f67d04a16 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:52.508533 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_05e9fa4b726a482ea4de0b4b6e982624" } modify_external_catalogs: true
I20260617 20:16:52.508687 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_05e9fa4b726a482ea4de0b4b6e982624" } modify_external_catalogs: true
I20260617 20:16:52.509105 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65af976b808d42d4aeded71a00cf7252" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:52.509569 28987 raft_consensus.cc:3060] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:52.504117 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569e339c17764486a65a1c3b43c92adf" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:52.503474 29376 log.cc:1199] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/4516e7a7fa284eaa816558b2d58cd213
W20260617 20:16:52.512466 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 086bd3079e8f4a6d85ccc681a38a47b0 consensus state has no leader
I20260617 20:16:52.512948 29383 tablet_bootstrap.cc:492] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:52.513728 28925 leader_election.cc:343] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:52.513886 28925 leader_election.cc:304] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:52.514331 28987 raft_consensus.cc:2468] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:52.513180 29376 ts_tablet_manager.cc:1950] T 4516e7a7fa284eaa816558b2d58cd213 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:52.515748 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 260) took 3994 ms. Trace:
I20260617 20:16:52.515913 29376 rpcz_store.cc:276] 0617 20:16:48.520917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.520980 (+ 63us) service_pool.cc:224] Handling call
0617 20:16:52.425344 (+3904364us) ts_tablet_manager.cc:1151] Deleting tablet 4516e7a7fa284eaa816558b2d58cd213
0617 20:16:52.425351 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.453269 (+ 27918us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.490506 (+ 37237us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.515704 (+ 25198us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3904134}
I20260617 20:16:52.516352 29376 tablet_replica.cc:333] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:52.516654 29376 raft_consensus.cc:2243] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:52.516855 29376 raft_consensus.cc:2272] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:52.517395 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_64b36c5ea008434c9becd24d6a19eb0c" } new_table_name: "default.Table_685025bcfb0e499d9ee6da4954fabb82" modify_external_catalogs: true
I20260617 20:16:52.518745 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b247c97f4c9a4b788252faebaeedadbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.519265 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b247c97f4c9a4b788252faebaeedadbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.521059 29383 tablet_bootstrap.cc:654] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:52.521554 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_350b5e38df254cc69627edec8db5af45" } modify_external_catalogs: true
I20260617 20:16:52.521757 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_350b5e38df254cc69627edec8db5af45" } modify_external_catalogs: true
I20260617 20:16:52.523504 29376 ts_tablet_manager.cc:1916] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:52.525843 29093 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 383) took 1050 ms. Trace:
I20260617 20:16:52.525985 29093 rpcz_store.cc:276] 0617 20:16:51.469582 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.558701 (+ 89119us) service_pool.cc:224] Handling call
0617 20:16:51.593800 (+ 35099us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.593830 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.092531 (+498701us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.399583 (+307052us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.520480 (+120897us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.526433 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 49e7a29b7fdd411e9957d23861a996db (DEFAULT_TABLE table=default.Table_1e0e98bdedab480c9d07bc266771250e [id=55e2fa74a9a4405886cfb7982e27eb5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.527813 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 326eb1cffb9a47078320e6fcba0743ce (DEFAULT_TABLE table=default.Table_4187f9cfd1ac4fd0b4043202908b2c0d [id=42f2f56c7b0f4ac4bddd9a9eea89a7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.533527 29941 tablet.cc:1724] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 20:16:52.538079 28655 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 29a176d1f3b0446984af141e02bac329 (table default.Table_bce9de9998f24268b102dad1f0842744 [id=7b86b5406ae8463e98f2e27bc9c768c4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 29a176d1f3b0446984af141e02bac329 has no consensus state
I20260617 20:16:52.538759 29104 tablet_service.cc:1511] Processing CreateTablet for tablet da50400f49e24ca589519e6ec823957d (DEFAULT_TABLE table=default.Table_dd4d087b046a40bbbb48af81d2074752 [id=aa96a291aaef4872b81313bb635ebba0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.540750 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49e7a29b7fdd411e9957d23861a996db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.541150 29376 ts_tablet_manager.cc:1929] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:52.542459 29092 tablet_service.cc:1511] Processing CreateTablet for tablet a6522ae212784b7ebd47cc3403aa3477 (DEFAULT_TABLE table=default.Table_9b9ef0f3fc184c1d86b33196c9b9ae9d [id=a63c4334ac2d4313b19978ee3b4eeff8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.542765 29376 log.cc:1199] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/d9b7880a039a497fbd0fb5d4f74e7d23
I20260617 20:16:52.543589 29740 raft_consensus.cc:493] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:52.543781 29740 raft_consensus.cc:515] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.544440 29740 leader_election.cc:290] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:52.544538 28668 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 673639208c6748d096efb3e74ac28acd
W20260617 20:16:52.545753 29197 leader_election.cc:343] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 637b0b3e9cb648deaea6e63760b83255
I20260617 20:16:52.545533 29376 ts_tablet_manager.cc:1950] T d9b7880a039a497fbd0fb5d4f74e7d23 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:52.544679 29100 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 394) took 1003 ms. Trace:
I20260617 20:16:52.547192 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 261) took 3990 ms. Trace:
I20260617 20:16:52.547294 29376 rpcz_store.cc:276] 0617 20:16:48.556773 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.556824 (+ 51us) service_pool.cc:224] Handling call
0617 20:16:52.516276 (+3959452us) ts_tablet_manager.cc:1151] Deleting tablet d9b7880a039a497fbd0fb5d4f74e7d23
0617 20:16:52.516290 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.526813 (+ 10523us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.541074 (+ 14261us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.547139 (+ 6065us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3959219}
I20260617 20:16:52.548717 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65af976b808d42d4aeded71a00cf7252" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:16:52.549495 29198 leader_election.cc:343] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:52.550912 29198 leader_election.cc:343] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 637b0b3e9cb648deaea6e63760b83255
I20260617 20:16:52.551054 29198 leader_election.cc:304] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:52.551584 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326eb1cffb9a47078320e6fcba0743ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.552414 29740 raft_consensus.cc:2749] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:16:52.555415 29376 tablet_replica.cc:333] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:52.556164 29376 raft_consensus.cc:2243] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:52.556672 28663 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_921dd6771a094e7cb638a0bcd034177e [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 2 got 0
I20260617 20:16:52.556983 29376 raft_consensus.cc:2272] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:52.558059 29376 ts_tablet_manager.cc:1916] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:52.563220 29095 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 381) took 1093 ms. Trace:
I20260617 20:16:52.565156 29098 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 393) took 1031 ms. Trace:
I20260617 20:16:52.570883 29379 raft_consensus.cc:359] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:52.576773 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9f9844fab126448895c4c9d4c3c78d76 consensus state has no leader
I20260617 20:16:52.577104 29376 ts_tablet_manager.cc:1929] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:52.577208 29097 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 384) took 1068 ms. Trace:
W20260617 20:16:52.575100 29914 log.cc:927] Time spent T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: Append to log took a long time: real 0.086s user 0.000s sys 0.000s
I20260617 20:16:52.580102 29376 log.cc:1199] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/637b0b3e9cb648deaea6e63760b83255
I20260617 20:16:52.580564 29379 raft_consensus.cc:385] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:52.581233 29376 ts_tablet_manager.cc:1950] T 637b0b3e9cb648deaea6e63760b83255 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:52.582419 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 80d778641c354c679ee9e7d7b3eae3b5 (DEFAULT_TABLE table=default.Table_0f2a772bda6e4476b8b5a42f9d0fb42f [id=de3384ef7984460abc15ca893a9f8c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.583411 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 268) took 3785 ms. Trace:
I20260617 20:16:52.584908 29375 ts_tablet_manager.cc:1929] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:52.584884 29376 rpcz_store.cc:276] 0617 20:16:48.797854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.797914 (+ 60us) service_pool.cc:224] Handling call
0617 20:16:52.555324 (+3757410us) ts_tablet_manager.cc:1151] Deleting tablet 637b0b3e9cb648deaea6e63760b83255
0617 20:16:52.555337 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.563549 (+ 8212us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.577011 (+ 13462us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.583372 (+ 6361us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3757134}
I20260617 20:16:52.585649 29098 rpcz_store.cc:276] 0617 20:16:51.533476 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.038360 (+504884us) service_pool.cc:224] Handling call
0617 20:16:52.038857 (+ 497us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.038886 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.270489 (+231603us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.565005 (+294516us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.565124 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.586470 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da50400f49e24ca589519e6ec823957d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.586717 29376 tablet_replica.cc:333] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:52.587363 29376 raft_consensus.cc:2243] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:52.587862 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6522ae212784b7ebd47cc3403aa3477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.588081 29376 raft_consensus.cc:2272] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:52.588775 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 18440a4a5c254a25b87f8632de9c92b9
I20260617 20:16:52.588819 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20d0b861d48e4baf94387f4ff9d9f778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.582264 29100 rpcz_store.cc:276] 0617 20:16:51.533568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.041050 (+507482us) service_pool.cc:224] Handling call
0617 20:16:52.052209 (+ 11159us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.052237 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.243178 (+190941us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.429345 (+186167us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.537481 (+108136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2011}
I20260617 20:16:52.590114 29376 ts_tablet_manager.cc:1916] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:52.590233 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet d1654ae96ce041fa9b9b881af7dd342e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.590377 29095 rpcz_store.cc:276] 0617 20:16:51.469445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.509370 (+ 39925us) service_pool.cc:224] Handling call
0617 20:16:51.513405 (+ 4035us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.513440 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.274236 (+760796us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.563060 (+288824us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.563180 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.592010 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet f823290351d542179b8bcc683d7acf6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.592749 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 99a3d9ae347845dfa9357010819ebc58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.592367 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 08290c23fff5449481789b29d15c4781 (DEFAULT_TABLE table=default.Table_8ffb0a0b802f41e386bc73ae7574b693 [id=35f8afdc04fb4a1ebb52996f33d62d43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.596789 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4e27c5834baa48ed953fccef54e6c52b
I20260617 20:16:52.598011 29379 raft_consensus.cc:740] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:52.611979 29376 ts_tablet_manager.cc:1929] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:52.613159 29376 log.cc:1199] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/28146a1f84aa41ee88d9aea299256a90
I20260617 20:16:52.615383 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet cc8fa9f4c40b4ce9baa27a8837d3575c
I20260617 20:16:52.620002 29376 ts_tablet_manager.cc:1950] T 28146a1f84aa41ee88d9aea299256a90 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:52.622454 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 267) took 3824 ms. Trace:
I20260617 20:16:52.629642 29376 rpcz_store.cc:276] 0617 20:16:48.797676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.798245 (+ 569us) service_pool.cc:224] Handling call
0617 20:16:52.586652 (+3788407us) ts_tablet_manager.cc:1151] Deleting tablet 28146a1f84aa41ee88d9aea299256a90
0617 20:16:52.586663 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.593816 (+ 7153us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.611888 (+ 18072us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.622386 (+ 10498us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3788208}
I20260617 20:16:52.631628 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 272) took 3729 ms. Trace:
I20260617 20:16:52.632380 29376 rpcz_store.cc:276] 0617 20:16:48.902547 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.902756 (+ 209us) service_pool.cc:224] Handling call
0617 20:16:52.631263 (+3728507us) ts_tablet_manager.cc:1151] Deleting tablet 1a725364bb9646e6bc80fc4f67d04a16
0617 20:16:52.631434 (+ 171us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.631565 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3726695}
I20260617 20:16:52.634092 29098 tablet_service.cc:1558] Processing DeleteTablet for tablet b3278efaad07403ca0a2baecad46d0f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 08290c23fff5449481789b29d15c4781) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.634675 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 274) took 3706 ms. Trace:
I20260617 20:16:52.635087 29376 rpcz_store.cc:276] 0617 20:16:48.927133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.927189 (+ 56us) service_pool.cc:224] Handling call
0617 20:16:52.633656 (+3706467us) ts_tablet_manager.cc:1151] Deleting tablet 33e4407aa01642ffb03eba1b220afdba
0617 20:16:52.633665 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.633771 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3705752}
I20260617 20:16:52.636286 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 277) took 3690 ms. Trace:
I20260617 20:16:52.636992 29376 rpcz_store.cc:276] 0617 20:16:48.945803 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.945870 (+ 67us) service_pool.cc:224] Handling call
0617 20:16:52.636134 (+3690264us) ts_tablet_manager.cc:1151] Deleting tablet 3e80e776263c4a91ae7fffa9d0f4ebd4
0617 20:16:52.636144 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.636234 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3688466}
I20260617 20:16:52.638121 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 278) took 3659 ms. Trace:
I20260617 20:16:52.638906 29376 rpcz_store.cc:276] 0617 20:16:48.978797 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:48.979010 (+ 213us) service_pool.cc:224] Handling call
0617 20:16:52.637937 (+3658927us) ts_tablet_manager.cc:1151] Deleting tablet 70698bb6ff6f4fe0b465f2974fcc24ea
0617 20:16:52.637946 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.638080 (+ 134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3636671}
I20260617 20:16:52.639899 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 280) took 3631 ms. Trace:
I20260617 20:16:52.640610 29376 rpcz_store.cc:276] 0617 20:16:49.008181 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.008399 (+ 218us) service_pool.cc:224] Handling call
0617 20:16:52.639763 (+3631364us) ts_tablet_manager.cc:1151] Deleting tablet c21b585707b146ed9c015d150d858681
0617 20:16:52.639773 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.639852 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3631050}
I20260617 20:16:52.641630 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 284) took 3554 ms. Trace:
I20260617 20:16:52.642287 29376 rpcz_store.cc:276] 0617 20:16:49.086667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.086734 (+ 67us) service_pool.cc:224] Handling call
0617 20:16:52.641498 (+3554764us) ts_tablet_manager.cc:1151] Deleting tablet 75519f97f1ce49ceb3a739ba7c7bc239
0617 20:16:52.641506 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.641584 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3554187}
I20260617 20:16:52.643033 29094 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 397) took 1040 ms. Trace:
I20260617 20:16:52.643350 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 290) took 3387 ms. Trace:
I20260617 20:16:52.644109 29379 consensus_queue.cc:260] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.644027 29376 rpcz_store.cc:276] 0617 20:16:49.255680 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.264175 (+ 8495us) service_pool.cc:224] Handling call
0617 20:16:52.643214 (+3379039us) ts_tablet_manager.cc:1151] Deleting tablet 8880f8eadaa44887a49adf0ef157965e
0617 20:16:52.643224 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.643304 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3378765}
I20260617 20:16:52.645987 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 291) took 3317 ms. Trace:
I20260617 20:16:52.646555 29376 rpcz_store.cc:276] 0617 20:16:49.328875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.329024 (+ 149us) service_pool.cc:224] Handling call
0617 20:16:52.645279 (+3316255us) ts_tablet_manager.cc:1151] Deleting tablet 16d0360ec78844a1be3d5f51259bbcdf
0617 20:16:52.645287 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.645937 (+ 650us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3315131}
I20260617 20:16:52.648320 29094 rpcz_store.cc:276] 0617 20:16:51.559108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.104795 (+545687us) service_pool.cc:224] Handling call
0617 20:16:52.107035 (+ 2240us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.107083 (+ 48us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.323104 (+216021us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.599760 (+276656us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.599933 (+ 173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.649282 29097 rpcz_store.cc:276] 0617 20:16:51.487616 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.581105 (+ 93489us) service_pool.cc:224] Handling call
0617 20:16:51.756782 (+175677us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.756818 (+ 36us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.420717 (+663899us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.531534 (+110817us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.556493 (+ 24959us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24673}
I20260617 20:16:52.650470 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 292) took 3314 ms. Trace:
I20260617 20:16:52.651214 29376 rpcz_store.cc:276] 0617 20:16:49.335805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.335851 (+ 46us) service_pool.cc:224] Handling call
0617 20:16:52.650310 (+3314459us) ts_tablet_manager.cc:1151] Deleting tablet b19bce310bd24294b063b3b4f76b9f99
0617 20:16:52.650320 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.650418 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3314268}
I20260617 20:16:52.651561 29375 log.cc:1199] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/113fbbc739d04f529e82bc1cf1074bd7
I20260617 20:16:52.652509 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 293) took 3297 ms. Trace:
I20260617 20:16:52.653504 29376 rpcz_store.cc:276] 0617 20:16:49.354958 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.366391 (+ 11433us) service_pool.cc:224] Handling call
0617 20:16:52.652361 (+3285970us) ts_tablet_manager.cc:1151] Deleting tablet c8d373f177494f1486fcae4a67a13041
0617 20:16:52.652370 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.652456 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3268519}
I20260617 20:16:52.655201 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 294) took 3264 ms. Trace:
I20260617 20:16:52.655956 29376 rpcz_store.cc:276] 0617 20:16:49.390408 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.390731 (+ 323us) service_pool.cc:224] Handling call
0617 20:16:52.655055 (+3264324us) ts_tablet_manager.cc:1151] Deleting tablet d2db0467c5e64e38961d3b0e66375544
0617 20:16:52.655065 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.655151 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3263997}
I20260617 20:16:52.658105 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d778641c354c679ee9e7d7b3eae3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.658344 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 295) took 3260 ms. Trace:
I20260617 20:16:52.659173 29376 rpcz_store.cc:276] 0617 20:16:49.397783 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.399247 (+ 1464us) service_pool.cc:224] Handling call
0617 20:16:52.658186 (+3258939us) ts_tablet_manager.cc:1151] Deleting tablet 7b00437fb76c4000ad89c99ab2da2261
0617 20:16:52.658197 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.658292 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3248763}
I20260617 20:16:52.660175 29103 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 387) took 1140 ms. Trace:
I20260617 20:16:52.661326 29376 tablet_replica.cc:333] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:52.662009 29376 raft_consensus.cc:2243] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:52.662981 29376 raft_consensus.cc:2272] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:52.664836 29090 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 392) took 1117 ms. Trace:
I20260617 20:16:52.667088 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet cf8d04ef8acd4fcaa69df9253cd89462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.669035 29098 tablet_service.cc:1558] Processing DeleteTablet for tablet 938b61a0f6dc4d178971034fd18c1674 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.669229 29379 ts_tablet_manager.cc:1434] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.262s user 0.003s sys 0.000s
I20260617 20:16:52.669634 29379 tablet_bootstrap.cc:492] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:52.669778 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet da50400f49e24ca589519e6ec823957d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.670099 29108 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 385) took 1155 ms. Trace:
I20260617 20:16:52.670204 29108 rpcz_store.cc:276] 0617 20:16:51.498356 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.805739 (+307383us) service_pool.cc:224] Handling call
0617 20:16:51.918839 (+113100us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.918868 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.328143 (+409275us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.652441 (+324298us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.653353 (+ 912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.670795 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08290c23fff5449481789b29d15c4781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.671509 29103 rpcz_store.cc:276] 0617 20:16:51.519707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.840259 (+320552us) service_pool.cc:224] Handling call
0617 20:16:51.853051 (+ 12792us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.853083 (+ 32us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.372994 (+519911us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.660000 (+287006us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.660143 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.671901 29090 rpcz_store.cc:276] 0617 20:16:51.533376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.037450 (+504074us) service_pool.cc:224] Handling call
0617 20:16:52.072167 (+ 34717us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.072201 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.409973 (+337772us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.650938 (+240965us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.651115 (+ 177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.674052 29379 tablet_bootstrap.cc:654] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:52.676874 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3124306094c72ad78e5473aa35bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.699050 29375 ts_tablet_manager.cc:1950] T 113fbbc739d04f529e82bc1cf1074bd7 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:52.700083 28667 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:52.706784 29740 raft_consensus.cc:493] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:52.706970 29740 raft_consensus.cc:515] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.707612 29740 leader_election.cc:290] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:52.708845 28667 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:52.514374 29916 raft_consensus.cc:2749] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:52.549155 28956 tablet_service.cc:1511] Processing CreateTablet for tablet bcecdba377334298b883d80a9e192acd (DEFAULT_TABLE table=default.Table_0e5594d587744a97a20c6887115d761f [id=e0f22822bb2d4cf2bafa8e5c49de8f45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.713717 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcecdba377334298b883d80a9e192acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.713975 28665 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:52.549362 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 40845d7a668045ec9a40cb6d1d76137d (DEFAULT_TABLE table=default.Table_636eb4922f27475dacee040515cd1500 [id=1ad7af7cccd1476bac74a5542b87cba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.714967 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40845d7a668045ec9a40cb6d1d76137d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.549553 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 4d23acc051c34ebfb0edb790faec1b2b (DEFAULT_TABLE table=default.Table_af28a00e98914b0ab585c8d9ee784ed5 [id=2212743dc6a34b7d9fee3c868fa5a794]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.717609 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d23acc051c34ebfb0edb790faec1b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.718647 29197 leader_election.cc:304] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:52.719416 29227 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e27c5834baa48ed953fccef54e6c52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.719732 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8fa9f4c40b4ce9baa27a8837d3575c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.719959 29233 tablet_service.cc:1511] Processing CreateTablet for tablet bcecdba377334298b883d80a9e192acd (DEFAULT_TABLE table=default.Table_0e5594d587744a97a20c6887115d761f [id=e0f22822bb2d4cf2bafa8e5c49de8f45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.720381 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcecdba377334298b883d80a9e192acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.550253 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 8a56191018d04a2881ee3e1a243c1a19 (DEFAULT_TABLE table=default.Table_0c03983bb7554bf081b91ed5c44c8f56 [id=b7eef4d472bd428db226ac6443208bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.721812 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a56191018d04a2881ee3e1a243c1a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.551357 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5949e832ca477e9effbe340f439e9c (DEFAULT_TABLE table=default.Table_8fe57f69092a42f585d9f8c5abeb30f7 [id=3294644f679b4a5ebad7932a3eeceb22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.725613 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5949e832ca477e9effbe340f439e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.725768 29243 tablet_service.cc:1511] Processing CreateTablet for tablet 4d23acc051c34ebfb0edb790faec1b2b (DEFAULT_TABLE table=default.Table_af28a00e98914b0ab585c8d9ee784ed5 [id=2212743dc6a34b7d9fee3c868fa5a794]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.726230 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d23acc051c34ebfb0edb790faec1b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.727311 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 40845d7a668045ec9a40cb6d1d76137d (DEFAULT_TABLE table=default.Table_636eb4922f27475dacee040515cd1500 [id=1ad7af7cccd1476bac74a5542b87cba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.727711 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40845d7a668045ec9a40cb6d1d76137d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.728753 29376 ts_tablet_manager.cc:1916] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:52.553227 28964 tablet_service.cc:1511] Processing CreateTablet for tablet 18791cd3384f4bd48c333a3460e85286 (DEFAULT_TABLE table=default.Table_6a6c1b531b834b7394845c8421570068 [id=29bf58c24f9742b38fe3a37c509f92e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.729382 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5949e832ca477e9effbe340f439e9c (DEFAULT_TABLE table=default.Table_8fe57f69092a42f585d9f8c5abeb30f7 [id=3294644f679b4a5ebad7932a3eeceb22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.729575 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18791cd3384f4bd48c333a3460e85286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.729712 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5949e832ca477e9effbe340f439e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.730860 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 18791cd3384f4bd48c333a3460e85286 (DEFAULT_TABLE table=default.Table_6a6c1b531b834b7394845c8421570068 [id=29bf58c24f9742b38fe3a37c509f92e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.731272 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18791cd3384f4bd48c333a3460e85286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.733085 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 71049338f673401bad32204d232bfe43 (DEFAULT_TABLE table=default.Table_5b91f4d24aeb4208b2b9082d421fd325 [id=23afb56e2d6d4944943854ecd94017ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.553848 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 71049338f673401bad32204d232bfe43 (DEFAULT_TABLE table=default.Table_5b91f4d24aeb4208b2b9082d421fd325 [id=23afb56e2d6d4944943854ecd94017ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.733465 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71049338f673401bad32204d232bfe43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.733600 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71049338f673401bad32204d232bfe43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.734769 29226 tablet_service.cc:1511] Processing CreateTablet for tablet fee909c8988d49779612e98f5cd82972 (DEFAULT_TABLE table=default.Table_4bafc10932fd4cc79175b416a102af18 [id=fa73dade259e48acb260c0c1ef23606c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.735106 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee909c8988d49779612e98f5cd82972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.736145 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 4ceb3ae3c1a44442966ad37fbcbc658b (DEFAULT_TABLE table=default.Table_941592c8a96145e3bd446c7c631f2018 [id=64b672d6818042519a4ae455fca1e857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.736451 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ceb3ae3c1a44442966ad37fbcbc658b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.737020 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.559170 28965 tablet_service.cc:1511] Processing CreateTablet for tablet fee909c8988d49779612e98f5cd82972 (DEFAULT_TABLE table=default.Table_4bafc10932fd4cc79175b416a102af18 [id=fa73dade259e48acb260c0c1ef23606c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.737641 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee909c8988d49779612e98f5cd82972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.739349 29740 raft_consensus.cc:2804] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:52.739498 29740 raft_consensus.cc:697] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:52.739774 29740 consensus_queue.cc:237] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.559970 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 4ceb3ae3c1a44442966ad37fbcbc658b (DEFAULT_TABLE table=default.Table_941592c8a96145e3bd446c7c631f2018 [id=64b672d6818042519a4ae455fca1e857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.741607 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ceb3ae3c1a44442966ad37fbcbc658b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.741590 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 6f15a7c18faa4e36bbb62809bb6e976c (DEFAULT_TABLE table=default.Table_bd9c906c4e4d4dab8971c902645a444e [id=4a829294ba3e4303b768b4bc58e697fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.741967 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f15a7c18faa4e36bbb62809bb6e976c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.742125 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 29a176d1f3b0446984af141e02bac329 (DEFAULT_TABLE table=default.Table_bce9de9998f24268b102dad1f0842744 [id=7b86b5406ae8463e98f2e27bc9c768c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.742347 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 54969e138cf745739b54203c11e4c94e (DEFAULT_TABLE table=default.Table_8d26d11366614614982fcb5b40bb6620 [id=2f7caf34e912409caa372c4ac69c6f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.742669 29238 tablet_service.cc:1511] Processing CreateTablet for tablet d00c2be45d82425bb70ae577fa3155fa (DEFAULT_TABLE table=default.Table_977eca2b43be413ea87a6f080ea27de0 [id=805224e5ece140629e8db5fc81aac186]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.742720 29224 tablet_service.cc:1511] Processing CreateTablet for tablet d811ca370ee54db8a7e4f6056017cd01 (DEFAULT_TABLE table=default.Table_8bd2d33a2bb845f6879b462750ebe59c [id=92f8e90bbc1a4563bf267eaa0f900101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.742429 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a176d1f3b0446984af141e02bac329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.743018 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00c2be45d82425bb70ae577fa3155fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.743204 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54969e138cf745739b54203c11e4c94e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.743464 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 6f544f486c144cd89ca7c5b83d252ee9 (DEFAULT_TABLE table=default.Table_00e6d18efea641ec906c6dc4d4d2b1c7 [id=c5fb7373ddb24e70af1553dd8f75c253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.743999 29241 tablet_service.cc:1511] Processing CreateTablet for tablet b278ba32316c42d1b101e9803657af99 (DEFAULT_TABLE table=default.Table_2d169273aef9434c86e36818639e3879 [id=4423aef723674116a36387035529e9c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.744534 29239 tablet_service.cc:1511] Processing CreateTablet for tablet 7a89e42d091f423bb926f671797141ea (DEFAULT_TABLE table=default.Table_651121ed4f3b4491ac90435c5b0c3b1d [id=4377e7ebf32b49db99bb68a65e2d1c80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.579691 29377 ts_tablet_manager.cc:1929] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:52.745427 29377 log.cc:1199] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/1ce9f5deea614e6d9e02e88d3d5ff2c6
I20260617 20:16:52.745864 29377 ts_tablet_manager.cc:1950] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:52.746680 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 326) took 2335 ms. Trace:
I20260617 20:16:52.746791 29377 rpcz_store.cc:276] 0617 20:16:50.411327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.412063 (+ 736us) service_pool.cc:224] Handling call
0617 20:16:52.471646 (+2059583us) ts_tablet_manager.cc:1151] Deleting tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6
0617 20:16:52.471661 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.499020 (+ 27359us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.579585 (+ 80565us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.746639 (+167054us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2047757}
I20260617 20:16:52.747272 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 328) took 2060 ms. Trace:
I20260617 20:16:52.747382 29377 rpcz_store.cc:276] 0617 20:16:50.686874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.687071 (+ 197us) service_pool.cc:224] Handling call
0617 20:16:52.747126 (+2060055us) ts_tablet_manager.cc:1151] Deleting tablet 46ea43994a0a42fe9e16d7bc6a2118e6
0617 20:16:52.747136 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.747244 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2043324}
I20260617 20:16:52.747769 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 327) took 2090 ms. Trace:
I20260617 20:16:52.747874 29377 rpcz_store.cc:276] 0617 20:16:50.657539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.657609 (+ 70us) service_pool.cc:224] Handling call
0617 20:16:52.747631 (+2090022us) ts_tablet_manager.cc:1151] Deleting tablet 3726e55ed36f420ab63bcfb5a81c5aab
0617 20:16:52.747639 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.747734 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2042116}
I20260617 20:16:52.748951 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 334) took 1998 ms. Trace:
I20260617 20:16:52.750258 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 89d79b7023ae478698a06562b2e4c578 (DEFAULT_TABLE table=default.Table_09c8c95fbef548a5a674578b0f83917a [id=9acd747f0c134e3d98485dd851ed980f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.583952 29378 tablet_bootstrap.cc:492] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:52.750950 29378 ts_tablet_manager.cc:1403] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.286s user 0.005s sys 0.000s
I20260617 20:16:52.750908 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 6323292f162b4063b7c413eaecfce791 (DEFAULT_TABLE table=default.Table_6608950ce63c4189ba3fd0cca3a42bd9 [id=5e4eb42ba8894b78a217d5af391de888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.751946 29378 raft_consensus.cc:359] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.752127 29378 raft_consensus.cc:385] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:52.752218 29378 raft_consensus.cc:740] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:52.752431 29378 consensus_queue.cc:260] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.752827 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 9574c6f0765b4329af28d72c8e94240a (DEFAULT_TABLE table=default.Table_d45c5dfa81904202b64c8dee6eb00b24 [id=b0075b31722149588ce8215af28b6e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.752966 29378 ts_tablet_manager.cc:1434] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:52.590003 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.753484 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 8a56191018d04a2881ee3e1a243c1a19 (DEFAULT_TABLE table=default.Table_0c03983bb7554bf081b91ed5c44c8f56 [id=b7eef4d472bd428db226ac6443208bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.753696 28957 tablet_service.cc:1511] Processing CreateTablet for tablet b278ba32316c42d1b101e9803657af99 (DEFAULT_TABLE table=default.Table_2d169273aef9434c86e36818639e3879 [id=4423aef723674116a36387035529e9c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.754101 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b278ba32316c42d1b101e9803657af99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.597822 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e27c5834baa48ed953fccef54e6c52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.757660 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 6323292f162b4063b7c413eaecfce791 (DEFAULT_TABLE table=default.Table_6608950ce63c4189ba3fd0cca3a42bd9 [id=5e4eb42ba8894b78a217d5af391de888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.758045 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6323292f162b4063b7c413eaecfce791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.616515 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8fa9f4c40b4ce9baa27a8837d3575c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.761659 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 9574c6f0765b4329af28d72c8e94240a (DEFAULT_TABLE table=default.Table_d45c5dfa81904202b64c8dee6eb00b24 [id=b0075b31722149588ce8215af28b6e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.762022 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9574c6f0765b4329af28d72c8e94240a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.644882 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 7a89e42d091f423bb926f671797141ea (DEFAULT_TABLE table=default.Table_651121ed4f3b4491ac90435c5b0c3b1d [id=4377e7ebf32b49db99bb68a65e2d1c80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.765600 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a89e42d091f423bb926f671797141ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.645802 28959 tablet_service.cc:1511] Processing CreateTablet for tablet d811ca370ee54db8a7e4f6056017cd01 (DEFAULT_TABLE table=default.Table_8bd2d33a2bb845f6879b462750ebe59c [id=92f8e90bbc1a4563bf267eaa0f900101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.769621 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d811ca370ee54db8a7e4f6056017cd01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.647228 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 6f15a7c18faa4e36bbb62809bb6e976c (DEFAULT_TABLE table=default.Table_bd9c906c4e4d4dab8971c902645a444e [id=4a829294ba3e4303b768b4bc58e697fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.648051 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 54969e138cf745739b54203c11e4c94e (DEFAULT_TABLE table=default.Table_8d26d11366614614982fcb5b40bb6620 [id=2f7caf34e912409caa372c4ac69c6f7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.652088 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 29a176d1f3b0446984af141e02bac329 (DEFAULT_TABLE table=default.Table_bce9de9998f24268b102dad1f0842744 [id=7b86b5406ae8463e98f2e27bc9c768c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.773658 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f15a7c18faa4e36bbb62809bb6e976c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.653436 28952 tablet_service.cc:1511] Processing CreateTablet for tablet d00c2be45d82425bb70ae577fa3155fa (DEFAULT_TABLE table=default.Table_977eca2b43be413ea87a6f080ea27de0 [id=805224e5ece140629e8db5fc81aac186]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.773942 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54969e138cf745739b54203c11e4c94e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.654783 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 6f544f486c144cd89ca7c5b83d252ee9 (DEFAULT_TABLE table=default.Table_00e6d18efea641ec906c6dc4d4d2b1c7 [id=c5fb7373ddb24e70af1553dd8f75c253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.774302 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f544f486c144cd89ca7c5b83d252ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.775687 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6f8a81734a6345ebb32b7ac32365e739"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:52.775799 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 4516e7a7fa284eaa816558b2d58cd213 (table default.Table_1ce996ccf50542bfb287108b493eb4cc [id=c02a5e81598b47b9830a236256da4bba]) successfully deleted
I20260617 20:16:52.776006 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet d9b7880a039a497fbd0fb5d4f74e7d23 (table default.Table_ceb8ef16219d4297985dadd23cf17cea [id=fb5dfa8d54e347559f21ed2427fd160c]) successfully deleted
I20260617 20:16:52.776190 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 637b0b3e9cb648deaea6e63760b83255 (table default.Table_fcf0d313e34c4117a4d36e5638a1a4b4 [id=7a4a3c7360114f72b54f5dd645215114]) successfully deleted
W20260617 20:16:52.776301 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f8a81734a6345ebb32b7ac32365e739 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.777508 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6e3a4cd286c74acca399a55d5202d4ac" } modify_external_catalogs: true
I20260617 20:16:52.777688 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6e3a4cd286c74acca399a55d5202d4ac" } modify_external_catalogs: true
I20260617 20:16:52.656770 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 89d79b7023ae478698a06562b2e4c578 (DEFAULT_TABLE table=default.Table_09c8c95fbef548a5a674578b0f83917a [id=9acd747f0c134e3d98485dd851ed980f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.779234 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c059c2f38bf74dc9a7c05c2b5dc8ac21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.779740 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c059c2f38bf74dc9a7c05c2b5dc8ac21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.780828 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b1aa4707d2794652bd00fbbb2d66dc9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.781278 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1aa4707d2794652bd00fbbb2d66dc9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.782408 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_921dd6771a094e7cb638a0bcd034177e" } new_table_name: "default.Table_192444e7b6dc4e918c77df128cae877a" modify_external_catalogs: true
I20260617 20:16:52.783486 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1a988e93d48746dd823e6330382ee315" } new_table_name: "default.Table_ffa0c6d530ee478f9cd5bc64e8d1ed83" modify_external_catalogs: true
I20260617 20:16:52.784554 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5420a15e4fa749039b1bce59b563517d" } new_table_name: "default.Table_1447e53a07e04f0aad77f02ce6c222e7" modify_external_catalogs: true
I20260617 20:16:52.786414 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f544f486c144cd89ca7c5b83d252ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.789608 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9574c6f0765b4329af28d72c8e94240a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.791985 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 (table default.Table_8ca126699bab4f66b23ce38c90e050bb [id=f119f85b0a244e149caec77aab7063ad]) successfully deleted
W20260617 20:16:52.792263 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46ea43994a0a42fe9e16d7bc6a2118e6 already in progress: creating tablet
I20260617 20:16:52.793998 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b278ba32316c42d1b101e9803657af99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.795143 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d79b7023ae478698a06562b2e4c578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.797714 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a89e42d091f423bb926f671797141ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.797848 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_552ce9d68419437fafcd73d16413fb03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.798413 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_552ce9d68419437fafcd73d16413fb03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.776352 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 28146a1f84aa41ee88d9aea299256a90 (table default.Table_6ed5c9767b364748ae14ecead288e68c [id=eeb28ad64e5f425988b6e1667865134d]) successfully deleted
W20260617 20:16:52.804296 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 1a725364bb9646e6bc80fc4f67d04a16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a725364bb9646e6bc80fc4f67d04a16 already in progress: creating tablet
W20260617 20:16:52.804615 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 33e4407aa01642ffb03eba1b220afdba because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33e4407aa01642ffb03eba1b220afdba already in progress: creating tablet
W20260617 20:16:52.804893 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 already in progress: creating tablet
W20260617 20:16:52.805164 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 70698bb6ff6f4fe0b465f2974fcc24ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 70698bb6ff6f4fe0b465f2974fcc24ea already in progress: creating tablet
I20260617 20:16:52.805761 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d79b7023ae478698a06562b2e4c578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.806573 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a176d1f3b0446984af141e02bac329. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.807250 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00c2be45d82425bb70ae577fa3155fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.805258 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 39ca961cfea54a7187cc7ea8d16a627f
W20260617 20:16:52.805578 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 75519f97f1ce49ceb3a739ba7c7bc239 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75519f97f1ce49ceb3a739ba7c7bc239 already in progress: creating tablet
W20260617 20:16:52.815445 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 8880f8eadaa44887a49adf0ef157965e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8880f8eadaa44887a49adf0ef157965e already in progress: creating tablet
W20260617 20:16:52.815765 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 16d0360ec78844a1be3d5f51259bbcdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16d0360ec78844a1be3d5f51259bbcdf already in progress: creating tablet
W20260617 20:16:52.816030 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet b19bce310bd24294b063b3b4f76b9f99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b19bce310bd24294b063b3b4f76b9f99 already in progress: creating tablet
W20260617 20:16:52.816388 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet c8d373f177494f1486fcae4a67a13041 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8d373f177494f1486fcae4a67a13041 already in progress: creating tablet
W20260617 20:16:52.816627 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d2db0467c5e64e38961d3b0e66375544 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2db0467c5e64e38961d3b0e66375544 already in progress: creating tablet
W20260617 20:16:52.816875 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 7b00437fb76c4000ad89c99ab2da2261 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7b00437fb76c4000ad89c99ab2da2261 already in progress: creating tablet
I20260617 20:16:52.818056 29378 tablet_bootstrap.cc:492] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:52.749208 29377 rpcz_store.cc:276] 0617 20:16:50.749718 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.749771 (+ 53us) service_pool.cc:224] Handling call
0617 20:16:52.748099 (+1998328us) ts_tablet_manager.cc:1151] Deleting tablet f4de5dafb1474de1911148bb3b4527cf
0617 20:16:52.748107 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.748183 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1998124}
W20260617 20:16:52.825062 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f4de5dafb1474de1911148bb3b4527cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4de5dafb1474de1911148bb3b4527cf already in progress: creating tablet
I20260617 20:16:52.700423 29940 tablet.cc:1724] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:52.712594 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e704d08c0da484a986c9d882a42e6f1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:52.826686 28990 raft_consensus.cc:2468] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:52.825313 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a56191018d04a2881ee3e1a243c1a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.831506 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 331) took 2082 ms. Trace:
I20260617 20:16:52.831634 29377 rpcz_store.cc:276] 0617 20:16:50.748862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.749221 (+ 359us) service_pool.cc:224] Handling call
0617 20:16:52.825419 (+2076198us) ts_tablet_manager.cc:1151] Deleting tablet e59430dd630b4ca6b573ea4230212abf
0617 20:16:52.831316 (+ 5897us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.831464 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2075235}
I20260617 20:16:52.832065 29377 tablet_replica.cc:333] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:52.825677 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 39ca961cfea54a7187cc7ea8d16a627f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:52.832019 28970 tablet_service.cc:1511] Processing CreateTablet for tablet a52873eade4048af81a8e51233b9d079 (DEFAULT_TABLE table=default.Table_8388a2681a87463b92758e227df2b510 [id=9dd225a437df48ca8de2f67be1905a03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.827152 29197 leader_election.cc:304] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:52.832257 29377 raft_consensus.cc:2243] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:52.832417 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a52873eade4048af81a8e51233b9d079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.832392 29917 raft_consensus.cc:2804] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:52.832540 29917 raft_consensus.cc:493] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:52.832597 29377 raft_consensus.cc:2272] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:52.832651 29917 raft_consensus.cc:3060] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:52.817512 29234 tablet_service.cc:1511] Processing CreateTablet for tablet cc8d29712eee47e497872df101404f26 (DEFAULT_TABLE table=default.Table_6ff346c8167a49878fc3900007fa2904 [id=a3145e0f371647c98fb79739624d5258]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:52.833222 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet e59430dd630b4ca6b573ea4230212abf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e59430dd630b4ca6b573ea4230212abf already in progress: creating tablet
I20260617 20:16:52.814532 29228 tablet_service.cc:1511] Processing CreateTablet for tablet a52873eade4048af81a8e51233b9d079 (DEFAULT_TABLE table=default.Table_8388a2681a87463b92758e227df2b510 [id=9dd225a437df48ca8de2f67be1905a03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.842815 29917 raft_consensus.cc:515] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.844696 29917 leader_election.cc:290] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:52.848330 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fa15915b0ec44ff8b66920e4c207536 with delete_type TABLET_DATA_DELETED (replaced by tablet d4130f3529ef4adaa4cedf12e53b6895) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.851645 29383 tablet_bootstrap.cc:492] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:52.854771 29089 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 402) took 1236 ms. Trace:
I20260617 20:16:52.854909 29089 rpcz_store.cc:276] 0617 20:16:51.618778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.161808 (+543030us) service_pool.cc:224] Handling call
0617 20:16:52.184489 (+ 22681us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.184514 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.678879 (+494365us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.854523 (+175644us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.854706 (+ 183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.855098 29383 ts_tablet_manager.cc:1403] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.342s user 0.022s sys 0.026s
I20260617 20:16:52.855350 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e4407aa01642ffb03eba1b220afdba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.856010 29383 raft_consensus.cc:359] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.856201 29383 raft_consensus.cc:385] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:52.856303 29383 raft_consensus.cc:740] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:52.856544 29383 consensus_queue.cc:260] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.856932 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 342) took 1908 ms. Trace:
I20260617 20:16:52.857046 29383 ts_tablet_manager.cc:1434] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:52.839604 28956 tablet_service.cc:1511] Processing CreateTablet for tablet cc8d29712eee47e497872df101404f26 (DEFAULT_TABLE table=default.Table_6ff346c8167a49878fc3900007fa2904 [id=a3145e0f371647c98fb79739624d5258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.862423 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 39ca961cfea54a7187cc7ea8d16a627f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:52.863669 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e704d08c0da484a986c9d882a42e6f1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:52.863888 28990 raft_consensus.cc:3060] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:52.864454 29378 tablet_bootstrap.cc:654] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:52.866437 29928 log.cc:927] Time spent T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: Append to log took a long time: real 0.158s user 0.000s sys 0.000s
I20260617 20:16:52.867017 29105 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 389) took 1327 ms. Trace:
I20260617 20:16:52.867125 29105 rpcz_store.cc:276] 0617 20:16:51.533040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.929464 (+396424us) service_pool.cc:224] Handling call
0617 20:16:51.941614 (+ 12150us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:51.941641 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.575936 (+634295us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.860742 (+284806us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.860907 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.873893 29090 tablet_service.cc:1511] Processing CreateTablet for tablet bcecdba377334298b883d80a9e192acd (DEFAULT_TABLE table=default.Table_0e5594d587744a97a20c6887115d761f [id=e0f22822bb2d4cf2bafa8e5c49de8f45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.875054 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e704d08c0da484a986c9d882a42e6f1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:52.874099 29103 tablet_service.cc:1511] Processing CreateTablet for tablet 4d23acc051c34ebfb0edb790faec1b2b (DEFAULT_TABLE table=default.Table_af28a00e98914b0ab585c8d9ee784ed5 [id=2212743dc6a34b7d9fee3c868fa5a794]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.876462 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8d29712eee47e497872df101404f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.874500 29375 rpcz_store.cc:276] 0617 20:16:50.812957 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.815290 (+ 2333us) service_pool.cc:224] Handling call
0617 20:16:52.017839 (+1202549us) ts_tablet_manager.cc:1151] Deleting tablet 113fbbc739d04f529e82bc1cf1074bd7
0617 20:16:52.017849 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.384429 (+366580us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x616000152854. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7767e0 00007fedcbac2933 00007fedce685ae7 00007fedce6b8bb4 00007fedce6995d0 00007fedce69935d 0000000000aa681c 00007fedbe7169ff 00007fedbe719d1b 00007fedbe719b98
0617 20:16:52.533750 (+149321us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.579320 (+ 45570us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.721404 (+142084us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740235520,"tablet-delete.queue_time_us":1202331}
I20260617 20:16:52.877640 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 71049338f673401bad32204d232bfe43 (DEFAULT_TABLE table=default.Table_5b91f4d24aeb4208b2b9082d421fd325 [id=23afb56e2d6d4944943854ecd94017ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.888362 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 4ceb3ae3c1a44442966ad37fbcbc658b (DEFAULT_TABLE table=default.Table_941592c8a96145e3bd446c7c631f2018 [id=64b672d6818042519a4ae455fca1e857]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.888904 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 18791cd3384f4bd48c333a3460e85286 (DEFAULT_TABLE table=default.Table_6a6c1b531b834b7394845c8421570068 [id=29bf58c24f9742b38fe3a37c509f92e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.889632 29098 tablet_service.cc:1511] Processing CreateTablet for tablet fee909c8988d49779612e98f5cd82972 (DEFAULT_TABLE table=default.Table_4bafc10932fd4cc79175b416a102af18 [id=fa73dade259e48acb260c0c1ef23606c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.894157 29092 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 406) took 1075 ms. Trace:
I20260617 20:16:52.894795 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5949e832ca477e9effbe340f439e9c (DEFAULT_TABLE table=default.Table_8fe57f69092a42f585d9f8c5abeb30f7 [id=3294644f679b4a5ebad7932a3eeceb22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.895238 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e704d08c0da484a986c9d882a42e6f1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:52.895783 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcecdba377334298b883d80a9e192acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.896070 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d23acc051c34ebfb0edb790faec1b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.896318 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fee909c8988d49779612e98f5cd82972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.897220 28990 raft_consensus.cc:2468] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:52.898524 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18791cd3384f4bd48c333a3460e85286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.899865 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ceb3ae3c1a44442966ad37fbcbc658b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.900614 29940 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55834 (request call id 409) took 1266 ms. Trace:
I20260617 20:16:52.904141 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71049338f673401bad32204d232bfe43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.900995 29940 rpcz_store.cc:276] 0617 20:16:51.633796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.985034 (+351238us) service_pool.cc:224] Handling call
0617 20:16:52.900501 (+915467us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:16:52.071255 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0617 20:16:52.075182 (+ 3927us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0617 20:16:52.075195 (+ 13us) alter_schema_op.cc:66] Acquired schema lock
0617 20:16:52.075220 (+ 25us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0617 20:16:52.079469 (+ 4249us) alter_schema_op.cc:128] START. Timestamp: 1781727412079400
0617 20:16:52.079474 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 20:16:52.140958 (+ 61484us) log.cc:844] Serialized 173 byte log entry
0617 20:16:52.390908 (+249950us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x6160001a68b8. stack: 00007ffae652a496 00007ffae652a250 00007ffae55553ad 000000000099c914 000000000099c8dd 00007ffaf5a0b6bd 00007ffaf5a0b7b3 00007ffaf24d653f 00007ffaf24d59ee 00007ffaf25a5095 00007ffaf25a5ef9 00007ffaf3987305 00007ffaf3985e29 00007ffaf398e250 00007ffaf398e05d 0000000000aa681c
0617 20:16:52.394836 (+ 3928us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x6160001a68b8. stack: 00007ffae652a496 00007ffae652a250 00007ffae55553ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007ffaf24d1ff9 00007ffaf24ea0a9 00007ffaf24e9e11 00007ffafa42a7ed 00007ffaf253631d 00007ffaf253b0fe 00007ffaf253ae81 00007ffafa42a7ed 00007ffaf1e79228 00007ffaf1e61333
0617 20:16:52.413197 (+ 18361us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x617000062a70. stack: 00007ffae652a496 00007ffae652a250 00007ffae55553ad 000000000099c914 000000000099c8dd 00007ffaf5a0b6bd 00007ffaf5a0b7b3 00007ffaf24a9eb8 00007ffaf24b3bd1 00007ffaf24b38bd 0000000000aa681c 00007ffae65709ff 00007ffae6573d1b 00007ffae6573b98 0000000000aa681c 00007ffae654ff48
0617 20:16:52.505200 (+ 92003us) op_driver.cc:464] REPLICATION: finished
0617 20:16:52.700348 (+195148us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0617 20:16:52.826832 (+126484us) log.cc:844] Serialized 5 byte log entry
0617 20:16:52.889118 (+ 62286us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.900091 (+ 10973us) log.cc:844] Serialized 14 byte log entry
0617 20:16:52.900411 (+ 320us) alter_schema_op.cc:73] Released schema lock
0617 20:16:52.900419 (+ 8us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":195054,"prepare.queue_time_us":75993,"prepare.run_cpu_time_us":25737,"prepare.run_wall_time_us":319719,"raft.queue_time_us":2277,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":19973,"replication_time_us":425679,"spinlock_wait_cycles":242434944,"thread_start_us":581382,"threads_started":3,"wal-append.queue_time_us":215141}]]}
I20260617 20:16:52.910717 29378 tablet_bootstrap.cc:492] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:52.910881 29378 ts_tablet_manager.cc:1403] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.158s user 0.006s sys 0.005s
I20260617 20:16:52.911724 29378 raft_consensus.cc:359] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.911916 29378 raft_consensus.cc:385] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:52.912029 29378 raft_consensus.cc:740] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:52.912325 29378 consensus_queue.cc:260] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.912884 29378 ts_tablet_manager.cc:1434] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:52.913141 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5949e832ca477e9effbe340f439e9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.914393 29378 tablet_bootstrap.cc:492] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:52.916134 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 8a56191018d04a2881ee3e1a243c1a19 (DEFAULT_TABLE table=default.Table_0c03983bb7554bf081b91ed5c44c8f56 [id=b7eef4d472bd428db226ac6443208bfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.916649 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a56191018d04a2881ee3e1a243c1a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.919087 29378 tablet_bootstrap.cc:654] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:52.922434 29375 tablet_replica.cc:333] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:52.931133 29378 tablet_bootstrap.cc:492] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:52.931438 29378 ts_tablet_manager.cc:1403] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.007s
I20260617 20:16:52.932578 29378 raft_consensus.cc:359] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.922649 29375 raft_consensus.cc:2243] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:52.932842 29378 raft_consensus.cc:385] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:52.933008 29378 raft_consensus.cc:740] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:52.933022 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 40845d7a668045ec9a40cb6d1d76137d (DEFAULT_TABLE table=default.Table_636eb4922f27475dacee040515cd1500 [id=1ad7af7cccd1476bac74a5542b87cba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.933362 29378 consensus_queue.cc:260] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.934232 29378 ts_tablet_manager.cc:1434] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:52.934849 29378 tablet_bootstrap.cc:492] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:52.935257 29377 ts_tablet_manager.cc:1916] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:52.941911 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 113fbbc739d04f529e82bc1cf1074bd7 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]) successfully deleted
I20260617 20:16:52.942133 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3091c332a14c4c99bd28e401769e30 (DEFAULT_TABLE table=default.Table_b247c97f4c9a4b788252faebaeedadbe [id=19bd9015790b453194adb1f20e520a9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.943286 29378 tablet_bootstrap.cc:654] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:52.937278 29375 raft_consensus.cc:2272] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:52.944357 28956 tablet_service.cc:1511] Processing CreateTablet for tablet d19d34e3bbe3453ca6de6ed7e62f7af4 (DEFAULT_TABLE table=default.Table_813114f7354f4c1b9a3976e27bb3ef59 [id=f734fe28a0f44ac2b90a882b695901a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:52.944572 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3091c332a14c4c99bd28e401769e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.944968 29375 ts_tablet_manager.cc:1916] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:52.945065 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19d34e3bbe3453ca6de6ed7e62f7af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.946684 29099 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 407) took 1122 ms. Trace:
I20260617 20:16:52.947201 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40845d7a668045ec9a40cb6d1d76137d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.947604 29379 tablet_bootstrap.cc:492] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:52.947656 29099 rpcz_store.cc:276] 0617 20:16:51.814535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.524749 (+710214us) service_pool.cc:224] Handling call
0617 20:16:52.528016 (+ 3267us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.528039 (+ 23us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.638898 (+110859us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.932431 (+293533us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.932642 (+ 211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.942049 29891 raft_consensus.cc:493] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:52.940894 29098 tablet_service.cc:1558] Processing DeleteTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.949245 29379 ts_tablet_manager.cc:1403] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.278s user 0.011s sys 0.004s
I20260617 20:16:52.943910 29106 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 400) took 1371 ms. Trace:
I20260617 20:16:52.943966 29092 rpcz_store.cc:276] 0617 20:16:51.802255 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.522492 (+720237us) service_pool.cc:224] Handling call
0617 20:16:52.548513 (+ 26021us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.548571 (+ 58us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.863066 (+314495us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.873135 (+ 10069us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.877393 (+ 4258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.924629 29096 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 410) took 1098 ms. Trace:
I20260617 20:16:52.956532 29377 ts_tablet_manager.cc:1929] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:52.958693 29377 log.cc:1199] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/a76b0744ef2a472091999681d5639fec
I20260617 20:16:52.959275 29377 ts_tablet_manager.cc:1950] T a76b0744ef2a472091999681d5639fec P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:52.960717 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e27c5834baa48ed953fccef54e6c52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:52.961130 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 333) took 2211 ms. Trace:
I20260617 20:16:52.960373 29891 raft_consensus.cc:515] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:52.963239 29377 rpcz_store.cc:276] 0617 20:16:50.749115 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.749367 (+ 252us) service_pool.cc:224] Handling call
0617 20:16:52.831996 (+2082629us) ts_tablet_manager.cc:1151] Deleting tablet a76b0744ef2a472091999681d5639fec
0617 20:16:52.832010 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.941724 (+109714us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.956441 (+ 14717us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.961060 (+ 4619us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2080535}
I20260617 20:16:52.963563 29106 rpcz_store.cc:276] 0617 20:16:51.572632 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.132279 (+559647us) service_pool.cc:224] Handling call
0617 20:16:52.183429 (+ 51150us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.183458 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.661621 (+478163us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.943698 (+282077us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.943855 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:52.963845 28667 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet dcd999d88d954e50810cc01b297a27a9 (table default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a]). Expected version 1 got 0
I20260617 20:16:52.964694 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_19d4b3eff37e4ff380a1c64661e07166"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:52.966048 29377 tablet_replica.cc:333] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:16:52.966276 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19d4b3eff37e4ff380a1c64661e07166 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.966542 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0fa7c2d732b943eb86cf43d30ab2d880"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:52.967206 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b333834cd9d748a1b546a9026aba6d48" } new_table_name: "default.Table_af56ee6211a54ce4b85c0fc8f2558372" modify_external_catalogs: true
I20260617 20:16:52.967746 29197 leader_election.cc:304] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:16:52.967741 29198 leader_election.cc:343] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:52.968935 29377 raft_consensus.cc:2243] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:52.972671 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8bd2d33a2bb845f6879b462750ebe59c" } modify_external_catalogs: true
I20260617 20:16:52.973371 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet a76b0744ef2a472091999681d5639fec (table default.Table_9f236274be424e44818107f2fed5331c [id=a3772e01cb314c7e88e85833d727617d]) successfully deleted
W20260617 20:16:52.974608 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 55494.4us
I20260617 20:16:52.975095 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6323292f162b4063b7c413eaecfce791. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:52.976862 29198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 89903.2us
I20260617 20:16:52.977267 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8d29712eee47e497872df101404f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.976883 29917 raft_consensus.cc:2804] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:52.983037 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8bd2d33a2bb845f6879b462750ebe59c" } modify_external_catalogs: true
W20260617 20:16:52.987502 29198 leader_election.cc:343] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:52.987762 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c095015a04284e9186b06fe5c250ab93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:52.987980 29917 raft_consensus.cc:697] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:52.988191 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7fae59f461764d15a6b9c04597cb6611"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:52.988245 29917 consensus_queue.cc:237] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:52.989517 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c095015a04284e9186b06fe5c250ab93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:52.990527 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fa7c2d732b943eb86cf43d30ab2d880 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:52.991464 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2089215acdf478ca725c9d26b94d692 consensus state has no leader
I20260617 20:16:52.991847 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d6c8360190ec4dfeb18e990430f716cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:52.992722 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6c8360190ec4dfeb18e990430f716cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:52.996718 29916 raft_consensus.cc:493] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:52.996917 29916 raft_consensus.cc:515] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:52.997390 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a52873eade4048af81a8e51233b9d079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.997712 29916 leader_election.cc:290] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:52.998565 29377 raft_consensus.cc:2272] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:52.998734 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d811ca370ee54db8a7e4f6056017cd01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:52.999444 29377 ts_tablet_manager.cc:1916] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.005153 29378 tablet_bootstrap.cc:492] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.005434 29378 ts_tablet_manager.cc:1403] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.071s user 0.007s sys 0.008s
I20260617 20:16:53.006317 29378 raft_consensus.cc:359] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.006649 29378 raft_consensus.cc:385] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.006767 29378 raft_consensus.cc:740] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.007088 29378 consensus_queue.cc:260] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.008219 29377 ts_tablet_manager.cc:1929] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:53.008397 29377 log.cc:1199] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/a7b59053006046e98d27c694808ca34d
I20260617 20:16:53.008893 29377 ts_tablet_manager.cc:1950] T a7b59053006046e98d27c694808ca34d P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.009377 29378 ts_tablet_manager.cc:1434] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:53.009734 29378 tablet_bootstrap.cc:492] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.010883 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 332) took 2261 ms. Trace:
I20260617 20:16:53.011072 29377 rpcz_store.cc:276] 0617 20:16:50.749005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.749338 (+ 333us) service_pool.cc:224] Handling call
0617 20:16:52.965024 (+2215686us) ts_tablet_manager.cc:1151] Deleting tablet a7b59053006046e98d27c694808ca34d
0617 20:16:52.965035 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.005146 (+ 40111us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.008136 (+ 2990us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.010838 (+ 2702us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2213403}
I20260617 20:16:53.011585 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 335) took 2259 ms. Trace:
I20260617 20:16:53.011756 29377 rpcz_store.cc:276] 0617 20:16:50.752513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.752567 (+ 54us) service_pool.cc:224] Handling call
0617 20:16:53.011448 (+2258881us) ts_tablet_manager.cc:1151] Deleting tablet f8e0c5d20a4548cc8124302aa38bcb21
0617 20:16:53.011456 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.011548 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2258705}
I20260617 20:16:53.012208 29377 tablet_replica.cc:333] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.013499 29377 raft_consensus.cc:2243] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.013824 29377 raft_consensus.cc:2272] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.014879 29377 ts_tablet_manager.cc:1916] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.015995 29378 tablet_bootstrap.cc:654] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.016794 29376 ts_tablet_manager.cc:1929] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:53.016920 29376 log.cc:1199] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/4332e33d60964bd6a0c7e7caaa6bdc76
I20260617 20:16:53.021855 29377 ts_tablet_manager.cc:1929] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:53.022073 29377 log.cc:1199] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/60a43dd885aa4411a4177b67807b0ac4
I20260617 20:16:53.022583 29377 ts_tablet_manager.cc:1950] T 60a43dd885aa4411a4177b67807b0ac4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.023435 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 342) took 2203 ms. Trace:
I20260617 20:16:53.023589 29377 rpcz_store.cc:276] 0617 20:16:50.819778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.819861 (+ 83us) service_pool.cc:224] Handling call
0617 20:16:53.012077 (+2192216us) ts_tablet_manager.cc:1151] Deleting tablet 60a43dd885aa4411a4177b67807b0ac4
0617 20:16:53.012087 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.018573 (+ 6486us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.021792 (+ 3219us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.023380 (+ 1588us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2191732}
I20260617 20:16:53.024247 29377 tablet_replica.cc:333] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.024487 29377 raft_consensus.cc:2243] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.024735 29377 raft_consensus.cc:2272] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.025314 29377 ts_tablet_manager.cc:1916] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.026101 29376 ts_tablet_manager.cc:1950] T 4332e33d60964bd6a0c7e7caaa6bdc76 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.027109 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 296) took 3535 ms. Trace:
I20260617 20:16:53.028932 29378 tablet_bootstrap.cc:492] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.027493 29376 rpcz_store.cc:276] 0617 20:16:49.491820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.491866 (+ 46us) service_pool.cc:224] Handling call
0617 20:16:52.661228 (+3169362us) ts_tablet_manager.cc:1151] Deleting tablet 4332e33d60964bd6a0c7e7caaa6bdc76
0617 20:16:52.661237 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:52.865103 (+203866us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.016291 (+151188us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.027066 (+ 10775us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3169112}
I20260617 20:16:53.029136 29376 tablet_replica.cc:333] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.029616 29378 ts_tablet_manager.cc:1403] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260617 20:16:53.030544 29378 raft_consensus.cc:359] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.030854 29378 raft_consensus.cc:385] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.030969 29376 raft_consensus.cc:2243] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:53.030994 29378 raft_consensus.cc:740] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.031306 29376 raft_consensus.cc:2272] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.031415 29378 consensus_queue.cc:260] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.032343 29377 ts_tablet_manager.cc:1929] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.032516 29377 log.cc:1199] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/65af976b808d42d4aeded71a00cf7252
I20260617 20:16:53.033003 29377 ts_tablet_manager.cc:1950] T 65af976b808d42d4aeded71a00cf7252 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.033780 29378 ts_tablet_manager.cc:1434] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:53.034169 29378 tablet_bootstrap.cc:492] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.035197 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 341) took 2216 ms. Trace:
I20260617 20:16:53.035370 29377 rpcz_store.cc:276] 0617 20:16:50.818637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.818732 (+ 95us) service_pool.cc:224] Handling call
0617 20:16:53.024162 (+2205430us) ts_tablet_manager.cc:1151] Deleting tablet 65af976b808d42d4aeded71a00cf7252
0617 20:16:53.024173 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.028983 (+ 4810us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.032256 (+ 3273us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.035155 (+ 2899us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2201738}
I20260617 20:16:53.035964 29377 tablet_replica.cc:333] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.036216 29377 raft_consensus.cc:2243] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.036437 29377 raft_consensus.cc:2272] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.038468 29376 ts_tablet_manager.cc:1916] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.039913 29378 tablet_bootstrap.cc:654] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.043231 29377 ts_tablet_manager.cc:1916] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.044060 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bd9c906c4e4d4dab8971c902645a444e" } modify_external_catalogs: true
I20260617 20:16:53.044286 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bd9c906c4e4d4dab8971c902645a444e" } modify_external_catalogs: true
I20260617 20:16:53.048372 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4e433e1c254048ceb654a95a0275289e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.049042 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e433e1c254048ceb654a95a0275289e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.049428 29376 ts_tablet_manager.cc:1929] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:53.050136 29376 log.cc:1199] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/113fbbc739d04f529e82bc1cf1074bd7
I20260617 20:16:53.050534 29098 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8fa9f4c40b4ce9baa27a8837d3575c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:53.051051 29376 ts_tablet_manager.cc:1950] T 113fbbc739d04f529e82bc1cf1074bd7 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.053658 29377 ts_tablet_manager.cc:1929] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.054754 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 297) took 3494 ms. Trace:
I20260617 20:16:53.054917 29376 rpcz_store.cc:276] 0617 20:16:49.560705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.560761 (+ 56us) service_pool.cc:224] Handling call
0617 20:16:53.029076 (+3468315us) ts_tablet_manager.cc:1151] Deleting tablet 113fbbc739d04f529e82bc1cf1074bd7
0617 20:16:53.029084 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.041762 (+ 12678us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.049355 (+ 7593us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.054682 (+ 5327us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3467997}
I20260617 20:16:53.055368 29376 tablet_replica.cc:333] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.055377 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 7a89e42d091f423bb926f671797141ea (DEFAULT_TABLE table=default.Table_651121ed4f3b4491ac90435c5b0c3b1d [id=4377e7ebf32b49db99bb68a65e2d1c80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.055637 29376 raft_consensus.cc:2243] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.056150 29376 raft_consensus.cc:2272] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.056912 29376 ts_tablet_manager.cc:1916] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.057185 29377 log.cc:1199] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/98467525f81f4a48878eae17e3a9c982
I20260617 20:16:53.057482 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet a7b59053006046e98d27c694808ca34d (table default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]) successfully deleted
W20260617 20:16:53.057663 28655 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 45729.7us
W20260617 20:16:53.058323 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f8e0c5d20a4548cc8124302aa38bcb21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8e0c5d20a4548cc8124302aa38bcb21 already in progress: creating tablet
I20260617 20:16:53.058565 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 60a43dd885aa4411a4177b67807b0ac4 (table default.Table_fd835dc9ea8f4041b36c069dcac9d69a [id=3a41dd53c3974256877f193219240234]) successfully deleted
W20260617 20:16:53.058779 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 090b8720e5df447aa0da147bd8dfaa8c consensus state has no leader
I20260617 20:16:53.058801 29377 ts_tablet_manager.cc:1950] T 98467525f81f4a48878eae17e3a9c982 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.060499 29098 tablet_service.cc:1511] Processing CreateTablet for tablet 6f15a7c18faa4e36bbb62809bb6e976c (DEFAULT_TABLE table=default.Table_bd9c906c4e4d4dab8971c902645a444e [id=4a829294ba3e4303b768b4bc58e697fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.062088 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 65af976b808d42d4aeded71a00cf7252 (table default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]) successfully deleted
W20260617 20:16:53.062304 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fae59f461764d15a6b9c04597cb6611 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.063396 29096 rpcz_store.cc:276] 0617 20:16:51.825917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.557546 (+731629us) service_pool.cc:224] Handling call
0617 20:16:52.582851 (+ 25305us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.582878 (+ 27us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.886320 (+303442us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.924418 (+ 38098us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:52.924583 (+ 165us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260617 20:16:53.063868 29062 consensus_peers.cc:597] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7b59053006046e98d27c694808ca34d. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:53.060187 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 343) took 2238 ms. Trace:
W20260617 20:16:53.064883 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 30f6dcc384154d41866cf8060cf05837 consensus state has no leader
I20260617 20:16:53.064929 29377 rpcz_store.cc:276] 0617 20:16:50.821587 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.822467 (+ 880us) service_pool.cc:224] Handling call
0617 20:16:53.035901 (+2213434us) ts_tablet_manager.cc:1151] Deleting tablet 98467525f81f4a48878eae17e3a9c982
0617 20:16:53.035910 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.046696 (+ 10786us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.053591 (+ 6895us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.060107 (+ 6516us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2206388}
I20260617 20:16:53.065462 29377 tablet_replica.cc:333] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.065622 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 98467525f81f4a48878eae17e3a9c982 (table default.Table_b299a2d2bb2d43c0a27ba56bfd754a14 [id=7be1ef9796444187a095e577b3f29690]) successfully deleted
I20260617 20:16:53.065769 29377 raft_consensus.cc:2243] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.066423 29377 raft_consensus.cc:2272] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.069187 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b312ecd37cf2447c864d075d578c23e8" } new_table_name: "default.Table_479db691829f41f8a1c2b7082935d1ac" modify_external_catalogs: true
I20260617 20:16:53.069679 29383 tablet_bootstrap.cc:492] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:53.070684 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2cc66b9f491541379d5bb95e9d64b6db" } modify_external_catalogs: true
I20260617 20:16:53.070895 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2cc66b9f491541379d5bb95e9d64b6db" } modify_external_catalogs: true
I20260617 20:16:53.071257 29377 ts_tablet_manager.cc:1916] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.074293 29106 tablet_service.cc:1511] Processing CreateTablet for tablet d811ca370ee54db8a7e4f6056017cd01 (DEFAULT_TABLE table=default.Table_8bd2d33a2bb845f6879b462750ebe59c [id=92f8e90bbc1a4563bf267eaa0f900101]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.074782 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1bde48f5ad7a4a8194df9687d8971c33" } modify_external_catalogs: true
I20260617 20:16:53.074973 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1bde48f5ad7a4a8194df9687d8971c33" } modify_external_catalogs: true
I20260617 20:16:53.070339 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 29a176d1f3b0446984af141e02bac329 (DEFAULT_TABLE table=default.Table_bce9de9998f24268b102dad1f0842744 [id=7b86b5406ae8463e98f2e27bc9c768c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.075850 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8ffb0a0b802f41e386bc73ae7574b693" } new_table_name: "default.Table_ec9b81dbecf641cf9110b33876e99612" modify_external_catalogs: true
I20260617 20:16:53.077286 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_eacb11ffc7ea46848481b65cc3c5cb81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:53.077663 29891 leader_election.cc:290] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:53.077760 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 54969e138cf745739b54203c11e4c94e (DEFAULT_TABLE table=default.Table_8d26d11366614614982fcb5b40bb6620 [id=2f7caf34e912409caa372c4ac69c6f7d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:53.077911 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eacb11ffc7ea46848481b65cc3c5cb81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.079633 28970 tablet_service.cc:1558] Processing DeleteTablet for tablet 17917ffc3e8f43afb2a8bc413159137c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.087651 29378 tablet_bootstrap.cc:492] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.087894 29378 ts_tablet_manager.cc:1403] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.007s
I20260617 20:16:53.088227 29376 ts_tablet_manager.cc:1929] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.088402 29376 log.cc:1199] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/9b96c186469e4e8a8baa0dcab96d66bf
I20260617 20:16:53.088805 29378 raft_consensus.cc:359] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.089071 29378 raft_consensus.cc:385] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.089188 29378 raft_consensus.cc:740] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.089600 29378 consensus_queue.cc:260] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.089751 29376 ts_tablet_manager.cc:1950] T 9b96c186469e4e8a8baa0dcab96d66bf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.090525 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 298) took 3396 ms. Trace:
W20260617 20:16:53.090577 29944 log.cc:927] Time spent T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: Append to log took a long time: real 0.110s user 0.000s sys 0.000s
W20260617 20:16:53.090819 29062 consensus_peers.cc:597] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60a43dd885aa4411a4177b67807b0ac4. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:16:53.091081 29062 leader_election.cc:343] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 8eee68618cdf462283d7fd9f098c2a0d
I20260617 20:16:53.091547 29378 ts_tablet_manager.cc:1434] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:53.092305 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_08229bcb0d3e45ec991f5946cfc5cfda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:53.089322 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65814c56424256b53d3c9f94c1b74a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:53.092873 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08229bcb0d3e45ec991f5946cfc5cfda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:53.093047 28925 leader_election.cc:343] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.096010 29378 tablet_bootstrap.cc:492] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.097812 29378 tablet_bootstrap.cc:654] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.098534 29376 rpcz_store.cc:276] 0617 20:16:49.693874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:49.693939 (+ 65us) service_pool.cc:224] Handling call
0617 20:16:53.055287 (+3361348us) ts_tablet_manager.cc:1151] Deleting tablet 9b96c186469e4e8a8baa0dcab96d66bf
0617 20:16:53.055297 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.067392 (+ 12095us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.088132 (+ 20740us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.090491 (+ 2359us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3361095}
I20260617 20:16:53.099010 29376 tablet_replica.cc:333] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.101442 29376 raft_consensus.cc:2243] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.102315 29376 raft_consensus.cc:2272] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.101189 29377 ts_tablet_manager.cc:1929] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.102671 29377 log.cc:1199] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/8e704d08c0da484a986c9d882a42e6f1
I20260617 20:16:53.103240 29376 ts_tablet_manager.cc:1916] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.105477 29107 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 404) took 1458 ms. Trace:
I20260617 20:16:53.105581 29107 rpcz_store.cc:276] 0617 20:16:51.645323 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.308737 (+663414us) service_pool.cc:224] Handling call
0617 20:16:52.369252 (+ 60515us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.369287 (+ 35us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.858356 (+489069us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.959489 (+101133us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:53.104069 (+144580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:53.106592 29379 raft_consensus.cc:359] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.107275 29377 ts_tablet_manager.cc:1950] T 8e704d08c0da484a986c9d882a42e6f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.109993 29091 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 398) took 1542 ms. Trace:
I20260617 20:16:53.110173 29102 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 403) took 1470 ms. Trace:
I20260617 20:16:53.111235 29093 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 409) took 1289 ms. Trace:
I20260617 20:16:53.111330 29093 rpcz_store.cc:276] 0617 20:16:51.825005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.526206 (+701201us) service_pool.cc:224] Handling call
0617 20:16:52.526773 (+ 567us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.526801 (+ 28us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.561372 (+ 34571us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.985858 (+424486us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:53.104188 (+118330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:53.111575 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 349) took 2245 ms. Trace:
I20260617 20:16:53.111810 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 6f544f486c144cd89ca7c5b83d252ee9 (DEFAULT_TABLE table=default.Table_00e6d18efea641ec906c6dc4d4d2b1c7 [id=c5fb7373ddb24e70af1553dd8f75c253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.111847 29377 rpcz_store.cc:276] 0617 20:16:50.866895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.866952 (+ 57us) service_pool.cc:224] Handling call
0617 20:16:53.065353 (+2198401us) ts_tablet_manager.cc:1151] Deleting tablet 8e704d08c0da484a986c9d882a42e6f1
0617 20:16:53.065366 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.085736 (+ 20370us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.101106 (+ 15370us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.111492 (+ 10386us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2197619}
I20260617 20:16:53.112128 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f15a7c18faa4e36bbb62809bb6e976c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.112371 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a89e42d091f423bb926f671797141ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.112491 29379 raft_consensus.cc:385] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.112594 29379 raft_consensus.cc:740] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.112818 29379 consensus_queue.cc:260] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.113330 29379 ts_tablet_manager.cc:1434] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.164s user 0.002s sys 0.000s
I20260617 20:16:53.113495 29091 rpcz_store.cc:276] 0617 20:16:51.562133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.105718 (+543585us) service_pool.cc:224] Handling call
0617 20:16:52.113960 (+ 8242us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.113990 (+ 30us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.936532 (+822542us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:52.960087 (+ 23555us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:53.104120 (+144033us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:53.113718 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 8e704d08c0da484a986c9d882a42e6f1 (table default.Table_270b09836c954e6c94328615b8059bb0 [id=c1ee5736ea3541af850fd0c99d5fbcfe]) successfully deleted
I20260617 20:16:53.113934 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 89d79b7023ae478698a06562b2e4c578 (DEFAULT_TABLE table=default.Table_09c8c95fbef548a5a674578b0f83917a [id=9acd747f0c134e3d98485dd851ed980f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.115156 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 355) took 2125 ms. Trace:
I20260617 20:16:53.115338 29377 rpcz_store.cc:276] 0617 20:16:50.988351 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.034651 (+ 46300us) service_pool.cc:224] Handling call
0617 20:16:53.113623 (+2078972us) ts_tablet_manager.cc:1151] Deleting tablet fc36f62aa0bf46278cb84ec8cb7eef55
0617 20:16:53.113634 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.114016 (+ 382us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1817389}
W20260617 20:16:53.115947 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet fc36f62aa0bf46278cb84ec8cb7eef55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc36f62aa0bf46278cb84ec8cb7eef55 already in progress: creating tablet
I20260617 20:16:53.119112 29107 tablet_service.cc:1511] Processing CreateTablet for tablet d00c2be45d82425bb70ae577fa3155fa (DEFAULT_TABLE table=default.Table_977eca2b43be413ea87a6f080ea27de0 [id=805224e5ece140629e8db5fc81aac186]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.119161 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 358) took 1801 ms. Trace:
I20260617 20:16:53.119288 29377 rpcz_store.cc:276] 0617 20:16:51.316136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.316233 (+ 97us) service_pool.cc:224] Handling call
0617 20:16:53.115927 (+1799694us) ts_tablet_manager.cc:1151] Deleting tablet 8b6f05ae7d624efba571d059ce2f1c91
0617 20:16:53.115935 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.117511 (+ 1576us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1798363}
I20260617 20:16:53.119634 29377 tablet_replica.cc:333] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:16:53.119776 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 8b6f05ae7d624efba571d059ce2f1c91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b6f05ae7d624efba571d059ce2f1c91 already in progress: creating tablet
I20260617 20:16:53.119890 29377 raft_consensus.cc:2243] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.120066 29376 ts_tablet_manager.cc:1929] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:53.120085 29377 raft_consensus.cc:2272] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.120285 29376 log.cc:1199] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/2a9e12c91df344ee84a586b7d4a27071
I20260617 20:16:53.120817 29376 ts_tablet_manager.cc:1950] T 2a9e12c91df344ee84a586b7d4a27071 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.120859 29377 ts_tablet_manager.cc:1916] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.121754 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 310) took 3120 ms. Trace:
I20260617 20:16:53.122043 29376 rpcz_store.cc:276] 0617 20:16:50.001561 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.009675 (+ 8114us) service_pool.cc:224] Handling call
0617 20:16:53.098935 (+3089260us) ts_tablet_manager.cc:1151] Deleting tablet 2a9e12c91df344ee84a586b7d4a27071
0617 20:16:53.098945 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.106274 (+ 7329us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.119993 (+ 13719us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.121701 (+ 1708us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3085463}
I20260617 20:16:53.122459 29376 tablet_replica.cc:333] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.122691 29376 raft_consensus.cc:2243] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.122924 29376 raft_consensus.cc:2272] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.123456 29376 ts_tablet_manager.cc:1916] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.114226 29102 rpcz_store.cc:276] 0617 20:16:51.633892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.175796 (+541904us) service_pool.cc:224] Handling call
0617 20:16:52.204852 (+ 29056us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.206000 (+ 1148us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.655348 (+449348us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.055200 (+399852us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:53.104243 (+ 49043us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:53.128207 29377 ts_tablet_manager.cc:1929] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.128510 29377 log.cc:1199] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/2d0c245563fe44b59d32616bd35d3dae
I20260617 20:16:53.128899 29377 ts_tablet_manager.cc:1950] T 2d0c245563fe44b59d32616bd35d3dae P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.129698 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 357) took 1814 ms. Trace:
I20260617 20:16:53.129846 29377 rpcz_store.cc:276] 0617 20:16:51.314805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.314912 (+ 107us) service_pool.cc:224] Handling call
0617 20:16:53.119574 (+1804662us) ts_tablet_manager.cc:1151] Deleting tablet 2d0c245563fe44b59d32616bd35d3dae
0617 20:16:53.119583 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.124119 (+ 4536us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.128146 (+ 4027us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.129641 (+ 1495us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1800663}
I20260617 20:16:53.130311 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 2d0c245563fe44b59d32616bd35d3dae (table default.Table_df31bee3761040b9973aa917f8f1e0a0 [id=aba28f2e637d403fb4225835adef96cd]) successfully deleted
I20260617 20:16:53.130584 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 359) took 1813 ms. Trace:
I20260617 20:16:53.130719 29377 rpcz_store.cc:276] 0617 20:16:51.316649 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.316725 (+ 76us) service_pool.cc:224] Handling call
0617 20:16:53.130362 (+1813637us) ts_tablet_manager.cc:1151] Deleting tablet 370db89a92a6455190edaf80e5a56205
0617 20:16:53.130371 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.130525 (+ 154us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1810627}
W20260617 20:16:53.131217 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 370db89a92a6455190edaf80e5a56205 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370db89a92a6455190edaf80e5a56205 already in progress: creating tablet
I20260617 20:16:53.131419 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 360) took 1812 ms. Trace:
I20260617 20:16:53.131539 29377 rpcz_store.cc:276] 0617 20:16:51.318503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.318559 (+ 56us) service_pool.cc:224] Handling call
0617 20:16:53.131196 (+1812637us) ts_tablet_manager.cc:1151] Deleting tablet 379ef43e02ec4bbbb03f2d6a53a66403
0617 20:16:53.131204 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.131362 (+ 158us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1807905}
I20260617 20:16:53.131788 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a176d1f3b0446984af141e02bac329. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:53.131922 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 379ef43e02ec4bbbb03f2d6a53a66403 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 379ef43e02ec4bbbb03f2d6a53a66403 already in progress: creating tablet
I20260617 20:16:53.132115 29377 tablet_replica.cc:333] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.132266 29376 ts_tablet_manager.cc:1929] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.132385 29376 log.cc:1199] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/98467525f81f4a48878eae17e3a9c982
I20260617 20:16:53.132334 29086 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43328 (request call id 102) took 1688 ms. Trace:
I20260617 20:16:53.132483 29377 raft_consensus.cc:2243] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:53.132748 29376 ts_tablet_manager.cc:1950] T 98467525f81f4a48878eae17e3a9c982 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.132934 29377 raft_consensus.cc:2272] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.133668 29377 ts_tablet_manager.cc:1916] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.138173 29378 tablet_bootstrap.cc:492] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.138363 29378 ts_tablet_manager.cc:1403] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.000s
I20260617 20:16:53.139676 29378 raft_consensus.cc:359] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.139918 29378 raft_consensus.cc:385] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.140079 29377 ts_tablet_manager.cc:1929] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:16:53.140029 29378 raft_consensus.cc:740] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.140245 29377 log.cc:1199] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/9e1dc756edd5473183afc75eef7112d6
I20260617 20:16:53.140537 29378 consensus_queue.cc:260] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.141327 29378 ts_tablet_manager.cc:1434] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260617 20:16:53.142256 29377 ts_tablet_manager.cc:1950] T 9e1dc756edd5473183afc75eef7112d6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.142791 29378 tablet_bootstrap.cc:492] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.146488 29088 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43328 (request call id 98) took 2293 ms. Trace:
I20260617 20:16:53.146515 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 368) took 1816 ms. Trace:
I20260617 20:16:53.146605 29088 rpcz_store.cc:276] 0617 20:16:50.852951 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.852999 (+ 48us) service_pool.cc:224] Handling call
0617 20:16:51.446922 (+593923us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x6160000b1b30. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedcbacc673 00007fedce5f6d28 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.450040 (+1003118us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x616000200254. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.533986 (+ 83946us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x616000210830. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedcbacc673 00007fedce5f6d28 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.691134 (+157148us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x6160000b0554. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.962383 (+271249us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x616000121054. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:53.146428 (+184045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1964873088}
I20260617 20:16:53.146631 29377 rpcz_store.cc:276] 0617 20:16:51.327424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.327480 (+ 56us) service_pool.cc:224] Handling call
0617 20:16:53.131976 (+1804496us) ts_tablet_manager.cc:1151] Deleting tablet 9e1dc756edd5473183afc75eef7112d6
0617 20:16:53.131986 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.136667 (+ 4681us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.139863 (+ 3196us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.143442 (+ 3579us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1802312}
I20260617 20:16:53.147055 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_7e16fff91c254edc8becd81ac1de334f [id=0ece007078c749e3bd4bab93ada3b311]) successfully deleted
I20260617 20:16:53.147169 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 361) took 1820 ms. Trace:
I20260617 20:16:53.147287 29377 rpcz_store.cc:276] 0617 20:16:51.326780 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.327685 (+ 905us) service_pool.cc:224] Handling call
0617 20:16:53.147027 (+1819342us) ts_tablet_manager.cc:1151] Deleting tablet 203666e6127b49ed92731bc87ce01798
0617 20:16:53.147036 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.147138 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1797440}
W20260617 20:16:53.147640 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 203666e6127b49ed92731bc87ce01798 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 203666e6127b49ed92731bc87ce01798 already in progress: creating tablet
I20260617 20:16:53.147779 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 406) took 1715 ms. Trace:
I20260617 20:16:53.147830 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 315) took 3056 ms. Trace:
I20260617 20:16:53.147883 29377 rpcz_store.cc:276] 0617 20:16:51.432038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.964267 (+532229us) service_pool.cc:224] Handling call
0617 20:16:53.147647 (+1183380us) ts_tablet_manager.cc:1151] Deleting tablet b3278efaad07403ca0a2baecad46d0f1
0617 20:16:53.147655 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.147749 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1154219}
I20260617 20:16:53.147943 29376 rpcz_store.cc:276] 0617 20:16:50.091151 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.091207 (+ 56us) service_pool.cc:224] Handling call
0617 20:16:53.122382 (+3031175us) ts_tablet_manager.cc:1151] Deleting tablet 98467525f81f4a48878eae17e3a9c982
0617 20:16:53.122391 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.129374 (+ 6983us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.132192 (+ 2818us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.147786 (+ 15594us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3030381}
I20260617 20:16:53.148355 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 317) took 3047 ms. Trace:
I20260617 20:16:53.148525 29378 tablet_bootstrap.cc:654] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.149523 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 408) took 1520 ms. Trace:
I20260617 20:16:53.149667 29377 rpcz_store.cc:276] 0617 20:16:51.628613 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.984364 (+355751us) service_pool.cc:224] Handling call
0617 20:16:53.149383 (+1165019us) ts_tablet_manager.cc:1151] Deleting tablet f823290351d542179b8bcc683d7acf6a
0617 20:16:53.149391 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.149492 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1146898}
I20260617 20:16:53.150190 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 412) took 1236 ms. Trace:
I20260617 20:16:53.150341 29377 rpcz_store.cc:276] 0617 20:16:51.913900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.002531 (+ 88631us) service_pool.cc:224] Handling call
0617 20:16:53.150024 (+1147493us) ts_tablet_manager.cc:1151] Deleting tablet 99a3d9ae347845dfa9357010819ebc58
0617 20:16:53.150031 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.150108 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1147310}
I20260617 20:16:53.150616 29376 rpcz_store.cc:276] 0617 20:16:50.101362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.101412 (+ 50us) service_pool.cc:224] Handling call
0617 20:16:53.148212 (+3046800us) ts_tablet_manager.cc:1151] Deleting tablet fed593a3fa7742a18ccc2124c3ee0fb9
0617 20:16:53.148221 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.148321 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3046569}
I20260617 20:16:53.150876 29377 tablet_replica.cc:333] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.151122 29377 raft_consensus.cc:2243] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.151342 29377 raft_consensus.cc:2272] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:53.151336 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet b3278efaad07403ca0a2baecad46d0f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3278efaad07403ca0a2baecad46d0f1 already in progress: creating tablet
W20260617 20:16:53.151597 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f823290351d542179b8bcc683d7acf6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f823290351d542179b8bcc683d7acf6a already in progress: creating tablet
W20260617 20:16:53.151796 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 99a3d9ae347845dfa9357010819ebc58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99a3d9ae347845dfa9357010819ebc58 already in progress: creating tablet
I20260617 20:16:53.151995 29377 ts_tablet_manager.cc:1916] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.152050 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 319) took 3049 ms. Trace:
I20260617 20:16:53.144668 29102 tablet_service.cc:1511] Processing CreateTablet for tablet b278ba32316c42d1b101e9803657af99 (DEFAULT_TABLE table=default.Table_2d169273aef9434c86e36818639e3879 [id=4423aef723674116a36387035529e9c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.152527 29376 rpcz_store.cc:276] 0617 20:16:50.102731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.115584 (+ 12853us) service_pool.cc:224] Handling call
0617 20:16:53.151186 (+3035602us) ts_tablet_manager.cc:1151] Deleting tablet 33a1c96212014333935ec7f7c92a306c
0617 20:16:53.151197 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.152016 (+ 819us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3035259}
I20260617 20:16:53.153829 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 314) took 3077 ms. Trace:
I20260617 20:16:53.154012 29086 rpcz_store.cc:276] 0617 20:16:51.436447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.437404 (+ 957us) service_pool.cc:224] Handling call
0617 20:16:52.450040 (+1012636us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x616000200254. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.523973 (+ 73933us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x616000210830. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedcbacc673 00007fedce5f6d28 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.546941 (+ 22968us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x616000083c30. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedcbacc673 00007fedce5f6d28 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.697587 (+150646us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x6160000b0554. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.956140 (+258553us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x616000121054. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:53.124874 (+168734us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865035776}
I20260617 20:16:53.154945 29376 rpcz_store.cc:276] 0617 20:16:50.076793 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.148804 (+ 72011us) service_pool.cc:224] Handling call
0617 20:16:53.153658 (+3004854us) ts_tablet_manager.cc:1151] Deleting tablet 488b06f05d9b4273a61bcb2d6e0ad796
0617 20:16:53.153666 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.153761 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3004553}
I20260617 20:16:53.155551 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 324) took 2979 ms. Trace:
I20260617 20:16:53.156977 29376 rpcz_store.cc:276] 0617 20:16:50.175885 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.176071 (+ 186us) service_pool.cc:224] Handling call
0617 20:16:53.155398 (+2979327us) ts_tablet_manager.cc:1151] Deleting tablet 0e6cee209a5a44d6b35eb50e9c33228f
0617 20:16:53.155407 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.155500 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2978453}
I20260617 20:16:53.157478 29101 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 405) took 1360 ms. Trace:
I20260617 20:16:53.157910 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54969e138cf745739b54203c11e4c94e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.157473 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 323) took 2983 ms. Trace:
I20260617 20:16:53.159029 29376 rpcz_store.cc:276] 0617 20:16:50.173947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.174057 (+ 110us) service_pool.cc:224] Handling call
0617 20:16:53.157311 (+2983254us) ts_tablet_manager.cc:1151] Deleting tablet b4240e14b48f4a43b7ce9c6512fc7ff2
0617 20:16:53.157320 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.157435 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2980160}
I20260617 20:16:53.159507 29376 tablet_replica.cc:333] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.160902 29376 raft_consensus.cc:2243] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.161145 29376 raft_consensus.cc:2272] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.161688 29377 ts_tablet_manager.cc:1929] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.162359 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 6323292f162b4063b7c413eaecfce791 (DEFAULT_TABLE table=default.Table_6608950ce63c4189ba3fd0cca3a42bd9 [id=5e4eb42ba8894b78a217d5af391de888]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.162871 29377 log.cc:1199] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/569e339c17764486a65a1c3b43c92adf
I20260617 20:16:53.163172 29376 ts_tablet_manager.cc:1916] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.163405 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b278ba32316c42d1b101e9803657af99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.163457 29377 ts_tablet_manager.cc:1950] T 569e339c17764486a65a1c3b43c92adf P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.164242 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 413) took 1245 ms. Trace:
I20260617 20:16:53.165645 29377 rpcz_store.cc:276] 0617 20:16:51.918961 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.002725 (+ 83764us) service_pool.cc:224] Handling call
0617 20:16:53.150817 (+1148092us) ts_tablet_manager.cc:1151] Deleting tablet 569e339c17764486a65a1c3b43c92adf
0617 20:16:53.150825 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.155111 (+ 4286us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.161614 (+ 6503us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.164174 (+ 2560us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1136765}
I20260617 20:16:53.166332 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 569e339c17764486a65a1c3b43c92adf (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]) successfully deleted
I20260617 20:16:53.166718 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 414) took 1189 ms. Trace:
I20260617 20:16:53.166836 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 9574c6f0765b4329af28d72c8e94240a (DEFAULT_TABLE table=default.Table_d45c5dfa81904202b64c8dee6eb00b24 [id=b0075b31722149588ce8215af28b6e0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.167060 29377 rpcz_store.cc:276] 0617 20:16:51.977598 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.014083 (+ 36485us) service_pool.cc:224] Handling call
0617 20:16:53.166412 (+1152329us) ts_tablet_manager.cc:1151] Deleting tablet 67a3124306094c72ad78e5473aa35bdb
0617 20:16:53.166424 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.166668 (+ 244us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1152144}
W20260617 20:16:53.167721 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 67a3124306094c72ad78e5473aa35bdb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67a3124306094c72ad78e5473aa35bdb already in progress: creating tablet
I20260617 20:16:53.168049 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 407) took 1543 ms. Trace:
I20260617 20:16:53.168366 29377 rpcz_store.cc:276] 0617 20:16:51.628310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.964373 (+336063us) service_pool.cc:224] Handling call
0617 20:16:53.167729 (+1203356us) ts_tablet_manager.cc:1151] Deleting tablet d1654ae96ce041fa9b9b881af7dd342e
0617 20:16:53.167739 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.167998 (+ 259us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1150899}
I20260617 20:16:53.168480 29101 rpcz_store.cc:276] 0617 20:16:51.796760 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.374503 (+577743us) service_pool.cc:224] Handling call
0617 20:16:52.523624 (+149121us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.523674 (+ 50us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:53.053472 (+529798us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.157251 (+103779us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:53.157438 (+ 187us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260617 20:16:53.168941 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d1654ae96ce041fa9b9b881af7dd342e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1654ae96ce041fa9b9b881af7dd342e already in progress: creating tablet
I20260617 20:16:53.169139 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 415) took 1010 ms. Trace:
I20260617 20:16:53.169559 29377 rpcz_store.cc:276] 0617 20:16:52.158390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.159359 (+ 969us) service_pool.cc:224] Handling call
0617 20:16:53.168970 (+1009611us) ts_tablet_manager.cc:1151] Deleting tablet 938b61a0f6dc4d178971034fd18c1674
0617 20:16:53.168978 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.169080 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":994564}
W20260617 20:16:53.170189 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 938b61a0f6dc4d178971034fd18c1674 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 938b61a0f6dc4d178971034fd18c1674 already in progress: creating tablet
I20260617 20:16:53.170255 29377 tablet_replica.cc:333] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.170742 29377 raft_consensus.cc:2243] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.171231 29377 raft_consensus.cc:2272] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.171820 29377 ts_tablet_manager.cc:1916] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.173725 29378 tablet_bootstrap.cc:492] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.173931 29378 ts_tablet_manager.cc:1403] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.031s user 0.011s sys 0.001s
I20260617 20:16:53.174192 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6323292f162b4063b7c413eaecfce791. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.174808 29378 raft_consensus.cc:359] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.175062 29378 raft_consensus.cc:385] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.175165 29378 raft_consensus.cc:740] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.175485 29378 consensus_queue.cc:260] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.177350 29378 ts_tablet_manager.cc:1434] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:53.177691 29378 tablet_bootstrap.cc:492] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.179073 29101 tablet_service.cc:1511] Processing CreateTablet for tablet a52873eade4048af81a8e51233b9d079 (DEFAULT_TABLE table=default.Table_8388a2681a87463b92758e227df2b510 [id=9dd225a437df48ca8de2f67be1905a03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.181139 29378 tablet_bootstrap.cc:654] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.183532 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9574c6f0765b4329af28d72c8e94240a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.186620 29376 ts_tablet_manager.cc:1929] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.186949 29377 ts_tablet_manager.cc:1929] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.189203 29376 log.cc:1199] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/1ce9f5deea614e6d9e02e88d3d5ff2c6
I20260617 20:16:53.189404 29377 log.cc:1199] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/57e19abe093a40f6886908a8a3a0cad4
I20260617 20:16:53.189989 29377 ts_tablet_manager.cc:1950] T 57e19abe093a40f6886908a8a3a0cad4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.191425 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 416) took 1020 ms. Trace:
I20260617 20:16:53.192651 29377 rpcz_store.cc:276] 0617 20:16:52.170695 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.171209 (+ 514us) service_pool.cc:224] Handling call
0617 20:16:53.170176 (+998967us) ts_tablet_manager.cc:1151] Deleting tablet 57e19abe093a40f6886908a8a3a0cad4
0617 20:16:53.170186 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.183873 (+ 13687us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.186857 (+ 2984us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.191363 (+ 4506us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":992628}
I20260617 20:16:53.193346 29376 ts_tablet_manager.cc:1950] T 1ce9f5deea614e6d9e02e88d3d5ff2c6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.193475 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 57e19abe093a40f6886908a8a3a0cad4 (table default.Table_bf43c1c307304b35a6b33eb8fb011be2 [id=c36f4aec7e564c10b3782a48ecdafef7]) successfully deleted
W20260617 20:16:53.194044 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet da50400f49e24ca589519e6ec823957d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da50400f49e24ca589519e6ec823957d already in progress: creating tablet
W20260617 20:16:53.194639 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet cf8d04ef8acd4fcaa69df9253cd89462 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf8d04ef8acd4fcaa69df9253cd89462 already in progress: creating tablet
W20260617 20:16:53.195322 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 18440a4a5c254a25b87f8632de9c92b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18440a4a5c254a25b87f8632de9c92b9 already in progress: creating tablet
I20260617 20:16:53.195345 29379 tablet_bootstrap.cc:492] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:53.195637 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 4e27c5834baa48ed953fccef54e6c52b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e27c5834baa48ed953fccef54e6c52b already in progress: creating tablet
I20260617 20:16:53.195793 29094 tablet_service.cc:1511] Processing CreateTablet for tablet d19d34e3bbe3453ca6de6ed7e62f7af4 (DEFAULT_TABLE table=default.Table_813114f7354f4c1b9a3976e27bb3ef59 [id=f734fe28a0f44ac2b90a882b695901a4]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:53.196187 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet cc8fa9f4c40b4ce9baa27a8837d3575c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc8fa9f4c40b4ce9baa27a8837d3575c already in progress: creating tablet
I20260617 20:16:53.196244 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 39ca961cfea54a7187cc7ea8d16a627f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:53.196336 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 325) took 2777 ms. Trace:
I20260617 20:16:53.196461 29377 tablet_replica.cc:333] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.196437 29376 rpcz_store.cc:276] 0617 20:16:50.418522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.419173 (+ 651us) service_pool.cc:224] Handling call
0617 20:16:53.159431 (+2740258us) ts_tablet_manager.cc:1151] Deleting tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6
0617 20:16:53.159443 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.175862 (+ 16419us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.186544 (+ 10682us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.196261 (+ 9717us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2739927}
I20260617 20:16:53.196535 29087 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43328 (request call id 103) took 1395 ms. Trace:
I20260617 20:16:53.196962 29377 raft_consensus.cc:2243] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.196799 29087 rpcz_store.cc:276] 0617 20:16:51.794163 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.794469 (+ 306us) service_pool.cc:224] Handling call
0617 20:16:52.475609 (+681140us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x616000200254. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.509825 (+ 34216us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x616000210830. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedcbacc673 00007fedce5f6d28 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.692772 (+182947us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x6160000b0554. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:52.962246 (+269474us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x616000121054. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:53.190040 (+227794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156731136}
I20260617 20:16:53.197486 29377 raft_consensus.cc:2272] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.198132 29376 tablet_replica.cc:333] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.198351 29377 ts_tablet_manager.cc:1916] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.199420 29376 raft_consensus.cc:2243] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.199681 29376 raft_consensus.cc:2272] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.200273 29376 ts_tablet_manager.cc:1916] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.200259 29104 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 408) took 1376 ms. Trace:
I20260617 20:16:53.201445 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a52873eade4048af81a8e51233b9d079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.201930 29104 rpcz_store.cc:276] 0617 20:16:51.814707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.524904 (+710197us) service_pool.cc:224] Handling call
0617 20:16:52.539257 (+ 14353us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.539323 (+ 66us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:52.961785 (+422462us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.095612 (+133827us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:53.191289 (+ 95677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:53.202556 29103 tablet_service.cc:1511] Processing CreateTablet for tablet cc8d29712eee47e497872df101404f26 (DEFAULT_TABLE table=default.Table_6ff346c8167a49878fc3900007fa2904 [id=a3145e0f371647c98fb79739624d5258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.205125 29377 ts_tablet_manager.cc:1929] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.210139 29377 log.cc:1199] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/1fa15915b0ec44ff8b66920e4c207536
I20260617 20:16:53.210948 29378 tablet_bootstrap.cc:492] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.211163 29378 ts_tablet_manager.cc:1403] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.034s user 0.014s sys 0.000s
I20260617 20:16:53.212021 29378 raft_consensus.cc:359] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.212289 29378 raft_consensus.cc:385] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.212488 29378 raft_consensus.cc:740] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.212796 29378 consensus_queue.cc:260] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.214905 29378 ts_tablet_manager.cc:1434] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:53.215255 29378 tablet_bootstrap.cc:492] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.215811 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d79b7023ae478698a06562b2e4c578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.217022 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3091c332a14c4c99bd28e401769e30 (DEFAULT_TABLE table=default.Table_b247c97f4c9a4b788252faebaeedadbe [id=19bd9015790b453194adb1f20e520a9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.217695 29377 ts_tablet_manager.cc:1950] T 1fa15915b0ec44ff8b66920e4c207536 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.218822 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 1fa15915b0ec44ff8b66920e4c207536 (table default.Table_20b86d94fc1845f7890c393e5f122ae7 [id=d037cdc970c044ec92ca7b0b46be209f]) successfully deleted
I20260617 20:16:53.219486 29377 tablet_replica.cc:333] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:16:53.219494 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 39ca961cfea54a7187cc7ea8d16a627f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39ca961cfea54a7187cc7ea8d16a627f already in progress: creating tablet
I20260617 20:16:53.219727 29377 raft_consensus.cc:2243] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.219978 29377 raft_consensus.cc:2272] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.220801 29377 ts_tablet_manager.cc:1916] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.224604 29940 tablet.cc:1724] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:53.227188 29783 raft_consensus.cc:493] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.227345 29783 raft_consensus.cc:515] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.228020 29783 leader_election.cc:290] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.228469 29377 ts_tablet_manager.cc:1929] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.228796 29377 log.cc:1199] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/17917ffc3e8f43afb2a8bc413159137c
I20260617 20:16:53.229247 29377 ts_tablet_manager.cc:1950] T 17917ffc3e8f43afb2a8bc413159137c P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.231738 29378 tablet_bootstrap.cc:654] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:53.231760 29062 leader_election.cc:343] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1f85271eeb854194a968215ebc08f47a
I20260617 20:16:53.232199 29376 ts_tablet_manager.cc:1929] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.232314 29376 log.cc:1199] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/216f91e7bda148bc9334b19e3c868910
I20260617 20:16:53.232676 29376 ts_tablet_manager.cc:1950] T 216f91e7bda148bc9334b19e3c868910 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.235117 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 327) took 2812 ms. Trace:
I20260617 20:16:53.236901 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f544f486c144cd89ca7c5b83d252ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.237418 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 17917ffc3e8f43afb2a8bc413159137c (table default.Table_ac0c318d8f1947d99a30561f61ebb675 [id=8d93392a8f2d47608dc8535439b92c72]) successfully deleted
I20260617 20:16:53.237653 29376 rpcz_store.cc:276] 0617 20:16:50.422746 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.422873 (+ 127us) service_pool.cc:224] Handling call
0617 20:16:53.198046 (+2775173us) ts_tablet_manager.cc:1151] Deleting tablet 216f91e7bda148bc9334b19e3c868910
0617 20:16:53.198056 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.213017 (+ 14961us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.232095 (+ 19078us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.235068 (+ 2973us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2774953}
I20260617 20:16:53.241868 29376 tablet_replica.cc:333] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.243383 29376 raft_consensus.cc:2243] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:53.244184 29376 pending_rounds.cc:70] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:53.244336 29378 tablet_bootstrap.cc:492] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.244570 29378 ts_tablet_manager.cc:1403] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.010s
I20260617 20:16:53.245513 29378 raft_consensus.cc:359] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.245769 29378 raft_consensus.cc:385] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.245908 29378 raft_consensus.cc:740] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.246237 29376 pending_rounds.cc:77] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955473182838784 op_type: NO_OP noop_request { }
I20260617 20:16:53.246253 29378 consensus_queue.cc:260] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.246405 29376 raft_consensus.cc:2889] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:53.246574 29376 raft_consensus.cc:2272] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.247156 29376 ts_tablet_manager.cc:1916] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.248142 29378 ts_tablet_manager.cc:1434] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:53.248500 29378 tablet_bootstrap.cc:492] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.251704 29378 tablet_bootstrap.cc:654] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.258356 29376 ts_tablet_manager.cc:1929] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:53.258635 29376 log.cc:1199] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/3b67b915758d4ab0a8faa0227de08593
I20260617 20:16:53.259263 29376 ts_tablet_manager.cc:1950] T 3b67b915758d4ab0a8faa0227de08593 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.260787 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 326) took 2838 ms. Trace:
I20260617 20:16:53.261011 29376 rpcz_store.cc:276] 0617 20:16:50.422480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.422528 (+ 48us) service_pool.cc:224] Handling call
0617 20:16:53.241774 (+2819246us) ts_tablet_manager.cc:1151] Deleting tablet 3b67b915758d4ab0a8faa0227de08593
0617 20:16:53.241790 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.254126 (+ 12336us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.258245 (+ 4119us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.260739 (+ 2494us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2818554}
I20260617 20:16:53.261695 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 328) took 2838 ms. Trace:
I20260617 20:16:53.261878 29376 rpcz_store.cc:276] 0617 20:16:50.423022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.423072 (+ 50us) service_pool.cc:224] Handling call
0617 20:16:53.261541 (+2838469us) ts_tablet_manager.cc:1151] Deleting tablet 808c455e74e645aa8e2b0d08ca81d4f9
0617 20:16:53.261555 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.261658 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2838276}
I20260617 20:16:53.262418 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 329) took 2616 ms. Trace:
I20260617 20:16:53.262627 29376 rpcz_store.cc:276] 0617 20:16:50.646022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.646273 (+ 251us) service_pool.cc:224] Handling call
0617 20:16:53.262262 (+2615989us) ts_tablet_manager.cc:1151] Deleting tablet 46ea43994a0a42fe9e16d7bc6a2118e6
0617 20:16:53.262274 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.262382 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2615744}
I20260617 20:16:53.263159 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 330) took 2615 ms. Trace:
I20260617 20:16:53.263230 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8d29712eee47e497872df101404f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.263847 29376 rpcz_store.cc:276] 0617 20:16:50.648123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.648184 (+ 61us) service_pool.cc:224] Handling call
0617 20:16:53.262977 (+2614793us) ts_tablet_manager.cc:1151] Deleting tablet 3726e55ed36f420ab63bcfb5a81c5aab
0617 20:16:53.262988 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.263124 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2612283}
I20260617 20:16:53.264259 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 333) took 2532 ms. Trace:
I20260617 20:16:53.264417 29378 tablet_bootstrap.cc:492] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.264418 29376 rpcz_store.cc:276] 0617 20:16:50.732284 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.733348 (+ 1064us) service_pool.cc:224] Handling call
0617 20:16:53.264148 (+2530800us) ts_tablet_manager.cc:1151] Deleting tablet e59430dd630b4ca6b573ea4230212abf
0617 20:16:53.264157 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.264231 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2530577}
I20260617 20:16:53.264600 29378 ts_tablet_manager.cc:1403] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.012s
I20260617 20:16:53.264762 29376 tablet_replica.cc:333] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.265017 29376 raft_consensus.cc:2243] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.265233 29376 raft_consensus.cc:2272] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.265525 29378 raft_consensus.cc:359] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.265709 29378 raft_consensus.cc:385] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.265841 29378 raft_consensus.cc:740] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.266165 29378 consensus_queue.cc:260] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.266335 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19d34e3bbe3453ca6de6ed7e62f7af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.266808 29376 ts_tablet_manager.cc:1916] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.268020 29378 ts_tablet_manager.cc:1434] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:53.268441 29378 tablet_bootstrap.cc:492] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.273396 29378 tablet_bootstrap.cc:654] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.278596 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00c2be45d82425bb70ae577fa3155fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.279497 29095 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43332 (request call id 414) took 1426 ms. Trace:
I20260617 20:16:53.280682 29376 ts_tablet_manager.cc:1929] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:53.280969 29376 log.cc:1199] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/a7b59053006046e98d27c694808ca34d
I20260617 20:16:53.281637 29376 ts_tablet_manager.cc:1950] T a7b59053006046e98d27c694808ca34d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.281546 29095 rpcz_store.cc:276] 0617 20:16:51.840985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.590960 (+749975us) service_pool.cc:224] Handling call
0617 20:16:52.593723 (+ 2763us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:52.593752 (+ 29us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:16:53.097031 (+503279us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.256193 (+159162us) tablet_replica.cc:206] Creating consensus instance
0617 20:16:53.267331 (+ 11138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:16:53.282822 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 334) took 2532 ms. Trace:
I20260617 20:16:53.283022 29376 rpcz_store.cc:276] 0617 20:16:50.750039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.750330 (+ 291us) service_pool.cc:224] Handling call
0617 20:16:53.264708 (+2514378us) ts_tablet_manager.cc:1151] Deleting tablet a7b59053006046e98d27c694808ca34d
0617 20:16:53.264716 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.273919 (+ 9203us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.280586 (+ 6667us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.282747 (+ 2161us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2514157}
I20260617 20:16:53.283598 29376 tablet_replica.cc:333] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.283919 29376 raft_consensus.cc:2243] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.284248 29376 raft_consensus.cc:2272] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.285394 29376 ts_tablet_manager.cc:1916] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.288754 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3091c332a14c4c99bd28e401769e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.291801 29375 ts_tablet_manager.cc:1929] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:53.292537 29375 log.cc:1199] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/4332e33d60964bd6a0c7e7caaa6bdc76
I20260617 20:16:53.293419 29375 ts_tablet_manager.cc:1950] T 4332e33d60964bd6a0c7e7caaa6bdc76 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:53.293824 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 344) took 2480 ms. Trace:
I20260617 20:16:53.294210 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d811ca370ee54db8a7e4f6056017cd01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.309522 29375 rpcz_store.cc:276] 0617 20:16:50.813201 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.815638 (+ 2437us) service_pool.cc:224] Handling call
0617 20:16:52.881568 (+2065930us) ts_tablet_manager.cc:1151] Deleting tablet 4332e33d60964bd6a0c7e7caaa6bdc76
0617 20:16:52.881580 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.162183 (+280603us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.288326 (+126143us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.293785 (+ 5459us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2061255}
I20260617 20:16:53.329011 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 4332e33d60964bd6a0c7e7caaa6bdc76 (table default.Table_81f4fb86b1a8470db7f74e35dc15a3fa [id=229a4fa545c84500af515f5992b547c7]) successfully deleted
I20260617 20:16:53.339408 29379 tablet_bootstrap.cc:654] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.365345 29916 raft_consensus.cc:493] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.365641 29916 raft_consensus.cc:515] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.366796 29916 leader_election.cc:290] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.385710 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1a416f802948d5bc150855d82b54c1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:53.386556 28925 leader_election.cc:343] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.387006 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 345) took 2573 ms. Trace:
I20260617 20:16:53.387179 29375 rpcz_store.cc:276] 0617 20:16:50.813368 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.815849 (+ 2481us) service_pool.cc:224] Handling call
0617 20:16:53.310132 (+2494283us) ts_tablet_manager.cc:1151] Deleting tablet 65af976b808d42d4aeded71a00cf7252
0617 20:16:53.386833 (+ 76701us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.386968 (+ 135us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2494140}
I20260617 20:16:53.387629 29375 tablet_replica.cc:333] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:53.387905 29375 raft_consensus.cc:2243] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.388124 29375 pending_rounds.cc:70] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:53.388245 29375 pending_rounds.cc:77] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7297955479877222400 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "a76b0744ef2a472091999681d5639fec" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_9f236274be424e44818107f2fed5331c" dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" new_extra_config { } }
I20260617 20:16:53.388760 29375 raft_consensus.cc:2272] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.390041 29375 ts_tablet_manager.cc:1916] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:53.394205 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 65af976b808d42d4aeded71a00cf7252 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65af976b808d42d4aeded71a00cf7252 already in progress: creating tablet
W20260617 20:16:53.395804 28631 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-taskRePpQS/build/asan/bin/kudu pid 28707: Timed out: CheckLeaks RPC to 127.27.245.253:38361 timed out after 1.000s (SENT)
I20260617 20:16:53.396083 28631 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRePpQS/build/asan/bin/kudu with pid 28707
I20260617 20:16:53.399605 29916 raft_consensus.cc:493] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.399825 29916 raft_consensus.cc:515] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.400745 29916 leader_election.cc:290] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.409405 28665 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:53.412571 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 9655a1164fa84f53bdb9fd31b2fcda78 (DEFAULT_TABLE table=default.Table_b1aa4707d2794652bd00fbbb2d66dc9b [id=ce30ff8f9aa148879cb0f930fffc1f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.415458 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9655a1164fa84f53bdb9fd31b2fcda78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.417114 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08911643f3ca451d80e2471b1b5b2342" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:53.418869 28925 leader_election.cc:343] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.424049 29967 tablet.cc:1724] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:53.435211 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1ce996ccf50542bfb287108b493eb4cc" } modify_external_catalogs: true
I20260617 20:16:53.439020 28970 tablet_service.cc:1511] Processing CreateTablet for tablet c2c6d214816540ac90dc9b2ad3cdb89f (DEFAULT_TABLE table=default.Table_c059c2f38bf74dc9a7c05c2b5dc8ac21 [id=57281538991341b485d434ca4abbdf9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.439574 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c6d214816540ac90dc9b2ad3cdb89f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.442974 29383 tablet_bootstrap.cc:654] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.444432 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1ce996ccf50542bfb287108b493eb4cc" } modify_external_catalogs: true
I20260617 20:16:53.445708 28667 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 (table default.Table_0b2903f0c1204e4eacd6a8987e8b688a [id=8b2c257acdb0498f8c9c4e8e44535f31]). Expected version 1 got 0
I20260617 20:16:53.447180 28667 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet a8eefc4f3c7d4f468c0adca837b73bb2 (table default.Table_b14e233170894814b3e2708e612aaa61 [id=405880e9419e43449f08e705aab0ba7c]). Expected version 2 got 0
W20260617 20:16:53.448911 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08290c23fff5449481789b29d15c4781 consensus state has no leader
I20260617 20:16:53.450202 29740 raft_consensus.cc:493] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.450440 29740 raft_consensus.cc:515] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.451244 29916 raft_consensus.cc:493] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.451448 29916 raft_consensus.cc:515] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.452134 29916 leader_election.cc:290] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.456502 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e48a4a827d44afca912dc8723be4542" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:53.457119 28925 leader_election.cc:343] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.458161 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 9655a1164fa84f53bdb9fd31b2fcda78 (DEFAULT_TABLE table=default.Table_b1aa4707d2794652bd00fbbb2d66dc9b [id=ce30ff8f9aa148879cb0f930fffc1f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.458791 29090 tablet_service.cc:1511] Processing CreateTablet for tablet c2c6d214816540ac90dc9b2ad3cdb89f (DEFAULT_TABLE table=default.Table_c059c2f38bf74dc9a7c05c2b5dc8ac21 [id=57281538991341b485d434ca4abbdf9c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:53.459444 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3897179e7724fdeb87a979ae4ef2091 consensus state has no leader
I20260617 20:16:53.465728 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9655a1164fa84f53bdb9fd31b2fcda78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.465720 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet 7e48a4a827d44afca912dc8723be4542 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:53.466095 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d5804c5dc2dd4b429190b2aefcbfd3f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.466704 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5804c5dc2dd4b429190b2aefcbfd3f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.465720 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 9f9844fab126448895c4c9d4c3c78d76 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:53.471158 28667 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_192444e7b6dc4e918c77df128cae877a [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 3 got 0
I20260617 20:16:53.471343 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c6d214816540ac90dc9b2ad3cdb89f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.471478 28667 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:53.474124 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_642cc41f3bdf4f4892418e1b130fc953"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.475337 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_642cc41f3bdf4f4892418e1b130fc953 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.476809 29967 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43332 (request call id 416) took 1521 ms. Trace:
I20260617 20:16:53.481124 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d811ca370ee54db8a7e4f6056017cd01
I20260617 20:16:53.481225 29940 tablet.cc:1724] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:16:53.481880 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 6f15a7c18faa4e36bbb62809bb6e976c
I20260617 20:16:53.482543 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0c3573fbceb84376afbe284979c815a2" } new_table_name: "default.Table_b6faf540da644f658eb715d3ffacd616" modify_external_catalogs: true
I20260617 20:16:53.482968 28662 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_192444e7b6dc4e918c77df128cae877a [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 3 got 2
I20260617 20:16:53.483652 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet 569e339c17764486a65a1c3b43c92adf from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:53.484170 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_bd07d5c811d84966aadb9e3d06ff2eb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.484673 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd07d5c811d84966aadb9e3d06ff2eb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.485122 29916 raft_consensus.cc:493] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.485268 29916 raft_consensus.cc:515] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.486538 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 8a5d9677bc184c30be1a11bfa85a97c8
I20260617 20:16:53.486579 29916 leader_election.cc:290] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.486800 28970 tablet_service.cc:1558] Processing DeleteTablet for tablet d811ca370ee54db8a7e4f6056017cd01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.487026 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f15a7c18faa4e36bbb62809bb6e976c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.487349 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b14e233170894814b3e2708e612aaa61" } new_table_name: "default.Table_a41d5a63ab0c47adafaeff2f42205397" modify_external_catalogs: true
W20260617 20:16:53.492326 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d811ca370ee54db8a7e4f6056017cd01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d811ca370ee54db8a7e4f6056017cd01 already in progress: creating tablet
I20260617 20:16:53.492571 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d9677bc184c30be1a11bfa85a97c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:53.492626 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 6f15a7c18faa4e36bbb62809bb6e976c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f15a7c18faa4e36bbb62809bb6e976c already in progress: creating tablet
W20260617 20:16:53.493264 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 8a5d9677bc184c30be1a11bfa85a97c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a5d9677bc184c30be1a11bfa85a97c8 already in progress: creating tablet
I20260617 20:16:53.494830 29376 ts_tablet_manager.cc:1929] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260617 20:16:53.494670 29197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s user 0.006s sys 0.009s
I20260617 20:16:53.495383 29740 leader_election.cc:290] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:53.495813 29376 log.cc:1199] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/a76b0744ef2a472091999681d5639fec
I20260617 20:16:53.500288 29376 ts_tablet_manager.cc:1950] T a76b0744ef2a472091999681d5639fec P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.500713 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 335) took 2749 ms. Trace:
I20260617 20:16:53.500815 29376 rpcz_store.cc:276] 0617 20:16:50.750915 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.750965 (+ 50us) service_pool.cc:224] Handling call
0617 20:16:53.283493 (+2532528us) ts_tablet_manager.cc:1151] Deleting tablet a76b0744ef2a472091999681d5639fec
0617 20:16:53.283507 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.413379 (+129872us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.453116 (+ 39737us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.500682 (+ 47566us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2532260}
I20260617 20:16:53.501161 29376 tablet_replica.cc:333] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.501552 29376 raft_consensus.cc:2243] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.501768 29376 raft_consensus.cc:2272] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.502228 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd999d88d954e50810cc01b297a27a9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:53.502810 28925 leader_election.cc:343] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.503394 29376 ts_tablet_manager.cc:1916] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.509482 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d9677bc184c30be1a11bfa85a97c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:53.510458 29198 leader_election.cc:343] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 3ae50375e5934acbb213379fb7c87989
W20260617 20:16:53.510758 29917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s user 0.010s sys 0.004s
W20260617 20:16:53.510891 29917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s user 0.011s sys 0.004s
W20260617 20:16:53.511117 29197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s user 0.006s sys 0.009s
I20260617 20:16:53.514427 29916 raft_consensus.cc:493] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.514639 29916 raft_consensus.cc:515] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.515494 29916 leader_election.cc:290] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.519137 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f85271eeb854194a968215ebc08f47a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:53.520569 29103 tablet_service.cc:1558] Processing DeleteTablet for tablet 8eee68618cdf462283d7fd9f098c2a0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:46 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:53.521334 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3091c332a14c4c99bd28e401769e30 (DEFAULT_TABLE table=default.Table_b247c97f4c9a4b788252faebaeedadbe [id=19bd9015790b453194adb1f20e520a9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.521749 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3091c332a14c4c99bd28e401769e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.529042 29240 tablet_service.cc:1511] Processing CreateTablet for tablet d19d34e3bbe3453ca6de6ed7e62f7af4 (DEFAULT_TABLE table=default.Table_813114f7354f4c1b9a3976e27bb3ef59 [id=f734fe28a0f44ac2b90a882b695901a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.529584 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d19d34e3bbe3453ca6de6ed7e62f7af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.533452 29379 tablet_bootstrap.cc:492] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:53.534299 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8eefc4f3c7d4f468c0adca837b73bb2" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:53.534667 29379 ts_tablet_manager.cc:1403] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.342s user 0.010s sys 0.003s
I20260617 20:16:53.535003 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f15a7c18faa4e36bbb62809bb6e976c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:53.535247 28925 leader_election.cc:343] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.535800 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 9655a1164fa84f53bdb9fd31b2fcda78 (DEFAULT_TABLE table=default.Table_b1aa4707d2794652bd00fbbb2d66dc9b [id=ce30ff8f9aa148879cb0f930fffc1f51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.536191 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9655a1164fa84f53bdb9fd31b2fcda78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.509337 29967 rpcz_store.cc:276] 0617 20:16:51.955462 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.593578 (+638116us) service_pool.cc:224] Handling call
0617 20:16:53.476760 (+883182us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:16:52.635125 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0617 20:16:52.637431 (+ 2306us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0617 20:16:52.637443 (+ 12us) alter_schema_op.cc:66] Acquired schema lock
0617 20:16:52.637453 (+ 10us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0617 20:16:52.637503 (+ 50us) alter_schema_op.cc:128] START. Timestamp: 1781727412637453
0617 20:16:52.637508 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 20:16:52.657034 (+ 19526us) log.cc:844] Serialized 173 byte log entry
0617 20:16:53.073592 (+416558us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x60c0003e2c40. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedd2513a05 00007fedca020210 00007fedbe6f53e0 0000000000a932a6 00007fedbe71469a 00007fedbe7100bc 00007fedbe7153ee 00007fedca00543c 00007fedca01276b 00007fedca0131a0
0617 20:16:53.103615 (+ 30023us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x60c0003e2c40. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedd2513a05 00007fedbe71688e 00007fedbe719d1b 00007fedbe719b98 0000000000aa681c 00007fedbe6f5f48 00007fedc1dbf6da 00007fedba87d61e
0617 20:16:53.223652 (+120037us) op_driver.cc:464] REPLICATION: finished
0617 20:16:53.400118 (+176466us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0617 20:16:53.425896 (+ 25778us) log.cc:844] Serialized 5 byte log entry
0617 20:16:53.475055 (+ 49159us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.476503 (+ 1448us) log.cc:844] Serialized 14 byte log entry
0617 20:16:53.476720 (+ 217us) alter_schema_op.cc:73] Released schema lock
0617 20:16:53.476725 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":160985,"mutex_wait_us":2031,"prepare.queue_time_us":42,"prepare.run_cpu_time_us":56350,"prepare.run_wall_time_us":440661,"raft.queue_time_us":29190,"raft.run_cpu_time_us":724,"raft.run_wall_time_us":13308,"replication_time_us":586108,"spinlock_wait_cycles":22459136,"thread_start_us":527869,"threads_started":2,"wal-append.queue_time_us":405096}]]}
I20260617 20:16:53.544661 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet d811ca370ee54db8a7e4f6056017cd01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:53.550520 29228 tablet_service.cc:1511] Processing CreateTablet for tablet c2c6d214816540ac90dc9b2ad3cdb89f (DEFAULT_TABLE table=default.Table_c059c2f38bf74dc9a7c05c2b5dc8ac21 [id=57281538991341b485d434ca4abbdf9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.551124 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c6d214816540ac90dc9b2ad3cdb89f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.543146 29972 tablet.cc:1724] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260617 20:16:53.558055 28656 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet ead0291870a443d9b76ea919a45a4303 (table default.Table_dee4e7a09180402da49e21d594f587a8 [id=0ef22e22306747b28d49d58d0fa45620], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet ead0291870a443d9b76ea919a45a4303 consensus state has no leader
I20260617 20:16:53.564260 29379 raft_consensus.cc:359] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.564491 29379 raft_consensus.cc:385] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.564580 29379 raft_consensus.cc:740] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.564829 29375 ts_tablet_manager.cc:1929] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:53.564949 29375 log.cc:1199] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/a76b0744ef2a472091999681d5639fec
I20260617 20:16:53.565359 29375 ts_tablet_manager.cc:1950] T a76b0744ef2a472091999681d5639fec P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:53.568239 29379 consensus_queue.cc:260] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.568931 29379 ts_tablet_manager.cc:1434] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.034s user 0.001s sys 0.001s
W20260617 20:16:53.570076 29198 consensus_peers.cc:597] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:53.571476 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet d811ca370ee54db8a7e4f6056017cd01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.572329 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 330) took 2820 ms. Trace:
I20260617 20:16:53.572507 29375 rpcz_store.cc:276] 0617 20:16:50.751692 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.751794 (+ 102us) service_pool.cc:224] Handling call
0617 20:16:53.387566 (+2635772us) ts_tablet_manager.cc:1151] Deleting tablet a76b0744ef2a472091999681d5639fec
0617 20:16:53.387575 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.455529 (+ 67954us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.564756 (+109227us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.572265 (+ 7509us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2444432}
I20260617 20:16:53.573433 29375 tablet_replica.cc:333] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:53.573684 29375 raft_consensus.cc:2243] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:53.574110 29375 raft_consensus.cc:2272] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.575263 29375 ts_tablet_manager.cc:1916] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.575735 29916 raft_consensus.cc:493] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.575810 29379 tablet_bootstrap.cc:492] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:53.575915 29916 raft_consensus.cc:515] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.576591 29916 leader_election.cc:290] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.577371 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f822e3f4ca4946a116ee172e83628b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:53.577683 29379 tablet_bootstrap.cc:654] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:53.578038 28925 leader_election.cc:343] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.579916 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet a76b0744ef2a472091999681d5639fec (table default.Table_9f236274be424e44818107f2fed5331c [id=a3772e01cb314c7e88e85833d727617d]) successfully deleted
I20260617 20:16:53.580757 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f15a7c18faa4e36bbb62809bb6e976c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.581523 29972 tablet.cc:1724] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:53.550020 29376 ts_tablet_manager.cc:1929] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.588557 29376 log.cc:1199] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/9d2a38be2e8e4796a98f1ae1d011249f
I20260617 20:16:53.589133 29379 tablet_bootstrap.cc:492] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:53.589124 29376 ts_tablet_manager.cc:1950] T 9d2a38be2e8e4796a98f1ae1d011249f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.589332 29379 ts_tablet_manager.cc:1403] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.001s
I20260617 20:16:53.590170 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 336) took 2838 ms. Trace:
I20260617 20:16:53.590324 29376 rpcz_store.cc:276] 0617 20:16:50.752000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.753126 (+ 1126us) service_pool.cc:224] Handling call
0617 20:16:53.501096 (+2747970us) ts_tablet_manager.cc:1151] Deleting tablet 9d2a38be2e8e4796a98f1ae1d011249f
0617 20:16:53.501106 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.506777 (+ 5671us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.549935 (+ 43158us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.590118 (+ 40183us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2747738}
I20260617 20:16:53.591413 29379 raft_consensus.cc:359] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.591646 29379 raft_consensus.cc:385] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.591735 29379 raft_consensus.cc:740] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.592829 29379 consensus_queue.cc:260] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.598351 29379 ts_tablet_manager.cc:1434] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260617 20:16:53.600144 29379 tablet_bootstrap.cc:492] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:53.603703 29379 tablet_bootstrap.cc:654] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.603813 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d738ab2f8c784c76947a3a76bd040219
I20260617 20:16:53.604732 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet d738ab2f8c784c76947a3a76bd040219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:53.605505 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d738ab2f8c784c76947a3a76bd040219 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d738ab2f8c784c76947a3a76bd040219 already in progress: creating tablet
I20260617 20:16:53.605729 28661 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
I20260617 20:16:53.606119 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet d738ab2f8c784c76947a3a76bd040219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:53.607502 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 4332e33d60964bd6a0c7e7caaa6bdc76 (table default.Table_81f4fb86b1a8470db7f74e35dc15a3fa [id=229a4fa545c84500af515f5992b547c7]) successfully deleted
I20260617 20:16:53.607951 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 113fbbc739d04f529e82bc1cf1074bd7 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]) successfully deleted
I20260617 20:16:53.608145 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 9b96c186469e4e8a8baa0dcab96d66bf (table default.Table_33168ad831b44c79a651427dd6011f2b [id=1a6ef514b9104d7d92bce17d40b5e3f9]) successfully deleted
I20260617 20:16:53.608311 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 2a9e12c91df344ee84a586b7d4a27071 (table default.Table_2420afe282984f72ab42715fbc33380a [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]) successfully deleted
I20260617 20:16:53.608495 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 98467525f81f4a48878eae17e3a9c982 (table default.Table_b299a2d2bb2d43c0a27ba56bfd754a14 [id=7be1ef9796444187a095e577b3f29690]) successfully deleted
W20260617 20:16:53.608678 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet fed593a3fa7742a18ccc2124c3ee0fb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fed593a3fa7742a18ccc2124c3ee0fb9 already in progress: creating tablet
W20260617 20:16:53.608884 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 33a1c96212014333935ec7f7c92a306c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33a1c96212014333935ec7f7c92a306c already in progress: creating tablet
W20260617 20:16:53.609076 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 488b06f05d9b4273a61bcb2d6e0ad796 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 488b06f05d9b4273a61bcb2d6e0ad796 already in progress: creating tablet
I20260617 20:16:53.610482 29378 tablet_bootstrap.cc:492] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.610661 29378 ts_tablet_manager.cc:1403] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.342s user 0.065s sys 0.125s
I20260617 20:16:53.611481 29378 raft_consensus.cc:359] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.611720 29378 raft_consensus.cc:385] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.611802 29378 raft_consensus.cc:740] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.612134 29378 consensus_queue.cc:260] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.612787 29378 ts_tablet_manager.cc:1434] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:53.614460 29378 tablet_bootstrap.cc:492] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.621097 29378 tablet_bootstrap.cc:654] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.593554 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d9677bc184c30be1a11bfa85a97c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.623569 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 337) took 2869 ms. Trace:
I20260617 20:16:53.623636 29379 tablet_bootstrap.cc:492] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:53.623766 29379 ts_tablet_manager.cc:1403] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.003s
I20260617 20:16:53.623679 29376 rpcz_store.cc:276] 0617 20:16:50.753742 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.753798 (+ 56us) service_pool.cc:224] Handling call
0617 20:16:53.623367 (+2869569us) ts_tablet_manager.cc:1151] Deleting tablet f4de5dafb1474de1911148bb3b4527cf
0617 20:16:53.623379 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.623511 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2869334}
I20260617 20:16:53.624197 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 338) took 2849 ms. Trace:
I20260617 20:16:53.624297 29376 rpcz_store.cc:276] 0617 20:16:50.774228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.802815 (+ 28587us) service_pool.cc:224] Handling call
0617 20:16:53.623973 (+2821158us) ts_tablet_manager.cc:1151] Deleting tablet f8e0c5d20a4548cc8124302aa38bcb21
0617 20:16:53.623985 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.624078 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2816646}
I20260617 20:16:53.624598 29376 tablet_replica.cc:333] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.624568 29379 raft_consensus.cc:359] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.624730 29379 raft_consensus.cc:385] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.624788 29376 raft_consensus.cc:2243] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.624807 29379 raft_consensus.cc:740] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.625041 29376 raft_consensus.cc:2272] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.625010 29379 consensus_queue.cc:260] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.625492 29379 ts_tablet_manager.cc:1434] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:53.625615 29376 ts_tablet_manager.cc:1916] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.627126 29379 tablet_bootstrap.cc:492] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:53.630157 29379 tablet_bootstrap.cc:654] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.597507 29976 tablet.cc:1724] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:53.621408 29383 tablet_bootstrap.cc:492] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:53.635646 29383 ts_tablet_manager.cc:1403] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.778s user 0.002s sys 0.006s
I20260617 20:16:53.636515 29383 raft_consensus.cc:359] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.637924 29383 raft_consensus.cc:385] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.638070 29383 raft_consensus.cc:740] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.638300 29378 tablet_bootstrap.cc:492] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.638386 29383 consensus_queue.cc:260] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.638487 29378 ts_tablet_manager.cc:1403] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.004s
I20260617 20:16:53.639012 29383 ts_tablet_manager.cc:1434] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:53.639333 29378 raft_consensus.cc:359] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.639483 29378 raft_consensus.cc:385] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.639552 29378 raft_consensus.cc:740] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.639786 29378 consensus_queue.cc:260] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.640432 29378 ts_tablet_manager.cc:1434] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:53.639393 29383 tablet_bootstrap.cc:492] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:53.640686 29378 tablet_bootstrap.cc:492] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.642386 29383 tablet_bootstrap.cc:654] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.643777 29378 tablet_bootstrap.cc:654] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.647584 29379 tablet_bootstrap.cc:492] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:53.647800 29379 ts_tablet_manager.cc:1403] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.003s
I20260617 20:16:53.648559 29379 raft_consensus.cc:359] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.648804 29379 raft_consensus.cc:385] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.648916 29379 raft_consensus.cc:740] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.649201 29379 consensus_queue.cc:260] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.654314 29379 ts_tablet_manager.cc:1434] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 20:16:53.656111 29379 tablet_bootstrap.cc:492] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:53.657725 29379 tablet_bootstrap.cc:654] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.660333 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eee68618cdf462283d7fd9f098c2a0d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.660643 29259 raft_consensus.cc:2468] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:53.662221 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85271eeb854194a968215ebc08f47a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.662415 29263 raft_consensus.cc:2468] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:53.662868 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65814c56424256b53d3c9f94c1b74a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.663669 29378 tablet_bootstrap.cc:492] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.663851 29378 ts_tablet_manager.cc:1403] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.001s
I20260617 20:16:53.664529 29378 raft_consensus.cc:359] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.664701 29378 raft_consensus.cc:385] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.664758 29378 raft_consensus.cc:740] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.664983 29378 consensus_queue.cc:260] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.666934 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1a416f802948d5bc150855d82b54c1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.667526 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8eefc4f3c7d4f468c0adca837b73bb2" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.667588 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f822e3f4ca4946a116ee172e83628b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.667873 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08911643f3ca451d80e2471b1b5b2342" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.668303 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e48a4a827d44afca912dc8723be4542" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.668787 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd999d88d954e50810cc01b297a27a9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.669530 29378 ts_tablet_manager.cc:1434] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:16:53.669957 29378 tablet_bootstrap.cc:492] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.671228 29379 tablet_bootstrap.cc:492] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:53.671444 29379 ts_tablet_manager.cc:1403] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20260617 20:16:53.672276 29379 raft_consensus.cc:359] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.672530 29379 raft_consensus.cc:385] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.672665 29379 raft_consensus.cc:740] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.672931 29379 consensus_queue.cc:260] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.673089 29378 tablet_bootstrap.cc:654] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.675602 29379 ts_tablet_manager.cc:1434] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 20:16:53.675931 29379 tablet_bootstrap.cc:492] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:53.677781 29379 tablet_bootstrap.cc:654] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.623360 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 7e48a4a827d44afca912dc8723be4542
W20260617 20:16:53.609279 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 0e6cee209a5a44d6b35eb50e9c33228f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e6cee209a5a44d6b35eb50e9c33228f already in progress: creating tablet
I20260617 20:16:53.681617 28670 catalog_manager.cc:6784] ReplaceTablet: tablet 7e48a4a827d44afca912dc8723be4542 deleted and replaced by tablet 33b01c9c27904a1986e285477921ac4f
W20260617 20:16:53.682171 28656 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 72904.7us
I20260617 20:16:53.683130 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e48a4a827d44afca912dc8723be4542 with delete_type TABLET_DATA_DELETED (replaced by tablet 33b01c9c27904a1986e285477921ac4f) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.683470 29377 tablet_replica.cc:333] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.683749 29377 raft_consensus.cc:2243] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.683938 29377 raft_consensus.cc:2272] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.658082 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 9f9844fab126448895c4c9d4c3c78d76
I20260617 20:16:53.684661 29377 ts_tablet_manager.cc:1916] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:53.675032 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a8eefc4f3c7d4f468c0adca837b73bb2 consensus state has no leader
I20260617 20:16:53.684931 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 (table default.Table_8ca126699bab4f66b23ce38c90e050bb [id=f119f85b0a244e149caec77aab7063ad]) successfully deleted
I20260617 20:16:53.685143 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 216f91e7bda148bc9334b19e3c868910 (table default.Table_1944004da2ec4937b26d524aa808d0b3 [id=295609419d07485fa5651914ddd75ce8]) successfully deleted
I20260617 20:16:53.670082 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1b2e51959bad407996ecd0596aa27cf9" } new_table_name: "default.Table_2b5ab81def9b44fa8d7d148f7758ec63" modify_external_catalogs: true
I20260617 20:16:53.685845 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f9844fab126448895c4c9d4c3c78d76 with delete_type TABLET_DATA_DELETED (replaced by tablet cdd24a60a91b43cd9e31ecca3d21ec60) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.653439 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 1 got 0
W20260617 20:16:53.675083 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5df6af49cb484f59ad1f32235753e1db consensus state has no leader
I20260617 20:16:53.687711 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet 5df6af49cb484f59ad1f32235753e1db from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:53.684945 28663 catalog_manager.cc:6784] ReplaceTablet: tablet 9f9844fab126448895c4c9d4c3c78d76 deleted and replaced by tablet cdd24a60a91b43cd9e31ecca3d21ec60
I20260617 20:16:53.692967 29377 ts_tablet_manager.cc:1929] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.692976 29063 leader_election.cc:304] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:53.693216 29377 log.cc:1199] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/7e48a4a827d44afca912dc8723be4542
I20260617 20:16:53.693415 29955 raft_consensus.cc:2804] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:53.693517 29955 raft_consensus.cc:493] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:53.693565 29377 ts_tablet_manager.cc:1950] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.693612 29955 raft_consensus.cc:3060] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:53.694145 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 3b67b915758d4ab0a8faa0227de08593 (table default.Table_ef23aa968984448793f5605fea074d86 [id=f521ee60b1604df983bce5d5c1d0b3d1]) successfully deleted
W20260617 20:16:53.694609 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 808c455e74e645aa8e2b0d08ca81d4f9 because the tablet was not found. No further retry: Not found: Tablet not found: 808c455e74e645aa8e2b0d08ca81d4f9
I20260617 20:16:53.696105 29063 leader_election.cc:304] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:53.696538 29859 raft_consensus.cc:2804] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:53.696636 29859 raft_consensus.cc:493] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:53.696780 29859 raft_consensus.cc:3060] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:53.697536 29063 consensus_peers.cc:597] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a9e12c91df344ee84a586b7d4a27071. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:53.700279 29955 raft_consensus.cc:515] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.700564 29859 raft_consensus.cc:515] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.701049 29955 leader_election.cc:290] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:53.701963 29062 leader_election.cc:343] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 8eee68618cdf462283d7fd9f098c2a0d
I20260617 20:16:53.701776 29859 leader_election.cc:290] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.695246 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 7e48a4a827d44afca912dc8723be4542 (table default.Table_e6908a670d534e828a0770f48cace3db [id=b24f0a25c8574b62842179a4c9bbc2f8]) successfully deleted
I20260617 20:16:53.695367 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet b427ba6320be4f2a929eaf18a56b4309 from {username='slave'} at 127.0.0.1:60552
W20260617 20:16:53.702704 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46ea43994a0a42fe9e16d7bc6a2118e6 already in progress: creating tablet
W20260617 20:16:53.702704 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 9f9844fab126448895c4c9d4c3c78d76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f9844fab126448895c4c9d4c3c78d76 already in progress: creating tablet
W20260617 20:16:53.703711 29062 leader_election.cc:343] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1f85271eeb854194a968215ebc08f47a
I20260617 20:16:53.703975 29383 tablet_bootstrap.cc:492] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:53.704157 29383 ts_tablet_manager.cc:1403] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.065s user 0.000s sys 0.003s
I20260617 20:16:53.704996 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_153027e782904859919297102e88af8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:53.705364 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_26d6375fbd0444359f9460701d4c61a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.705639 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_153027e782904859919297102e88af8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:53.705830 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26d6375fbd0444359f9460701d4c61a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.706998 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_563b00b87d974ad88a8fba7f9df09d6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:53.706998 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b60299a5315d44ca846c6b09fdc0ae03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.707544 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_563b00b87d974ad88a8fba7f9df09d6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:53.707661 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b60299a5315d44ca846c6b09fdc0ae03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.705008 29383 raft_consensus.cc:359] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.708748 29383 raft_consensus.cc:385] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.708873 29383 raft_consensus.cc:740] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.709134 29383 consensus_queue.cc:260] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.709849 29383 ts_tablet_manager.cc:1434] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260617 20:16:53.710685 29379 tablet_bootstrap.cc:492] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:53.710915 29379 ts_tablet_manager.cc:1403] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.001s
I20260617 20:16:53.711968 29379 raft_consensus.cc:359] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.712394 29379 raft_consensus.cc:385] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.712534 29379 raft_consensus.cc:740] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.712826 29379 consensus_queue.cc:260] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.714905 29379 ts_tablet_manager.cc:1434] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:16:53.715230 29379 tablet_bootstrap.cc:492] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:53.717648 28925 leader_election.cc:343] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.717819 28925 leader_election.cc:304] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:53.718220 29916 raft_consensus.cc:2749] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:53.718453 29379 tablet_bootstrap.cc:654] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:53.719066 28925 leader_election.cc:343] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.719233 28925 leader_election.cc:304] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:53.719597 29916 raft_consensus.cc:2749] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:53.720422 28925 leader_election.cc:343] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.720577 28925 leader_election.cc:304] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:53.720976 29916 raft_consensus.cc:2749] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:53.721455 28925 leader_election.cc:343] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.721580 28925 leader_election.cc:304] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:53.721976 29916 raft_consensus.cc:2749] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:53.722214 29378 tablet_bootstrap.cc:492] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.722388 29378 ts_tablet_manager.cc:1403] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.053s user 0.010s sys 0.000s
I20260617 20:16:53.723182 29378 raft_consensus.cc:359] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.723519 29378 raft_consensus.cc:385] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.723637 29378 raft_consensus.cc:740] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.723932 29378 consensus_queue.cc:260] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.725818 29378 ts_tablet_manager.cc:1434] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:16:53.726147 29378 tablet_bootstrap.cc:492] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.730286 29378 tablet_bootstrap.cc:654] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:53.702999 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet e59430dd630b4ca6b573ea4230212abf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e59430dd630b4ca6b573ea4230212abf already in progress: creating tablet
I20260617 20:16:53.735404 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet a7b59053006046e98d27c694808ca34d (table default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]) successfully deleted
I20260617 20:16:53.735733 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet a76b0744ef2a472091999681d5639fec (table default.Table_9f236274be424e44818107f2fed5331c [id=a3772e01cb314c7e88e85833d727617d]) successfully deleted
I20260617 20:16:53.736284 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 9d2a38be2e8e4796a98f1ae1d011249f (table default.Table_6bd15ccc82e94f2a9d16a99288ae6d3c [id=cd4abe077ee04673bad87834b3af273b]) successfully deleted
W20260617 20:16:53.736603 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f4de5dafb1474de1911148bb3b4527cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4de5dafb1474de1911148bb3b4527cf already in progress: creating tablet
W20260617 20:16:53.736944 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f8e0c5d20a4548cc8124302aa38bcb21 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f8e0c5d20a4548cc8124302aa38bcb21 already in progress: creating tablet
I20260617 20:16:53.738384 29101 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e48a4a827d44afca912dc8723be4542 with delete_type TABLET_DATA_DELETED (replaced by tablet 33b01c9c27904a1986e285477921ac4f) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:53.738622 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f9844fab126448895c4c9d4c3c78d76 with delete_type TABLET_DATA_DELETED (replaced by tablet cdd24a60a91b43cd9e31ecca3d21ec60) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:53.740060 28925 leader_election.cc:343] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.740244 28925 leader_election.cc:304] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:53.740688 29916 raft_consensus.cc:2749] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:53.741346 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet d738ab2f8c784c76947a3a76bd040219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.741850 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e4407aa01642ffb03eba1b220afdba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.742200 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e48a4a827d44afca912dc8723be4542 with delete_type TABLET_DATA_DELETED (replaced by tablet 33b01c9c27904a1986e285477921ac4f) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.742595 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f9844fab126448895c4c9d4c3c78d76 with delete_type TABLET_DATA_DELETED (replaced by tablet cdd24a60a91b43cd9e31ecca3d21ec60) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:53.743254 29197 leader_election.cc:343] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3ae50375e5934acbb213379fb7c87989
I20260617 20:16:53.743412 29197 leader_election.cc:304] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:53.743676 29957 raft_consensus.cc:2749] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:53.745098 28925 leader_election.cc:343] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.745257 28925 leader_election.cc:304] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:53.745492 28925 raft_consensus.cc:2686] T 7e48a4a827d44afca912dc8723be4542 P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260617 20:16:53.746311 28925 leader_election.cc:343] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:53.746500 28925 leader_election.cc:304] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:53.746750 29916 raft_consensus.cc:2749] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:53.753371 29375 ts_tablet_manager.cc:1929] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:53.753576 29375 log.cc:1199] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/a7b59053006046e98d27c694808ca34d
I20260617 20:16:53.754130 29375 ts_tablet_manager.cc:1950] T a7b59053006046e98d27c694808ca34d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:53.755026 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 329) took 3003 ms. Trace:
I20260617 20:16:53.755163 29375 rpcz_store.cc:276] 0617 20:16:50.751516 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.751870 (+ 354us) service_pool.cc:224] Handling call
0617 20:16:53.573325 (+2821455us) ts_tablet_manager.cc:1151] Deleting tablet a7b59053006046e98d27c694808ca34d
0617 20:16:53.573336 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.644409 (+ 71073us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.692731 (+ 48322us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.754979 (+ 62248us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2629147}
I20260617 20:16:53.755594 29375 tablet_replica.cc:333] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:53.755841 29375 raft_consensus.cc:2243] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.756038 29375 raft_consensus.cc:2272] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.756551 29383 tablet_bootstrap.cc:492] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:53.758523 29383 tablet_bootstrap.cc:654] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.760301 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eee68618cdf462283d7fd9f098c2a0d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:53.760495 29262 raft_consensus.cc:3060] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:53.760963 29378 tablet_bootstrap.cc:492] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.761204 29378 ts_tablet_manager.cc:1403] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.002s
I20260617 20:16:53.762123 29378 raft_consensus.cc:359] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.763904 29262 raft_consensus.cc:2468] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:53.764317 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f85271eeb854194a968215ebc08f47a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:53.764559 29263 raft_consensus.cc:3060] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:53.762400 29378 raft_consensus.cc:385] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.765081 29378 raft_consensus.cc:740] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.765475 29940 tablet.cc:1724] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:53.765506 29378 consensus_queue.cc:260] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.767544 29378 ts_tablet_manager.cc:1434] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:16:53.767926 29378 tablet_bootstrap.cc:492] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.769860 29378 tablet_bootstrap.cc:654] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.770212 28666 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_192444e7b6dc4e918c77df128cae877a [id=fa80809528dd419192774bcc7ac5f5bf]). Expected version 3 got 2
I20260617 20:16:53.770272 29063 leader_election.cc:304] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:53.770536 28666 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet e7f822e3f4ca4946a116ee172e83628b (table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]). Expected version 1 got 0
I20260617 20:16:53.770722 29859 raft_consensus.cc:2804] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:53.770920 29859 raft_consensus.cc:697] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:53.771209 29859 consensus_queue.cc:237] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.773480 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 08911643f3ca451d80e2471b1b5b2342
I20260617 20:16:53.776239 29263 raft_consensus.cc:2468] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:53.776918 28661 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_192444e7b6dc4e918c77df128cae877a [id=fa80809528dd419192774bcc7ac5f5bf] alter complete (version 3)
W20260617 20:16:53.777465 29063 consensus_peers.cc:597] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:53.777441 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c19457bc061d40ccb5a93ffbd622589e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.778055 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c19457bc061d40ccb5a93ffbd622589e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.778858 29063 leader_election.cc:304] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:53.779408 29955 raft_consensus.cc:2804] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:53.779573 29955 raft_consensus.cc:697] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:53.779506 29976 tablet.cc:1724] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:53.779860 29955 consensus_queue.cc:237] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.780252 29375 ts_tablet_manager.cc:1916] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:53.781622 29198 consensus_peers.cc:597] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:53.781745 29783 raft_consensus.cc:493] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.781895 29783 raft_consensus.cc:515] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.782500 29783 leader_election.cc:290] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:53.784524 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86dd216fa0ab46f5bb16e1b7bf1ca4f9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.784724 29263 raft_consensus.cc:2468] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:53.791255 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 2c583de2973e4fb0abacf2692f3ab829 (DEFAULT_TABLE table=default.Table_4e433e1c254048ceb654a95a0275289e [id=6361cd6c2ce14ffca426481ea0208f3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.792886 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c583de2973e4fb0abacf2692f3ab829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.793454 29976 tablet.cc:1724] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260617 20:16:53.799599 28666 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet e7f822e3f4ca4946a116ee172e83628b (table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e7f822e3f4ca4946a116ee172e83628b consensus state has no leader
I20260617 20:16:53.800276 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3dd481bc2745fba5460e26e49fa53b (DEFAULT_TABLE table=default.Table_d6c8360190ec4dfeb18e990430f716cd [id=c11c505593f1442e8811e75167217fb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.800709 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3dd481bc2745fba5460e26e49fa53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.801556 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_adc3eb10b2d6455d90215f3f5de73e0e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.802863 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_adc3eb10b2d6455d90215f3f5de73e0e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.802965 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet a7b59053006046e98d27c694808ca34d (table default.Table_c2ad7d91e2a84af3bddceffdaf386c94 [id=cdf43e1acf164be1a5cd9c98b4491d9a]) successfully deleted
W20260617 20:16:53.803674 29197 consensus_peers.cc:597] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65af976b808d42d4aeded71a00cf7252. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:53.803805 29239 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae5bf7cdde5427cb24d6144ccb274f5 (DEFAULT_TABLE table=default.Table_c095015a04284e9186b06fe5c250ab93 [id=f64859ec3a8a4c508922ed8483275b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.804311 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae5bf7cdde5427cb24d6144ccb274f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.804781 29383 tablet_bootstrap.cc:492] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:53.804955 29383 ts_tablet_manager.cc:1403] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.048s user 0.000s sys 0.003s
I20260617 20:16:53.807137 29383 raft_consensus.cc:359] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.807339 29383 raft_consensus.cc:385] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.807437 29383 raft_consensus.cc:740] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.808005 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 5eedf2442f964048b7a3a460b6b22f2a (DEFAULT_TABLE table=default.Table_552ce9d68419437fafcd73d16413fb03 [id=1aeac03a50494e4ea7d6ee8b5f1d58fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.808444 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eedf2442f964048b7a3a460b6b22f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.773021 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 2c583de2973e4fb0abacf2692f3ab829 (DEFAULT_TABLE table=default.Table_4e433e1c254048ceb654a95a0275289e [id=6361cd6c2ce14ffca426481ea0208f3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.773519 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 85633d391613474db52dd2f86210a659 (DEFAULT_TABLE table=default.Table_19d4b3eff37e4ff380a1c64661e07166 [id=c98f856b0a854bd6800c41bab86abbb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.773964 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3dd481bc2745fba5460e26e49fa53b (DEFAULT_TABLE table=default.Table_d6c8360190ec4dfeb18e990430f716cd [id=c11c505593f1442e8811e75167217fb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.781507 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 08911643f3ca451d80e2471b1b5b2342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.792372 28955 tablet_service.cc:1511] Processing CreateTablet for tablet d7dc704cf0844f579cced79fdf8c3da5 (DEFAULT_TABLE table=default.Table_0fa7c2d732b943eb86cf43d30ab2d880 [id=47a11e9a79bb4d778e64e90707d01584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.809073 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c583de2973e4fb0abacf2692f3ab829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.809242 29377 tablet_replica.cc:333] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.809286 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dc704cf0844f579cced79fdf8c3da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.809480 29377 raft_consensus.cc:2243] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.809672 29377 raft_consensus.cc:2272] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.810294 29377 ts_tablet_manager.cc:1916] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.811450 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85633d391613474db52dd2f86210a659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.793417 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae5bf7cdde5427cb24d6144ccb274f5 (DEFAULT_TABLE table=default.Table_c095015a04284e9186b06fe5c250ab93 [id=f64859ec3a8a4c508922ed8483275b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.798769 28959 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.798991 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e287ba95be7408b8fc75e6f0709d8f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.800930 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e48a4a827d44afca912dc8723be4542 with delete_type TABLET_DATA_DELETED (replaced by tablet 33b01c9c27904a1986e285477921ac4f) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.805327 28958 tablet_service.cc:1511] Processing CreateTablet for tablet c4598874c14344c58ef0b87508b67211 (DEFAULT_TABLE table=default.Table_6f8a81734a6345ebb32b7ac32365e739 [id=259e4a64dcfe44db8b28b012ed5b400f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.808030 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 5eedf2442f964048b7a3a460b6b22f2a (DEFAULT_TABLE table=default.Table_552ce9d68419437fafcd73d16413fb03 [id=1aeac03a50494e4ea7d6ee8b5f1d58fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.812420 29234 tablet_service.cc:1511] Processing CreateTablet for tablet d7dc704cf0844f579cced79fdf8c3da5 (DEFAULT_TABLE table=default.Table_0fa7c2d732b943eb86cf43d30ab2d880 [id=47a11e9a79bb4d778e64e90707d01584]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.812752 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dc704cf0844f579cced79fdf8c3da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.812767 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3dd481bc2745fba5460e26e49fa53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.813807 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae5bf7cdde5427cb24d6144ccb274f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.814646 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4598874c14344c58ef0b87508b67211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.815249 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eedf2442f964048b7a3a460b6b22f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.812570 29383 consensus_queue.cc:260] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.817122 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed860fa375848708beb31ff89056214 (DEFAULT_TABLE table=default.Table_7fae59f461764d15a6b9c04597cb6611 [id=77e2352dd7d84649893c0dada224aa64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.817453 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 08911643f3ca451d80e2471b1b5b2342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.817765 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed860fa375848708beb31ff89056214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.817835 29242 tablet_service.cc:1511] Processing CreateTablet for tablet c4598874c14344c58ef0b87508b67211 (DEFAULT_TABLE table=default.Table_6f8a81734a6345ebb32b7ac32365e739 [id=259e4a64dcfe44db8b28b012ed5b400f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.818203 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4598874c14344c58ef0b87508b67211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.819445 29383 ts_tablet_manager.cc:1434] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20260617 20:16:53.821439 29063 leader_election.cc:304] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:53.821851 29783 raft_consensus.cc:2804] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:53.821954 29783 raft_consensus.cc:493] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:53.822067 29783 raft_consensus.cc:3060] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:53.822139 29383 tablet_bootstrap.cc:492] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:53.824813 29783 raft_consensus.cc:515] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.827111 29383 tablet_bootstrap.cc:654] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.829895 29376 ts_tablet_manager.cc:1929] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:53.830044 29376 log.cc:1199] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/60a43dd885aa4411a4177b67807b0ac4
I20260617 20:16:53.830717 29376 ts_tablet_manager.cc:1950] T 60a43dd885aa4411a4177b67807b0ac4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:53.831600 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 344) took 3016 ms. Trace:
I20260617 20:16:53.831719 29376 rpcz_store.cc:276] 0617 20:16:50.815086 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.815330 (+ 244us) service_pool.cc:224] Handling call
0617 20:16:53.624528 (+2809198us) ts_tablet_manager.cc:1151] Deleting tablet 60a43dd885aa4411a4177b67807b0ac4
0617 20:16:53.624535 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.628848 (+ 4313us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.829783 (+200935us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:53.831564 (+ 1781us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2808493}
I20260617 20:16:53.832228 29376 tablet_replica.cc:333] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:53.832484 29376 raft_consensus.cc:2243] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:53.832818 29376 pending_rounds.cc:70] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:53.832926 29376 pending_rounds.cc:77] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955482584473600 op_type: NO_OP noop_request { }
I20260617 20:16:53.833053 29376 raft_consensus.cc:2889] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:53.833185 29376 raft_consensus.cc:2272] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.834429 29383 tablet_bootstrap.cc:492] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:53.834546 29383 ts_tablet_manager.cc:1403] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.003s
I20260617 20:16:53.835238 29383 raft_consensus.cc:359] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.835427 29383 raft_consensus.cc:385] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.835522 29383 raft_consensus.cc:740] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.836521 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 85633d391613474db52dd2f86210a659 (DEFAULT_TABLE table=default.Table_19d4b3eff37e4ff380a1c64661e07166 [id=c98f856b0a854bd6800c41bab86abbb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.836936 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85633d391613474db52dd2f86210a659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.836998 29916 raft_consensus.cc:493] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.837162 29916 raft_consensus.cc:515] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.837899 29916 leader_election.cc:290] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.839912 29383 consensus_queue.cc:260] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:53.840473 29383 ts_tablet_manager.cc:1434] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:16:53.840768 29383 tablet_bootstrap.cc:492] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:53.842598 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f31bf7ed828f44b398f5bdac6b9b63e7 consensus state has no leader
I20260617 20:16:53.842684 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7fae59f461764d15a6b9c04597cb6611" } new_table_name: "default.Table_b38397bd90c94aa5ab36026db378ccd8" modify_external_catalogs: true
I20260617 20:16:53.843001 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_09c8c95fbef548a5a674578b0f83917a" } new_table_name: "default.Table_ab272d9bce0349baa6e89f438aeae096" modify_external_catalogs: true
I20260617 20:16:53.844220 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet a857c28d94f04dabb9a57aeca662b836 (table default.Table_1d1b3b6470e146c189f41d0e2fcd63c5 [id=3201002f51ca4f788cc1e153333862d4]). Expected version 1 got 0
I20260617 20:16:53.844930 29957 raft_consensus.cc:493] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.845085 29957 raft_consensus.cc:515] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.846107 29957 leader_election.cc:290] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:53.852908 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ffa0c6d530ee478f9cd5bc64e8d1ed83" } modify_external_catalogs: true
I20260617 20:16:53.853157 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ffa0c6d530ee478f9cd5bc64e8d1ed83" } modify_external_catalogs: true
I20260617 20:16:53.853840 29383 tablet_bootstrap.cc:654] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.861395 29916 raft_consensus.cc:493] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.861563 29916 raft_consensus.cc:515] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.862424 29916 leader_election.cc:290] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.866883 29376 ts_tablet_manager.cc:1916] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.870275 29377 ts_tablet_manager.cc:1929] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.872021 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_08034aa4f7de43169cb855082c050daa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:53.872385 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5df6af49cb484f59ad1f32235753e1db
W20260617 20:16:53.872653 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08034aa4f7de43169cb855082c050daa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.872879 28669 catalog_manager.cc:6784] ReplaceTablet: tablet 5df6af49cb484f59ad1f32235753e1db deleted and replaced by tablet 663dbe73689d4849a85b68a79ea4062c
I20260617 20:16:53.873200 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_62c85e3d42be4e9ca7183846e7d67145" } modify_external_catalogs: true
I20260617 20:16:53.873391 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_62c85e3d42be4e9ca7183846e7d67145" } modify_external_catalogs: true
I20260617 20:16:53.877019 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c059c2f38bf74dc9a7c05c2b5dc8ac21" } modify_external_catalogs: true
I20260617 20:16:53.877219 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c059c2f38bf74dc9a7c05c2b5dc8ac21" } modify_external_catalogs: true
I20260617 20:16:53.879318 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet 46ea43994a0a42fe9e16d7bc6a2118e6 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:53.879709 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b427ba6320be4f2a929eaf18a56b4309
I20260617 20:16:53.877470 28665 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_649e9f8868b847939f847fc704618700 [id=06b76ab80c3b453986d047f7f1f832ac] alter complete (version 1)
I20260617 20:16:53.880344 28663 catalog_manager.cc:6784] ReplaceTablet: tablet b427ba6320be4f2a929eaf18a56b4309 deleted and replaced by tablet c59a8c127d5b446a90b57a7677c37c08
I20260617 20:16:53.882027 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_07f654ca505c4bc5bc80b432a51acaa8" } modify_external_catalogs: true
I20260617 20:16:53.882193 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_07f654ca505c4bc5bc80b432a51acaa8" } modify_external_catalogs: true
I20260617 20:16:53.879159 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 5df6af49cb484f59ad1f32235753e1db with delete_type TABLET_DATA_DELETED (replaced by tablet 663dbe73689d4849a85b68a79ea4062c) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.886876 29916 raft_consensus.cc:493] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:53.889685 29916 raft_consensus.cc:515] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.890323 29916 leader_election.cc:290] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:53.888887 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 379ef43e02ec4bbbb03f2d6a53a66403 with delete_type TABLET_DATA_DELETED (replaced by tablet 80d778641c354c679ee9e7d7b3eae3b5) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.889076 28970 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b00437fb76c4000ad89c99ab2da2261 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.889205 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet d738ab2f8c784c76947a3a76bd040219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.889367 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet b427ba6320be4f2a929eaf18a56b4309 with delete_type TABLET_DATA_DELETED (replaced by tablet c59a8c127d5b446a90b57a7677c37c08) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.891264 29377 log.cc:1199] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/08911643f3ca451d80e2471b1b5b2342
I20260617 20:16:53.891755 29377 ts_tablet_manager.cc:1950] T 08911643f3ca451d80e2471b1b5b2342 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.892848 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 08911643f3ca451d80e2471b1b5b2342 (table default.Table_1ce996ccf50542bfb287108b493eb4cc [id=c02a5e81598b47b9830a236256da4bba]) successfully deleted
I20260617 20:16:53.893271 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 60a43dd885aa4411a4177b67807b0ac4 (table default.Table_fd835dc9ea8f4041b36c069dcac9d69a [id=3a41dd53c3974256877f193219240234]) successfully deleted
I20260617 20:16:53.894044 29377 tablet_replica.cc:333] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.894954 29377 raft_consensus.cc:2243] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.895951 29377 raft_consensus.cc:2272] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.896556 29377 ts_tablet_manager.cc:1916] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.904007 29377 ts_tablet_manager.cc:1929] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.905035 29377 log.cc:1199] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/3e80e776263c4a91ae7fffa9d0f4ebd4
I20260617 20:16:53.905683 29377 ts_tablet_manager.cc:1950] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:16:53.907595 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 89d79b7023ae478698a06562b2e4c578 consensus state has no leader
I20260617 20:16:53.908310 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c2c6d214816540ac90dc9b2ad3cdb89f
I20260617 20:16:53.909008 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet dd4f190a1005433ebcfbfe3a86aa9e70
W20260617 20:16:53.909137 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ed860fa375848708beb31ff89056214 consensus state has no leader
I20260617 20:16:53.909375 28669 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet c59a8c127d5b446a90b57a7677c37c08
I20260617 20:16:53.910205 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet dd4f190a1005433ebcfbfe3a86aa9e70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.911077 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c6d214816540ac90dc9b2ad3cdb89f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:53.912341 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 (table default.Table_b50a2ea6dd054c8282ce507b0c871fb2 [id=7d0ccdf07bf14fd1b7fd55deb990bdae]) successfully deleted
I20260617 20:16:53.913573 29377 tablet_replica.cc:333] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:53.914167 29377 raft_consensus.cc:2243] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.914764 29377 raft_consensus.cc:2272] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.916014 29377 ts_tablet_manager.cc:1916] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.916354 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 2c583de2973e4fb0abacf2692f3ab829 (DEFAULT_TABLE table=default.Table_4e433e1c254048ceb654a95a0275289e [id=6361cd6c2ce14ffca426481ea0208f3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.916951 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c583de2973e4fb0abacf2692f3ab829. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:53.917857 29062 leader_election.cc:343] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 86dd216fa0ab46f5bb16e1b7bf1ca4f9
I20260617 20:16:53.920842 29378 tablet_bootstrap.cc:492] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:53.921023 29378 ts_tablet_manager.cc:1403] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.153s user 0.007s sys 0.002s
W20260617 20:16:53.921190 29062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 92431.6us
I20260617 20:16:53.921228 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da8b2c2ecd34b56a046ac3b32c0c5f1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:53.922878 29378 raft_consensus.cc:359] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.922930 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da8b2c2ecd34b56a046ac3b32c0c5f1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.923205 29378 raft_consensus.cc:385] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:53.923362 29378 raft_consensus.cc:740] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:53.923676 29378 consensus_queue.cc:260] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:53.929678 29378 ts_tablet_manager.cc:1434] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260617 20:16:53.930078 29378 tablet_bootstrap.cc:492] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:53.933444 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379ef43e02ec4bbbb03f2d6a53a66403" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.933892 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e287ba95be7408b8fc75e6f0709d8f1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:53.934487 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 569e339c17764486a65a1c3b43c92adf with delete_type TABLET_DATA_DELETED (replaced by tablet f4de5dafb1474de1911148bb3b4527cf) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.934903 29378 tablet_bootstrap.cc:654] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:53.937963 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet b427ba6320be4f2a929eaf18a56b4309 with delete_type TABLET_DATA_DELETED (replaced by tablet c59a8c127d5b446a90b57a7677c37c08) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.938246 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c6d214816540ac90dc9b2ad3cdb89f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.938432 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet dd4f190a1005433ebcfbfe3a86aa9e70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.939510 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed860fa375848708beb31ff89056214 (DEFAULT_TABLE table=default.Table_7fae59f461764d15a6b9c04597cb6611 [id=77e2352dd7d84649893c0dada224aa64]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:53.939852 28925 leader_election.cc:343] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:53.940043 28925 leader_election.cc:343] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:53.940176 28925 leader_election.cc:343] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:53.942303 29197 leader_election.cc:343] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 33e4407aa01642ffb03eba1b220afdba
I20260617 20:16:53.944368 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_649e9f8868b847939f847fc704618700" } new_table_name: "default.Table_ae4ab5348d244f92a3ecd4fac3ca86b2" modify_external_catalogs: true
I20260617 20:16:53.944564 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_26d6375fbd0444359f9460701d4c61a1" } new_table_name: "default.Table_d26967cbe1c54191941e64021b51c03a" modify_external_catalogs: true
I20260617 20:16:53.944491 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a54a8950e6fd43248d608f5bb5f9b765"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.945145 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a54a8950e6fd43248d608f5bb5f9b765 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.944370 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_20836b89113d47f1a735b4f6100d9002"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.946151 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20836b89113d47f1a735b4f6100d9002 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.944393 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_bb2d4abaff574992b845f37916732047"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:53.947554 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb2d4abaff574992b845f37916732047 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:53.949537 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 5e53946c85ab4a8286a6e174cc411c5e (table default.Table_2ca839bde234444b97808d82d7974e3c [id=e682c8658ea84718a5e3909a6f6b7246]). Expected version 3 got 0
I20260617 20:16:53.953550 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 425c1727564745b2ab84b39a2d190db5 (DEFAULT_TABLE table=default.Table_d5804c5dc2dd4b429190b2aefcbfd3f9 [id=ace0c10d79f74e72877f216ad9ac8415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.954048 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425c1727564745b2ab84b39a2d190db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.957633 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 88ab6fe7319940fcabd315193c51e199 (DEFAULT_TABLE table=default.Table_eacb11ffc7ea46848481b65cc3c5cb81 [id=87b798ab976b423dbda0634ab2539456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.958068 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ab6fe7319940fcabd315193c51e199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.959586 29377 ts_tablet_manager.cc:1929] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:53.959728 29377 log.cc:1199] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/3e287ba95be7408b8fc75e6f0709d8f1
I20260617 20:16:53.961607 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 5806949c371b41b0a162a4c8cbf6b435 (DEFAULT_TABLE table=default.Table_08229bcb0d3e45ec991f5946cfc5cfda [id=67b6ac3a114644f3ab7a357b30bcdc9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.962035 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5806949c371b41b0a162a4c8cbf6b435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.964659 29377 ts_tablet_manager.cc:1950] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:53.965672 28955 tablet_service.cc:1511] Processing CreateTablet for tablet cdd24a60a91b43cd9e31ecca3d21ec60 (DEFAULT_TABLE table=default.Table_685025bcfb0e499d9ee6da4954fabb82 [id=8b51ca1875e847c5b75b682be93e6107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.966064 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd24a60a91b43cd9e31ecca3d21ec60. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:53.966933 28926 connection.cc:573] client connection to 127.27.245.253:38361 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 20:16:53.969745 29377 tablet_replica.cc:333] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:16:53.969755 28657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.27.245.253:38361 (error 108) [suppressed 4 similar messages]
I20260617 20:16:53.970203 29377 raft_consensus.cc:2243] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:53.971256 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 3e287ba95be7408b8fc75e6f0709d8f1 (table default.Table_20465bbedb344857a72376aa345ec532 [id=f673f240ab2341c39c57117ea2e4d92a]) successfully deleted
W20260617 20:16:53.971572 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 7e48a4a827d44afca912dc8723be4542 because the tablet was not found. No further retry: Not found: Tablet not found: 7e48a4a827d44afca912dc8723be4542
W20260617 20:16:53.971863 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5df6af49cb484f59ad1f32235753e1db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5df6af49cb484f59ad1f32235753e1db already in progress: creating tablet
I20260617 20:16:53.971238 28958 tablet_service.cc:1511] Processing CreateTablet for tablet c4b2d190dda24f0e800b6f75bc165a57 (DEFAULT_TABLE table=default.Table_bd07d5c811d84966aadb9e3d06ff2eb4 [id=108c32b01ca947faad79a1632296797e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.975044 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b2d190dda24f0e800b6f75bc165a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:53.971592 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 33b01c9c27904a1986e285477921ac4f (DEFAULT_TABLE table=default.Table_e6908a670d534e828a0770f48cace3db [id=b24f0a25c8574b62842179a4c9bbc2f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.972395 28957 tablet_service.cc:1511] Processing CreateTablet for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 (DEFAULT_TABLE table=default.Table_642cc41f3bdf4f4892418e1b130fc953 [id=4c4310d6d44044adbd5749170442065a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:53.976682 29377 raft_consensus.cc:2272] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:53.977802 29377 ts_tablet_manager.cc:1916] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:53.997258 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b01c9c27904a1986e285477921ac4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.006548 29377 ts_tablet_manager.cc:1929] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.006911 29377 log.cc:1199] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/379ef43e02ec4bbbb03f2d6a53a66403
I20260617 20:16:54.009048 29377 ts_tablet_manager.cc:1950] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:54.009701 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.010327 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 379ef43e02ec4bbbb03f2d6a53a66403 (table default.Table_0f2a772bda6e4476b8b5a42f9d0fb42f [id=de3384ef7984460abc15ca893a9f8c83]) successfully deleted
I20260617 20:16:54.010845 29377 tablet_replica.cc:333] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:54.009855 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 85633d391613474db52dd2f86210a659 (DEFAULT_TABLE table=default.Table_19d4b3eff37e4ff380a1c64661e07166 [id=c98f856b0a854bd6800c41bab86abbb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.009158 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e4407aa01642ffb03eba1b220afdba" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:54.011771 29377 raft_consensus.cc:2243] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.011989 29377 raft_consensus.cc:2272] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.013314 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "379ef43e02ec4bbbb03f2d6a53a66403" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:54.014874 28925 leader_election.cc:343] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.015076 28925 leader_election.cc:304] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:54.015532 28925 leader_election.cc:343] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.015681 28925 leader_election.cc:304] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:54.015856 28925 raft_consensus.cc:2686] T 379ef43e02ec4bbbb03f2d6a53a66403 P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:16:54.016598 29916 raft_consensus.cc:2749] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:54.016906 29916 raft_consensus.cc:493] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:54.017068 29916 raft_consensus.cc:515] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.017719 29916 leader_election.cc:290] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:54.017900 29377 ts_tablet_manager.cc:1916] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.019219 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 6c3dd481bc2745fba5460e26e49fa53b (DEFAULT_TABLE table=default.Table_d6c8360190ec4dfeb18e990430f716cd [id=c11c505593f1442e8811e75167217fb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.020294 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ab272d9bce0349baa6e89f438aeae096" } modify_external_catalogs: true
I20260617 20:16:54.020532 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ab272d9bce0349baa6e89f438aeae096" } modify_external_catalogs: true
I20260617 20:16:54.020653 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 5e53946c85ab4a8286a6e174cc411c5e (table default.Table_2ca839bde234444b97808d82d7974e3c [id=e682c8658ea84718a5e3909a6f6b7246]). Expected version 3 got 0
I20260617 20:16:54.022197 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85633d391613474db52dd2f86210a659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.023484 29240 tablet_service.cc:1558] Processing DeleteTablet for tablet 5df6af49cb484f59ad1f32235753e1db with delete_type TABLET_DATA_DELETED (replaced by tablet 663dbe73689d4849a85b68a79ea4062c) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:53.939538 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86dd216fa0ab46f5bb16e1b7bf1ca4f9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:54.023867 29263 raft_consensus.cc:3060] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:54.025611 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 08911643f3ca451d80e2471b1b5b2342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.020022 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e287ba95be7408b8fc75e6f0709d8f1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:54.028190 29126 raft_consensus.cc:2468] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:16:54.028517 29992 log.cc:927] Time spent T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: Append to log took a long time: real 0.091s user 0.000s sys 0.000s
I20260617 20:16:54.033538 29377 ts_tablet_manager.cc:1929] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.034061 29103 tablet_service.cc:1511] Processing CreateTablet for tablet d7dc704cf0844f579cced79fdf8c3da5 (DEFAULT_TABLE table=default.Table_0fa7c2d732b943eb86cf43d30ab2d880 [id=47a11e9a79bb4d778e64e90707d01584]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:54.035147 28657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.253:38361, user_credentials={real_user=slave}} blocked reactor thread for 65418.7us
I20260617 20:16:54.035281 29783 leader_election.cc:290] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:54.037408 29377 log.cc:1199] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/7b00437fb76c4000ad89c99ab2da2261
I20260617 20:16:54.037851 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c3dd481bc2745fba5460e26e49fa53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.037967 29377 ts_tablet_manager.cc:1950] T 7b00437fb76c4000ad89c99ab2da2261 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:54.038995 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 7b00437fb76c4000ad89c99ab2da2261 (table default.Table_6f68970fea69478eba2df21752f2ea0a [id=40e28570c43d428b90d13ccc0123be2b]) successfully deleted
W20260617 20:16:54.040323 29062 leader_election.cc:343] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 86dd216fa0ab46f5bb16e1b7bf1ca4f9
W20260617 20:16:54.040910 28925 leader_election.cc:343] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.041036 28925 leader_election.cc:304] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:54.041240 28925 raft_consensus.cc:2686] T 3e287ba95be7408b8fc75e6f0709d8f1 P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:16:54.042363 29377 tablet_replica.cc:333] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:54.042603 29377 raft_consensus.cc:2243] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.042800 29377 raft_consensus.cc:2272] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.042920 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738ab2f8c784c76947a3a76bd040219" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:54.043447 28657 consensus_peers.cc:597] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a -> Peer 87437cd320a4470fa0dedd43aa7ea3eb (127.27.245.253:38361): Couldn't send request to peer 87437cd320a4470fa0dedd43aa7ea3eb. Status: Network error: Client connection negotiation failed: client connection to 127.27.245.253:38361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:54.043639 29377 ts_tablet_manager.cc:1916] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.043850 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dc704cf0844f579cced79fdf8c3da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.047467 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_dec67a2333294dc6aa579c8eef5adacd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.048059 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dec67a2333294dc6aa579c8eef5adacd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.049515 29377 ts_tablet_manager.cc:1929] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.049448 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_70137395fd5347969cead58202834395"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.049959 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70137395fd5347969cead58202834395 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.051708 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_af28a00e98914b0ab585c8d9ee784ed5" } new_table_name: "default.Table_77adab16d0fe4dc18b86a7a45bcfdad3" modify_external_catalogs: true
I20260617 20:16:54.051869 29377 log.cc:1199] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/d738ab2f8c784c76947a3a76bd040219
I20260617 20:16:54.052279 29377 ts_tablet_manager.cc:1950] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:54.053128 29377 tablet_replica.cc:333] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:54.053095 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet d738ab2f8c784c76947a3a76bd040219 (table default.Table_1bde48f5ad7a4a8194df9687d8971c33 [id=cde5899e2baa4b2b9fe34bb5d11ebe13]) successfully deleted
I20260617 20:16:54.054766 29377 raft_consensus.cc:2243] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 20:16:54.055207 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4342e29fbc98442ea2e2d25c7aea8853 has no consensus state
I20260617 20:16:54.055241 29377 raft_consensus.cc:2272] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.055838 29377 ts_tablet_manager.cc:1916] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.056478 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 30f6dcc384154d41866cf8060cf05837
I20260617 20:16:54.057205 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 89d79b7023ae478698a06562b2e4c578
W20260617 20:16:54.060277 28925 leader_election.cc:343] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.062474 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 0ae5bf7cdde5427cb24d6144ccb274f5 (DEFAULT_TABLE table=default.Table_c095015a04284e9186b06fe5c250ab93 [id=f64859ec3a8a4c508922ed8483275b6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.063283 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_de502b1f036f4436bb0991e0b6720e6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.063660 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed860fa375848708beb31ff89056214 (DEFAULT_TABLE table=default.Table_7fae59f461764d15a6b9c04597cb6611 [id=77e2352dd7d84649893c0dada224aa64]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:54.063872 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de502b1f036f4436bb0991e0b6720e6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.064218 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 5eedf2442f964048b7a3a460b6b22f2a (DEFAULT_TABLE table=default.Table_552ce9d68419437fafcd73d16413fb03 [id=1aeac03a50494e4ea7d6ee8b5f1d58fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.065013 29094 tablet_service.cc:1511] Processing CreateTablet for tablet c4598874c14344c58ef0b87508b67211 (DEFAULT_TABLE table=default.Table_6f8a81734a6345ebb32b7ac32365e739 [id=259e4a64dcfe44db8b28b012ed5b400f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.065451 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eedf2442f964048b7a3a460b6b22f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.066314 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 89d79b7023ae478698a06562b2e4c578 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.066545 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f6dcc384154d41866cf8060cf05837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.068022 29377 ts_tablet_manager.cc:1929] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:54.068152 29377 log.cc:1199] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/dd4f190a1005433ebcfbfe3a86aa9e70
I20260617 20:16:54.068562 29377 ts_tablet_manager.cc:1950] T dd4f190a1005433ebcfbfe3a86aa9e70 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:54.069667 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet dd4f190a1005433ebcfbfe3a86aa9e70 (table default.Table_07f654ca505c4bc5bc80b432a51acaa8 [id=556d100af09b4115bb4acc3f5f4dfade]) successfully deleted
W20260617 20:16:54.070250 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet c2c6d214816540ac90dc9b2ad3cdb89f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2c6d214816540ac90dc9b2ad3cdb89f already in progress: creating tablet
W20260617 20:16:54.070490 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 89d79b7023ae478698a06562b2e4c578 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89d79b7023ae478698a06562b2e4c578 already in progress: creating tablet
W20260617 20:16:54.070748 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 30f6dcc384154d41866cf8060cf05837 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30f6dcc384154d41866cf8060cf05837 already in progress: creating tablet
I20260617 20:16:54.071707 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed860fa375848708beb31ff89056214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.077376 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet 5df6af49cb484f59ad1f32235753e1db with delete_type TABLET_DATA_DELETED (replaced by tablet 663dbe73689d4849a85b68a79ea4062c) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.079102 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ef916ebf00b449979408f9dab4fb264e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.079645 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef916ebf00b449979408f9dab4fb264e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.088060 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c00e7d6f133c42eeb8b0ced7774c79ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.088641 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c00e7d6f133c42eeb8b0ced7774c79ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:54.091563 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d23acc051c34ebfb0edb790faec1b2b consensus state has no leader
I20260617 20:16:54.093381 29783 raft_consensus.cc:493] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:54.093924 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4598874c14344c58ef0b87508b67211. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.094806 29783 raft_consensus.cc:515] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.095552 29783 leader_election.cc:290] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:54.096654 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65814c56424256b53d3c9f94c1b74a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:54.096879 28987 raft_consensus.cc:2468] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:54.097968 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet c2c6d214816540ac90dc9b2ad3cdb89f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.101079 29062 leader_election.cc:304] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:54.101398 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet dd4f190a1005433ebcfbfe3a86aa9e70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.101553 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet b427ba6320be4f2a929eaf18a56b4309 with delete_type TABLET_DATA_DELETED (replaced by tablet c59a8c127d5b446a90b57a7677c37c08) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.103679 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 4d281eec19b34aaa8729d8891547b8e4 (DEFAULT_TABLE table=default.Table_adc3eb10b2d6455d90215f3f5de73e0e [id=5b6c386e9c894660a60d2ba0298d592a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.104367 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d281eec19b34aaa8729d8891547b8e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.105715 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 425c1727564745b2ab84b39a2d190db5 (DEFAULT_TABLE table=default.Table_d5804c5dc2dd4b429190b2aefcbfd3f9 [id=ace0c10d79f74e72877f216ad9ac8415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.106137 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ae5bf7cdde5427cb24d6144ccb274f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.110594 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 3180f1336fd841d8b4cf7fdf94015955 (DEFAULT_TABLE table=default.Table_563b00b87d974ad88a8fba7f9df09d6c [id=be86dcc9070d4f35830fa755339d2cd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.110994 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3180f1336fd841d8b4cf7fdf94015955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.113618 28968 tablet_service.cc:1511] Processing CreateTablet for tablet e35d84540ee74348a3222c5b928e002f (DEFAULT_TABLE table=default.Table_153027e782904859919297102e88af8c [id=9a28154d784c4243bea4d135bfb34e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.114005 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35d84540ee74348a3222c5b928e002f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.118805 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 37214b955d63478088b9f723bcbc588a (DEFAULT_TABLE table=default.Table_c19457bc061d40ccb5a93ffbd622589e [id=dc6173b97e40451aaf245fe2ec542e94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.119163 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37214b955d63478088b9f723bcbc588a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.121562 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 4342e29fbc98442ea2e2d25c7aea8853 (DEFAULT_TABLE table=default.Table_d26967cbe1c54191941e64021b51c03a [id=5bff9a3c56d042d3a4caf6d0cc75351d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.121928 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4342e29fbc98442ea2e2d25c7aea8853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.125589 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 663dbe73689d4849a85b68a79ea4062c (DEFAULT_TABLE table=default.Table_b6faf540da644f658eb715d3ffacd616 [id=8ebd35bd7b464cd489f6a15d0e70800e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.125946 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663dbe73689d4849a85b68a79ea4062c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.131912 29949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:16:54.132225 29949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: This master's current role is: LEADER
I20260617 20:16:54.134289 29783 raft_consensus.cc:2804] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:54.134423 29783 raft_consensus.cc:493] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:54.135038 29783 raft_consensus.cc:3060] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:54.137363 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_50062ea6504540bf8c760f69ae119740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.137991 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1666eb767add47a487e4c3dc5f691a35" } new_table_name: "default.Table_c54f8dc65b95412db87f8018bc68292e" modify_external_catalogs: true
W20260617 20:16:54.138130 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50062ea6504540bf8c760f69ae119740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.139479 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bd07d5c811d84966aadb9e3d06ff2eb4" } modify_external_catalogs: true
I20260617 20:16:54.139642 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bd07d5c811d84966aadb9e3d06ff2eb4" } modify_external_catalogs: true
I20260617 20:16:54.139977 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_20dcfb508ecf4cacbaca2e229fe563d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.140727 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20dcfb508ecf4cacbaca2e229fe563d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.140688 28951 tablet_service.cc:1511] Processing CreateTablet for tablet a819956f29954a4dbbd1aa1dcccad3c0 (DEFAULT_TABLE table=default.Table_08034aa4f7de43169cb855082c050daa [id=6a0c1850d45b4e53b04c59905d2d5692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.140940 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_adc3eb10b2d6455d90215f3f5de73e0e" } modify_external_catalogs: true
I20260617 20:16:54.141131 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a819956f29954a4dbbd1aa1dcccad3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.141110 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_adc3eb10b2d6455d90215f3f5de73e0e" } modify_external_catalogs: true
I20260617 20:16:54.142457 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d3381a68eac743b28435e4756ba0cb2e" } new_table_name: "default.Table_6039bf8f7372476bb786690cad75b43c" modify_external_catalogs: true
I20260617 20:16:54.138034 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0b2903f0c1204e4eacd6a8987e8b688a" } modify_external_catalogs: true
I20260617 20:16:54.145005 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0b2903f0c1204e4eacd6a8987e8b688a" } modify_external_catalogs: true
W20260617 20:16:54.147990 29064 connection.cc:573] client connection to 127.27.245.253:38361 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 20:16:54.148502 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425c1727564745b2ab84b39a2d190db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.148991 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 5a09fbb3e8eb4b66acba0d6b572713ef (DEFAULT_TABLE table=default.Table_b60299a5315d44ca846c6b09fdc0ae03 [id=8e179900a6774ea3877a6e4347aa9fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.149947 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 88ab6fe7319940fcabd315193c51e199 (DEFAULT_TABLE table=default.Table_eacb11ffc7ea46848481b65cc3c5cb81 [id=87b798ab976b423dbda0634ab2539456]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:54.153815 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cde88371f4454a4bb3053c6cd1afb801 consensus state has no leader
I20260617 20:16:54.154127 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a09fbb3e8eb4b66acba0d6b572713ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.156404 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 89d79b7023ae478698a06562b2e4c578 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.156750 29105 tablet_service.cc:1511] Processing CreateTablet for tablet c4b2d190dda24f0e800b6f75bc165a57 (DEFAULT_TABLE table=default.Table_bd07d5c811d84966aadb9e3d06ff2eb4 [id=108c32b01ca947faad79a1632296797e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.163834 29095 tablet_service.cc:1511] Processing CreateTablet for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 (DEFAULT_TABLE table=default.Table_642cc41f3bdf4f4892418e1b130fc953 [id=4c4310d6d44044adbd5749170442065a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.164049 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f6dcc384154d41866cf8060cf05837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.164600 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 37214b955d63478088b9f723bcbc588a (DEFAULT_TABLE table=default.Table_c19457bc061d40ccb5a93ffbd622589e [id=dc6173b97e40451aaf245fe2ec542e94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.165481 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c4b2d190dda24f0e800b6f75bc165a57
I20260617 20:16:54.165656 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 5806949c371b41b0a162a4c8cbf6b435 (DEFAULT_TABLE table=default.Table_08229bcb0d3e45ec991f5946cfc5cfda [id=67b6ac3a114644f3ab7a357b30bcdc9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.165933 29098 tablet_service.cc:1511] Processing CreateTablet for tablet 33b01c9c27904a1986e285477921ac4f (DEFAULT_TABLE table=default.Table_e6908a670d534e828a0770f48cace3db [id=b24f0a25c8574b62842179a4c9bbc2f8]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:54.167032 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 14a5e5917a414c99b25ea2efeab4063d consensus state has no leader
I20260617 20:16:54.167276 29100 tablet_service.cc:1511] Processing CreateTablet for tablet e35d84540ee74348a3222c5b928e002f (DEFAULT_TABLE table=default.Table_153027e782904859919297102e88af8c [id=9a28154d784c4243bea4d135bfb34e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.167335 29099 tablet_service.cc:1511] Processing CreateTablet for tablet cdd24a60a91b43cd9e31ecca3d21ec60 (DEFAULT_TABLE table=default.Table_685025bcfb0e499d9ee6da4954fabb82 [id=8b51ca1875e847c5b75b682be93e6107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.172762 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 4342e29fbc98442ea2e2d25c7aea8853 (DEFAULT_TABLE table=default.Table_d26967cbe1c54191941e64021b51c03a [id=5bff9a3c56d042d3a4caf6d0cc75351d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.166460 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 3180f1336fd841d8b4cf7fdf94015955 (DEFAULT_TABLE table=default.Table_563b00b87d974ad88a8fba7f9df09d6c [id=be86dcc9070d4f35830fa755339d2cd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.176426 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 4d281eec19b34aaa8729d8891547b8e4 (DEFAULT_TABLE table=default.Table_adc3eb10b2d6455d90215f3f5de73e0e [id=5b6c386e9c894660a60d2ba0298d592a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.176899 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ab6fe7319940fcabd315193c51e199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.177203 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd24a60a91b43cd9e31ecca3d21ec60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.183902 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet c4b2d190dda24f0e800b6f75bc165a57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:54.184792 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet c4b2d190dda24f0e800b6f75bc165a57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4b2d190dda24f0e800b6f75bc165a57 already in progress: creating tablet
I20260617 20:16:54.214385 28664 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_ae4ab5348d244f92a3ecd4fac3ca86b2 [id=06b76ab80c3b453986d047f7f1f832ac]). Expected version 2 got 1
I20260617 20:16:54.215498 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 663dbe73689d4849a85b68a79ea4062c (DEFAULT_TABLE table=default.Table_b6faf540da644f658eb715d3ffacd616 [id=8ebd35bd7b464cd489f6a15d0e70800e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.218089 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d281eec19b34aaa8729d8891547b8e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.219730 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.221053 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3180f1336fd841d8b4cf7fdf94015955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.221272 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4342e29fbc98442ea2e2d25c7aea8853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.222306 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37214b955d63478088b9f723bcbc588a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.226922 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b01c9c27904a1986e285477921ac4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.226981 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4d281eec19b34aaa8729d8891547b8e4
I20260617 20:16:54.228094 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1
I20260617 20:16:54.229579 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35d84540ee74348a3222c5b928e002f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.236454 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed860fa375848708beb31ff89056214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.237530 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 88ab6fe7319940fcabd315193c51e199 (DEFAULT_TABLE table=default.Table_eacb11ffc7ea46848481b65cc3c5cb81 [id=87b798ab976b423dbda0634ab2539456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.237720 29233 tablet_service.cc:1511] Processing CreateTablet for tablet cdd24a60a91b43cd9e31ecca3d21ec60 (DEFAULT_TABLE table=default.Table_685025bcfb0e499d9ee6da4954fabb82 [id=8b51ca1875e847c5b75b682be93e6107]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.238401 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 5806949c371b41b0a162a4c8cbf6b435 (DEFAULT_TABLE table=default.Table_08229bcb0d3e45ec991f5946cfc5cfda [id=67b6ac3a114644f3ab7a357b30bcdc9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.238438 29232 tablet_service.cc:1511] Processing CreateTablet for tablet c4b2d190dda24f0e800b6f75bc165a57 (DEFAULT_TABLE table=default.Table_bd07d5c811d84966aadb9e3d06ff2eb4 [id=108c32b01ca947faad79a1632296797e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.239341 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.239981 29957 raft_consensus.cc:493] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:54.240146 29957 raft_consensus.cc:515] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.243114 29377 tablet_replica.cc:333] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:54.243193 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d281eec19b34aaa8729d8891547b8e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.243364 29377 raft_consensus.cc:2243] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.243552 29377 raft_consensus.cc:2272] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.244158 29377 ts_tablet_manager.cc:1916] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.245793 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5806949c371b41b0a162a4c8cbf6b435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.256268 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 5a09fbb3e8eb4b66acba0d6b572713ef (DEFAULT_TABLE table=default.Table_b60299a5315d44ca846c6b09fdc0ae03 [id=8e179900a6774ea3877a6e4347aa9fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.257095 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663dbe73689d4849a85b68a79ea4062c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.242313 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 425c1727564745b2ab84b39a2d190db5 (DEFAULT_TABLE table=default.Table_d5804c5dc2dd4b429190b2aefcbfd3f9 [id=ace0c10d79f74e72877f216ad9ac8415]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.242668 29957 leader_election.cc:290] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:54.242728 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:54.243371 29199 connection.cc:573] client connection to 127.27.245.253:38361 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 20:16:54.243717 29242 tablet_service.cc:1511] Processing CreateTablet for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 (DEFAULT_TABLE table=default.Table_642cc41f3bdf4f4892418e1b130fc953 [id=4c4310d6d44044adbd5749170442065a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.270139 29377 ts_tablet_manager.cc:1929] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.243793 29198 leader_election.cc:304] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:54.243847 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 33b01c9c27904a1986e285477921ac4f (DEFAULT_TABLE table=default.Table_e6908a670d534e828a0770f48cace3db [id=b24f0a25c8574b62842179a4c9bbc2f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.263900 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ab6fe7319940fcabd315193c51e199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.272002 29377 log.cc:1199] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/4da8b2c2ecd34b56a046ac3b32c0c5f1
I20260617 20:16:54.275735 29377 ts_tablet_manager.cc:1950] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:54.277451 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b2d190dda24f0e800b6f75bc165a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.279640 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b2d190dda24f0e800b6f75bc165a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.281448 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd24a60a91b43cd9e31ecca3d21ec60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.281549 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 0916139a64df436fafa18c7e86fbf91c (DEFAULT_TABLE table=default.Table_c00e7d6f133c42eeb8b0ced7774c79ea [id=270e1c2a36594a5091aa0eec2b19d30e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.281916 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0916139a64df436fafa18c7e86fbf91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.282596 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425c1727564745b2ab84b39a2d190db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.283320 29783 raft_consensus.cc:515] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.285003 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65814c56424256b53d3c9f94c1b74a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:54.285171 28987 raft_consensus.cc:3060] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:54.285451 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.287935 28987 raft_consensus.cc:2468] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:54.289455 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b01c9c27904a1986e285477921ac4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.289407 29062 leader_election.cc:304] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:54.291576 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_15da5b97a103487c96348ca7f22dc3b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.292227 29859 raft_consensus.cc:2804] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:54.292183 29106 tablet_service.cc:1511] Processing CreateTablet for tablet a819956f29954a4dbbd1aa1dcccad3c0 (DEFAULT_TABLE table=default.Table_08034aa4f7de43169cb855082c050daa [id=6a0c1850d45b4e53b04c59905d2d5692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.292392 29859 raft_consensus.cc:697] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:54.292673 29859 consensus_queue.cc:237] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.294026 30007 raft_consensus.cc:2804] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:54.294134 30007 raft_consensus.cc:493] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:54.294238 30007 raft_consensus.cc:3060] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:54.294802 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_20b86d94fc1845f7890c393e5f122ae7" } new_table_name: "default.Table_41df43a4da14469eabad96a692395510" modify_external_catalogs: true
I20260617 20:16:54.295320 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f1d4ead31fe746b3ac30b939a8d7885d" } new_table_name: "default.Table_230ee4baedc44720869f17501e15a05e" modify_external_catalogs: true
I20260617 20:16:54.295452 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 (table default.Table_0b2903f0c1204e4eacd6a8987e8b688a [id=8b2c257acdb0498f8c9c4e8e44535f31]) successfully deleted
I20260617 20:16:54.295703 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6039bf8f7372476bb786690cad75b43c" } modify_external_catalogs: true
I20260617 20:16:54.294855 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8cd5575879f54274afa3ecac3cc58ea7" } modify_external_catalogs: true
I20260617 20:16:54.296016 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5806949c371b41b0a162a4c8cbf6b435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.296458 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ac91b73059814eb6b58292b2e1558ace"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.296727 30007 raft_consensus.cc:515] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:54.297051 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15da5b97a103487c96348ca7f22dc3b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.297549 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0f5f4151702f48399790f86347a98506"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.298436 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 3180f1336fd841d8b4cf7fdf94015955 (DEFAULT_TABLE table=default.Table_563b00b87d974ad88a8fba7f9df09d6c [id=be86dcc9070d4f35830fa755339d2cd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.298900 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3180f1336fd841d8b4cf7fdf94015955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.298703 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 5a09fbb3e8eb4b66acba0d6b572713ef (DEFAULT_TABLE table=default.Table_b60299a5315d44ca846c6b09fdc0ae03 [id=8e179900a6774ea3877a6e4347aa9fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.298678 30007 leader_election.cc:290] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:54.299126 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d281eec19b34aaa8729d8891547b8e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.299458 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 0916139a64df436fafa18c7e86fbf91c (DEFAULT_TABLE table=default.Table_c00e7d6f133c42eeb8b0ced7774c79ea [id=270e1c2a36594a5091aa0eec2b19d30e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.299616 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 4d281eec19b34aaa8729d8891547b8e4 (DEFAULT_TABLE table=default.Table_adc3eb10b2d6455d90215f3f5de73e0e [id=5b6c386e9c894660a60d2ba0298d592a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.299808 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0916139a64df436fafa18c7e86fbf91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.300064 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 37214b955d63478088b9f723bcbc588a (DEFAULT_TABLE table=default.Table_c19457bc061d40ccb5a93ffbd622589e [id=dc6173b97e40451aaf245fe2ec542e94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.300396 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37214b955d63478088b9f723bcbc588a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.298434 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 4342e29fbc98442ea2e2d25c7aea8853 (DEFAULT_TABLE table=default.Table_d26967cbe1c54191941e64021b51c03a [id=5bff9a3c56d042d3a4caf6d0cc75351d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.301697 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4342e29fbc98442ea2e2d25c7aea8853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.301824 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e4407aa01642ffb03eba1b220afdba" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:54.301997 29124 raft_consensus.cc:3060] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:54.304000 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f5f4151702f48399790f86347a98506 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.304601 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 663dbe73689d4849a85b68a79ea4062c (DEFAULT_TABLE table=default.Table_b6faf540da644f658eb715d3ffacd616 [id=8ebd35bd7b464cd489f6a15d0e70800e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.304647 29124 raft_consensus.cc:2468] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:54.304939 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 663dbe73689d4849a85b68a79ea4062c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.305083 29198 leader_election.cc:304] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:54.305519 30007 raft_consensus.cc:2804] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:54.305680 30007 raft_consensus.cc:697] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:54.305972 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e7c6fb0fbdc84455826b618b3d85ddb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.306540 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7c6fb0fbdc84455826b618b3d85ddb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.307508 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6039bf8f7372476bb786690cad75b43c" } modify_external_catalogs: true
I20260617 20:16:54.308681 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8cd5575879f54274afa3ecac3cc58ea7" } modify_external_catalogs: true
I20260617 20:16:54.309562 29235 tablet_service.cc:1511] Processing CreateTablet for tablet a819956f29954a4dbbd1aa1dcccad3c0 (DEFAULT_TABLE table=default.Table_08034aa4f7de43169cb855082c050daa [id=6a0c1850d45b4e53b04c59905d2d5692]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:54.309880 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac91b73059814eb6b58292b2e1558ace in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.309921 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a819956f29954a4dbbd1aa1dcccad3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.310845 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4e433e1c254048ceb654a95a0275289e" } new_table_name: "default.Table_2a05556c6a7e4dfa97378055d732828a" modify_external_catalogs: true
I20260617 20:16:54.311738 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet c4b2d190dda24f0e800b6f75bc165a57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.311996 29237 tablet_service.cc:1558] Processing DeleteTablet for tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.312023 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c237cdc555974e0e8a2bc336adf356a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.312568 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c237cdc555974e0e8a2bc336adf356a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.309559 30007 consensus_queue.cc:237] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.313618 29225 tablet_service.cc:1511] Processing CreateTablet for tablet e35d84540ee74348a3222c5b928e002f (DEFAULT_TABLE table=default.Table_153027e782904859919297102e88af8c [id=9a28154d784c4243bea4d135bfb34e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.314025 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f6dcc384154d41866cf8060cf05837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.314193 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d281eec19b34aaa8729d8891547b8e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.316217 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569e339c17764486a65a1c3b43c92adf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:54.316440 29126 raft_consensus.cc:2468] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:54.317178 29198 leader_election.cc:304] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:54.317526 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a09fbb3e8eb4b66acba0d6b572713ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.318634 29783 leader_election.cc:290] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:54.321410 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35d84540ee74348a3222c5b928e002f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.326011 29375 ts_tablet_manager.cc:1929] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:16:54.326406 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5faea831376646c1bdfcaf8fbbc7ca6d consensus state has no leader
I20260617 20:16:54.326779 29263 raft_consensus.cc:2468] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:54.326922 29375 log.cc:1199] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/8e704d08c0da484a986c9d882a42e6f1
I20260617 20:16:54.327091 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet 89d79b7023ae478698a06562b2e4c578 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.327948 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0023728d2dae4d0b9dbecc4370e3127e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.328526 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0023728d2dae4d0b9dbecc4370e3127e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.330072 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a819956f29954a4dbbd1aa1dcccad3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.333514 29957 raft_consensus.cc:2804] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:54.333649 29957 raft_consensus.cc:493] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:54.333753 29957 raft_consensus.cc:3060] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:54.336488 29957 raft_consensus.cc:515] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.337174 29957 leader_election.cc:290] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:54.340057 29375 ts_tablet_manager.cc:1950] T 8e704d08c0da484a986c9d882a42e6f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:54.345857 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "569e339c17764486a65a1c3b43c92adf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:54.346954 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65814c56424256b53d3c9f94c1b74a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:54.346989 29126 raft_consensus.cc:3060] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:54.347180 29259 raft_consensus.cc:2468] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:54.347641 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b65814c56424256b53d3c9f94c1b74a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:54.347831 29259 raft_consensus.cc:3060] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:54.349447 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 353) took 3474 ms. Trace:
I20260617 20:16:54.350401 29259 raft_consensus.cc:2468] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:54.351780 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_eeda1b309ce24b77967522bd8810c6d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.353798 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eeda1b309ce24b77967522bd8810c6d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.355664 29375 rpcz_store.cc:276] 0617 20:16:50.866059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.944179 (+ 78120us) service_pool.cc:224] Handling call
0617 20:16:53.755486 (+2811307us) ts_tablet_manager.cc:1151] Deleting tablet 8e704d08c0da484a986c9d882a42e6f1
0617 20:16:53.755497 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.014190 (+258693us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.325314 (+311124us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.340418 (+ 15104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2811161}
I20260617 20:16:54.361517 29378 tablet_bootstrap.cc:492] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:54.363097 29378 ts_tablet_manager.cc:1403] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.433s user 0.030s sys 0.014s
I20260617 20:16:54.364055 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a09fbb3e8eb4b66acba0d6b572713ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.364861 29063 leader_election.cc:304] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
W20260617 20:16:54.365896 29197 leader_election.cc:343] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 569e339c17764486a65a1c3b43c92adf
W20260617 20:16:54.366240 29197 leader_election.cc:343] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 33e4407aa01642ffb03eba1b220afdba
W20260617 20:16:54.366549 29197 consensus_peers.cc:597] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e704d08c0da484a986c9d882a42e6f1. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:54.366864 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738ab2f8c784c76947a3a76bd040219" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:54.366971 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 331) took 3604 ms. Trace:
I20260617 20:16:54.367095 29375 rpcz_store.cc:276] 0617 20:16:50.754157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.754214 (+ 57us) service_pool.cc:224] Handling call
0617 20:16:54.357422 (+3603208us) ts_tablet_manager.cc:1151] Deleting tablet f4de5dafb1474de1911148bb3b4527cf
0617 20:16:54.357433 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.358555 (+ 1122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3412234}
I20260617 20:16:54.368383 29379 tablet_bootstrap.cc:492] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:54.368432 29998 raft_consensus.cc:2804] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:54.368532 29379 ts_tablet_manager.cc:1403] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.653s user 0.029s sys 0.037s
I20260617 20:16:54.368599 29998 raft_consensus.cc:697] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:54.370433 29375 tablet_replica.cc:333] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:54.370695 29375 raft_consensus.cc:2243] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.371387 29375 raft_consensus.cc:2272] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.371771 29379 raft_consensus.cc:359] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.371953 29379 raft_consensus.cc:385] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:54.371737 29998 consensus_queue.cc:237] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.372058 29379 raft_consensus.cc:740] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:54.372314 29379 consensus_queue.cc:260] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:54.372725 28925 leader_election.cc:343] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.372835 29379 ts_tablet_manager.cc:1434] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:54.372855 28925 leader_election.cc:304] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:54.373106 29379 tablet_bootstrap.cc:492] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:54.373086 28925 raft_consensus.cc:2686] T d738ab2f8c784c76947a3a76bd040219 P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:16:54.374065 29378 raft_consensus.cc:359] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.374444 29378 raft_consensus.cc:385] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:54.374576 29378 raft_consensus.cc:740] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:54.374881 29378 consensus_queue.cc:260] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.375471 29378 ts_tablet_manager.cc:1434] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260617 20:16:54.376467 29375 ts_tablet_manager.cc:1916] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.388048 29916 raft_consensus.cc:493] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:54.388240 29916 raft_consensus.cc:515] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.388914 29916 leader_election.cc:290] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:54.388341 29378 tablet_bootstrap.cc:492] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:54.390367 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_53b5071e49a2403a9045e136cfafa85b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.391004 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53b5071e49a2403a9045e136cfafa85b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.391347 29378 tablet_bootstrap.cc:654] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:54.399029 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 4d281eec19b34aaa8729d8891547b8e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d281eec19b34aaa8729d8891547b8e4 already in progress: creating tablet
W20260617 20:16:54.399780 29197 leader_election.cc:343] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 569e339c17764486a65a1c3b43c92adf
I20260617 20:16:54.401973 29126 raft_consensus.cc:2468] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:16:54.403156 29383 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.528s user 0.083s sys 0.162s
I20260617 20:16:54.403304 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a857c28d94f04dabb9a57aeca662b836" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:54.403437 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d4130f3529ef4adaa4cedf12e53b6895 consensus state has no leader
W20260617 20:16:54.404568 28925 leader_election.cc:343] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.407635 29230 tablet_service.cc:1511] Processing CreateTablet for tablet fe6c261318b24a6caa3a376215f44f0f (DEFAULT_TABLE table=default.Table_ef916ebf00b449979408f9dab4fb264e [id=3b1ee3a0a7f54dfd921749144e963305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.408077 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6c261318b24a6caa3a376215f44f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.408789 29198 leader_election.cc:304] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:54.409605 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a857c28d94f04dabb9a57aeca662b836" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:54.409698 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet 16d0360ec78844a1be3d5f51259bbcdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.409171 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1049746575e44a9ab370495af7e4dea9" } new_table_name: "default.Table_717bed2f0fd24890b33e6efaea1b5529" modify_external_catalogs: true
I20260617 20:16:54.411324 29378 tablet_bootstrap.cc:492] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:54.411473 29378 ts_tablet_manager.cc:1403] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.001s
I20260617 20:16:54.412407 29378 raft_consensus.cc:359] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.412571 29378 raft_consensus.cc:385] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:54.412652 29378 raft_consensus.cc:740] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:54.412879 29378 consensus_queue.cc:260] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.413426 29378 ts_tablet_manager.cc:1434] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:54.413729 29378 tablet_bootstrap.cc:492] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:54.414746 29377 tablet_replica.cc:333] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:54.415802 28951 tablet_service.cc:1511] Processing CreateTablet for tablet fe6c261318b24a6caa3a376215f44f0f (DEFAULT_TABLE table=default.Table_ef916ebf00b449979408f9dab4fb264e [id=3b1ee3a0a7f54dfd921749144e963305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.416415 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6c261318b24a6caa3a376215f44f0f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:54.418210 28925 leader_election.cc:343] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.418336 28925 leader_election.cc:304] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:54.418764 29916 raft_consensus.cc:2749] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:54.420624 29379 tablet_bootstrap.cc:654] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:54.422053 29957 raft_consensus.cc:2804] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:54.424151 29377 raft_consensus.cc:2243] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.425621 29377 raft_consensus.cc:2272] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.430706 29377 ts_tablet_manager.cc:1916] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.431419 29376 ts_tablet_manager.cc:1929] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:54.431617 29376 log.cc:1199] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/65af976b808d42d4aeded71a00cf7252
I20260617 20:16:54.432173 29376 ts_tablet_manager.cc:1950] T 65af976b808d42d4aeded71a00cf7252 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:54.435125 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 6afb3ed704bb4a269d92f1741455161b (DEFAULT_TABLE table=default.Table_de502b1f036f4436bb0991e0b6720e6a [id=b2c65ae25feb4d93b534ca5c3a33bcb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.436703 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afb3ed704bb4a269d92f1741455161b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:54.432380 29383 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.548s user 0.083s sys 0.162s
I20260617 20:16:54.438467 29383 tablet_bootstrap.cc:492] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:54.439733 29383 ts_tablet_manager.cc:1403] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.599s user 0.085s sys 0.163s
I20260617 20:16:54.440757 29383 raft_consensus.cc:359] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.436838 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 6afb3ed704bb4a269d92f1741455161b (DEFAULT_TABLE table=default.Table_de502b1f036f4436bb0991e0b6720e6a [id=b2c65ae25feb4d93b534ca5c3a33bcb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.445092 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afb3ed704bb4a269d92f1741455161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.445436 30016 tablet.cc:1724] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:54.446295 29378 tablet_bootstrap.cc:654] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:54.447921 29375 ts_tablet_manager.cc:1929] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.448037 29375 log.cc:1199] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/c65a4345552844fe9e7512105fd79877
I20260617 20:16:54.448410 29375 ts_tablet_manager.cc:1950] T c65a4345552844fe9e7512105fd79877 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:54.448698 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 340) took 3636 ms. Trace:
I20260617 20:16:54.448822 29375 rpcz_store.cc:276] 0617 20:16:50.812576 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.813419 (+ 843us) service_pool.cc:224] Handling call
0617 20:16:54.367393 (+3553974us) ts_tablet_manager.cc:1151] Deleting tablet c65a4345552844fe9e7512105fd79877
0617 20:16:54.367404 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.415938 (+ 48534us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.447833 (+ 31895us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.448663 (+ 830us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3419622}
I20260617 20:16:54.439355 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 343) took 3626 ms. Trace:
I20260617 20:16:54.449437 29376 rpcz_store.cc:276] 0617 20:16:50.813008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.816759 (+ 3751us) service_pool.cc:224] Handling call
0617 20:16:53.832152 (+3015393us) ts_tablet_manager.cc:1151] Deleting tablet 65af976b808d42d4aeded71a00cf7252
0617 20:16:53.832164 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:53.894177 (+ 62013us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.421930 (+527753us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.439316 (+ 17386us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3014374}
I20260617 20:16:54.449934 29376 tablet_replica.cc:333] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:54.451421 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 65af976b808d42d4aeded71a00cf7252 (table default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]) successfully deleted
I20260617 20:16:54.451931 29376 raft_consensus.cc:2243] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.459389 29376 raft_consensus.cc:2272] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.461596 29376 ts_tablet_manager.cc:1916] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.466099 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 8e704d08c0da484a986c9d882a42e6f1 (table default.Table_270b09836c954e6c94328615b8059bb0 [id=c1ee5736ea3541af850fd0c99d5fbcfe]) successfully deleted
W20260617 20:16:54.466445 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet f4de5dafb1474de1911148bb3b4527cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4de5dafb1474de1911148bb3b4527cf already in progress: creating tablet
I20260617 20:16:54.449232 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 339) took 3637 ms. Trace:
I20260617 20:16:54.467099 29375 rpcz_store.cc:276] 0617 20:16:50.812224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.812297 (+ 73us) service_pool.cc:224] Handling call
0617 20:16:54.449124 (+3636827us) ts_tablet_manager.cc:1151] Deleting tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6
0617 20:16:54.449133 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.449205 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3501284}
I20260617 20:16:54.457789 30014 tablet.cc:1724] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260617 20:16:54.451205 29197 consensus_peers.cc:597] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd4f190a1005433ebcfbfe3a86aa9e70. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:54.467271 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 14a5e5917a414c99b25ea2efeab4063d
I20260617 20:16:54.468482 29375 tablet_replica.cc:333] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:54.468474 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a5e5917a414c99b25ea2efeab4063d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.452152 29383 raft_consensus.cc:385] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:54.468650 29383 raft_consensus.cc:740] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:54.468698 29375 raft_consensus.cc:2243] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.468860 29375 raft_consensus.cc:2272] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.468925 29383 consensus_queue.cc:260] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.469431 29375 ts_tablet_manager.cc:1916] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.469810 29383 ts_tablet_manager.cc:1434] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.030s user 0.001s sys 0.001s
I20260617 20:16:54.470148 29383 tablet_bootstrap.cc:492] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:54.470760 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a5e5917a414c99b25ea2efeab4063d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.472271 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet c4b2d190dda24f0e800b6f75bc165a57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.473760 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2b68c9711d6147e88a1aba5ea0a8f2bd" } new_table_name: "default.Table_b5d227c61e734225b76fd057b7ad9b96" modify_external_catalogs: true
I20260617 20:16:54.475764 29859 raft_consensus.cc:493] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:54.476055 29859 raft_consensus.cc:515] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:54.477626 29062 leader_election.cc:343] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 65af976b808d42d4aeded71a00cf7252
I20260617 20:16:54.477926 29859 leader_election.cc:290] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:54.478528 29063 leader_election.cc:343] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 65af976b808d42d4aeded71a00cf7252
I20260617 20:16:54.478668 29063 leader_election.cc:304] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:54.474959 30011 log.cc:927] Time spent T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: Append to log took a long time: real 0.077s user 0.000s sys 0.000s
I20260617 20:16:54.480041 29378 tablet_bootstrap.cc:492] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:54.480456 29378 ts_tablet_manager.cc:1403] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.005s
I20260617 20:16:54.481245 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 569e339c17764486a65a1c3b43c92adf with delete_type TABLET_DATA_DELETED (replaced by tablet f4de5dafb1474de1911148bb3b4527cf) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.481521 29378 raft_consensus.cc:359] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.481837 29378 raft_consensus.cc:385] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:54.481851 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.481959 29378 raft_consensus.cc:740] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:54.482424 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 98467525f81f4a48878eae17e3a9c982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.482312 29378 consensus_queue.cc:260] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.482931 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 65af976b808d42d4aeded71a00cf7252 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.483640 30021 tablet.cc:1724] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:54.484700 29957 raft_consensus.cc:697] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:54.485096 29957 consensus_queue.cc:237] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.485468 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c2ad7d91e2a84af3bddceffdaf386c94" } modify_external_catalogs: true
I20260617 20:16:54.485678 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c2ad7d91e2a84af3bddceffdaf386c94" } modify_external_catalogs: true
I20260617 20:16:54.487305 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet c65a4345552844fe9e7512105fd79877 (table default.Table_cd9432cef0ba46d9a560d5ba59f1d58d [id=6c1d98916a69411393b9f32eeb861bd7]) successfully deleted
I20260617 20:16:54.488435 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d281eec19b34aaa8729d8891547b8e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.488629 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.491010 29096 tablet_service.cc:1511] Processing CreateTablet for tablet fe6c261318b24a6caa3a376215f44f0f (DEFAULT_TABLE table=default.Table_ef916ebf00b449979408f9dab4fb264e [id=3b1ee3a0a7f54dfd921749144e963305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.491721 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe6c261318b24a6caa3a376215f44f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.494606 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 0916139a64df436fafa18c7e86fbf91c (DEFAULT_TABLE table=default.Table_c00e7d6f133c42eeb8b0ced7774c79ea [id=270e1c2a36594a5091aa0eec2b19d30e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.494961 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0916139a64df436fafa18c7e86fbf91c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.495314 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 593d9de6a2fb47e18d86649e45ba80b9
I20260617 20:16:54.496448 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a5e5917a414c99b25ea2efeab4063d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:54.497143 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 1ce9f5deea614e6d9e02e88d3d5ff2c6 because the tablet was not found. No further retry: Not found: Tablet not found: 1ce9f5deea614e6d9e02e88d3d5ff2c6
I20260617 20:16:54.499691 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d9de6a2fb47e18d86649e45ba80b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.501677 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 6afb3ed704bb4a269d92f1741455161b (DEFAULT_TABLE table=default.Table_de502b1f036f4436bb0991e0b6720e6a [id=b2c65ae25feb4d93b534ca5c3a33bcb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.502018 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afb3ed704bb4a269d92f1741455161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.509262 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 9370421288e2449fae454aec32883810 (DEFAULT_TABLE table=default.Table_70137395fd5347969cead58202834395 [id=d554f41bd92a4353a4df75f859847926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.492621 29378 ts_tablet_manager.cc:1434] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260617 20:16:54.497263 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d9de6a2fb47e18d86649e45ba80b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.500643 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 9370421288e2449fae454aec32883810 (DEFAULT_TABLE table=default.Table_70137395fd5347969cead58202834395 [id=d554f41bd92a4353a4df75f859847926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.517251 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9370421288e2449fae454aec32883810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.518450 28968 tablet_service.cc:1511] Processing CreateTablet for tablet d44524b02e6f4c1291bca50e9261459b (DEFAULT_TABLE table=default.Table_20836b89113d47f1a735b4f6100d9002 [id=bbd9142963fd450583aef1d8d715e35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.518886 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44524b02e6f4c1291bca50e9261459b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.519178 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d9de6a2fb47e18d86649e45ba80b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.520088 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 3defb7ba4604412597316f8e5c8d5ccd (DEFAULT_TABLE table=default.Table_dec67a2333294dc6aa579c8eef5adacd [id=ed5699d64bbb4a62ac877e932e22b6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.520498 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3defb7ba4604412597316f8e5c8d5ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.522331 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 3defb7ba4604412597316f8e5c8d5ccd (DEFAULT_TABLE table=default.Table_dec67a2333294dc6aa579c8eef5adacd [id=ed5699d64bbb4a62ac877e932e22b6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.522331 29230 tablet_service.cc:1511] Processing CreateTablet for tablet d44524b02e6f4c1291bca50e9261459b (DEFAULT_TABLE table=default.Table_20836b89113d47f1a735b4f6100d9002 [id=bbd9142963fd450583aef1d8d715e35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.508955 29783 raft_consensus.cc:2749] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:54.523748 28970 tablet_service.cc:1511] Processing CreateTablet for tablet c09634384b5747659c34d25a489f6279 (DEFAULT_TABLE table=default.Table_a54a8950e6fd43248d608f5bb5f9b765 [id=10265d7c2b0a467c8d5a3aded9e23521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.511466 29998 raft_consensus.cc:493] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:54.524995 29998 raft_consensus.cc:515] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.522481 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 3defb7ba4604412597316f8e5c8d5ccd (DEFAULT_TABLE table=default.Table_dec67a2333294dc6aa579c8eef5adacd [id=ed5699d64bbb4a62ac877e932e22b6f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.525415 29091 tablet_service.cc:1511] Processing CreateTablet for tablet c09634384b5747659c34d25a489f6279 (DEFAULT_TABLE table=default.Table_a54a8950e6fd43248d608f5bb5f9b765 [id=10265d7c2b0a467c8d5a3aded9e23521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.525552 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3defb7ba4604412597316f8e5c8d5ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.525782 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c09634384b5747659c34d25a489f6279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.527908 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 9370421288e2449fae454aec32883810 (DEFAULT_TABLE table=default.Table_70137395fd5347969cead58202834395 [id=d554f41bd92a4353a4df75f859847926]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.528005 29098 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6dc68c7f10490f87df2b70a548cf72 (DEFAULT_TABLE table=default.Table_bb2d4abaff574992b845f37916732047 [id=e5516c07301447348a57361f1cdc74bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.528285 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9370421288e2449fae454aec32883810. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:54.531046 29063 leader_election.cc:343] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 98467525f81f4a48878eae17e3a9c982
I20260617 20:16:54.531735 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6dc68c7f10490f87df2b70a548cf72 (DEFAULT_TABLE table=default.Table_bb2d4abaff574992b845f37916732047 [id=e5516c07301447348a57361f1cdc74bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.532465 29228 tablet_service.cc:1511] Processing CreateTablet for tablet c09634384b5747659c34d25a489f6279 (DEFAULT_TABLE table=default.Table_a54a8950e6fd43248d608f5bb5f9b765 [id=10265d7c2b0a467c8d5a3aded9e23521]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.508795 29375 ts_tablet_manager.cc:1929] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.536329 28669 catalog_manager.cc:5696] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194). New cstate: current_term: 1 leader_uuid: "6d4ce30e1fce4591b64c398747f8d37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:54.542223 29096 tablet_service.cc:1511] Processing CreateTablet for tablet d44524b02e6f4c1291bca50e9261459b (DEFAULT_TABLE table=default.Table_20836b89113d47f1a735b4f6100d9002 [id=bbd9142963fd450583aef1d8d715e35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.542224 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6dc68c7f10490f87df2b70a548cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.545104 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9370421288e2449fae454aec32883810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.545823 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6dc68c7f10490f87df2b70a548cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.546429 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c09634384b5747659c34d25a489f6279. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:54.546551 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2c583de2973e4fb0abacf2692f3ab829 consensus state has no leader
I20260617 20:16:54.547057 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_489218ed90a3450591befcb0c8064bc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.547428 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c09634384b5747659c34d25a489f6279. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:54.547700 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_489218ed90a3450591befcb0c8064bc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.547921 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_97de59fa992e4c7097d3114d1b261de7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.548404 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97de59fa992e4c7097d3114d1b261de7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.549003 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3defb7ba4604412597316f8e5c8d5ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.549633 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44524b02e6f4c1291bca50e9261459b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.550217 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet dee426100bb645f391be123aeb52e412 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:54.559281 29376 ts_tablet_manager.cc:1929] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.559433 29376 log.cc:1199] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/1f85271eeb854194a968215ebc08f47a
I20260617 20:16:54.559823 29376 ts_tablet_manager.cc:1950] T 1f85271eeb854194a968215ebc08f47a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:54.561520 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 6d6dc68c7f10490f87df2b70a548cf72 (DEFAULT_TABLE table=default.Table_bb2d4abaff574992b845f37916732047 [id=e5516c07301447348a57361f1cdc74bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.563935 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_941592c8a96145e3bd446c7c631f2018" } modify_external_catalogs: true
I20260617 20:16:54.564177 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_941592c8a96145e3bd446c7c631f2018" } modify_external_catalogs: true
I20260617 20:16:54.564842 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bb7f63dd419f420bb7bed4cf3bd9042e" } modify_external_catalogs: true
I20260617 20:16:54.566481 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bb7f63dd419f420bb7bed4cf3bd9042e" } modify_external_catalogs: true
I20260617 20:16:54.568681 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet cbeae97639fd4e6290768dae12f6a4ce from {username='slave'} at 127.0.0.1:60552
W20260617 20:16:54.569041 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32c3a4c3bee5444697f5d53d51c62894 consensus state has no leader
W20260617 20:16:54.569332 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b2797384f7845969ee9744b444f1acc consensus state has no leader
I20260617 20:16:54.570600 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet dee426100bb645f391be123aeb52e412
I20260617 20:16:54.570448 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_50ecb5070ca44573941f0c8ab0803f77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.570990 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet b1b3565799894d82a3cc29ab2a19307c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:54.570458 28657 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 1ed860fa375848708beb31ff89056214 (table default.Table_b38397bd90c94aa5ab36026db378ccd8 [id=77e2352dd7d84649893c0dada224aa64], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1ed860fa375848708beb31ff89056214 consensus state has no leader
W20260617 20:16:54.573374 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50ecb5070ca44573941f0c8ab0803f77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.583760 29383 tablet_bootstrap.cc:654] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:54.585376 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0c03983bb7554bf081b91ed5c44c8f56" } new_table_name: "default.Table_63d1c7b660324600bb6950041e28f284" modify_external_catalogs: true
I20260617 20:16:54.589751 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet dee426100bb645f391be123aeb52e412 with delete_type TABLET_DATA_DELETED (replaced by tablet c3496887f6a045e293698d09d9cc1c16) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.590927 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 345) took 3772 ms. Trace:
I20260617 20:16:54.591125 29376 rpcz_store.cc:276] 0617 20:16:50.818022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.818087 (+ 65us) service_pool.cc:224] Handling call
0617 20:16:54.449861 (+3631774us) ts_tablet_manager.cc:1151] Deleting tablet 1f85271eeb854194a968215ebc08f47a
0617 20:16:54.449873 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.544594 (+ 94721us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.559203 (+ 14609us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.590859 (+ 31656us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3631474}
I20260617 20:16:54.591758 29376 tablet_replica.cc:333] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:54.592108 29376 raft_consensus.cc:2243] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:54.592555 29376 pending_rounds.cc:70] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:54.592936 29376 pending_rounds.cc:77] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955483624914944 op_type: NO_OP noop_request { }
I20260617 20:16:54.593158 29376 raft_consensus.cc:2889] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:54.593348 29376 raft_consensus.cc:2272] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.593444 29998 leader_election.cc:290] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:54.593982 29376 ts_tablet_manager.cc:1916] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.597899 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet dee426100bb645f391be123aeb52e412 with delete_type TABLET_DATA_DELETED (replaced by tablet c3496887f6a045e293698d09d9cc1c16) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.598869 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet dee426100bb645f391be123aeb52e412 with delete_type TABLET_DATA_DELETED (replaced by tablet c3496887f6a045e293698d09d9cc1c16) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.599958 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6dc68c7f10490f87df2b70a548cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.601778 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44524b02e6f4c1291bca50e9261459b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.602020 29379 tablet_bootstrap.cc:492] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:54.604287 29379 ts_tablet_manager.cc:1403] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.231s user 0.008s sys 0.002s
I20260617 20:16:54.605217 29379 raft_consensus.cc:359] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.605461 29379 raft_consensus.cc:385] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:54.605545 29379 raft_consensus.cc:740] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:54.605778 29379 consensus_queue.cc:260] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.606279 29379 ts_tablet_manager.cc:1434] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:54.606588 29379 tablet_bootstrap.cc:492] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:54.610069 29062 consensus_peers.cc:597] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8eee68618cdf462283d7fd9f098c2a0d. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:16:54.611326 29062 leader_election.cc:343] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 98467525f81f4a48878eae17e3a9c982
I20260617 20:16:54.611444 29062 leader_election.cc:304] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:54.612298 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5eaddd6519dc490c8358be629b21a2d9
I20260617 20:16:54.615625 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_61769387a2da409d86a5ce7c83821992"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.616916 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e19abe093a40f6886908a8a3a0cad4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.623222 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 1f85271eeb854194a968215ebc08f47a (table default.Table_8278dd326f2d440e9b3823471e55dff7 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]) successfully deleted
I20260617 20:16:54.624301 29375 log.cc:1199] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/1f32ebd7448843b48b981d3d70a87023
I20260617 20:16:54.624639 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b247c97f4c9a4b788252faebaeedadbe" } new_table_name: "default.Table_778028dc2b7b43e9b5b16d42baf40772" modify_external_catalogs: true
I20260617 20:16:54.624897 29098 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eaddd6519dc490c8358be629b21a2d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.626417 28664 catalog_manager.cc:6784] ReplaceTablet: tablet dee426100bb645f391be123aeb52e412 deleted and replaced by tablet c3496887f6a045e293698d09d9cc1c16
W20260617 20:16:54.627295 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61769387a2da409d86a5ce7c83821992 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.629098 28669 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_ae4ab5348d244f92a3ecd4fac3ca86b2 [id=06b76ab80c3b453986d047f7f1f832ac] alter complete (version 2)
W20260617 20:16:54.632665 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a56191018d04a2881ee3e1a243c1a19 consensus state has no leader
I20260617 20:16:54.634487 29098 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fa15915b0ec44ff8b66920e4c207536 with delete_type TABLET_DATA_DELETED (replaced by tablet d4130f3529ef4adaa4cedf12e53b6895) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:54.634641 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6b3091c332a14c4c99bd28e401769e30 consensus state has no leader
I20260617 20:16:54.641896 29859 raft_consensus.cc:2749] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:54.642436 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4ceb3ae3c1a44442966ad37fbcbc658b
I20260617 20:16:54.642916 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet cbeae97639fd4e6290768dae12f6a4ce
I20260617 20:16:54.643348 28667 catalog_manager.cc:6784] ReplaceTablet: tablet cbeae97639fd4e6290768dae12f6a4ce deleted and replaced by tablet cc547148aa124907a5e5def6941f734c
I20260617 20:16:54.643579 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 89f7b878728a495f83b6584f8a6aca67
I20260617 20:16:54.645094 29375 ts_tablet_manager.cc:1950] T 1f32ebd7448843b48b981d3d70a87023 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:54.646206 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 4f232832e4af48e691ddd50576188203 (DEFAULT_TABLE table=default.Table_0f5f4151702f48399790f86347a98506 [id=d4319ca115ed4935b14fef47fd239c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.647661 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f232832e4af48e691ddd50576188203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.647694 29098 tablet_service.cc:1511] Processing CreateTablet for tablet 8e765deb9fe84707a5e9e2964310a36d (DEFAULT_TABLE table=default.Table_e7c6fb0fbdc84455826b618b3d85ddb4 [id=6e73368fb6f74908b0583b369af8de2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.649434 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e765deb9fe84707a5e9e2964310a36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.651456 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet d1654ae96ce041fa9b9b881af7dd342e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.652245 29378 tablet_bootstrap.cc:492] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:54.653528 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 081844c92e744d5a870c47437999e895 (DEFAULT_TABLE table=default.Table_15da5b97a103487c96348ca7f22dc3b0 [id=842f3db66d544b8c8ea0a8b58f8ea775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.653927 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081844c92e744d5a870c47437999e895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.655122 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 341) took 3832 ms. Trace:
I20260617 20:16:54.655354 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eaddd6519dc490c8358be629b21a2d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.655972 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eaddd6519dc490c8358be629b21a2d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.657073 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 6db24d70cc7643599d7be9158b5a7450 (DEFAULT_TABLE table=default.Table_20dcfb508ecf4cacbaca2e229fe563d7 [id=ccb19fa7c76b445f9801722edcd4dfb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.657105 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6bf28f4e434da794db9391ca7ad738 (DEFAULT_TABLE table=default.Table_ac91b73059814eb6b58292b2e1558ace [id=e2933414bca44da084411334f63ccfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.657557 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 4f232832e4af48e691ddd50576188203 (DEFAULT_TABLE table=default.Table_0f5f4151702f48399790f86347a98506 [id=d4319ca115ed4935b14fef47fd239c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.657958 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 081844c92e744d5a870c47437999e895 (DEFAULT_TABLE table=default.Table_15da5b97a103487c96348ca7f22dc3b0 [id=842f3db66d544b8c8ea0a8b58f8ea775]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.657958 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 50a5480896af417f93a98e336890f8e1 (DEFAULT_TABLE table=default.Table_50062ea6504540bf8c760f69ae119740 [id=97e6dec6db75462c87ea869c7c4fe9f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.658692 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 8e765deb9fe84707a5e9e2964310a36d (DEFAULT_TABLE table=default.Table_e7c6fb0fbdc84455826b618b3d85ddb4 [id=6e73368fb6f74908b0583b369af8de2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.659200 29376 ts_tablet_manager.cc:1929] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:54.659333 29376 log.cc:1199] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/8e704d08c0da484a986c9d882a42e6f1
I20260617 20:16:54.659547 29383 tablet_bootstrap.cc:492] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:54.659682 29383 ts_tablet_manager.cc:1403] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.190s user 0.004s sys 0.001s
I20260617 20:16:54.659762 29376 ts_tablet_manager.cc:1950] T 8e704d08c0da484a986c9d882a42e6f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:54.660352 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ceb3ae3c1a44442966ad37fbcbc658b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.660629 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet cbeae97639fd4e6290768dae12f6a4ce with delete_type TABLET_DATA_DELETED (replaced by tablet cc547148aa124907a5e5def6941f734c) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.660637 29383 raft_consensus.cc:359] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.660900 29383 raft_consensus.cc:385] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:54.661032 29383 raft_consensus.cc:740] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:54.661010 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 8e765deb9fe84707a5e9e2964310a36d (DEFAULT_TABLE table=default.Table_e7c6fb0fbdc84455826b618b3d85ddb4 [id=6e73368fb6f74908b0583b369af8de2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.661444 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e765deb9fe84707a5e9e2964310a36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.661350 29383 consensus_queue.cc:260] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.661886 29383 ts_tablet_manager.cc:1434] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:54.660790 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f7b878728a495f83b6584f8a6aca67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.663240 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 4f232832e4af48e691ddd50576188203 (DEFAULT_TABLE table=default.Table_0f5f4151702f48399790f86347a98506 [id=d4319ca115ed4935b14fef47fd239c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.663611 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f232832e4af48e691ddd50576188203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.665141 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6bf28f4e434da794db9391ca7ad738 (DEFAULT_TABLE table=default.Table_ac91b73059814eb6b58292b2e1558ace [id=e2933414bca44da084411334f63ccfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.665627 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db24d70cc7643599d7be9158b5a7450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.666402 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f232832e4af48e691ddd50576188203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.666822 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 50a5480896af417f93a98e336890f8e1 (DEFAULT_TABLE table=default.Table_50062ea6504540bf8c760f69ae119740 [id=97e6dec6db75462c87ea869c7c4fe9f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.666956 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ceb3ae3c1a44442966ad37fbcbc658b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.667138 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 50a5480896af417f93a98e336890f8e1 (DEFAULT_TABLE table=default.Table_50062ea6504540bf8c760f69ae119740 [id=97e6dec6db75462c87ea869c7c4fe9f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.667227 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a5480896af417f93a98e336890f8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.667843 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f7b878728a495f83b6584f8a6aca67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.668483 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081844c92e744d5a870c47437999e895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.668509 29378 tablet_bootstrap.cc:654] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:54.668933 29379 tablet_bootstrap.cc:654] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:54.669085 29375 rpcz_store.cc:276] 0617 20:16:50.812855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.815216 (+ 2361us) service_pool.cc:224] Handling call
0617 20:16:54.468415 (+3653199us) ts_tablet_manager.cc:1151] Deleting tablet 1f32ebd7448843b48b981d3d70a87023
0617 20:16:54.468427 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.489526 (+ 21099us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.508732 (+ 19206us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.645428 (+136696us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3519966}
I20260617 20:16:54.669550 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6bf28f4e434da794db9391ca7ad738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.683229 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 083b8903abd646dc89717b9d2caf5647 (DEFAULT_TABLE table=default.Table_c237cdc555974e0e8a2bc336adf356a6 [id=2b30d550d0e445e882179d01fb066334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.683439 28631 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRePpQS/build/asan/bin/kudu
/tmp/dist-test-taskRePpQS/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.253:38361
--webserver_interface=127.27.245.253
--webserver_port=44941
--builtin_ntp_servers=127.27.245.212:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260617 20:16:54.684098 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 1f32ebd7448843b48b981d3d70a87023 (table default.Table_8e019e33cf25495289e2e63f59c874ef [id=ba10931c3fce41668047da142da71026]) successfully deleted
I20260617 20:16:54.684221 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_651121ed4f3b4491ac90435c5b0c3b1d" } modify_external_catalogs: true
I20260617 20:16:54.684396 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_651121ed4f3b4491ac90435c5b0c3b1d" } modify_external_catalogs: true
I20260617 20:16:54.685040 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_618ad76b555e4e38a2a0f86b2a755535"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.685407 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet cbeae97639fd4e6290768dae12f6a4ce with delete_type TABLET_DATA_DELETED (replaced by tablet cc547148aa124907a5e5def6941f734c) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:54.685629 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_618ad76b555e4e38a2a0f86b2a755535 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.687093 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6435bac04e472c99e81b6e7e9a6012 (DEFAULT_TABLE table=default.Table_0023728d2dae4d0b9dbecc4370e3127e [id=d84be237c46a4dc58e1c9722935bf5d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.687640 29241 tablet_service.cc:1511] Processing CreateTablet for tablet f62c5a2071dd46dfbde504459508b069 (DEFAULT_TABLE table=default.Table_489218ed90a3450591befcb0c8064bc7 [id=9f014e9b411e496398d894dc77706d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.688169 29234 tablet_service.cc:1511] Processing CreateTablet for tablet c3496887f6a045e293698d09d9cc1c16 (DEFAULT_TABLE table=default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.688660 29225 tablet_service.cc:1511] Processing CreateTablet for tablet e5396b42681e4a1fbf0df74c86ee810c (DEFAULT_TABLE table=default.Table_53b5071e49a2403a9045e136cfafa85b [id=df45a919527444a5b096737284b70a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.689584 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 7f47e81154eb48fb9e891cfff5250af2 (DEFAULT_TABLE table=default.Table_97de59fa992e4c7097d3114d1b261de7 [id=d8e345fe630b4072820cc8c71189ea50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.689707 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 59a3766053144e6c9ee680f099ff1766 (DEFAULT_TABLE table=default.Table_50ecb5070ca44573941f0c8ab0803f77 [id=d86155eb37074ec3a29fa8b560d0649d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.691094 29226 tablet_service.cc:1511] Processing CreateTablet for tablet fd226ca6595148638d5036356c50313f (DEFAULT_TABLE table=default.Table_eeda1b309ce24b77967522bd8810c6d8 [id=aaa2d2913e5d438b901d6bd519eaf891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.691576 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ceb3ae3c1a44442966ad37fbcbc658b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.692823 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a5480896af417f93a98e336890f8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.693974 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 6db24d70cc7643599d7be9158b5a7450 (DEFAULT_TABLE table=default.Table_20dcfb508ecf4cacbaca2e229fe563d7 [id=ccb19fa7c76b445f9801722edcd4dfb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.699818 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c54f8dc65b95412db87f8018bc68292e" } modify_external_catalogs: true
I20260617 20:16:54.700060 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c54f8dc65b95412db87f8018bc68292e" } modify_external_catalogs: true
I20260617 20:16:54.699994 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3f6418bb5b1044818dab9ca960037e3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.700565 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 7a89e42d091f423bb926f671797141ea
W20260617 20:16:54.700593 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f6418bb5b1044818dab9ca960037e3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.702701 29859 consensus_queue.cc:1048] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:54.704806 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a89e42d091f423bb926f671797141ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.705384 29383 tablet_bootstrap.cc:492] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:54.705752 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 352) took 3820 ms. Trace:
I20260617 20:16:54.707934 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6bf28f4e434da794db9391ca7ad738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.709245 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet cde88371f4454a4bb3053c6cd1afb801
I20260617 20:16:54.710952 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50a5480896af417f93a98e336890f8e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.714983 29376 rpcz_store.cc:276] 0617 20:16:50.885719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.889356 (+ 3637us) service_pool.cc:224] Handling call
0617 20:16:54.591649 (+3702293us) ts_tablet_manager.cc:1151] Deleting tablet 8e704d08c0da484a986c9d882a42e6f1
0617 20:16:54.591661 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.597203 (+ 5542us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.659128 (+ 61925us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.705690 (+ 46562us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3688718}
I20260617 20:16:54.715673 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 358) took 3724 ms. Trace:
I20260617 20:16:54.711903 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e765deb9fe84707a5e9e2964310a36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.716104 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5396b42681e4a1fbf0df74c86ee810c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.714195 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet cde88371f4454a4bb3053c6cd1afb801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.716115 28970 tablet_service.cc:1511] Processing CreateTablet for tablet fd226ca6595148638d5036356c50313f (DEFAULT_TABLE table=default.Table_eeda1b309ce24b77967522bd8810c6d8 [id=aaa2d2913e5d438b901d6bd519eaf891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.719364 29383 tablet_bootstrap.cc:654] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:54.720275 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd226ca6595148638d5036356c50313f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.720278 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3496887f6a045e293698d09d9cc1c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.721695 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 083b8903abd646dc89717b9d2caf5647 (DEFAULT_TABLE table=default.Table_c237cdc555974e0e8a2bc336adf356a6 [id=2b30d550d0e445e882179d01fb066334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.721922 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 8e704d08c0da484a986c9d882a42e6f1 (table default.Table_270b09836c954e6c94328615b8059bb0 [id=c1ee5736ea3541af850fd0c99d5fbcfe]) successfully deleted
I20260617 20:16:54.722112 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 6db24d70cc7643599d7be9158b5a7450 (DEFAULT_TABLE table=default.Table_20dcfb508ecf4cacbaca2e229fe563d7 [id=ccb19fa7c76b445f9801722edcd4dfb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.722884 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 7f47e81154eb48fb9e891cfff5250af2 (DEFAULT_TABLE table=default.Table_97de59fa992e4c7097d3114d1b261de7 [id=d8e345fe630b4072820cc8c71189ea50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.723066 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet cbeae97639fd4e6290768dae12f6a4ce with delete_type TABLET_DATA_DELETED (replaced by tablet cc547148aa124907a5e5def6941f734c) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.723800 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62c5a2071dd46dfbde504459508b069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.724011 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f7b878728a495f83b6584f8a6aca67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.724932 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 59a3766053144e6c9ee680f099ff1766 (DEFAULT_TABLE table=default.Table_50ecb5070ca44573941f0c8ab0803f77 [id=d86155eb37074ec3a29fa8b560d0649d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.727092 29377 ts_tablet_manager.cc:1929] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.727229 29377 log.cc:1199] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/16d0360ec78844a1be3d5f51259bbcdf
I20260617 20:16:54.727608 29377 ts_tablet_manager.cc:1950] T 16d0360ec78844a1be3d5f51259bbcdf P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:54.727859 29916 raft_consensus.cc:493] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:54.727988 29916 raft_consensus.cc:515] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.728660 29916 leader_election.cc:290] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:54.729446 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f47e81154eb48fb9e891cfff5250af2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.731307 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ea76ad1ec64d22a64bdd4c97e288c6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:54.733497 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 083b8903abd646dc89717b9d2caf5647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.734562 29957 raft_consensus.cc:493] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:54.734737 29957 raft_consensus.cc:515] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.735401 29957 leader_election.cc:290] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:54.737493 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6435bac04e472c99e81b6e7e9a6012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.739681 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a3766053144e6c9ee680f099ff1766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.743767 28961 tablet_service.cc:1511] Processing CreateTablet for tablet e5396b42681e4a1fbf0df74c86ee810c (DEFAULT_TABLE table=default.Table_53b5071e49a2403a9045e136cfafa85b [id=df45a919527444a5b096737284b70a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.744781 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 081844c92e744d5a870c47437999e895 (DEFAULT_TABLE table=default.Table_15da5b97a103487c96348ca7f22dc3b0 [id=842f3db66d544b8c8ea0a8b58f8ea775]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:54.744971 28925 leader_election.cc:343] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.745116 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6435bac04e472c99e81b6e7e9a6012 (DEFAULT_TABLE table=default.Table_0023728d2dae4d0b9dbecc4370e3127e [id=d84be237c46a4dc58e1c9722935bf5d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.709406 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 59a3766053144e6c9ee680f099ff1766 (DEFAULT_TABLE table=default.Table_50ecb5070ca44573941f0c8ab0803f77 [id=d86155eb37074ec3a29fa8b560d0649d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.712080 29105 tablet_service.cc:1511] Processing CreateTablet for tablet fd226ca6595148638d5036356c50313f (DEFAULT_TABLE table=default.Table_eeda1b309ce24b77967522bd8810c6d8 [id=aaa2d2913e5d438b901d6bd519eaf891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.714378 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 083b8903abd646dc89717b9d2caf5647 (DEFAULT_TABLE table=default.Table_c237cdc555974e0e8a2bc336adf356a6 [id=2b30d550d0e445e882179d01fb066334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.729789 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ea76ad1ec64d22a64bdd4c97e288c6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:54.735930 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0c245563fe44b59d32616bd35d3dae" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:54.746733 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 083b8903abd646dc89717b9d2caf5647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.737607 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 5f6435bac04e472c99e81b6e7e9a6012 (DEFAULT_TABLE table=default.Table_0023728d2dae4d0b9dbecc4370e3127e [id=d84be237c46a4dc58e1c9722935bf5d3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:54.747741 29198 leader_election.cc:343] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.704284 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db24d70cc7643599d7be9158b5a7450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.749223 28960 tablet_service.cc:1511] Processing CreateTablet for tablet f62c5a2071dd46dfbde504459508b069 (DEFAULT_TABLE table=default.Table_489218ed90a3450591befcb0c8064bc7 [id=9f014e9b411e496398d894dc77706d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.749786 28952 tablet_service.cc:1511] Processing CreateTablet for tablet c3496887f6a045e293698d09d9cc1c16 (DEFAULT_TABLE table=default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.750101 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a89e42d091f423bb926f671797141ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.751335 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet cde88371f4454a4bb3053c6cd1afb801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:54.752031 28925 leader_election.cc:343] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.752175 28925 leader_election.cc:304] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:54.752490 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd226ca6595148638d5036356c50313f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.752610 29916 raft_consensus.cc:2749] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:54.757797 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6bf28f4e434da794db9391ca7ad738 (DEFAULT_TABLE table=default.Table_ac91b73059814eb6b58292b2e1558ace [id=e2933414bca44da084411334f63ccfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.758257 29375 tablet_replica.cc:333] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:54.758612 29375 raft_consensus.cc:2243] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:54.759233 29375 raft_consensus.cc:2272] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.760159 29375 ts_tablet_manager.cc:1916] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.761477 29916 raft_consensus.cc:493] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:54.761626 29916 raft_consensus.cc:515] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.762265 29916 leader_election.cc:290] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:54.720288 29376 rpcz_store.cc:276] 0617 20:16:50.991208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.991290 (+ 82us) service_pool.cc:224] Handling call
0617 20:16:54.715465 (+3724175us) ts_tablet_manager.cc:1151] Deleting tablet fc36f62aa0bf46278cb84ec8cb7eef55
0617 20:16:54.715476 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.715615 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3697939}
I20260617 20:16:54.764998 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 364) took 3567 ms. Trace:
I20260617 20:16:54.765441 29094 tablet_service.cc:1511] Processing CreateTablet for tablet f62c5a2071dd46dfbde504459508b069 (DEFAULT_TABLE table=default.Table_489218ed90a3450591befcb0c8064bc7 [id=9f014e9b411e496398d894dc77706d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.765551 29376 rpcz_store.cc:276] 0617 20:16:51.197093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.197144 (+ 51us) service_pool.cc:224] Handling call
0617 20:16:54.764780 (+3567636us) ts_tablet_manager.cc:1151] Deleting tablet 203666e6127b49ed92731bc87ce01798
0617 20:16:54.764788 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.764929 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3457669}
I20260617 20:16:54.765939 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 362) took 3570 ms. Trace:
I20260617 20:16:54.768098 29376 rpcz_store.cc:276] 0617 20:16:51.195737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.199666 (+ 3929us) service_pool.cc:224] Handling call
0617 20:16:54.765796 (+3566130us) ts_tablet_manager.cc:1151] Deleting tablet 370db89a92a6455190edaf80e5a56205
0617 20:16:54.765804 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.765883 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3447645}
I20260617 20:16:54.768823 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 363) took 3572 ms. Trace:
I20260617 20:16:54.769359 29376 rpcz_store.cc:276] 0617 20:16:51.196334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.199878 (+ 3544us) service_pool.cc:224] Handling call
0617 20:16:54.768646 (+3568768us) ts_tablet_manager.cc:1151] Deleting tablet 379ef43e02ec4bbbb03f2d6a53a66403
0617 20:16:54.768655 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.768759 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3450383}
I20260617 20:16:54.769889 29376 tablet_replica.cc:333] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:54.770579 29376 raft_consensus.cc:2243] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.771018 29376 raft_consensus.cc:2272] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.771010 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 7f47e81154eb48fb9e891cfff5250af2 (DEFAULT_TABLE table=default.Table_97de59fa992e4c7097d3114d1b261de7 [id=d8e345fe630b4072820cc8c71189ea50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.771559 29377 tablet_replica.cc:333] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:54.771762 29093 tablet_service.cc:1511] Processing CreateTablet for tablet c3496887f6a045e293698d09d9cc1c16 (DEFAULT_TABLE table=default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.771827 29377 raft_consensus.cc:2243] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.771790 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a89e42d091f423bb926f671797141ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.772003 29377 raft_consensus.cc:2272] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.772051 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet cde88371f4454a4bb3053c6cd1afb801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.772603 29376 ts_tablet_manager.cc:1916] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.773211 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 16d0360ec78844a1be3d5f51259bbcdf (table default.Table_160815abfba040f29bfce92cd08c5e46 [id=a27723f7b3f545288e30fe60ff87669b]) successfully deleted
W20260617 20:16:54.773535 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 14a5e5917a414c99b25ea2efeab4063d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14a5e5917a414c99b25ea2efeab4063d already in progress: creating tablet
W20260617 20:16:54.773739 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 593d9de6a2fb47e18d86649e45ba80b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 593d9de6a2fb47e18d86649e45ba80b9 already in progress: creating tablet
W20260617 20:16:54.773975 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet dee426100bb645f391be123aeb52e412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dee426100bb645f391be123aeb52e412 already in progress: creating tablet
I20260617 20:16:54.774039 29377 ts_tablet_manager.cc:1916] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.782858 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_63aeaed1b2164cacbfd67e0ba8890880" } new_table_name: "default.Table_dbb696fb66174d14a4bc214d64519784" modify_external_catalogs: true
I20260617 20:16:54.783165 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_50ecb5070ca44573941f0c8ab0803f77" } new_table_name: "default.Table_c6631ee4b2694bfaba80e0e44c938698" modify_external_catalogs: true
I20260617 20:16:54.783551 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b2bc5d281977451a9a9ba94e2a6af6d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.783885 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f1bd0e3c31144e44a9480f046b282290" } new_table_name: "default.Table_0f4e43a3060149998dfc5e0ea3ef1fa0" modify_external_catalogs: true
W20260617 20:16:54.784101 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2bc5d281977451a9a9ba94e2a6af6d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.784422 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e6e71aa967a248a3a1c006d77527f64c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.784911 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_59007bd54d0f4bc291fa36712918f213"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.785149 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_31050496cd7e4fcebe468daf037802af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.785454 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59007bd54d0f4bc291fa36712918f213 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.785369 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0d8a074c057147a5a47d1cf13ada48d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.785657 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31050496cd7e4fcebe468daf037802af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:54.785863 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d8a074c057147a5a47d1cf13ada48d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.786864 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_97cc2bb3e3014e8d83c52d378dbde4e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.787312 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97cc2bb3e3014e8d83c52d378dbde4e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:54.784940 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6e71aa967a248a3a1c006d77527f64c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.790854 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e53946c85ab4a8286a6e174cc411c5e" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:54.791699 28925 leader_election.cc:343] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.794670 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62c5a2071dd46dfbde504459508b069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.796370 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f47e81154eb48fb9e891cfff5250af2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.797494 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a3766053144e6c9ee680f099ff1766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.798334 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd226ca6595148638d5036356c50313f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.799094 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 083b8903abd646dc89717b9d2caf5647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.800433 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6435bac04e472c99e81b6e7e9a6012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.801608 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3496887f6a045e293698d09d9cc1c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.803009 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6bf28f4e434da794db9391ca7ad738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.804705 29100 tablet_service.cc:1511] Processing CreateTablet for tablet e5396b42681e4a1fbf0df74c86ee810c (DEFAULT_TABLE table=default.Table_53b5071e49a2403a9045e136cfafa85b [id=df45a919527444a5b096737284b70a5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.806746 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59a3766053144e6c9ee680f099ff1766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.807359 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3496887f6a045e293698d09d9cc1c16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.807791 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62c5a2071dd46dfbde504459508b069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.808203 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f6435bac04e472c99e81b6e7e9a6012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.808660 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5396b42681e4a1fbf0df74c86ee810c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.809455 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f47e81154eb48fb9e891cfff5250af2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.809980 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 081844c92e744d5a870c47437999e895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.810478 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db24d70cc7643599d7be9158b5a7450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.811270 29376 ts_tablet_manager.cc:1929] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.811395 29376 log.cc:1199] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/2d0c245563fe44b59d32616bd35d3dae
I20260617 20:16:54.811738 29376 ts_tablet_manager.cc:1950] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:54.812218 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 360) took 3617 ms. Trace:
I20260617 20:16:54.812328 29376 rpcz_store.cc:276] 0617 20:16:51.194539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.200044 (+ 5505us) service_pool.cc:224] Handling call
0617 20:16:54.769802 (+3569758us) ts_tablet_manager.cc:1151] Deleting tablet 2d0c245563fe44b59d32616bd35d3dae
0617 20:16:54.769810 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.797415 (+ 27605us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.811178 (+ 13763us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.812183 (+ 1005us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3451448}
I20260617 20:16:54.812862 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 361) took 3617 ms. Trace:
I20260617 20:16:54.814014 29376 rpcz_store.cc:276] 0617 20:16:51.195044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.200183 (+ 5139us) service_pool.cc:224] Handling call
0617 20:16:54.812676 (+3612493us) ts_tablet_manager.cc:1151] Deleting tablet 8b6f05ae7d624efba571d059ce2f1c91
0617 20:16:54.812684 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.812825 (+ 141us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3491964}
I20260617 20:16:54.814424 29376 tablet_replica.cc:333] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:54.814728 29376 raft_consensus.cc:2243] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.815042 29376 raft_consensus.cc:2272] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.815932 29376 ts_tablet_manager.cc:1916] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:54.820418 29197 leader_election.cc:343] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 2d0c245563fe44b59d32616bd35d3dae
I20260617 20:16:54.820586 29197 leader_election.cc:304] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:16:54.820819 29197 raft_consensus.cc:2686] T 2d0c245563fe44b59d32616bd35d3dae P a8c0aea0206f44d683ed3b6b18c719f6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:16:54.825186 29377 ts_tablet_manager.cc:1929] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.825382 29377 log.cc:1199] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/b1b3565799894d82a3cc29ab2a19307c
I20260617 20:16:54.832299 29377 ts_tablet_manager.cc:1950] T b1b3565799894d82a3cc29ab2a19307c P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:54.834198 29376 ts_tablet_manager.cc:1929] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:16:54.834421 29376 log.cc:1199] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/9e1dc756edd5473183afc75eef7112d6
I20260617 20:16:54.835438 29376 ts_tablet_manager.cc:1950] T 9e1dc756edd5473183afc75eef7112d6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:54.835697 29377 tablet_replica.cc:333] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:54.835906 29377 raft_consensus.cc:2243] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.836102 29377 raft_consensus.cc:2272] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.836947 29377 ts_tablet_manager.cc:1916] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.836210 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet b1b3565799894d82a3cc29ab2a19307c (table default.Table_2f2534b9a19341bdb7f92a6da5470fea [id=2133bdb470c34a7dbc0508a2d780094b]) successfully deleted
I20260617 20:16:54.845657 29377 ts_tablet_manager.cc:1929] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.845870 29377 log.cc:1199] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/d1654ae96ce041fa9b9b881af7dd342e
I20260617 20:16:54.846386 29377 ts_tablet_manager.cc:1950] T d1654ae96ce041fa9b9b881af7dd342e P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:54.846787 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 371) took 3464 ms. Trace:
I20260617 20:16:54.848734 29376 rpcz_store.cc:276] 0617 20:16:51.382589 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.394265 (+ 11676us) service_pool.cc:224] Handling call
0617 20:16:54.814363 (+3420098us) ts_tablet_manager.cc:1151] Deleting tablet 9e1dc756edd5473183afc75eef7112d6
0617 20:16:54.814372 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.822378 (+ 8006us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.834124 (+ 11746us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.846728 (+ 12604us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3389418}
I20260617 20:16:54.849421 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 411) took 2885 ms. Trace:
I20260617 20:16:54.849574 29376 rpcz_store.cc:276] 0617 20:16:51.964249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.222140 (+257891us) service_pool.cc:224] Handling call
0617 20:16:54.849231 (+2627091us) ts_tablet_manager.cc:1151] Deleting tablet d1654ae96ce041fa9b9b881af7dd342e
0617 20:16:54.849242 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.849372 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2612479}
I20260617 20:16:54.850042 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 409) took 2948 ms. Trace:
I20260617 20:16:54.850179 29376 rpcz_store.cc:276] 0617 20:16:51.901995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.172736 (+270741us) service_pool.cc:224] Handling call
0617 20:16:54.849883 (+2677147us) ts_tablet_manager.cc:1151] Deleting tablet b3278efaad07403ca0a2baecad46d0f1
0617 20:16:54.849892 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.849993 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2609271}
I20260617 20:16:54.850188 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5396b42681e4a1fbf0df74c86ee810c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.850654 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 413) took 2885 ms. Trace:
I20260617 20:16:54.850788 29376 rpcz_store.cc:276] 0617 20:16:51.965585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.239550 (+273965us) service_pool.cc:224] Handling call
0617 20:16:54.850516 (+2610966us) ts_tablet_manager.cc:1151] Deleting tablet f823290351d542179b8bcc683d7acf6a
0617 20:16:54.850526 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.850608 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2565164}
I20260617 20:16:54.851191 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 416) took 2885 ms. Trace:
I20260617 20:16:54.851332 29376 rpcz_store.cc:276] 0617 20:16:51.965904 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.254404 (+288500us) service_pool.cc:224] Handling call
0617 20:16:54.851068 (+2596664us) ts_tablet_manager.cc:1151] Deleting tablet 99a3d9ae347845dfa9357010819ebc58
0617 20:16:54.851076 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.851146 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2565168}
I20260617 20:16:54.851677 29376 tablet_replica.cc:333] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:54.851902 29376 raft_consensus.cc:2243] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.852164 29376 raft_consensus.cc:2272] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.860707 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet d1654ae96ce041fa9b9b881af7dd342e (table default.Table_1d839677a1834e13914e3c77a8f38f01 [id=82e506e43d294d23988395ecdb33cffd]) successfully deleted
W20260617 20:16:54.861053 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5eaddd6519dc490c8358be629b21a2d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eaddd6519dc490c8358be629b21a2d9 already in progress: creating tablet
W20260617 20:16:54.861397 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 4ceb3ae3c1a44442966ad37fbcbc658b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ceb3ae3c1a44442966ad37fbcbc658b already in progress: creating tablet
W20260617 20:16:54.861660 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet cbeae97639fd4e6290768dae12f6a4ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbeae97639fd4e6290768dae12f6a4ce already in progress: creating tablet
W20260617 20:16:54.861917 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 89f7b878728a495f83b6584f8a6aca67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89f7b878728a495f83b6584f8a6aca67 already in progress: creating tablet
W20260617 20:16:54.862484 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 7a89e42d091f423bb926f671797141ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a89e42d091f423bb926f671797141ea already in progress: creating tablet
W20260617 20:16:54.862794 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet cde88371f4454a4bb3053c6cd1afb801 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cde88371f4454a4bb3053c6cd1afb801 already in progress: creating tablet
I20260617 20:16:54.865897 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e53946c85ab4a8286a6e174cc411c5e" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:54.866405 29957 raft_consensus.cc:493] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:16:54.866544 28925 leader_election.cc:343] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.866593 29957 raft_consensus.cc:515] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.866685 28925 leader_election.cc:304] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:54.867076 29916 raft_consensus.cc:2749] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:54.867295 29957 leader_election.cc:290] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:54.868618 29197 leader_election.cc:343] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 4da8b2c2ecd34b56a046ac3b32c0c5f1
I20260617 20:16:54.873848 29376 ts_tablet_manager.cc:1916] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:54.879153 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet fc36f62aa0bf46278cb84ec8cb7eef55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc36f62aa0bf46278cb84ec8cb7eef55 already in progress: creating tablet
W20260617 20:16:54.881235 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 203666e6127b49ed92731bc87ce01798 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 203666e6127b49ed92731bc87ce01798 already in progress: creating tablet
W20260617 20:16:54.882542 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 370db89a92a6455190edaf80e5a56205 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370db89a92a6455190edaf80e5a56205 already in progress: creating tablet
W20260617 20:16:54.883332 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 379ef43e02ec4bbbb03f2d6a53a66403 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 379ef43e02ec4bbbb03f2d6a53a66403 already in progress: creating tablet
I20260617 20:16:54.886936 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 2d0c245563fe44b59d32616bd35d3dae (table default.Table_df31bee3761040b9973aa917f8f1e0a0 [id=aba28f2e637d403fb4225835adef96cd]) successfully deleted
W20260617 20:16:54.887233 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 8b6f05ae7d624efba571d059ce2f1c91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b6f05ae7d624efba571d059ce2f1c91 already in progress: creating tablet
I20260617 20:16:54.888428 29378 tablet_bootstrap.cc:492] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
W20260617 20:16:54.888798 29063 consensus_peers.cc:597] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f85271eeb854194a968215ebc08f47a. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:54.891700 29376 ts_tablet_manager.cc:1929] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:54.891848 29376 log.cc:1199] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/8eee68618cdf462283d7fd9f098c2a0d
I20260617 20:16:54.892501 29376 ts_tablet_manager.cc:1950] T 8eee68618cdf462283d7fd9f098c2a0d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:54.893393 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_7e16fff91c254edc8becd81ac1de334f [id=0ece007078c749e3bd4bab93ada3b311]) successfully deleted
I20260617 20:16:54.893415 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 410) took 2969 ms. Trace:
I20260617 20:16:54.893529 29376 rpcz_store.cc:276] 0617 20:16:51.924142 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.191418 (+267276us) service_pool.cc:224] Handling call
0617 20:16:54.851604 (+2660186us) ts_tablet_manager.cc:1151] Deleting tablet 8eee68618cdf462283d7fd9f098c2a0d
0617 20:16:54.851614 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.877180 (+ 25566us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.884103 (+ 6923us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:54.893376 (+ 9273us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2559183}
I20260617 20:16:54.893986 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 420) took 2450 ms. Trace:
I20260617 20:16:54.894096 29376 rpcz_store.cc:276] 0617 20:16:52.443661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.445584 (+ 1923us) service_pool.cc:224] Handling call
0617 20:16:54.893821 (+2448237us) ts_tablet_manager.cc:1151] Deleting tablet cf8d04ef8acd4fcaa69df9253cd89462
0617 20:16:54.893830 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.893948 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2447976}
I20260617 20:16:54.894490 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 418) took 2451 ms. Trace:
I20260617 20:16:54.894595 29376 rpcz_store.cc:276] 0617 20:16:52.443459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.445924 (+ 2465us) service_pool.cc:224] Handling call
0617 20:16:54.894323 (+2448399us) ts_tablet_manager.cc:1151] Deleting tablet 938b61a0f6dc4d178971034fd18c1674
0617 20:16:54.894332 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.894461 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2448113}
I20260617 20:16:54.894539 29378 ts_tablet_manager.cc:1403] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.372s user 0.007s sys 0.006s
I20260617 20:16:54.894929 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 419) took 2451 ms. Trace:
I20260617 20:16:54.895036 29376 rpcz_store.cc:276] 0617 20:16:52.443556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.446299 (+ 2743us) service_pool.cc:224] Handling call
0617 20:16:54.894806 (+2448507us) ts_tablet_manager.cc:1151] Deleting tablet da50400f49e24ca589519e6ec823957d
0617 20:16:54.894815 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.894885 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2448306}
I20260617 20:16:54.895356 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 417) took 2452 ms. Trace:
I20260617 20:16:54.895459 29376 rpcz_store.cc:276] 0617 20:16:52.443343 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.458723 (+ 15380us) service_pool.cc:224] Handling call
0617 20:16:54.895251 (+2436528us) ts_tablet_manager.cc:1151] Deleting tablet 67a3124306094c72ad78e5473aa35bdb
0617 20:16:54.895259 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.895327 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2436019}
I20260617 20:16:54.882133 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_77adab16d0fe4dc18b86a7a45bcfdad3" } modify_external_catalogs: true
I20260617 20:16:54.895795 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 431) took 2176 ms. Trace:
I20260617 20:16:54.895898 29376 rpcz_store.cc:276] 0617 20:16:52.719163 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.719302 (+ 139us) service_pool.cc:224] Handling call
0617 20:16:54.895687 (+2176385us) ts_tablet_manager.cc:1151] Deleting tablet 4e27c5834baa48ed953fccef54e6c52b
0617 20:16:54.895696 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.895765 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2176148}
I20260617 20:16:54.896260 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 432) took 2176 ms. Trace:
I20260617 20:16:54.896363 29376 rpcz_store.cc:276] 0617 20:16:52.719286 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.719632 (+ 346us) service_pool.cc:224] Handling call
0617 20:16:54.896129 (+2176497us) ts_tablet_manager.cc:1151] Deleting tablet cc8fa9f4c40b4ce9baa27a8837d3575c
0617 20:16:54.896138 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.896231 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2176298}
I20260617 20:16:54.896688 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 430) took 2178 ms. Trace:
I20260617 20:16:54.896795 29376 rpcz_store.cc:276] 0617 20:16:52.718517 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.736942 (+ 18425us) service_pool.cc:224] Handling call
0617 20:16:54.896583 (+2159641us) ts_tablet_manager.cc:1151] Deleting tablet 18440a4a5c254a25b87f8632de9c92b9
0617 20:16:54.896591 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.896661 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2159440}
W20260617 20:16:54.895593 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d1654ae96ce041fa9b9b881af7dd342e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1654ae96ce041fa9b9b881af7dd342e already in progress: creating tablet
I20260617 20:16:54.897130 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 446) took 2078 ms. Trace:
I20260617 20:16:54.897873 29378 raft_consensus.cc:359] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:54.899318 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet b3278efaad07403ca0a2baecad46d0f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3278efaad07403ca0a2baecad46d0f1 already in progress: creating tablet
W20260617 20:16:54.900491 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f823290351d542179b8bcc683d7acf6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f823290351d542179b8bcc683d7acf6a already in progress: creating tablet
W20260617 20:16:54.900993 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 99a3d9ae347845dfa9357010819ebc58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99a3d9ae347845dfa9357010819ebc58 already in progress: creating tablet
I20260617 20:16:54.902643 29378 raft_consensus.cc:385] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:54.903010 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 8eee68618cdf462283d7fd9f098c2a0d (table default.Table_d064dca2cbed4024b9214ed6bccc811e [id=b8a30f476ef24c6b8b533d15499492fd]) successfully deleted
W20260617 20:16:54.904072 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet cf8d04ef8acd4fcaa69df9253cd89462 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf8d04ef8acd4fcaa69df9253cd89462 already in progress: creating tablet
I20260617 20:16:54.897250 29376 rpcz_store.cc:276] 0617 20:16:52.818608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.825572 (+ 6964us) service_pool.cc:224] Handling call
0617 20:16:54.897016 (+2071444us) ts_tablet_manager.cc:1151] Deleting tablet 39ca961cfea54a7187cc7ea8d16a627f
0617 20:16:54.897025 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.897094 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2064867}
I20260617 20:16:54.904672 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 452) took 1335 ms. Trace:
I20260617 20:16:54.904800 29376 rpcz_store.cc:276] 0617 20:16:53.569733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.569781 (+ 48us) service_pool.cc:224] Handling call
0617 20:16:54.904549 (+1334768us) ts_tablet_manager.cc:1151] Deleting tablet d811ca370ee54db8a7e4f6056017cd01
0617 20:16:54.904558 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.904641 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1332829}
I20260617 20:16:54.904929 29957 raft_consensus.cc:493] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:54.905081 29957 raft_consensus.cc:515] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.905177 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 453) took 1324 ms. Trace:
I20260617 20:16:54.905288 29376 rpcz_store.cc:276] 0617 20:16:53.580607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.580658 (+ 51us) service_pool.cc:224] Handling call
0617 20:16:54.905028 (+1324370us) ts_tablet_manager.cc:1151] Deleting tablet 6f15a7c18faa4e36bbb62809bb6e976c
0617 20:16:54.905038 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.905142 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1324051}
I20260617 20:16:54.905781 29957 leader_election.cc:290] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:54.906073 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da8b2c2ecd34b56a046ac3b32c0c5f1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:54.906276 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ba3ad8de250a47da9c9a31dff7f495b5 consensus state has no leader
I20260617 20:16:54.906358 29126 raft_consensus.cc:2468] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:54.906703 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_563b00b87d974ad88a8fba7f9df09d6c" } new_table_name: "default.Table_1fb8413c68b4473abb8ca1748b6a3209" modify_external_catalogs: true
W20260617 20:16:54.907074 29197 leader_election.cc:343] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 57e19abe093a40f6886908a8a3a0cad4
I20260617 20:16:54.895953 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_77adab16d0fe4dc18b86a7a45bcfdad3" } modify_external_catalogs: true
W20260617 20:16:54.909132 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59a3766053144e6c9ee680f099ff1766 consensus state has no leader
I20260617 20:16:54.909601 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_88946ea5179f45118a05f7dddcdd92b0" } new_table_name: "default.Table_7e36e71e8aca4a5e8813c465c31db50a" modify_external_catalogs: true
I20260617 20:16:54.915695 29378 raft_consensus.cc:740] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:54.918560 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_390902ffe43c4f1483476e5da984b628"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.919114 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_390902ffe43c4f1483476e5da984b628 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.919416 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7f36ddd489fc48f8b9ad5920baa0d8cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:54.920040 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f36ddd489fc48f8b9ad5920baa0d8cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.921772 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d26967cbe1c54191941e64021b51c03a" } modify_external_catalogs: true
I20260617 20:16:54.921929 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d26967cbe1c54191941e64021b51c03a" } modify_external_catalogs: true
I20260617 20:16:54.921898 29378 consensus_queue.cc:260] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:54.904822 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 938b61a0f6dc4d178971034fd18c1674 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 938b61a0f6dc4d178971034fd18c1674 already in progress: creating tablet
I20260617 20:16:54.922680 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ca6c225acdee4376bbd9af7f2f727176" } modify_external_catalogs: true
I20260617 20:16:54.922860 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ca6c225acdee4376bbd9af7f2f727176" } modify_external_catalogs: true
I20260617 20:16:54.923022 29378 ts_tablet_manager.cc:1434] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20260617 20:16:54.923343 29378 tablet_bootstrap.cc:492] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:54.923455 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91c99389d24d4a8d8c934f0a9b9c2825 consensus state has no leader
I20260617 20:16:54.924988 29198 leader_election.cc:304] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:54.925347 29957 raft_consensus.cc:2804] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:54.925443 29957 raft_consensus.cc:493] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:54.925554 29957 raft_consensus.cc:3060] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:54.928189 29957 raft_consensus.cc:515] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.928855 29957 leader_election.cc:290] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:54.930393 29197 leader_election.cc:343] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 4da8b2c2ecd34b56a046ac3b32c0c5f1
I20260617 20:16:54.938010 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 6db7d5bf9a254b98b87ad25df1f51b3b (DEFAULT_TABLE table=default.Table_61769387a2da409d86a5ce7c83821992 [id=a5d1a4cb417d4d7ba4d33324672c42a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.938467 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db7d5bf9a254b98b87ad25df1f51b3b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:54.941612 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3180f1336fd841d8b4cf7fdf94015955 consensus state has no leader
W20260617 20:16:54.922703 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet da50400f49e24ca589519e6ec823957d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da50400f49e24ca589519e6ec823957d already in progress: creating tablet
I20260617 20:16:54.942117 28953 tablet_service.cc:1511] Processing CreateTablet for tablet cc547148aa124907a5e5def6941f734c (DEFAULT_TABLE table=default.Table_afafb0c05ae94a57a881021813c028a4 [id=95a0bdbc8666443dbd27f9572c6ecb8c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:54.942207 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 67a3124306094c72ad78e5473aa35bdb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67a3124306094c72ad78e5473aa35bdb already in progress: creating tablet
W20260617 20:16:54.942415 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4e27c5834baa48ed953fccef54e6c52b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e27c5834baa48ed953fccef54e6c52b already in progress: creating tablet
I20260617 20:16:54.942474 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc547148aa124907a5e5def6941f734c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:54.942644 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet cc8fa9f4c40b4ce9baa27a8837d3575c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc8fa9f4c40b4ce9baa27a8837d3575c already in progress: creating tablet
W20260617 20:16:54.942833 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 18440a4a5c254a25b87f8632de9c92b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18440a4a5c254a25b87f8632de9c92b9 already in progress: creating tablet
W20260617 20:16:54.943295 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 39ca961cfea54a7187cc7ea8d16a627f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39ca961cfea54a7187cc7ea8d16a627f already in progress: creating tablet
W20260617 20:16:54.943486 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d811ca370ee54db8a7e4f6056017cd01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d811ca370ee54db8a7e4f6056017cd01 already in progress: creating tablet
I20260617 20:16:54.907079 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 454) took 1312 ms. Trace:
I20260617 20:16:54.943969 29376 rpcz_store.cc:276] 0617 20:16:53.593377 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.593454 (+ 77us) service_pool.cc:224] Handling call
0617 20:16:54.905502 (+1312048us) ts_tablet_manager.cc:1151] Deleting tablet 8a5d9677bc184c30be1a11bfa85a97c8
0617 20:16:54.905511 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.905590 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1282259}
I20260617 20:16:54.945360 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4d23acc051c34ebfb0edb790faec1b2b
W20260617 20:16:54.945825 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 227d8a0d46294108a6b98a1a4b67fd6d consensus state has no leader
I20260617 20:16:54.946427 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 455) took 1205 ms. Trace:
I20260617 20:16:54.946559 29376 rpcz_store.cc:276] 0617 20:16:53.741167 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.741231 (+ 64us) service_pool.cc:224] Handling call
0617 20:16:54.946254 (+1205023us) ts_tablet_manager.cc:1151] Deleting tablet d738ab2f8c784c76947a3a76bd040219
0617 20:16:54.946267 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.946388 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1204742}
I20260617 20:16:54.948071 29378 tablet_bootstrap.cc:654] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:54.948668 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 90ae9c63c8c541bc91ecedd798a7d60f
I20260617 20:16:54.949077 29376 tablet_replica.cc:333] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:54.949579 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4342e29fbc98442ea2e2d25c7aea8853
W20260617 20:16:54.949757 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 6f15a7c18faa4e36bbb62809bb6e976c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f15a7c18faa4e36bbb62809bb6e976c already in progress: creating tablet
W20260617 20:16:54.949986 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 8a5d9677bc184c30be1a11bfa85a97c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a5d9677bc184c30be1a11bfa85a97c8 already in progress: creating tablet
W20260617 20:16:54.950202 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d738ab2f8c784c76947a3a76bd040219 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d738ab2f8c784c76947a3a76bd040219 already in progress: creating tablet
I20260617 20:16:54.950662 29376 raft_consensus.cc:2243] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:54.950989 29376 pending_rounds.cc:70] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:54.951133 29376 pending_rounds.cc:77] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955489028952064 op_type: NO_OP noop_request { }
I20260617 20:16:54.951566 29376 raft_consensus.cc:2889] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:54.952145 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d23acc051c34ebfb0edb790faec1b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.952416 29376 raft_consensus.cc:2272] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.952410 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 70698bb6ff6f4fe0b465f2974fcc24ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.952625 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 90ae9c63c8c541bc91ecedd798a7d60f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.952841 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 4342e29fbc98442ea2e2d25c7aea8853 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:54.953478 29377 tablet_replica.cc:333] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:54.953704 29377 raft_consensus.cc:2243] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:54.953886 29377 raft_consensus.cc:2272] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:54.954311 29383 tablet_bootstrap.cc:492] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
W20260617 20:16:54.954319 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 4d23acc051c34ebfb0edb790faec1b2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d23acc051c34ebfb0edb790faec1b2b already in progress: creating tablet
I20260617 20:16:54.954629 29383 ts_tablet_manager.cc:1403] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.249s user 0.042s sys 0.053s
I20260617 20:16:54.954677 29377 ts_tablet_manager.cc:1916] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:54.955017 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da8b2c2ecd34b56a046ac3b32c0c5f1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:54.955298 29123 raft_consensus.cc:3060] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:54.959872 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e19abe093a40f6886908a8a3a0cad4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:54.961381 29377 ts_tablet_manager.cc:1929] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:54.961401 29123 raft_consensus.cc:2468] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:54.961560 29377 log.cc:1199] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/70698bb6ff6f4fe0b465f2974fcc24ea
I20260617 20:16:54.962002 29377 ts_tablet_manager.cc:1950] T 70698bb6ff6f4fe0b465f2974fcc24ea P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:54.963392 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 70698bb6ff6f4fe0b465f2974fcc24ea (table default.Table_324930e6680749aeb68583d56acef5eb [id=b997135a77454a3b83cbd538427aa2f1]) successfully deleted
W20260617 20:16:54.963866 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 90ae9c63c8c541bc91ecedd798a7d60f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90ae9c63c8c541bc91ecedd798a7d60f already in progress: creating tablet
W20260617 20:16:54.964129 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 4342e29fbc98442ea2e2d25c7aea8853 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4342e29fbc98442ea2e2d25c7aea8853 already in progress: creating tablet
I20260617 20:16:54.966434 29096 tablet_service.cc:1511] Processing CreateTablet for tablet cc547148aa124907a5e5def6941f734c (DEFAULT_TABLE table=default.Table_afafb0c05ae94a57a881021813c028a4 [id=95a0bdbc8666443dbd27f9572c6ecb8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.967190 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc547148aa124907a5e5def6941f734c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.970098 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe from {username='slave'} at 127.0.0.1:60552
W20260617 20:16:54.961129 29198 leader_election.cc:343] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:54.971483 29198 leader_election.cc:304] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:54.971662 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_80443acf939b4eaca45d21a7d9d2fa7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.971824 29957 raft_consensus.cc:2749] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:54.972133 29198 leader_election.cc:304] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
W20260617 20:16:54.972244 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80443acf939b4eaca45d21a7d9d2fa7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.972186 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8caf7f807d004b8b9f981df76b53a90f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:54.965720 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 6db7d5bf9a254b98b87ad25df1f51b3b (DEFAULT_TABLE table=default.Table_61769387a2da409d86a5ce7c83821992 [id=a5d1a4cb417d4d7ba4d33324672c42a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.972458 29957 raft_consensus.cc:2804] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:54.972604 29957 raft_consensus.cc:697] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:54.972899 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db7d5bf9a254b98b87ad25df1f51b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:54.973980 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5ea3587ee60a4b799967af4ad882af8d" } modify_external_catalogs: true
I20260617 20:16:54.974148 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5ea3587ee60a4b799967af4ad882af8d" } modify_external_catalogs: true
I20260617 20:16:54.975368 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet 8a5d9677bc184c30be1a11bfa85a97c8 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:54.966434 29228 tablet_service.cc:1511] Processing CreateTablet for tablet cc547148aa124907a5e5def6941f734c (DEFAULT_TABLE table=default.Table_afafb0c05ae94a57a881021813c028a4 [id=95a0bdbc8666443dbd27f9572c6ecb8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:54.977681 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc547148aa124907a5e5def6941f734c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:54.974146 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8caf7f807d004b8b9f981df76b53a90f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:54.967499 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d23acc051c34ebfb0edb790faec1b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.968389 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 90ae9c63c8c541bc91ecedd798a7d60f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.968894 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 4342e29fbc98442ea2e2d25c7aea8853 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:54.981787 29383 raft_consensus.cc:359] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.982051 29383 raft_consensus.cc:385] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:54.982156 29383 raft_consensus.cc:740] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:54.982581 29383 consensus_queue.cc:260] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:54.982493 29957 consensus_queue.cc:237] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:54.985605 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe
I20260617 20:16:54.986159 28665 catalog_manager.cc:6784] ReplaceTablet: tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe deleted and replaced by tablet 5a20867de1214c0fb4cb8504e8361c5b
I20260617 20:16:54.989773 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_153027e782904859919297102e88af8c" } modify_external_catalogs: true
I20260617 20:16:54.989987 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_153027e782904859919297102e88af8c" } modify_external_catalogs: true
I20260617 20:16:54.991511 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet eba86bae9e91404185d248dfd722a413
I20260617 20:16:54.994686 29383 ts_tablet_manager.cc:1434] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
W20260617 20:16:54.995141 28636 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 54944.9us
I20260617 20:16:54.998116 29383 tablet_bootstrap.cc:492] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.001821 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet b4240e14b48f4a43b7ce9c6512fc7ff2 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:55.002624 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe with delete_type TABLET_DATA_DELETED (replaced by tablet 5a20867de1214c0fb4cb8504e8361c5b) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.003468 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet eba86bae9e91404185d248dfd722a413 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.006783 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet e35d84540ee74348a3222c5b928e002f
I20260617 20:16:55.008327 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet eba86bae9e91404185d248dfd722a413 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.008554 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe with delete_type TABLET_DATA_DELETED (replaced by tablet 5a20867de1214c0fb4cb8504e8361c5b) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.009717 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d23acc051c34ebfb0edb790faec1b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:54.970978 29376 ts_tablet_manager.cc:1916] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.011191 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 6db7d5bf9a254b98b87ad25df1f51b3b (DEFAULT_TABLE table=default.Table_61769387a2da409d86a5ce7c83821992 [id=a5d1a4cb417d4d7ba4d33324672c42a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.011322 29383 tablet_bootstrap.cc:654] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.012650 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6db7d5bf9a254b98b87ad25df1f51b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.013998 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fa15915b0ec44ff8b66920e4c207536 with delete_type TABLET_DATA_DELETED (replaced by tablet d4130f3529ef4adaa4cedf12e53b6895) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.014276 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet e35d84540ee74348a3222c5b928e002f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.014636 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 90ae9c63c8c541bc91ecedd798a7d60f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.015942 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe with delete_type TABLET_DATA_DELETED (replaced by tablet 5a20867de1214c0fb4cb8504e8361c5b) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.016077 29093 tablet_service.cc:1558] Processing DeleteTablet for tablet 4342e29fbc98442ea2e2d25c7aea8853 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.016912 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet eba86bae9e91404185d248dfd722a413 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.017313 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet e35d84540ee74348a3222c5b928e002f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.019678 29376 ts_tablet_manager.cc:1929] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:55.020035 29376 log.cc:1199] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/33e4407aa01642ffb03eba1b220afdba
I20260617 20:16:55.020695 29376 ts_tablet_manager.cc:1950] T 33e4407aa01642ffb03eba1b220afdba P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:55.021828 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 456) took 1280 ms. Trace:
I20260617 20:16:55.022054 29376 rpcz_store.cc:276] 0617 20:16:53.741711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.741762 (+ 51us) service_pool.cc:224] Handling call
0617 20:16:54.949005 (+1207243us) ts_tablet_manager.cc:1151] Deleting tablet 33e4407aa01642ffb03eba1b220afdba
0617 20:16:54.949017 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.014576 (+ 65559us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.019574 (+ 4998us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.021779 (+ 2205us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1207022}
I20260617 20:16:55.022341 29383 tablet_bootstrap.cc:492] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.022611 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 33e4407aa01642ffb03eba1b220afdba (table default.Table_befd7af4f63843d9bf259896e10ce0f5 [id=257569c30deb403b8d3925a0925308be]) successfully deleted
I20260617 20:16:55.022801 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 457) took 1280 ms. Trace:
I20260617 20:16:55.023420 29383 ts_tablet_manager.cc:1403] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.003s
I20260617 20:16:55.023476 29376 rpcz_store.cc:276] 0617 20:16:53.742107 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.742149 (+ 42us) service_pool.cc:224] Handling call
0617 20:16:55.022611 (+1280462us) ts_tablet_manager.cc:1151] Deleting tablet 7e48a4a827d44afca912dc8723be4542
0617 20:16:55.022623 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.022771 (+ 148us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1280293}
I20260617 20:16:55.024380 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet e35d84540ee74348a3222c5b928e002f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:55.025080 29062 consensus_peers.cc:597] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f85271eeb854194a968215ebc08f47a. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:55.026136 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 043f11c4e0d84c6ba4c5b6b6cc9c10db (DEFAULT_TABLE table=default.Table_0d8a074c057147a5a47d1cf13ada48d1 [id=ba513fbd2a834f0994b528a1927fde6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.025854 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 043f11c4e0d84c6ba4c5b6b6cc9c10db (DEFAULT_TABLE table=default.Table_0d8a074c057147a5a47d1cf13ada48d1 [id=ba513fbd2a834f0994b528a1927fde6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.026582 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043f11c4e0d84c6ba4c5b6b6cc9c10db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.026593 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043f11c4e0d84c6ba4c5b6b6cc9c10db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.029017 28967 tablet_service.cc:1511] Processing CreateTablet for tablet a350456a8eb143838de58a05c76c9056 (DEFAULT_TABLE table=default.Table_b2bc5d281977451a9a9ba94e2a6af6d0 [id=60354fedf7204f85ac125d9f920113f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.029501 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a350456a8eb143838de58a05c76c9056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.031606 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 043f11c4e0d84c6ba4c5b6b6cc9c10db (DEFAULT_TABLE table=default.Table_0d8a074c057147a5a47d1cf13ada48d1 [id=ba513fbd2a834f0994b528a1927fde6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.033761 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 043f11c4e0d84c6ba4c5b6b6cc9c10db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:55.033892 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe already in progress: creating tablet
I20260617 20:16:55.034075 29095 tablet_service.cc:1511] Processing CreateTablet for tablet a350456a8eb143838de58a05c76c9056 (DEFAULT_TABLE table=default.Table_b2bc5d281977451a9a9ba94e2a6af6d0 [id=60354fedf7204f85ac125d9f920113f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.034354 29375 ts_tablet_manager.cc:1929] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:55.034446 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a350456a8eb143838de58a05c76c9056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.034489 29375 log.cc:1199] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/2a9e12c91df344ee84a586b7d4a27071
W20260617 20:16:55.034579 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet eba86bae9e91404185d248dfd722a413 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eba86bae9e91404185d248dfd722a413 already in progress: creating tablet
I20260617 20:16:55.034929 29375 ts_tablet_manager.cc:1950] T 2a9e12c91df344ee84a586b7d4a27071 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:16:55.035216 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet e35d84540ee74348a3222c5b928e002f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e35d84540ee74348a3222c5b928e002f already in progress: creating tablet
I20260617 20:16:55.035238 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 343) took 4222 ms. Trace:
I20260617 20:16:55.035354 29375 rpcz_store.cc:276] 0617 20:16:50.813066 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.815569 (+ 2503us) service_pool.cc:224] Handling call
0617 20:16:54.669423 (+3853854us) ts_tablet_manager.cc:1151] Deleting tablet 2a9e12c91df344ee84a586b7d4a27071
0617 20:16:54.669434 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:54.809113 (+139679us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.034267 (+225154us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.035199 (+ 932us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3720815}
I20260617 20:16:55.037122 28963 tablet_service.cc:1511] Processing CreateTablet for tablet debb84d5e57b4bc9ba37b0fab2d6698b (DEFAULT_TABLE table=default.Table_31050496cd7e4fcebe468daf037802af [id=2b41138080f94fd6907df45a5cb21850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.037601 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debb84d5e57b4bc9ba37b0fab2d6698b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.039666 29226 tablet_service.cc:1511] Processing CreateTablet for tablet debb84d5e57b4bc9ba37b0fab2d6698b (DEFAULT_TABLE table=default.Table_31050496cd7e4fcebe468daf037802af [id=2b41138080f94fd6907df45a5cb21850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.040047 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 51182783b1ba499fbd7f06c7e580e8af (DEFAULT_TABLE table=default.Table_3f6418bb5b1044818dab9ca960037e3b [id=c27ec2a6a229457594d26bae2222fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.039364 29228 tablet_service.cc:1511] Processing CreateTablet for tablet a350456a8eb143838de58a05c76c9056 (DEFAULT_TABLE table=default.Table_b2bc5d281977451a9a9ba94e2a6af6d0 [id=60354fedf7204f85ac125d9f920113f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.040270 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 458) took 1290 ms. Trace:
I20260617 20:16:55.040071 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debb84d5e57b4bc9ba37b0fab2d6698b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.040429 29376 rpcz_store.cc:276] 0617 20:16:53.742457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.742500 (+ 43us) service_pool.cc:224] Handling call
0617 20:16:55.033112 (+1290612us) ts_tablet_manager.cc:1151] Deleting tablet 9f9844fab126448895c4c9d4c3c78d76
0617 20:16:55.033121 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.033216 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1290402}
I20260617 20:16:55.042430 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 51182783b1ba499fbd7f06c7e580e8af (DEFAULT_TABLE table=default.Table_3f6418bb5b1044818dab9ca960037e3b [id=c27ec2a6a229457594d26bae2222fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.042943 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51182783b1ba499fbd7f06c7e580e8af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.043030 29375 tablet_replica.cc:333] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:55.043272 29375 raft_consensus.cc:2243] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:55.043637 29375 raft_consensus.cc:2272] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.044253 29375 ts_tablet_manager.cc:1916] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.045511 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51182783b1ba499fbd7f06c7e580e8af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.052726 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 464) took 1250 ms. Trace:
I20260617 20:16:55.052783 29090 tablet_service.cc:1511] Processing CreateTablet for tablet debb84d5e57b4bc9ba37b0fab2d6698b (DEFAULT_TABLE table=default.Table_31050496cd7e4fcebe468daf037802af [id=2b41138080f94fd6907df45a5cb21850]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.052909 29376 rpcz_store.cc:276] 0617 20:16:53.801822 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.817348 (+ 15526us) service_pool.cc:224] Handling call
0617 20:16:55.040895 (+1223547us) ts_tablet_manager.cc:1151] Deleting tablet 08911643f3ca451d80e2471b1b5b2342
0617 20:16:55.052364 (+ 11469us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x61800000ed18. stack: 00007f5f5963e496 00007f5f5963e250 00007f5f586693ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f5f59633f2d 00007f5f59634f9e 00007f5f6d4e91ad 00007f5f6d4681d3 00007f5f695f1e96 00007f5f695f3229 00007f5f69626bb4 00007f5f696075d0 00007f5f6960735d 0000000000aa681c
0617 20:16:55.052575 (+ 211us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.052684 (+ 109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25945344,"tablet-delete.queue_time_us":1223300}
I20260617 20:16:55.053365 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debb84d5e57b4bc9ba37b0fab2d6698b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.053431 29376 tablet_replica.cc:333] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:55.053637 29376 raft_consensus.cc:2243] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:55.053857 29376 pending_rounds.cc:70] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:55.053932 29376 pending_rounds.cc:77] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955489733980160 op_type: NO_OP noop_request { }
I20260617 20:16:55.054034 29376 raft_consensus.cc:2889] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:55.054134 29376 raft_consensus.cc:2272] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.054876 29376 ts_tablet_manager.cc:1916] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.057983 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a350456a8eb143838de58a05c76c9056. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.064484 29375 ts_tablet_manager.cc:1929] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:55.068847 29376 ts_tablet_manager.cc:1929] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:55.068986 29376 log.cc:1199] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/569e339c17764486a65a1c3b43c92adf
W20260617 20:16:55.069694 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 7e48a4a827d44afca912dc8723be4542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e48a4a827d44afca912dc8723be4542 already in progress: creating tablet
W20260617 20:16:55.069947 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 9f9844fab126448895c4c9d4c3c78d76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f9844fab126448895c4c9d4c3c78d76 already in progress: creating tablet
W20260617 20:16:55.070207 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 08911643f3ca451d80e2471b1b5b2342 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08911643f3ca451d80e2471b1b5b2342 already in progress: creating tablet
I20260617 20:16:55.070353 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 768f932c2c6a43589f026a5a4ecbe660 (DEFAULT_TABLE table=default.Table_618ad76b555e4e38a2a0f86b2a755535 [id=a675f66582984b53aaed7fef04f05745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.070793 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 2a9e12c91df344ee84a586b7d4a27071 (table default.Table_2420afe282984f72ab42715fbc33380a [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]) successfully deleted
I20260617 20:16:55.070858 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768f932c2c6a43589f026a5a4ecbe660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.071985 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 768f932c2c6a43589f026a5a4ecbe660 (DEFAULT_TABLE table=default.Table_618ad76b555e4e38a2a0f86b2a755535 [id=a675f66582984b53aaed7fef04f05745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.072382 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768f932c2c6a43589f026a5a4ecbe660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.064553 29379 tablet_bootstrap.cc:492] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.076745 29379 ts_tablet_manager.cc:1403] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.470s user 0.042s sys 0.026s
I20260617 20:16:55.077566 29379 raft_consensus.cc:359] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.077741 29379 raft_consensus.cc:385] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.077817 29379 raft_consensus.cc:740] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.078022 29379 consensus_queue.cc:260] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.078522 29379 ts_tablet_manager.cc:1434] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:55.078821 29379 tablet_bootstrap.cc:492] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.080425 29379 tablet_bootstrap.cc:654] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.080559 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 9af3af6bc87843cfa6cd74e3d5e230f4 (DEFAULT_TABLE table=default.Table_e6e71aa967a248a3a1c006d77527f64c [id=95cd9fa957494d3a99653c28159cf4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.080950 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af3af6bc87843cfa6cd74e3d5e230f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.071854 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 51182783b1ba499fbd7f06c7e580e8af (DEFAULT_TABLE table=default.Table_3f6418bb5b1044818dab9ca960037e3b [id=c27ec2a6a229457594d26bae2222fec1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.084049 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51182783b1ba499fbd7f06c7e580e8af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.091044 29375 log.cc:1199] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/60a43dd885aa4411a4177b67807b0ac4
I20260617 20:16:55.091817 29375 ts_tablet_manager.cc:1950] T 60a43dd885aa4411a4177b67807b0ac4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:55.092876 29376 ts_tablet_manager.cc:1950] T 569e339c17764486a65a1c3b43c92adf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:55.093876 29378 tablet_bootstrap.cc:492] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:55.093945 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 346) took 4277 ms. Trace:
I20260617 20:16:55.094115 29378 ts_tablet_manager.cc:1403] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.171s user 0.001s sys 0.008s
I20260617 20:16:55.094902 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 3df2d190c1234ac3b5950d348ed2c701 (DEFAULT_TABLE table=default.Table_97cc2bb3e3014e8d83c52d378dbde4e3 [id=4c885f17ca3c4328b5e11fec962e8e54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.095007 29378 raft_consensus.cc:359] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.095201 29378 raft_consensus.cc:385] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.095274 29378 raft_consensus.cc:740] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.095338 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df2d190c1234ac3b5950d348ed2c701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.095599 29378 consensus_queue.cc:260] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.097810 29378 ts_tablet_manager.cc:1434] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:55.098330 29378 tablet_bootstrap.cc:492] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:55.099378 28661 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 64bb6d176a4845eca312848ae5104647 (table default.Table_12cb16608a854819a7e0834654f128bb [id=6e89910c5d7a4969a79960d34eff437c]). Expected version 2 got 0
I20260617 20:16:55.095640 29375 rpcz_store.cc:276] 0617 20:16:50.816585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.816630 (+ 45us) service_pool.cc:224] Handling call
0617 20:16:55.042945 (+4226315us) ts_tablet_manager.cc:1151] Deleting tablet 60a43dd885aa4411a4177b67807b0ac4
0617 20:16:55.042953 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.061540 (+ 18587us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.064416 (+ 2876us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.093885 (+ 29469us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4094169}
I20260617 20:16:55.100622 29378 tablet_bootstrap.cc:654] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.101001 29375 tablet_replica.cc:333] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:55.101197 29375 raft_consensus.cc:2243] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.101421 29375 raft_consensus.cc:2272] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.101976 29375 ts_tablet_manager.cc:1916] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.103987 29379 tablet_bootstrap.cc:492] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.104146 29379 ts_tablet_manager.cc:1403] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.002s
I20260617 20:16:55.104813 28661 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 64bb6d176a4845eca312848ae5104647 (table default.Table_12cb16608a854819a7e0834654f128bb [id=6e89910c5d7a4969a79960d34eff437c]). Expected version 2 got 0
I20260617 20:16:55.104897 29379 raft_consensus.cc:359] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.105065 29379 raft_consensus.cc:385] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.105064 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 3df2d190c1234ac3b5950d348ed2c701 (DEFAULT_TABLE table=default.Table_97cc2bb3e3014e8d83c52d378dbde4e3 [id=4c885f17ca3c4328b5e11fec962e8e54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.105145 29379 raft_consensus.cc:740] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.105463 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df2d190c1234ac3b5950d348ed2c701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.105611 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 9af3af6bc87843cfa6cd74e3d5e230f4 (DEFAULT_TABLE table=default.Table_e6e71aa967a248a3a1c006d77527f64c [id=95cd9fa957494d3a99653c28159cf4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.105942 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af3af6bc87843cfa6cd74e3d5e230f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.109449 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e287ba95be7408b8fc75e6f0709d8f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.109778 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet 938b61a0f6dc4d178971034fd18c1674 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:55.109710 29379 consensus_queue.cc:260] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.112890 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 60a43dd885aa4411a4177b67807b0ac4 (table default.Table_fd835dc9ea8f4041b36c069dcac9d69a [id=3a41dd53c3974256877f193219240234]) successfully deleted
I20260617 20:16:55.112869 29955 consensus_queue.cc:1048] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:55.113934 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 3df2d190c1234ac3b5950d348ed2c701 (DEFAULT_TABLE table=default.Table_97cc2bb3e3014e8d83c52d378dbde4e3 [id=4c885f17ca3c4328b5e11fec962e8e54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.114569 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df2d190c1234ac3b5950d348ed2c701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.115958 29379 ts_tablet_manager.cc:1434] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260617 20:16:55.117542 29379 tablet_bootstrap.cc:492] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.124929 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 768f932c2c6a43589f026a5a4ecbe660 (DEFAULT_TABLE table=default.Table_618ad76b555e4e38a2a0f86b2a755535 [id=a675f66582984b53aaed7fef04f05745]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.125840 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 768f932c2c6a43589f026a5a4ecbe660. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.125133 29379 tablet_bootstrap.cc:654] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.129961 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 470) took 1196 ms. Trace:
I20260617 20:16:55.130107 29376 rpcz_store.cc:276] 0617 20:16:53.933927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.933989 (+ 62us) service_pool.cc:224] Handling call
0617 20:16:55.053375 (+1119386us) ts_tablet_manager.cc:1151] Deleting tablet 569e339c17764486a65a1c3b43c92adf
0617 20:16:55.053383 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.065896 (+ 12513us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.068766 (+ 2870us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.129916 (+ 61150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1118597}
I20260617 20:16:55.024461 29383 raft_consensus.cc:359] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.133086 29383 raft_consensus.cc:385] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.133234 29383 raft_consensus.cc:740] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.133551 29383 consensus_queue.cc:260] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.134210 29383 ts_tablet_manager.cc:1434] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.110s user 0.001s sys 0.001s
W20260617 20:16:55.136349 28636 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 52541us
I20260617 20:16:55.137326 29998 consensus_queue.cc:1048] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260617 20:16:55.142773 28661 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet dcd999d88d954e50810cc01b297a27a9 (table default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a]). Expected version 1 got 0
I20260617 20:16:55.143218 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 471) took 1209 ms. Trace:
I20260617 20:16:55.143348 29376 rpcz_store.cc:276] 0617 20:16:53.934062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.934105 (+ 43us) service_pool.cc:224] Handling call
0617 20:16:55.143044 (+1208939us) ts_tablet_manager.cc:1151] Deleting tablet b427ba6320be4f2a929eaf18a56b4309
0617 20:16:55.143057 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.143180 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1204923}
I20260617 20:16:55.143952 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 472) took 1205 ms. Trace:
I20260617 20:16:55.144179 29376 rpcz_store.cc:276] 0617 20:16:53.938071 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.938163 (+ 92us) service_pool.cc:224] Handling call
0617 20:16:55.143799 (+1205636us) ts_tablet_manager.cc:1151] Deleting tablet c2c6d214816540ac90dc9b2ad3cdb89f
0617 20:16:55.143810 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.143906 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1205449}
I20260617 20:16:55.144810 29376 tablet_replica.cc:333] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:55.145139 29376 raft_consensus.cc:2243] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:55.145629 29376 raft_consensus.cc:2272] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.146371 29376 ts_tablet_manager.cc:1916] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.147444 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 9af3af6bc87843cfa6cd74e3d5e230f4 (DEFAULT_TABLE table=default.Table_e6e71aa967a248a3a1c006d77527f64c [id=95cd9fa957494d3a99653c28159cf4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.147857 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af3af6bc87843cfa6cd74e3d5e230f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:55.149370 29062 consensus_peers.cc:597] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86dd216fa0ab46f5bb16e1b7bf1ca4f9. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:55.150838 29383 tablet_bootstrap.cc:492] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.152346 29955 consensus_queue.cc:1048] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:55.153839 29383 tablet_bootstrap.cc:654] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.156196 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 17917ffc3e8f43afb2a8bc413159137c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.158879 29375 ts_tablet_manager.cc:1929] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.160415 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_80443acf939b4eaca45d21a7d9d2fa7f" } new_table_name: "default.Table_33a8edd5534942789db0e5c0b7361654" modify_external_catalogs: true
I20260617 20:16:55.160933 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_97de59fa992e4c7097d3114d1b261de7" } new_table_name: "default.Table_64af2fec232e48e8bfd3193d063c6d1d" modify_external_catalogs: true
I20260617 20:16:55.162511 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2bb5f77d341647ff9184094cb26eb790"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:55.162600 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9125c594bb904c249d84dd3b53caa011"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.163075 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bb5f77d341647ff9184094cb26eb790 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.163367 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_be5429b8220b4c0abce2d16b0dea29a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.163898 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be5429b8220b4c0abce2d16b0dea29a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.165055 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_10a2068f0dcf4304897997f6f319612a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:55.163089 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 569e339c17764486a65a1c3b43c92adf (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]) successfully deleted
W20260617 20:16:55.165529 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10a2068f0dcf4304897997f6f319612a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:55.165637 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet c2c6d214816540ac90dc9b2ad3cdb89f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2c6d214816540ac90dc9b2ad3cdb89f already in progress: creating tablet
I20260617 20:16:55.166952 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_31d6e6d29ea341a9939708a6ca1ba7ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.167418 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31d6e6d29ea341a9939708a6ca1ba7ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.168355 29375 log.cc:1199] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/cc945cdd482f4a5593d4874e5303ecd2
I20260617 20:16:55.168771 29375 ts_tablet_manager.cc:1950] T cc945cdd482f4a5593d4874e5303ecd2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:55.167934 29379 tablet_bootstrap.cc:492] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.169510 29379 ts_tablet_manager.cc:1403] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.003s
W20260617 20:16:55.163095 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9125c594bb904c249d84dd3b53caa011 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.171345 29379 raft_consensus.cc:359] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.172160 29379 raft_consensus.cc:385] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.172426 29379 raft_consensus.cc:740] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.171911 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 349) took 4337 ms. Trace:
I20260617 20:16:55.172933 29375 rpcz_store.cc:276] 0617 20:16:50.834188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.834235 (+ 47us) service_pool.cc:224] Handling call
0617 20:16:55.100915 (+4266680us) ts_tablet_manager.cc:1151] Deleting tablet cc945cdd482f4a5593d4874e5303ecd2
0617 20:16:55.100926 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.123350 (+ 22424us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.158789 (+ 35439us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.171873 (+ 13084us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4149614}
I20260617 20:16:55.175748 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_dee4e7a09180402da49e21d594f587a8" } new_table_name: "default.Table_465945c266b94889a143be020e08081e" modify_external_catalogs: true
I20260617 20:16:55.176985 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e35e0d6dd4344daa9725abfc5e70192b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.177500 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e35e0d6dd4344daa9725abfc5e70192b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.178269 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 359) took 4190 ms. Trace:
I20260617 20:16:55.178371 29375 rpcz_store.cc:276] 0617 20:16:50.988189 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:50.988250 (+ 61us) service_pool.cc:224] Handling call
0617 20:16:55.178094 (+4189844us) ts_tablet_manager.cc:1151] Deleting tablet fc36f62aa0bf46278cb84ec8cb7eef55
0617 20:16:55.178107 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.178236 (+ 129us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4187819}
I20260617 20:16:55.178539 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9511f5b57e564dab852577b8b6dd172a" } new_table_name: "default.Table_f805dba72b97480f827f702d8de0ae6b" modify_external_catalogs: true
I20260617 20:16:55.178789 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 361) took 3915 ms. Trace:
I20260617 20:16:55.178889 29375 rpcz_store.cc:276] 0617 20:16:51.263315 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.263378 (+ 63us) service_pool.cc:224] Handling call
0617 20:16:55.178622 (+3915244us) ts_tablet_manager.cc:1151] Deleting tablet 2d0c245563fe44b59d32616bd35d3dae
0617 20:16:55.178631 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.178739 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3913766}
I20260617 20:16:55.179265 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 365) took 3912 ms. Trace:
I20260617 20:16:55.179431 29375 rpcz_store.cc:276] 0617 20:16:51.266539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.266680 (+ 141us) service_pool.cc:224] Handling call
0617 20:16:55.179134 (+3912454us) ts_tablet_manager.cc:1151] Deleting tablet 203666e6127b49ed92731bc87ce01798
0617 20:16:55.179154 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.179229 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3900453}
I20260617 20:16:55.179822 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 363) took 3913 ms. Trace:
I20260617 20:16:55.179924 29375 rpcz_store.cc:276] 0617 20:16:51.266291 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.266701 (+ 410us) service_pool.cc:224] Handling call
0617 20:16:55.179675 (+3912974us) ts_tablet_manager.cc:1151] Deleting tablet 370db89a92a6455190edaf80e5a56205
0617 20:16:55.179684 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.179794 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3900974}
I20260617 20:16:55.180433 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 364) took 3914 ms. Trace:
I20260617 20:16:55.180583 29375 rpcz_store.cc:276] 0617 20:16:51.266414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.266650 (+ 236us) service_pool.cc:224] Handling call
0617 20:16:55.180218 (+3913568us) ts_tablet_manager.cc:1151] Deleting tablet 379ef43e02ec4bbbb03f2d6a53a66403
0617 20:16:55.180226 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.180376 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3899668}
I20260617 20:16:55.181093 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 362) took 3917 ms. Trace:
I20260617 20:16:55.177577 29379 consensus_queue.cc:260] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.181214 29375 rpcz_store.cc:276] 0617 20:16:51.263437 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.272165 (+ 8728us) service_pool.cc:224] Handling call
0617 20:16:55.180941 (+3908776us) ts_tablet_manager.cc:1151] Deleting tablet 8b6f05ae7d624efba571d059ce2f1c91
0617 20:16:55.180949 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.181036 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3882325}
I20260617 20:16:55.186712 29375 tablet_replica.cc:333] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:55.190357 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet cc945cdd482f4a5593d4874e5303ecd2 (table default.Table_1d8cf3e5102141cc9d4f9c93d77d385e [id=1222eab9683a43c681e8147c9ff67987]) successfully deleted
I20260617 20:16:55.188005 29379 ts_tablet_manager.cc:1434] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260617 20:16:55.193485 29375 raft_consensus.cc:2243] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 20:16:55.193527 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet fc36f62aa0bf46278cb84ec8cb7eef55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc36f62aa0bf46278cb84ec8cb7eef55 already in progress: creating tablet
I20260617 20:16:55.193738 29375 raft_consensus.cc:2272] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:55.194159 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 2d0c245563fe44b59d32616bd35d3dae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d0c245563fe44b59d32616bd35d3dae already in progress: creating tablet
W20260617 20:16:55.194464 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 203666e6127b49ed92731bc87ce01798 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 203666e6127b49ed92731bc87ce01798 already in progress: creating tablet
W20260617 20:16:55.194752 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 370db89a92a6455190edaf80e5a56205 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 370db89a92a6455190edaf80e5a56205 already in progress: creating tablet
I20260617 20:16:55.194841 29375 ts_tablet_manager.cc:1916] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:55.195016 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 379ef43e02ec4bbbb03f2d6a53a66403 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 379ef43e02ec4bbbb03f2d6a53a66403 already in progress: creating tablet
W20260617 20:16:55.195283 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 8b6f05ae7d624efba571d059ce2f1c91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b6f05ae7d624efba571d059ce2f1c91 already in progress: creating tablet
W20260617 20:16:55.195583 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4fa767d4abdb49e2acdc4f6af75d35e4 has no consensus state
W20260617 20:16:55.196481 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f47e81154eb48fb9e891cfff5250af2 consensus state has no leader
I20260617 20:16:55.203325 29376 ts_tablet_manager.cc:1929] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:55.202391 29379 tablet_bootstrap.cc:492] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.206799 29379 tablet_bootstrap.cc:654] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.212587 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 35d04a55d6524131b29aef7c6795fbf9 (DEFAULT_TABLE table=default.Table_8caf7f807d004b8b9f981df76b53a90f [id=5b8a7c9b972345b4ad60d664e3dfd9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.213340 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d04a55d6524131b29aef7c6795fbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.217079 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_66a0a3f036494df49e2add5e3fd4b44b" } new_table_name: "default.Table_fb5094632cbf4d34a3d5dee9d133483a" modify_external_catalogs: true
I20260617 20:16:55.221818 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 57e19abe093a40f6886908a8a3a0cad4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.222827 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_68e64a71a5ff47cba43d8fb5589e1d19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.223421 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68e64a71a5ff47cba43d8fb5589e1d19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.225435 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_19d4b3eff37e4ff380a1c64661e07166" } modify_external_catalogs: true
I20260617 20:16:55.225667 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_19d4b3eff37e4ff380a1c64661e07166" } modify_external_catalogs: true
I20260617 20:16:55.230851 29916 raft_consensus.cc:493] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.231022 29916 raft_consensus.cc:515] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.231644 29916 leader_election.cc:290] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:55.232410 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bb6d176a4845eca312848ae5104647" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:55.233062 28925 leader_election.cc:343] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:55.234388 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bb6d176a4845eca312848ae5104647" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:55.237838 28925 leader_election.cc:343] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:55.237924 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a445cef5739e4885982b17bdd98216da" } modify_external_catalogs: true
I20260617 20:16:55.238018 28925 leader_election.cc:304] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:55.238104 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a445cef5739e4885982b17bdd98216da" } modify_external_catalogs: true
I20260617 20:16:55.238687 29916 raft_consensus.cc:2749] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:55.241806 29376 log.cc:1199] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/dd4f190a1005433ebcfbfe3a86aa9e70
I20260617 20:16:55.242288 29376 ts_tablet_manager.cc:1950] T dd4f190a1005433ebcfbfe3a86aa9e70 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:55.243172 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 473) took 1304 ms. Trace:
I20260617 20:16:55.243278 29376 rpcz_store.cc:276] 0617 20:16:53.938217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.938375 (+ 158us) service_pool.cc:224] Handling call
0617 20:16:55.144726 (+1206351us) ts_tablet_manager.cc:1151] Deleting tablet dd4f190a1005433ebcfbfe3a86aa9e70
0617 20:16:55.144739 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.181941 (+ 37202us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.203243 (+ 21302us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.243120 (+ 39877us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1206195}
I20260617 20:16:55.243774 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet dd4f190a1005433ebcfbfe3a86aa9e70 (table default.Table_07f654ca505c4bc5bc80b432a51acaa8 [id=556d100af09b4115bb4acc3f5f4dfade]) successfully deleted
I20260617 20:16:55.252533 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_230ee4baedc44720869f17501e15a05e" } modify_external_catalogs: true
I20260617 20:16:55.252730 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_230ee4baedc44720869f17501e15a05e" } modify_external_catalogs: true
I20260617 20:16:55.257611 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 469) took 1323 ms. Trace:
I20260617 20:16:55.257797 29376 rpcz_store.cc:276] 0617 20:16:53.933801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.934285 (+ 484us) service_pool.cc:224] Handling call
0617 20:16:55.257413 (+1323128us) ts_tablet_manager.cc:1151] Deleting tablet 5df6af49cb484f59ad1f32235753e1db
0617 20:16:55.257424 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.257552 (+ 128us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1233754}
W20260617 20:16:55.258389 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5df6af49cb484f59ad1f32235753e1db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5df6af49cb484f59ad1f32235753e1db already in progress: creating tablet
I20260617 20:16:55.258504 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet b3278efaad07403ca0a2baecad46d0f1 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:55.259119 29376 tablet_replica.cc:333] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:55.259323 29376 raft_consensus.cc:2243] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.259552 29376 raft_consensus.cc:2272] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.260226 29383 tablet_bootstrap.cc:492] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.260483 29383 ts_tablet_manager.cc:1403] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.126s user 0.000s sys 0.008s
I20260617 20:16:55.260478 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_98c28a595ada4fc4b45db63ce655aa58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.261046 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98c28a595ada4fc4b45db63ce655aa58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.261313 29383 raft_consensus.cc:359] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.261566 29383 raft_consensus.cc:385] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.261665 29383 raft_consensus.cc:740] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.262243 29383 consensus_queue.cc:260] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.266094 29383 ts_tablet_manager.cc:1434] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260617 20:16:55.268991 29383 tablet_bootstrap.cc:492] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.270341 29375 ts_tablet_manager.cc:1929] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
W20260617 20:16:55.271025 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ead0291870a443d9b76ea919a45a4303 consensus state has no leader
I20260617 20:16:55.271159 29383 tablet_bootstrap.cc:654] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.272212 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 35d04a55d6524131b29aef7c6795fbf9 (DEFAULT_TABLE table=default.Table_8caf7f807d004b8b9f981df76b53a90f [id=5b8a7c9b972345b4ad60d664e3dfd9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.272655 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d04a55d6524131b29aef7c6795fbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.272589 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2ecc0415958749d2b7138a545e9b28c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.273084 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ecc0415958749d2b7138a545e9b28c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.273247 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 17917ffc3e8f43afb2a8bc413159137c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.275215 29376 ts_tablet_manager.cc:1916] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.275473 29375 log.cc:1199] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/9e1dc756edd5473183afc75eef7112d6
I20260617 20:16:55.281448 29226 tablet_service.cc:1511] Processing CreateTablet for tablet f384b65e9c324aa0953324c33d9a3d72 (DEFAULT_TABLE table=default.Table_7f36ddd489fc48f8b9ad5920baa0d8cb [id=93862a2d6edb4810bd079433287be030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.281906 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f384b65e9c324aa0953324c33d9a3d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.286784 29383 tablet_bootstrap.cc:492] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.286994 29383 ts_tablet_manager.cc:1403] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260617 20:16:55.287839 29383 raft_consensus.cc:359] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.288089 29383 raft_consensus.cc:385] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.286651 28955 tablet_service.cc:1511] Processing CreateTablet for tablet f384b65e9c324aa0953324c33d9a3d72 (DEFAULT_TABLE table=default.Table_7f36ddd489fc48f8b9ad5920baa0d8cb [id=93862a2d6edb4810bd079433287be030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.288450 29383 raft_consensus.cc:740] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.288652 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f384b65e9c324aa0953324c33d9a3d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.288789 29383 consensus_queue.cc:260] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.289067 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e6908a670d534e828a0770f48cace3db" } modify_external_catalogs: true
I20260617 20:16:55.289275 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e6908a670d534e828a0770f48cace3db" } modify_external_catalogs: true
I20260617 20:16:55.291344 29383 ts_tablet_manager.cc:1434] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:55.291689 29383 tablet_bootstrap.cc:492] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:55.292497 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c3014c93d6804f3896f452f041cbedc9 consensus state has no leader
I20260617 20:16:55.293582 29383 tablet_bootstrap.cc:654] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.295317 28668 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet e7f822e3f4ca4946a116ee172e83628b (table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]). Expected version 1 got 0
I20260617 20:16:55.296592 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 4b94d8148cf74a899c3d025f22541bd9 (DEFAULT_TABLE table=default.Table_390902ffe43c4f1483476e5da984b628 [id=a9180d2eeb4142f1a96d4841d0a73b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.296939 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b94d8148cf74a899c3d025f22541bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.304244 29378 tablet_bootstrap.cc:492] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:55.304395 29378 ts_tablet_manager.cc:1403] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.206s user 0.006s sys 0.001s
I20260617 20:16:55.280663 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 35d04a55d6524131b29aef7c6795fbf9 (DEFAULT_TABLE table=default.Table_8caf7f807d004b8b9f981df76b53a90f [id=5b8a7c9b972345b4ad60d664e3dfd9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.305713 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d04a55d6524131b29aef7c6795fbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.305804 29375 ts_tablet_manager.cc:1950] T 9e1dc756edd5473183afc75eef7112d6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:55.305853 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 4b94d8148cf74a899c3d025f22541bd9 (DEFAULT_TABLE table=default.Table_390902ffe43c4f1483476e5da984b628 [id=a9180d2eeb4142f1a96d4841d0a73b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.306222 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 372) took 3837 ms. Trace:
I20260617 20:16:55.306274 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b94d8148cf74a899c3d025f22541bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.306321 29375 rpcz_store.cc:276] 0617 20:16:51.468744 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:51.470044 (+ 1300us) service_pool.cc:224] Handling call
0617 20:16:55.186109 (+3716065us) ts_tablet_manager.cc:1151] Deleting tablet 9e1dc756edd5473183afc75eef7112d6
0617 20:16:55.186646 (+ 537us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.254733 (+ 68087us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.270257 (+ 15524us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.306154 (+ 35897us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3699438}
I20260617 20:16:55.306721 29375 tablet_replica.cc:333] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:55.306917 29375 raft_consensus.cc:2243] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.307111 29375 raft_consensus.cc:2272] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.307691 29375 ts_tablet_manager.cc:1916] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.288655 29102 tablet_service.cc:1511] Processing CreateTablet for tablet f384b65e9c324aa0953324c33d9a3d72 (DEFAULT_TABLE table=default.Table_7f36ddd489fc48f8b9ad5920baa0d8cb [id=93862a2d6edb4810bd079433287be030]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.309659 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f384b65e9c324aa0953324c33d9a3d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.309600 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 9e1dc756edd5473183afc75eef7112d6 (table default.Table_7e16fff91c254edc8becd81ac1de334f [id=0ece007078c749e3bd4bab93ada3b311]) successfully deleted
I20260617 20:16:55.305202 29378 raft_consensus.cc:359] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.310606 29378 raft_consensus.cc:385] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.310750 29378 raft_consensus.cc:740] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.310696 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5c012c3bc3674a6a84abd599c0b09e5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:55.311082 29378 consensus_queue.cc:260] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:55.311250 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c012c3bc3674a6a84abd599c0b09e5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.311610 29378 ts_tablet_manager.cc:1434] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 20:16:55.312081 29378 tablet_bootstrap.cc:492] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:55.315066 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 086bd3079e8f4a6d85ccc681a38a47b0 consensus state has no leader
I20260617 20:16:55.319149 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet e7f822e3f4ca4946a116ee172e83628b (table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]). Expected version 1 got 0
I20260617 20:16:55.320003 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_77d3422ed47c4d68ae6f518500ea89b1" } modify_external_catalogs: true
I20260617 20:16:55.320189 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_77d3422ed47c4d68ae6f518500ea89b1" } modify_external_catalogs: true
I20260617 20:16:55.320801 29378 tablet_bootstrap.cc:654] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.321031 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 4b94d8148cf74a899c3d025f22541bd9 (DEFAULT_TABLE table=default.Table_390902ffe43c4f1483476e5da984b628 [id=a9180d2eeb4142f1a96d4841d0a73b5e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.321540 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b94d8148cf74a899c3d025f22541bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.321832 29376 ts_tablet_manager.cc:1929] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:55.322451 29376 log.cc:1199] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/86dd216fa0ab46f5bb16e1b7bf1ca4f9
I20260617 20:16:55.322966 29376 ts_tablet_manager.cc:1950] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:55.323791 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 478) took 1086 ms. Trace:
I20260617 20:16:55.324353 29376 rpcz_store.cc:276] 0617 20:16:54.237650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.238065 (+ 415us) service_pool.cc:224] Handling call
0617 20:16:55.259040 (+1020975us) ts_tablet_manager.cc:1151] Deleting tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9
0617 20:16:55.259049 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.278418 (+ 19369us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.314248 (+ 35830us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.323749 (+ 9501us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":988997}
I20260617 20:16:55.330086 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa767d4abdb49e2acdc4f6af75d35e4 (DEFAULT_TABLE table=default.Table_33a8edd5534942789db0e5c0b7361654 [id=db00d9615d1b48ceb5cf02f8de509878]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.330505 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa767d4abdb49e2acdc4f6af75d35e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.330540 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa767d4abdb49e2acdc4f6af75d35e4 (DEFAULT_TABLE table=default.Table_33a8edd5534942789db0e5c0b7361654 [id=db00d9615d1b48ceb5cf02f8de509878]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.330924 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa767d4abdb49e2acdc4f6af75d35e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.334271 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet 379ef43e02ec4bbbb03f2d6a53a66403 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:55.337792 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 494) took 1039 ms. Trace:
I20260617 20:16:55.337939 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 (table default.Table_baac68c808f240b481611d52f21d428e [id=e6d0b31f8a8c40e8a9c5bf4ee11ea293]) successfully deleted
I20260617 20:16:55.337921 29376 rpcz_store.cc:276] 0617 20:16:54.298702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.298756 (+ 54us) service_pool.cc:224] Handling call
0617 20:16:55.337618 (+1038862us) ts_tablet_manager.cc:1151] Deleting tablet 4d281eec19b34aaa8729d8891547b8e4
0617 20:16:55.337630 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.337750 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1038369}
I20260617 20:16:55.338279 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 493) took 1039 ms. Trace:
W20260617 20:16:55.338408 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4d281eec19b34aaa8729d8891547b8e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d281eec19b34aaa8729d8891547b8e4 already in progress: creating tablet
I20260617 20:16:55.338379 29376 rpcz_store.cc:276] 0617 20:16:54.298600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.311672 (+ 13072us) service_pool.cc:224] Handling call
0617 20:16:55.338165 (+1026493us) ts_tablet_manager.cc:1151] Deleting tablet c4b2d190dda24f0e800b6f75bc165a57
0617 20:16:55.338174 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.338252 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1026312}
I20260617 20:16:55.338646 29376 tablet_replica.cc:333] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:55.338842 29376 raft_consensus.cc:2243] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:55.339074 29376 pending_rounds.cc:70] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:55.339140 29376 pending_rounds.cc:77] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955491779649536 op_type: NO_OP noop_request { }
I20260617 20:16:55.339185 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet d811ca370ee54db8a7e4f6056017cd01 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:55.339246 29376 raft_consensus.cc:2889] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:55.339349 29376 raft_consensus.cc:2272] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:55.339789 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet c4b2d190dda24f0e800b6f75bc165a57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4b2d190dda24f0e800b6f75bc165a57 already in progress: creating tablet
I20260617 20:16:55.340090 29378 tablet_bootstrap.cc:492] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:55.340955 29379 tablet_bootstrap.cc:492] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.341126 29379 ts_tablet_manager.cc:1403] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.140s user 0.003s sys 0.003s
I20260617 20:16:55.342023 29379 raft_consensus.cc:359] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.342232 29379 raft_consensus.cc:385] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.342327 29379 raft_consensus.cc:740] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.342566 29379 consensus_queue.cc:260] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.342696 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 5a20867de1214c0fb4cb8504e8361c5b (DEFAULT_TABLE table=default.Table_82cae984e6c341f18a7f783102a490f8 [id=c0e83fb2a91448d7937ba0ba68a48fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.343039 29379 ts_tablet_manager.cc:1434] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:55.343094 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a20867de1214c0fb4cb8504e8361c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.343374 29379 tablet_bootstrap.cc:492] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.340263 29378 ts_tablet_manager.cc:1403] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.002s
I20260617 20:16:55.342525 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 5a20867de1214c0fb4cb8504e8361c5b (DEFAULT_TABLE table=default.Table_82cae984e6c341f18a7f783102a490f8 [id=c0e83fb2a91448d7937ba0ba68a48fba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.346336 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a20867de1214c0fb4cb8504e8361c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.346619 29378 raft_consensus.cc:359] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.346827 29378 raft_consensus.cc:385] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.347289 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 85633d391613474db52dd2f86210a659
I20260617 20:16:55.348181 29378 raft_consensus.cc:740] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.348471 29378 consensus_queue.cc:260] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.349026 29378 ts_tablet_manager.cc:1434] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:55.349344 29378 tablet_bootstrap.cc:492] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:55.349285 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 85633d391613474db52dd2f86210a659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.349947 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 85633d391613474db52dd2f86210a659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.350962 29378 tablet_bootstrap.cc:654] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.353492 28670 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet dcd999d88d954e50810cc01b297a27a9 (table default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a]). Expected version 1 got 0
I20260617 20:16:55.353873 29379 tablet_bootstrap.cc:654] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.357268 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet 85633d391613474db52dd2f86210a659 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:55.359143 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 85633d391613474db52dd2f86210a659 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85633d391613474db52dd2f86210a659 already in progress: creating tablet
I20260617 20:16:55.360519 29998 raft_consensus.cc:493] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.361200 29998 raft_consensus.cc:515] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.362079 29998 leader_election.cc:290] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.362833 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 5a20867de1214c0fb4cb8504e8361c5b (DEFAULT_TABLE table=default.Table_82cae984e6c341f18a7f783102a490f8 [id=c0e83fb2a91448d7937ba0ba68a48fba]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:55.363157 29062 leader_election.cc:343] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1fa15915b0ec44ff8b66920e4c207536
I20260617 20:16:55.363294 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a20867de1214c0fb4cb8504e8361c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.363767 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa15915b0ec44ff8b66920e4c207536" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:55.363972 29263 raft_consensus.cc:2468] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:55.364488 29063 leader_election.cc:304] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:55.365018 29998 raft_consensus.cc:2804] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:55.365128 29998 raft_consensus.cc:493] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:55.365648 29998 raft_consensus.cc:3060] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.367933 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet adbc3219639748d9a0d71d45ae22ab36 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:55.372777 29375 ts_tablet_manager.cc:1929] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.372906 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 3e11c8b69b704e959e4463f565bf89ab (DEFAULT_TABLE table=default.Table_59007bd54d0f4bc291fa36712918f213 [id=455c5f742dc74ef2961710fe2656e613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.373350 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e11c8b69b704e959e4463f565bf89ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.370849 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa767d4abdb49e2acdc4f6af75d35e4 (DEFAULT_TABLE table=default.Table_33a8edd5534942789db0e5c0b7361654 [id=db00d9615d1b48ceb5cf02f8de509878]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.378547 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa767d4abdb49e2acdc4f6af75d35e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.375542 29998 raft_consensus.cc:515] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.377831 29859 raft_consensus.cc:493] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.381508 29859 raft_consensus.cc:515] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.382154 29859 leader_election.cc:290] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:55.383138 29062 leader_election.cc:343] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 17917ffc3e8f43afb2a8bc413159137c
I20260617 20:16:55.383356 29998 leader_election.cc:290] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:55.383678 29062 leader_election.cc:343] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1fa15915b0ec44ff8b66920e4c207536
I20260617 20:16:55.384708 29375 log.cc:1199] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/808c455e74e645aa8e2b0d08ca81d4f9
I20260617 20:16:55.385195 29375 ts_tablet_manager.cc:1950] T 808c455e74e645aa8e2b0d08ca81d4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:55.385588 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 396) took 3831 ms. Trace:
I20260617 20:16:55.385746 29375 rpcz_store.cc:276] 0617 20:16:51.554458 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.104518 (+550060us) service_pool.cc:224] Handling call
0617 20:16:55.306619 (+3202101us) ts_tablet_manager.cc:1151] Deleting tablet 808c455e74e645aa8e2b0d08ca81d4f9
0617 20:16:55.306628 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.332991 (+ 26363us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.372696 (+ 39705us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.385558 (+ 12862us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3201845}
I20260617 20:16:55.386328 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 808c455e74e645aa8e2b0d08ca81d4f9 (table default.Table_0ba339c37163434e8c628ef515624fe1 [id=8696ed2b09fd4e06a0f2746537370766]) successfully deleted
I20260617 20:16:55.386727 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5b65814c56424256b53d3c9f94c1b74a
I20260617 20:16:55.386765 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 412) took 3551 ms. Trace:
I20260617 20:16:55.387784 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b65814c56424256b53d3c9f94c1b74a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.388103 29377 tablet_replica.cc:333] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:55.388276 29377 raft_consensus.cc:2243] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.388458 29377 raft_consensus.cc:2272] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.386864 29375 rpcz_store.cc:276] 0617 20:16:51.835734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.590165 (+754431us) service_pool.cc:224] Handling call
0617 20:16:55.386625 (+2796460us) ts_tablet_manager.cc:1151] Deleting tablet d1654ae96ce041fa9b9b881af7dd342e
0617 20:16:55.386634 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.386733 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2796017}
W20260617 20:16:55.388981 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d1654ae96ce041fa9b9b881af7dd342e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d1654ae96ce041fa9b9b881af7dd342e already in progress: creating tablet
I20260617 20:16:55.388237 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b65814c56424256b53d3c9f94c1b74a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.389478 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 413) took 3550 ms. Trace:
I20260617 20:16:55.389590 29375 rpcz_store.cc:276] 0617 20:16:51.839381 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.590634 (+751253us) service_pool.cc:224] Handling call
0617 20:16:55.389347 (+2798713us) ts_tablet_manager.cc:1151] Deleting tablet f823290351d542179b8bcc683d7acf6a
0617 20:16:55.389356 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.389437 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2796680}
W20260617 20:16:55.390030 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet f823290351d542179b8bcc683d7acf6a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f823290351d542179b8bcc683d7acf6a already in progress: creating tablet
I20260617 20:16:55.390059 29377 ts_tablet_manager.cc:1916] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.390872 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 415) took 3521 ms. Trace:
I20260617 20:16:55.391285 29375 rpcz_store.cc:276] 0617 20:16:51.870340 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.592686 (+722346us) service_pool.cc:224] Handling call
0617 20:16:55.390758 (+2798072us) ts_tablet_manager.cc:1151] Deleting tablet 99a3d9ae347845dfa9357010819ebc58
0617 20:16:55.390766 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.390842 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2797315}
W20260617 20:16:55.391950 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 99a3d9ae347845dfa9357010819ebc58 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 99a3d9ae347845dfa9357010819ebc58 already in progress: creating tablet
I20260617 20:16:55.392378 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 411) took 3557 ms. Trace:
I20260617 20:16:55.382056 29383 tablet_bootstrap.cc:492] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.384292 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fa15915b0ec44ff8b66920e4c207536" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:55.392784 29259 raft_consensus.cc:3060] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.392814 29383 ts_tablet_manager.cc:1403] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.101s user 0.006s sys 0.009s
I20260617 20:16:55.392894 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 3e11c8b69b704e959e4463f565bf89ab (DEFAULT_TABLE table=default.Table_59007bd54d0f4bc291fa36712918f213 [id=455c5f742dc74ef2961710fe2656e613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.393536 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e11c8b69b704e959e4463f565bf89ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.393718 29383 raft_consensus.cc:359] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.393918 29383 raft_consensus.cc:385] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.394001 29383 raft_consensus.cc:740] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.394258 29383 consensus_queue.cc:260] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.395175 29383 ts_tablet_manager.cc:1434] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:55.395601 29383 tablet_bootstrap.cc:492] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.395768 29259 raft_consensus.cc:2468] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:55.397388 29383 tablet_bootstrap.cc:654] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.384562 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17917ffc3e8f43afb2a8bc413159137c" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:55.398768 29263 raft_consensus.cc:2468] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:55.388051 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b65814c56424256b53d3c9f94c1b74a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.401916 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e287ba95be7408b8fc75e6f0709d8f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.402007 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5faea831376646c1bdfcaf8fbbc7ca6d
I20260617 20:16:55.399637 29063 leader_election.cc:304] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:55.402925 29063 leader_election.cc:304] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:55.403296 29859 raft_consensus.cc:2804] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:55.403440 29859 raft_consensus.cc:697] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:55.403540 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 5faea831376646c1bdfcaf8fbbc7ca6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.403694 29859 consensus_queue.cc:237] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.404675 29783 raft_consensus.cc:2804] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:55.404763 29783 raft_consensus.cc:493] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:55.404866 29783 raft_consensus.cc:3060] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.406082 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 5faea831376646c1bdfcaf8fbbc7ca6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.406884 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 5faea831376646c1bdfcaf8fbbc7ca6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.407594 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0f4e43a3060149998dfc5e0ea3ef1fa0" } new_table_name: "default.Table_f7130590729b49af9644f1ffa516fe05" modify_external_catalogs: true
I20260617 20:16:55.407594 29783 raft_consensus.cc:515] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.408291 29783 leader_election.cc:290] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.408990 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_60168eec2672477faf619c2033f3b5c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.409413 29062 leader_election.cc:343] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 17917ffc3e8f43afb2a8bc413159137c
W20260617 20:16:55.409511 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60168eec2672477faf619c2033f3b5c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.411230 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17917ffc3e8f43afb2a8bc413159137c" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:55.411477 29263 raft_consensus.cc:3060] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.411633 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 0bbef4cc28ef46288cfc7d1933c71710 (table default.Table_e01af13e5b514cca8b4cfc05a15a949d [id=9850785700a84b33a30caf29ab508aea]). Expected version 1 got 0
I20260617 20:16:55.412492 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_68e64a71a5ff47cba43d8fb5589e1d19" } new_table_name: "default.Table_bb7b4e5ce3324565ab3f5893c46299d5" modify_external_catalogs: true
I20260617 20:16:55.414098 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 8880f8eadaa44887a49adf0ef157965e with delete_type TABLET_DATA_DELETED (replaced by tablet f02529cd1e764a3886de27d86e9690e3) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.414784 29955 raft_consensus.cc:493] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.414914 29955 raft_consensus.cc:515] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.415234 29377 ts_tablet_manager.cc:1929] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:55.415338 29377 log.cc:1199] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/5b65814c56424256b53d3c9f94c1b74a
I20260617 20:16:55.415485 29955 leader_election.cc:290] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:55.415730 29377 ts_tablet_manager.cc:1950] T 5b65814c56424256b53d3c9f94c1b74a P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:55.416087 29263 raft_consensus.cc:2468] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:55.416707 29377 tablet_replica.cc:333] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:55.416894 29377 raft_consensus.cc:2243] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 20:16:55.416973 29062 leader_election.cc:343] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 57e19abe093a40f6886908a8a3a0cad4
I20260617 20:16:55.417034 29377 raft_consensus.cc:2272] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.417254 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 5b65814c56424256b53d3c9f94c1b74a (table default.Table_a445cef5739e4885982b17bdd98216da [id=cb0d51091f8245b9b5a1468752343edc]) successfully deleted
W20260617 20:16:55.417559 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5faea831376646c1bdfcaf8fbbc7ca6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5faea831376646c1bdfcaf8fbbc7ca6d already in progress: creating tablet
I20260617 20:16:55.419266 29063 leader_election.cc:304] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:55.420017 29955 raft_consensus.cc:2804] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:55.420169 29955 raft_consensus.cc:697] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:55.420197 29377 ts_tablet_manager.cc:1916] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.420393 29955 consensus_queue.cc:237] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.426628 29377 ts_tablet_manager.cc:1929] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.426780 29377 log.cc:1199] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/8880f8eadaa44887a49adf0ef157965e
I20260617 20:16:55.427174 29377 ts_tablet_manager.cc:1950] T 8880f8eadaa44887a49adf0ef157965e P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:55.427779 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e19abe093a40f6886908a8a3a0cad4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:55.428050 29263 raft_consensus.cc:2468] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:55.428305 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 8880f8eadaa44887a49adf0ef157965e (table default.Table_fcf0d313e34c4117a4d36e5638a1a4b4 [id=7a4a3c7360114f72b54f5dd645215114]) successfully deleted
I20260617 20:16:55.428553 29063 leader_election.cc:304] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:55.428990 29783 raft_consensus.cc:2804] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:55.429112 29783 raft_consensus.cc:493] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:55.429183 29783 raft_consensus.cc:3060] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.432153 29783 raft_consensus.cc:515] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:55.433431 29062 leader_election.cc:343] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 57e19abe093a40f6886908a8a3a0cad4
I20260617 20:16:55.435478 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e19abe093a40f6886908a8a3a0cad4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:55.435765 29263 raft_consensus.cc:3060] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.438968 29383 tablet_bootstrap.cc:492] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.439750 29383 ts_tablet_manager.cc:1403] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.044s user 0.007s sys 0.012s
I20260617 20:16:55.440623 29383 raft_consensus.cc:359] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.440595 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_05dfcb6814c143ee9890aba309a96146"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:55.440932 29383 raft_consensus.cc:385] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.441076 29383 raft_consensus.cc:740] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
W20260617 20:16:55.441218 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05dfcb6814c143ee9890aba309a96146 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.441396 29383 consensus_queue.cc:260] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.438683 29263 raft_consensus.cc:2468] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:55.442437 29383 ts_tablet_manager.cc:1434] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:55.442750 29383 tablet_bootstrap.cc:492] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.443181 29957 raft_consensus.cc:493] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.443333 29957 raft_consensus.cc:515] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.444047 29957 leader_election.cc:290] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.445727 29383 tablet_bootstrap.cc:654] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.446043 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6a198d41f58e40d29bb3325eb77c19f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.446570 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a198d41f58e40d29bb3325eb77c19f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:55.447737 29197 leader_election.cc:343] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3e287ba95be7408b8fc75e6f0709d8f1
I20260617 20:16:55.448158 29063 leader_election.cc:304] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:55.448694 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e287ba95be7408b8fc75e6f0709d8f1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:55.448882 29123 raft_consensus.cc:2468] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:55.449254 29198 leader_election.cc:304] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:55.449671 29957 raft_consensus.cc:2804] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:55.449747 29957 raft_consensus.cc:493] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:55.449841 29957 raft_consensus.cc:3060] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.450611 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 33b01c9c27904a1986e285477921ac4f
I20260617 20:16:55.452488 29957 raft_consensus.cc:515] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.453228 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 33b01c9c27904a1986e285477921ac4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.454110 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 33b01c9c27904a1986e285477921ac4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.454186 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 33b01c9c27904a1986e285477921ac4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.454301 29957 leader_election.cc:290] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:55.455133 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 33b01c9c27904a1986e285477921ac4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33b01c9c27904a1986e285477921ac4f already in progress: creating tablet
W20260617 20:16:55.455206 29197 leader_election.cc:343] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3e287ba95be7408b8fc75e6f0709d8f1
I20260617 20:16:55.455245 29998 raft_consensus.cc:2804] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:55.455811 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e287ba95be7408b8fc75e6f0709d8f1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:55.455989 29123 raft_consensus.cc:3060] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.456400 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet a8eefc4f3c7d4f468c0adca837b73bb2 (table default.Table_a41d5a63ab0c47adafaeff2f42205397 [id=405880e9419e43449f08e705aab0ba7c]). Expected version 3 got 0
I20260617 20:16:55.458526 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5d01dcb6629a40f2a3dc693bbb860d62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:55.458657 29123 raft_consensus.cc:2468] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:16:55.459156 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d01dcb6629a40f2a3dc693bbb860d62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.459141 29198 leader_election.cc:304] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:55.459623 29957 raft_consensus.cc:2804] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:55.459895 29957 raft_consensus.cc:697] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:55.460152 29957 consensus_queue.cc:237] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.402372 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 3e11c8b69b704e959e4463f565bf89ab (DEFAULT_TABLE table=default.Table_59007bd54d0f4bc291fa36712918f213 [id=455c5f742dc74ef2961710fe2656e613]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.466559 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6073576da0f64d37bae015524bd119de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:55.466861 29783 leader_election.cc:290] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:55.467170 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6073576da0f64d37bae015524bd119de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.467649 30018 raft_consensus.cc:493] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.467815 30018 raft_consensus.cc:515] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.468679 30018 leader_election.cc:290] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.468942 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f822e3f4ca4946a116ee172e83628b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:55.469619 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f822e3f4ca4946a116ee172e83628b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:55.469858 28990 raft_consensus.cc:2468] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:55.470255 29197 leader_election.cc:304] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:16:55.470383 29198 leader_election.cc:343] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:55.470570 30018 raft_consensus.cc:2804] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:55.470674 30018 raft_consensus.cc:493] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:55.470763 30018 raft_consensus.cc:3060] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.473764 30018 raft_consensus.cc:515] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.473857 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_57173259c5b84c00b2a539220a0634b8" } new_table_name: "default.Table_8d82152eac954df48c864d5ee8ae87c3" modify_external_catalogs: true
I20260617 20:16:55.474617 30018 leader_election.cc:290] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.475162 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f822e3f4ca4946a116ee172e83628b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:55.475363 28990 raft_consensus.cc:3060] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.476786 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 0d1a416f802948d5bc150855d82b54c1
I20260617 20:16:55.477788 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d1a416f802948d5bc150855d82b54c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.478073 29377 tablet_replica.cc:333] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:55.478222 28990 raft_consensus.cc:2468] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:55.478266 29377 raft_consensus.cc:2243] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.478351 29383 tablet_bootstrap.cc:492] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.478451 29377 raft_consensus.cc:2272] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.478514 29383 ts_tablet_manager.cc:1403] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.009s
I20260617 20:16:55.478936 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7f822e3f4ca4946a116ee172e83628b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:55.478999 29377 ts_tablet_manager.cc:1916] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.479100 29197 leader_election.cc:304] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:55.479300 29383 raft_consensus.cc:359] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.479393 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d1a416f802948d5bc150855d82b54c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:55.479516 29198 leader_election.cc:343] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:55.480016 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d1a416f802948d5bc150855d82b54c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.479521 29383 raft_consensus.cc:385] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.481179 29383 raft_consensus.cc:740] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.481565 29383 consensus_queue.cc:260] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.483528 30018 raft_consensus.cc:2804] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:55.486644 29377 ts_tablet_manager.cc:1929] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.486543 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f2cdd74a01354e0597f1e2d7bc5458c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:55.486788 29377 log.cc:1199] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/0d1a416f802948d5bc150855d82b54c1
I20260617 20:16:55.487196 29377 ts_tablet_manager.cc:1950] T 0d1a416f802948d5bc150855d82b54c1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:16:55.487324 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f2cdd74a01354e0597f1e2d7bc5458c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.488341 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 0d1a416f802948d5bc150855d82b54c1 (table default.Table_77d3422ed47c4d68ae6f518500ea89b1 [id=071053dd948345bd9bc5d8b3cffe7935]) successfully deleted
I20260617 20:16:55.497911 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet adbc3219639748d9a0d71d45ae22ab36
I20260617 20:16:55.498525 28670 catalog_manager.cc:6784] ReplaceTablet: tablet adbc3219639748d9a0d71d45ae22ab36 deleted and replaced by tablet 3b00d3c0adcf48a48ba3d7a3de018b80
I20260617 20:16:55.498374 29375 rpcz_store.cc:276] 0617 20:16:51.834814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.586326 (+751512us) service_pool.cc:224] Handling call
0617 20:16:55.392247 (+2805921us) ts_tablet_manager.cc:1151] Deleting tablet b3278efaad07403ca0a2baecad46d0f1
0617 20:16:55.392256 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.392343 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2757031}
I20260617 20:16:55.499615 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet adbc3219639748d9a0d71d45ae22ab36 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b00d3c0adcf48a48ba3d7a3de018b80) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.499722 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet adbc3219639748d9a0d71d45ae22ab36 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b00d3c0adcf48a48ba3d7a3de018b80) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:55.500499 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet adbc3219639748d9a0d71d45ae22ab36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbc3219639748d9a0d71d45ae22ab36 already in progress: creating tablet
W20260617 20:16:55.501333 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet b3278efaad07403ca0a2baecad46d0f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b3278efaad07403ca0a2baecad46d0f1 already in progress: creating tablet
I20260617 20:16:55.501724 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet adbc3219639748d9a0d71d45ae22ab36 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b00d3c0adcf48a48ba3d7a3de018b80) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.504762 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6bd15ccc82e94f2a9d16a99288ae6d3c" } new_table_name: "default.Table_efb89ae603ed4713a25716af39bf03c3" modify_external_catalogs: true
W20260617 20:16:55.512912 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91c99389d24d4a8d8c934f0a9b9c2825 consensus state has no leader
I20260617 20:16:55.513033 29998 raft_consensus.cc:697] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:55.513362 29998 consensus_queue.cc:237] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.519294 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_717bed2f0fd24890b33e6efaea1b5529" } new_table_name: "default.Table_675137d48e694996a1fbfc31e4fd7c9b" modify_external_catalogs: true
I20260617 20:16:55.522903 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e11c8b69b704e959e4463f565bf89ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.529012 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 420) took 3101 ms. Trace:
I20260617 20:16:55.529237 29375 rpcz_store.cc:276] 0617 20:16:52.427288 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.649812 (+222524us) service_pool.cc:224] Handling call
0617 20:16:55.499338 (+2849526us) ts_tablet_manager.cc:1151] Deleting tablet cf8d04ef8acd4fcaa69df9253cd89462
0617 20:16:55.528850 (+ 29512us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.528975 (+ 125us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2832082}
W20260617 20:16:55.530630 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet cf8d04ef8acd4fcaa69df9253cd89462 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf8d04ef8acd4fcaa69df9253cd89462 already in progress: creating tablet
I20260617 20:16:55.531128 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 418) took 3247 ms. Trace:
I20260617 20:16:55.531315 29375 rpcz_store.cc:276] 0617 20:16:52.283330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.635249 (+351919us) service_pool.cc:224] Handling call
0617 20:16:55.530155 (+2894906us) ts_tablet_manager.cc:1151] Deleting tablet 938b61a0f6dc4d178971034fd18c1674
0617 20:16:55.530983 (+ 828us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.531083 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2860988}
W20260617 20:16:55.531787 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 938b61a0f6dc4d178971034fd18c1674 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 938b61a0f6dc4d178971034fd18c1674 already in progress: creating tablet
I20260617 20:16:55.532217 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 419) took 3248 ms. Trace:
I20260617 20:16:55.532404 29375 rpcz_store.cc:276] 0617 20:16:52.283509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.648805 (+365296us) service_pool.cc:224] Handling call
0617 20:16:55.532089 (+2883284us) ts_tablet_manager.cc:1151] Deleting tablet da50400f49e24ca589519e6ec823957d
0617 20:16:55.532097 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.532173 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2862057}
W20260617 20:16:55.533450 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet da50400f49e24ca589519e6ec823957d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da50400f49e24ca589519e6ec823957d already in progress: creating tablet
I20260617 20:16:55.533926 29376 ts_tablet_manager.cc:1916] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.536579 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5d78d818040145bf9a37f06eac741648"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.537328 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d78d818040145bf9a37f06eac741648 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:55.544050 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 174cb0af57d64742a49070a5a44e2292 has no consensus state
I20260617 20:16:55.545382 29383 ts_tablet_manager.cc:1434] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.067s user 0.016s sys 0.015s
I20260617 20:16:55.545464 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 417) took 3569 ms. Trace:
I20260617 20:16:55.546188 29375 rpcz_store.cc:276] 0617 20:16:51.976244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.618037 (+641793us) service_pool.cc:224] Handling call
0617 20:16:55.533762 (+2915725us) ts_tablet_manager.cc:1151] Deleting tablet 67a3124306094c72ad78e5473aa35bdb
0617 20:16:55.533836 (+ 74us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.545415 (+ 11579us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2834259}
I20260617 20:16:55.546366 29378 tablet_bootstrap.cc:492] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:55.546512 29378 ts_tablet_manager.cc:1403] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.197s user 0.029s sys 0.047s
I20260617 20:16:55.546551 29375 tablet_replica.cc:333] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:55.547288 29378 raft_consensus.cc:359] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.547485 29378 raft_consensus.cc:385] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.547567 29378 raft_consensus.cc:740] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.547788 29378 consensus_queue.cc:260] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:55.548249 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 67a3124306094c72ad78e5473aa35bdb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 67a3124306094c72ad78e5473aa35bdb already in progress: creating tablet
I20260617 20:16:55.548846 29375 raft_consensus.cc:2243] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.549043 29375 raft_consensus.cc:2272] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.550272 29378 ts_tablet_manager.cc:1434] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:16:55.550338 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_608970ae0a3443c5937e3180a495bc33" } modify_external_catalogs: true
I20260617 20:16:55.550514 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_608970ae0a3443c5937e3180a495bc33" } modify_external_catalogs: true
I20260617 20:16:55.550580 29378 tablet_bootstrap.cc:492] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:55.552132 29375 ts_tablet_manager.cc:1916] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.552361 29378 tablet_bootstrap.cc:654] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:55.552621 29063 consensus_peers.cc:597] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8eee68618cdf462283d7fd9f098c2a0d. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:55.549108 30018 raft_consensus.cc:697] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:55.553548 30018 consensus_queue.cc:237] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.560190 29379 tablet_bootstrap.cc:492] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.560387 29379 ts_tablet_manager.cc:1403] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.217s user 0.007s sys 0.002s
I20260617 20:16:55.561415 29379 raft_consensus.cc:359] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.561661 29379 raft_consensus.cc:385] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.561779 29379 raft_consensus.cc:740] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.562379 29379 consensus_queue.cc:260] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.565462 29383 tablet_bootstrap.cc:492] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.567220 29383 tablet_bootstrap.cc:654] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.568087 29376 ts_tablet_manager.cc:1929] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:55.574548 29376 log.cc:1199] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/4da8b2c2ecd34b56a046ac3b32c0c5f1
I20260617 20:16:55.575181 29376 ts_tablet_manager.cc:1950] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:55.576179 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 495) took 1277 ms. Trace:
I20260617 20:16:55.576349 29376 rpcz_store.cc:276] 0617 20:16:54.298897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.311877 (+ 12980us) service_pool.cc:224] Handling call
0617 20:16:55.338584 (+1026707us) ts_tablet_manager.cc:1151] Deleting tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1
0617 20:16:55.338592 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.546211 (+207619us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.568000 (+ 21789us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.576140 (+ 8140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1026492}
W20260617 20:16:55.576880 28654 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 7f47e81154eb48fb9e891cfff5250af2 (table default.Table_64af2fec232e48e8bfd3193d063c6d1d [id=d8e345fe630b4072820cc8c71189ea50], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f47e81154eb48fb9e891cfff5250af2 consensus state has no leader
I20260617 20:16:55.576978 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 (table default.Table_0b2903f0c1204e4eacd6a8987e8b688a [id=8b2c257acdb0498f8c9c4e8e44535f31]) successfully deleted
I20260617 20:16:55.577430 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 483) took 1279 ms. Trace:
I20260617 20:16:55.577584 29379 ts_tablet_manager.cc:1434] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260617 20:16:55.577600 29376 rpcz_store.cc:276] 0617 20:16:54.297504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.312655 (+ 15151us) service_pool.cc:224] Handling call
0617 20:16:55.577212 (+1264557us) ts_tablet_manager.cc:1151] Deleting tablet 30f6dcc384154d41866cf8060cf05837
0617 20:16:55.577221 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.577387 (+ 166us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1263058}
W20260617 20:16:55.578217 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 30f6dcc384154d41866cf8060cf05837 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30f6dcc384154d41866cf8060cf05837 already in progress: creating tablet
I20260617 20:16:55.578712 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 484) took 1281 ms. Trace:
I20260617 20:16:55.578876 29376 rpcz_store.cc:276] 0617 20:16:54.297638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.327011 (+ 29373us) service_pool.cc:224] Handling call
0617 20:16:55.578553 (+1251542us) ts_tablet_manager.cc:1151] Deleting tablet 89d79b7023ae478698a06562b2e4c578
0617 20:16:55.578565 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.578669 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1251337}
W20260617 20:16:55.579440 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 89d79b7023ae478698a06562b2e4c578 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89d79b7023ae478698a06562b2e4c578 already in progress: creating tablet
I20260617 20:16:55.579886 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 499) took 1111 ms. Trace:
I20260617 20:16:55.581406 29376 rpcz_store.cc:276] 0617 20:16:54.468330 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.468384 (+ 54us) service_pool.cc:224] Handling call
0617 20:16:55.579733 (+1111349us) ts_tablet_manager.cc:1151] Deleting tablet 14a5e5917a414c99b25ea2efeab4063d
0617 20:16:55.579743 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.579836 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1111132}
W20260617 20:16:55.582031 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 14a5e5917a414c99b25ea2efeab4063d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14a5e5917a414c99b25ea2efeab4063d already in progress: creating tablet
I20260617 20:16:55.583665 29379 tablet_bootstrap.cc:492] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.585973 29379 tablet_bootstrap.cc:654] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.586341 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 500) took 1089 ms. Trace:
I20260617 20:16:55.586536 29376 rpcz_store.cc:276] 0617 20:16:54.496967 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.519100 (+ 22133us) service_pool.cc:224] Handling call
0617 20:16:55.584892 (+1065792us) ts_tablet_manager.cc:1151] Deleting tablet 593d9de6a2fb47e18d86649e45ba80b9
0617 20:16:55.586109 (+ 1217us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.586266 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1065578}
I20260617 20:16:55.587845 29378 tablet_bootstrap.cc:492] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
W20260617 20:16:55.587927 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 593d9de6a2fb47e18d86649e45ba80b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 593d9de6a2fb47e18d86649e45ba80b9 already in progress: creating tablet
I20260617 20:16:55.588023 29378 ts_tablet_manager.cc:1403] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.005s
I20260617 20:16:55.588868 29378 raft_consensus.cc:359] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.589079 29378 raft_consensus.cc:385] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.589155 29378 raft_consensus.cc:740] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.589454 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_25c67ca49ed44c2d84e1262214bd184c" } modify_external_catalogs: true
I20260617 20:16:55.589612 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_25c67ca49ed44c2d84e1262214bd184c" } modify_external_catalogs: true
W20260617 20:16:55.590453 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet dee426100bb645f391be123aeb52e412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dee426100bb645f391be123aeb52e412 already in progress: creating tablet
I20260617 20:16:55.590770 29376 tablet_replica.cc:333] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:55.591248 29376 raft_consensus.cc:2243] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.591952 29375 ts_tablet_manager.cc:1929] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.592106 29375 log.cc:1199] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/33e4407aa01642ffb03eba1b220afdba
W20260617 20:16:55.592308 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f3032155e4e4ea8a23984f547d78752 consensus state has no leader
I20260617 20:16:55.592510 29375 ts_tablet_manager.cc:1950] T 33e4407aa01642ffb03eba1b220afdba P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:55.593091 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 421) took 2846 ms. Trace:
I20260617 20:16:55.593117 29376 raft_consensus.cc:2272] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.593806 29376 ts_tablet_manager.cc:1916] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.593204 29375 rpcz_store.cc:276] 0617 20:16:52.746665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.747219 (+ 554us) service_pool.cc:224] Handling call
0617 20:16:55.546467 (+2799248us) ts_tablet_manager.cc:1151] Deleting tablet 33e4407aa01642ffb03eba1b220afdba
0617 20:16:55.546479 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.567848 (+ 21369us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.591875 (+ 24027us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.593040 (+ 1165us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2690970}
I20260617 20:16:55.596453 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 33e4407aa01642ffb03eba1b220afdba (table default.Table_befd7af4f63843d9bf259896e10ce0f5 [id=257569c30deb403b8d3925a0925308be]) successfully deleted
I20260617 20:16:55.597379 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 431) took 2728 ms. Trace:
I20260617 20:16:55.597481 29375 rpcz_store.cc:276] 0617 20:16:52.868397 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.933263 (+ 64866us) service_pool.cc:224] Handling call
0617 20:16:55.597179 (+2663916us) ts_tablet_manager.cc:1151] Deleting tablet 18440a4a5c254a25b87f8632de9c92b9
0617 20:16:55.597190 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.597322 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2648460}
W20260617 20:16:55.597929 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 18440a4a5c254a25b87f8632de9c92b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 18440a4a5c254a25b87f8632de9c92b9 already in progress: creating tablet
I20260617 20:16:55.600960 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 433) took 2729 ms. Trace:
I20260617 20:16:55.601076 29375 rpcz_store.cc:276] 0617 20:16:52.870623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.948750 (+ 78127us) service_pool.cc:224] Handling call
0617 20:16:55.599857 (+2651107us) ts_tablet_manager.cc:1151] Deleting tablet cc8fa9f4c40b4ce9baa27a8837d3575c
0617 20:16:55.599867 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.599972 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2549171}
W20260617 20:16:55.601537 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet cc8fa9f4c40b4ce9baa27a8837d3575c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc8fa9f4c40b4ce9baa27a8837d3575c already in progress: creating tablet
I20260617 20:16:55.607153 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_64af2fec232e48e8bfd3193d063c6d1d" } modify_external_catalogs: true
I20260617 20:16:55.607429 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_64af2fec232e48e8bfd3193d063c6d1d" } modify_external_catalogs: true
I20260617 20:16:55.608819 29378 consensus_queue.cc:260] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.610219 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet 99a3d9ae347845dfa9357010819ebc58 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:55.611068 29378 ts_tablet_manager.cc:1434] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260617 20:16:55.611393 29378 tablet_bootstrap.cc:492] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:55.611744 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e58fbec4a9f14ddda42b5a4c0263972c consensus state has no leader
I20260617 20:16:55.614593 29383 tablet_bootstrap.cc:492] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.614746 29383 ts_tablet_manager.cc:1403] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.060s user 0.006s sys 0.000s
I20260617 20:16:55.615852 29383 raft_consensus.cc:359] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.616029 29383 raft_consensus.cc:385] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.616122 29383 raft_consensus.cc:740] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.616261 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 432) took 2745 ms. Trace:
I20260617 20:16:55.616427 29379 tablet_bootstrap.cc:492] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.616400 29383 consensus_queue.cc:260] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.616633 29379 ts_tablet_manager.cc:1403] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.002s
I20260617 20:16:55.617175 29383 ts_tablet_manager.cc:1434] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:55.617481 29383 tablet_bootstrap.cc:492] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.617465 29379 raft_consensus.cc:359] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.617659 29379 raft_consensus.cc:385] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.617733 29379 raft_consensus.cc:740] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.617969 29379 consensus_queue.cc:260] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.618475 29379 ts_tablet_manager.cc:1434] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:55.619906 29383 tablet_bootstrap.cc:654] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.620430 29379 tablet_bootstrap.cc:492] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.621716 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_432834dd55704c4589b84bcfae673d03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.622313 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_432834dd55704c4589b84bcfae673d03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.624707 29383 tablet_bootstrap.cc:492] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.624909 29383 ts_tablet_manager.cc:1403] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260617 20:16:55.625463 29378 tablet_bootstrap.cc:654] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.625913 29383 raft_consensus.cc:359] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.626106 29383 raft_consensus.cc:385] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.626188 29383 raft_consensus.cc:740] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.626478 29383 consensus_queue.cc:260] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.628057 29383 ts_tablet_manager.cc:1434] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:55.628086 29376 ts_tablet_manager.cc:1929] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.628225 29376 log.cc:1199] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/57e19abe093a40f6886908a8a3a0cad4
I20260617 20:16:55.628398 29383 tablet_bootstrap.cc:492] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:55.629822 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32c3a4c3bee5444697f5d53d51c62894 consensus state has no leader
I20260617 20:16:55.631457 29383 tablet_bootstrap.cc:654] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.632608 29376 ts_tablet_manager.cc:1950] T 57e19abe093a40f6886908a8a3a0cad4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:55.632722 29379 tablet_bootstrap.cc:654] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.633505 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 507) took 1017 ms. Trace:
I20260617 20:16:55.633599 29376 rpcz_store.cc:276] 0617 20:16:54.616445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.616773 (+ 328us) service_pool.cc:224] Handling call
0617 20:16:55.590703 (+973930us) ts_tablet_manager.cc:1151] Deleting tablet 57e19abe093a40f6886908a8a3a0cad4
0617 20:16:55.590712 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.603551 (+ 12839us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.628007 (+ 24456us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.633445 (+ 5438us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":973544}
I20260617 20:16:55.634095 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 508) took 1009 ms. Trace:
I20260617 20:16:55.634163 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 57e19abe093a40f6886908a8a3a0cad4 (table default.Table_bf43c1c307304b35a6b33eb8fb011be2 [id=c36f4aec7e564c10b3782a48ecdafef7]) successfully deleted
I20260617 20:16:55.634194 29376 rpcz_store.cc:276] 0617 20:16:54.624437 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.624508 (+ 71us) service_pool.cc:224] Handling call
0617 20:16:55.633931 (+1009423us) ts_tablet_manager.cc:1151] Deleting tablet 5eaddd6519dc490c8358be629b21a2d9
0617 20:16:55.633942 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.634045 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":978423}
W20260617 20:16:55.634656 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5eaddd6519dc490c8358be629b21a2d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eaddd6519dc490c8358be629b21a2d9 already in progress: creating tablet
I20260617 20:16:55.616362 29375 rpcz_store.cc:276] 0617 20:16:52.870513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:52.947932 (+ 77419us) service_pool.cc:224] Handling call
0617 20:16:55.601989 (+2654057us) ts_tablet_manager.cc:1151] Deleting tablet 4e27c5834baa48ed953fccef54e6c52b
0617 20:16:55.602000 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.616190 (+ 14190us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2551076}
W20260617 20:16:55.635887 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4ceb3ae3c1a44442966ad37fbcbc658b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ceb3ae3c1a44442966ad37fbcbc658b already in progress: creating tablet
W20260617 20:16:55.636106 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet cbeae97639fd4e6290768dae12f6a4ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbeae97639fd4e6290768dae12f6a4ce already in progress: creating tablet
W20260617 20:16:55.636277 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 89f7b878728a495f83b6584f8a6aca67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89f7b878728a495f83b6584f8a6aca67 already in progress: creating tablet
W20260617 20:16:55.636451 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 7a89e42d091f423bb926f671797141ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a89e42d091f423bb926f671797141ea already in progress: creating tablet
W20260617 20:16:55.636620 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet cde88371f4454a4bb3053c6cd1afb801 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cde88371f4454a4bb3053c6cd1afb801 already in progress: creating tablet
W20260617 20:16:55.636790 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4d23acc051c34ebfb0edb790faec1b2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d23acc051c34ebfb0edb790faec1b2b already in progress: creating tablet
I20260617 20:16:55.642994 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 448) took 2701 ms. Trace:
I20260617 20:16:55.643105 29375 rpcz_store.cc:276] 0617 20:16:52.940989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.192183 (+251194us) service_pool.cc:224] Handling call
0617 20:16:55.635603 (+2443420us) ts_tablet_manager.cc:1151] Deleting tablet 39ca961cfea54a7187cc7ea8d16a627f
0617 20:16:55.635613 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.642925 (+ 7312us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2439234}
I20260617 20:16:55.643502 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 457) took 2141 ms. Trace:
I20260617 20:16:55.643589 29375 rpcz_store.cc:276] 0617 20:16:53.501940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.509376 (+ 7436us) service_pool.cc:224] Handling call
0617 20:16:55.643327 (+2133951us) ts_tablet_manager.cc:1151] Deleting tablet 8a5d9677bc184c30be1a11bfa85a97c8
0617 20:16:55.643337 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.643439 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2133453}
I20260617 20:16:55.643857 29375 tablet_replica.cc:333] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:55.644042 29375 raft_consensus.cc:2243] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:55.644325 29375 pending_rounds.cc:70] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:55.644389 29375 pending_rounds.cc:77] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955486844993536 op_type: NO_OP noop_request { }
I20260617 20:16:55.644505 29375 raft_consensus.cc:2889] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:55.644591 29375 raft_consensus.cc:2272] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.645131 29375 ts_tablet_manager.cc:1916] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:55.646063 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 90ae9c63c8c541bc91ecedd798a7d60f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90ae9c63c8c541bc91ecedd798a7d60f already in progress: creating tablet
W20260617 20:16:55.646366 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4342e29fbc98442ea2e2d25c7aea8853 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4342e29fbc98442ea2e2d25c7aea8853 already in progress: creating tablet
W20260617 20:16:55.646622 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet eba86bae9e91404185d248dfd722a413 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eba86bae9e91404185d248dfd722a413 already in progress: creating tablet
I20260617 20:16:55.646749 29376 tablet_replica.cc:333] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:16:55.646868 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe already in progress: creating tablet
I20260617 20:16:55.646955 29376 raft_consensus.cc:2243] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.647130 29376 raft_consensus.cc:2272] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.647295 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_aa868f28a51b48dcbaa47027ea1ee54e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:55.647650 29376 ts_tablet_manager.cc:1916] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:55.648109 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa868f28a51b48dcbaa47027ea1ee54e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.651559 29383 tablet_bootstrap.cc:492] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.651769 29383 ts_tablet_manager.cc:1403] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.001s
I20260617 20:16:55.652645 29383 raft_consensus.cc:359] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.652921 29383 raft_consensus.cc:385] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.653059 29383 raft_consensus.cc:740] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
W20260617 20:16:55.653066 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4e27c5834baa48ed953fccef54e6c52b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4e27c5834baa48ed953fccef54e6c52b already in progress: creating tablet
W20260617 20:16:55.653319 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 39ca961cfea54a7187cc7ea8d16a627f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39ca961cfea54a7187cc7ea8d16a627f already in progress: creating tablet
I20260617 20:16:55.653396 29383 consensus_queue.cc:260] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:55.653607 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 8a5d9677bc184c30be1a11bfa85a97c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a5d9677bc184c30be1a11bfa85a97c8 already in progress: creating tablet
I20260617 20:16:55.653936 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet eb408723f7a346c3b5ea13cad237b44e
I20260617 20:16:55.654328 29383 ts_tablet_manager.cc:1434] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:55.655953 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet eb408723f7a346c3b5ea13cad237b44e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:55.656783 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet eb408723f7a346c3b5ea13cad237b44e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb408723f7a346c3b5ea13cad237b44e already in progress: creating tablet
I20260617 20:16:55.657335 29383 tablet_bootstrap.cc:492] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.658290 29378 tablet_bootstrap.cc:492] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:55.658512 29378 ts_tablet_manager.cc:1403] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.047s user 0.000s sys 0.010s
I20260617 20:16:55.659130 29383 tablet_bootstrap.cc:654] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.659477 29378 raft_consensus.cc:359] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.659734 29378 raft_consensus.cc:385] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.659868 29378 raft_consensus.cc:740] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.660188 29378 consensus_queue.cc:260] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.662273 29378 ts_tablet_manager.cc:1434] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260617 20:16:55.663333 29378 tablet_bootstrap.cc:492] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:55.667883 29378 tablet_bootstrap.cc:654] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.672881 29378 tablet_bootstrap.cc:492] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:55.673120 29378 ts_tablet_manager.cc:1403] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.003s
I20260617 20:16:55.673938 29378 raft_consensus.cc:359] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.674263 29378 raft_consensus.cc:385] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.674383 29378 raft_consensus.cc:740] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.674662 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet eb408723f7a346c3b5ea13cad237b44e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.676345 29376 ts_tablet_manager.cc:1929] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.678068 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4c12d5e303de44a398302513b3d158ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.679383 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c12d5e303de44a398302513b3d158ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.681002 29376 log.cc:1199] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/1fa15915b0ec44ff8b66920e4c207536
I20260617 20:16:55.681324 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_97cc2bb3e3014e8d83c52d378dbde4e3" } modify_external_catalogs: true
I20260617 20:16:55.681489 29376 ts_tablet_manager.cc:1950] T 1fa15915b0ec44ff8b66920e4c207536 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:55.681571 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_97cc2bb3e3014e8d83c52d378dbde4e3" } modify_external_catalogs: true
I20260617 20:16:55.682226 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4bafc10932fd4cc79175b416a102af18" } modify_external_catalogs: true
I20260617 20:16:55.682403 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4bafc10932fd4cc79175b416a102af18" } modify_external_catalogs: true
I20260617 20:16:55.682693 29383 tablet_bootstrap.cc:492] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.682888 29383 ts_tablet_manager.cc:1403] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.003s
I20260617 20:16:55.682880 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 1fa15915b0ec44ff8b66920e4c207536 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]) successfully deleted
I20260617 20:16:55.683630 29383 raft_consensus.cc:359] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:55.684499 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet e35d84540ee74348a3222c5b928e002f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e35d84540ee74348a3222c5b928e002f already in progress: creating tablet
I20260617 20:16:55.686331 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet eb408723f7a346c3b5ea13cad237b44e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.694263 29375 ts_tablet_manager.cc:1929] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 20:16:55.711925 30062 log.cc:927] Time spent T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260617 20:16:55.711948 29375 log.cc:1199] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/1f85271eeb854194a968215ebc08f47a
I20260617 20:16:55.714926 29375 ts_tablet_manager.cc:1950] T 1f85271eeb854194a968215ebc08f47a P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:55.684803 29376 tablet_replica.cc:333] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:55.715248 29383 raft_consensus.cc:385] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.715369 29376 raft_consensus.cc:2243] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.715474 29383 raft_consensus.cc:740] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.715492 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 453) took 2220 ms. Trace:
I20260617 20:16:55.715682 29376 raft_consensus.cc:2272] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.715708 29375 rpcz_store.cc:276] 0617 20:16:53.494828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.495053 (+ 225us) service_pool.cc:224] Handling call
0617 20:16:55.643773 (+2148720us) ts_tablet_manager.cc:1151] Deleting tablet 1f85271eeb854194a968215ebc08f47a
0617 20:16:55.643781 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.648337 (+ 4556us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.694186 (+ 45849us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.715411 (+ 21225us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2124423}
I20260617 20:16:55.715821 29383 consensus_queue.cc:260] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.716080 29375 tablet_replica.cc:333] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:55.716274 29375 raft_consensus.cc:2243] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:55.716382 29383 ts_tablet_manager.cc:1434] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.033s user 0.000s sys 0.001s
I20260617 20:16:55.716595 29375 raft_consensus.cc:2272] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.716971 29376 ts_tablet_manager.cc:1916] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.717474 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_465945c266b94889a143be020e08081e" } new_table_name: "default.Table_d353f219381d4d17a2927a233465454c" modify_external_catalogs: true
I20260617 20:16:55.718696 29378 consensus_queue.cc:260] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.720299 29383 tablet_bootstrap.cc:492] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.721444 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 1f85271eeb854194a968215ebc08f47a (table default.Table_8278dd326f2d440e9b3823471e55dff7 [id=2f1b3ee08d5f4c46b6653cc2aa6ed349]) successfully deleted
I20260617 20:16:55.721844 29375 ts_tablet_manager.cc:1916] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.724972 29376 ts_tablet_manager.cc:1929] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.725353 29376 log.cc:1199] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/17917ffc3e8f43afb2a8bc413159137c
I20260617 20:16:55.725757 29376 ts_tablet_manager.cc:1950] T 17917ffc3e8f43afb2a8bc413159137c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:55.725864 29378 ts_tablet_manager.cc:1434] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.053s user 0.000s sys 0.002s
I20260617 20:16:55.727012 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 17917ffc3e8f43afb2a8bc413159137c (table default.Table_ac0c318d8f1947d99a30561f61ebb675 [id=8d93392a8f2d47608dc8535439b92c72]) successfully deleted
W20260617 20:16:55.727636 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 85633d391613474db52dd2f86210a659 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85633d391613474db52dd2f86210a659 already in progress: creating tablet
I20260617 20:16:55.728034 29376 tablet_replica.cc:333] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:55.730764 29376 raft_consensus.cc:2243] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.731050 29376 raft_consensus.cc:2272] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.731148 29383 tablet_bootstrap.cc:654] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.733584 29378 tablet_bootstrap.cc:492] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:55.735270 29378 tablet_bootstrap.cc:654] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.736423 30018 raft_consensus.cc:493] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.736594 30018 raft_consensus.cc:515] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.737087 29375 ts_tablet_manager.cc:1929] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:55.737205 29375 log.cc:1199] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/8eee68618cdf462283d7fd9f098c2a0d
I20260617 20:16:55.737639 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8eefc4f3c7d4f468c0adca837b73bb2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:55.737854 29123 raft_consensus.cc:2468] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:55.737274 30018 leader_election.cc:290] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.738366 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8eefc4f3c7d4f468c0adca837b73bb2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:55.738582 28987 raft_consensus.cc:2468] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:55.739053 29197 leader_election.cc:304] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:55.739748 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a2798a47a5a746238dd22a3f89641417"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.740283 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2798a47a5a746238dd22a3f89641417 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.741554 30018 raft_consensus.cc:2804] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:55.741642 30018 raft_consensus.cc:493] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:55.741735 30018 raft_consensus.cc:3060] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.744326 30018 raft_consensus.cc:515] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.747201 28670 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet a8eefc4f3c7d4f468c0adca837b73bb2 (table default.Table_a41d5a63ab0c47adafaeff2f42205397 [id=405880e9419e43449f08e705aab0ba7c]). Expected version 3 got 0
I20260617 20:16:55.747900 28664 catalog_manager.cc:5696] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:55.748392 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet e7f822e3f4ca4946a116ee172e83628b (table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]). Expected version 1 got 0
I20260617 20:16:55.750905 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf654918dc148cdbca0e420e337478b (DEFAULT_TABLE table=default.Table_98c28a595ada4fc4b45db63ce655aa58 [id=03d78bcb3bc14b3ab6e25c348bbd067c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.751350 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf654918dc148cdbca0e420e337478b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.753578 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac (DEFAULT_TABLE table=default.Table_31d6e6d29ea341a9939708a6ca1ba7ee [id=dab4a704281b4b03a251b9d9d406206f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.753968 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:55.756130 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ead0291870a443d9b76ea919a45a4303 consensus state has no leader
I20260617 20:16:55.757377 29379 tablet_bootstrap.cc:492] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.758294 29379 ts_tablet_manager.cc:1403] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.140s user 0.018s sys 0.038s
I20260617 20:16:55.759233 29379 raft_consensus.cc:359] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.759428 29379 raft_consensus.cc:385] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.759531 29379 raft_consensus.cc:740] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.759781 29379 consensus_queue.cc:260] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.760169 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf654918dc148cdbca0e420e337478b (DEFAULT_TABLE table=default.Table_98c28a595ada4fc4b45db63ce655aa58 [id=03d78bcb3bc14b3ab6e25c348bbd067c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.760337 29379 ts_tablet_manager.cc:1434] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:55.760643 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf654918dc148cdbca0e420e337478b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.759860 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d0c245563fe44b59d32616bd35d3dae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.761607 29375 ts_tablet_manager.cc:1950] T 8eee68618cdf462283d7fd9f098c2a0d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:55.761940 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 454) took 2266 ms. Trace:
I20260617 20:16:55.760124 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac (DEFAULT_TABLE table=default.Table_31d6e6d29ea341a9939708a6ca1ba7ee [id=dab4a704281b4b03a251b9d9d406206f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.762333 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 1bf654918dc148cdbca0e420e337478b (DEFAULT_TABLE table=default.Table_98c28a595ada4fc4b45db63ce655aa58 [id=03d78bcb3bc14b3ab6e25c348bbd067c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.762558 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.762862 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bf654918dc148cdbca0e420e337478b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.764099 29379 tablet_bootstrap.cc:492] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.765282 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac (DEFAULT_TABLE table=default.Table_31d6e6d29ea341a9939708a6ca1ba7ee [id=dab4a704281b4b03a251b9d9d406206f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.765566 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_685025bcfb0e499d9ee6da4954fabb82" } new_table_name: "default.Table_5293e9d7c6ad4868b54d0aa5d41958b9" modify_external_catalogs: true
I20260617 20:16:55.765658 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.765802 29379 tablet_bootstrap.cc:654] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.769781 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.770073 29377 tablet_replica.cc:333] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:55.770282 29377 raft_consensus.cc:2243] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.770488 29377 raft_consensus.cc:2272] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.770807 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet c21b585707b146ed9c015d150d858681 with delete_type TABLET_DATA_DELETED (replaced by tablet 3726e55ed36f420ab63bcfb5a81c5aab) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.771015 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 640f53137c21443cbfc274c084ce13ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.771337 29377 ts_tablet_manager.cc:1916] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.779333 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a2f0e4601acf41bcb6c1eb2b630891d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.779914 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2f0e4601acf41bcb6c1eb2b630891d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.780715 29377 ts_tablet_manager.cc:1929] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.780849 29377 log.cc:1199] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/46ea43994a0a42fe9e16d7bc6a2118e6
I20260617 20:16:55.781512 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_354d9f3267f24461a3968a19cf2f5a70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:55.781257 29377 ts_tablet_manager.cc:1950] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:16:55.781991 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_354d9f3267f24461a3968a19cf2f5a70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.782730 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 46ea43994a0a42fe9e16d7bc6a2118e6 (table default.Table_c7a5b7a15b93440a82590a995e13b32c [id=efd2f4062eb343f491281fdab6875c9e]) successfully deleted
I20260617 20:16:55.783068 29377 tablet_replica.cc:333] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:55.783268 29377 raft_consensus.cc:2243] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.783247 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cc1b1d5f363341f89757851580c7be12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:55.783458 29377 raft_consensus.cc:2272] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:55.783663 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc1b1d5f363341f89757851580c7be12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.784168 29377 ts_tablet_manager.cc:1916] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.786821 29383 tablet_bootstrap.cc:492] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.787057 29383 ts_tablet_manager.cc:1403] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.009s
I20260617 20:16:55.787271 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 36234ae72453439c85474912870aec2d (DEFAULT_TABLE table=default.Table_10a2068f0dcf4304897997f6f319612a [id=87b48be639d14f4c8ef661db36695716]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.787663 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36234ae72453439c85474912870aec2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.787915 29383 raft_consensus.cc:359] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.788084 29383 raft_consensus.cc:385] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.788168 29383 raft_consensus.cc:740] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.788406 29383 consensus_queue.cc:260] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.789067 29383 ts_tablet_manager.cc:1434] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:55.789309 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 5477576e46c84bb6b8a8c7053c61641c (DEFAULT_TABLE table=default.Table_e35e0d6dd4344daa9725abfc5e70192b [id=622f395bf5b94547956e6397a0cf7685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.789530 29383 tablet_bootstrap.cc:492] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.790205 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 5477576e46c84bb6b8a8c7053c61641c (DEFAULT_TABLE table=default.Table_e35e0d6dd4344daa9725abfc5e70192b [id=622f395bf5b94547956e6397a0cf7685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.790793 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 27bc0aa8024c48c5974ea2d8a292c2cb (DEFAULT_TABLE table=default.Table_be5429b8220b4c0abce2d16b0dea29a9 [id=390c6d1236a3439ea3efc34e561174a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.791136 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27bc0aa8024c48c5974ea2d8a292c2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.791103 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 27bc0aa8024c48c5974ea2d8a292c2cb (DEFAULT_TABLE table=default.Table_be5429b8220b4c0abce2d16b0dea29a9 [id=390c6d1236a3439ea3efc34e561174a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.791333 29383 tablet_bootstrap.cc:654] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.791334 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5477576e46c84bb6b8a8c7053c61641c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.791563 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5477576e46c84bb6b8a8c7053c61641c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.797999 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27bc0aa8024c48c5974ea2d8a292c2cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.801873 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 36234ae72453439c85474912870aec2d (DEFAULT_TABLE table=default.Table_10a2068f0dcf4304897997f6f319612a [id=87b48be639d14f4c8ef661db36695716]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.802399 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36234ae72453439c85474912870aec2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.803534 30018 leader_election.cc:290] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.803781 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8eefc4f3c7d4f468c0adca837b73bb2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:55.804020 29123 raft_consensus.cc:3060] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.806018 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 36234ae72453439c85474912870aec2d (DEFAULT_TABLE table=default.Table_10a2068f0dcf4304897997f6f319612a [id=87b48be639d14f4c8ef661db36695716]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.806483 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36234ae72453439c85474912870aec2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.807253 29123 raft_consensus.cc:2468] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:55.808070 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8eefc4f3c7d4f468c0adca837b73bb2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:55.808379 28987 raft_consensus.cc:3060] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.808386 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 5477576e46c84bb6b8a8c7053c61641c (DEFAULT_TABLE table=default.Table_e35e0d6dd4344daa9725abfc5e70192b [id=622f395bf5b94547956e6397a0cf7685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.808835 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5477576e46c84bb6b8a8c7053c61641c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.811916 28987 raft_consensus.cc:2468] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:55.813501 29197 leader_election.cc:304] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:55.814463 30018 raft_consensus.cc:2804] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:55.814798 30018 raft_consensus.cc:697] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:55.815089 30018 consensus_queue.cc:237] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.826900 29916 raft_consensus.cc:493] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.827046 29916 raft_consensus.cc:515] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.827662 29916 leader_election.cc:290] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:55.828622 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbef4cc28ef46288cfc7d1933c71710" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:55.829128 28925 leader_election.cc:343] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:55.762061 29375 rpcz_store.cc:276] 0617 20:16:53.495120 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.495166 (+ 46us) service_pool.cc:224] Handling call
0617 20:16:55.715995 (+2220829us) ts_tablet_manager.cc:1151] Deleting tablet 8eee68618cdf462283d7fd9f098c2a0d
0617 20:16:55.716007 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.725213 (+ 9206us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.737009 (+ 11796us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.761902 (+ 24893us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2195248}
I20260617 20:16:55.832934 29376 ts_tablet_manager.cc:1916] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.833273 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 8eee68618cdf462283d7fd9f098c2a0d (table default.Table_d064dca2cbed4024b9214ed6bccc811e [id=b8a30f476ef24c6b8b533d15499492fd]) successfully deleted
I20260617 20:16:55.833407 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 456) took 2331 ms. Trace:
I20260617 20:16:55.833520 29375 rpcz_store.cc:276] 0617 20:16:53.501710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.509933 (+ 8223us) service_pool.cc:224] Handling call
0617 20:16:55.833216 (+2323283us) ts_tablet_manager.cc:1151] Deleting tablet 6f15a7c18faa4e36bbb62809bb6e976c
0617 20:16:55.833226 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.833365 (+ 139us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2298090}
W20260617 20:16:55.833977 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 6f15a7c18faa4e36bbb62809bb6e976c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f15a7c18faa4e36bbb62809bb6e976c already in progress: creating tablet
I20260617 20:16:55.834383 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 455) took 2332 ms. Trace:
I20260617 20:16:55.834518 29375 rpcz_store.cc:276] 0617 20:16:53.501538 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.509962 (+ 8424us) service_pool.cc:224] Handling call
0617 20:16:55.833953 (+2323991us) ts_tablet_manager.cc:1151] Deleting tablet d811ca370ee54db8a7e4f6056017cd01
0617 20:16:55.833963 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.834054 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2283352}
W20260617 20:16:55.834957 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d811ca370ee54db8a7e4f6056017cd01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d811ca370ee54db8a7e4f6056017cd01 already in progress: creating tablet
I20260617 20:16:55.835023 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 458) took 2229 ms. Trace:
I20260617 20:16:55.835114 29375 rpcz_store.cc:276] 0617 20:16:53.605950 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.606008 (+ 58us) service_pool.cc:224] Handling call
0617 20:16:55.834901 (+2228893us) ts_tablet_manager.cc:1151] Deleting tablet d738ab2f8c784c76947a3a76bd040219
0617 20:16:55.834911 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.834995 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2228648}
W20260617 20:16:55.835528 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d738ab2f8c784c76947a3a76bd040219 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d738ab2f8c784c76947a3a76bd040219 already in progress: creating tablet
I20260617 20:16:55.835664 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 459) took 2097 ms. Trace:
I20260617 20:16:55.835769 29375 rpcz_store.cc:276] 0617 20:16:53.738084 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.738264 (+ 180us) service_pool.cc:224] Handling call
0617 20:16:55.835534 (+2097270us) ts_tablet_manager.cc:1151] Deleting tablet 7e48a4a827d44afca912dc8723be4542
0617 20:16:55.835544 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.835632 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2096974}
I20260617 20:16:55.836267 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbef4cc28ef46288cfc7d1933c71710" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:55.837033 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 460) took 2098 ms. Trace:
W20260617 20:16:55.837148 28925 leader_election.cc:343] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:55.837268 28925 leader_election.cc:304] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:55.837698 29916 raft_consensus.cc:2749] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:55.843859 29377 ts_tablet_manager.cc:1929] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.843999 29377 log.cc:1199] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/c21b585707b146ed9c015d150d858681
I20260617 20:16:55.844380 29377 ts_tablet_manager.cc:1950] T c21b585707b146ed9c015d150d858681 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:55.846630 29378 tablet_bootstrap.cc:492] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:55.846807 29378 ts_tablet_manager.cc:1403] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.121s user 0.010s sys 0.019s
I20260617 20:16:55.847640 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet c21b585707b146ed9c015d150d858681 (table default.Table_fbaeb71321364cca9f5c971ee3419519 [id=cd2fab71637e4b968e9957070c30c936]) successfully deleted
I20260617 20:16:55.847754 29378 raft_consensus.cc:359] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.847968 29378 raft_consensus.cc:385] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.848075 29378 raft_consensus.cc:740] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.848326 29378 consensus_queue.cc:260] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.848901 29378 ts_tablet_manager.cc:1434] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:55.854216 30018 raft_consensus.cc:493] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.854386 30018 raft_consensus.cc:515] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.855120 30018 leader_election.cc:290] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.858268 30018 raft_consensus.cc:493] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.858446 30018 raft_consensus.cc:515] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.860291 30018 leader_election.cc:290] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.863544 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 7f47e81154eb48fb9e891cfff5250af2
I20260617 20:16:55.864131 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet fee909c8988d49779612e98f5cd82972
I20260617 20:16:55.864295 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f47e81154eb48fb9e891cfff5250af2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.864804 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet fee909c8988d49779612e98f5cd82972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.865206 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet fee909c8988d49779612e98f5cd82972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.866803 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f47e81154eb48fb9e891cfff5250af2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.866923 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd999d88d954e50810cc01b297a27a9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:55.867163 28990 raft_consensus.cc:2468] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:55.867815 29197 leader_election.cc:304] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:55.869858 29377 tablet_replica.cc:333] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:55.870083 29377 raft_consensus.cc:2243] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.870158 29378 tablet_bootstrap.cc:492] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:55.870270 29377 raft_consensus.cc:2272] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.871135 29377 ts_tablet_manager.cc:1916] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:55.874513 29197 leader_election.cc:343] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d738ab2f8c784c76947a3a76bd040219
I20260617 20:16:55.875607 29378 tablet_bootstrap.cc:654] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.877473 29377 ts_tablet_manager.cc:1929] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.877413 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 19f1c625d26747579b5e3a14cafa05ae (DEFAULT_TABLE table=default.Table_2bb5f77d341647ff9184094cb26eb790 [id=6e83cc5f778f46de8d9d7d8aa2c4512d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.877621 29377 log.cc:1199] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/640f53137c21443cbfc274c084ce13ef
I20260617 20:16:55.877904 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f1c625d26747579b5e3a14cafa05ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.877969 29377 ts_tablet_manager.cc:1950] T 640f53137c21443cbfc274c084ce13ef P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:55.879010 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 640f53137c21443cbfc274c084ce13ef (table default.Table_7d193ca323a14554af974ae3b173fa07 [id=2d1a8cb755fb4625b83e93bca0e70898]) successfully deleted
W20260617 20:16:55.879736 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 7f47e81154eb48fb9e891cfff5250af2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f47e81154eb48fb9e891cfff5250af2 already in progress: creating tablet
I20260617 20:16:55.880146 30018 raft_consensus.cc:2804] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:55.880250 30018 raft_consensus.cc:493] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:55.880359 30018 raft_consensus.cc:3060] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:55.880512 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet fee909c8988d49779612e98f5cd82972 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fee909c8988d49779612e98f5cd82972 already in progress: creating tablet
I20260617 20:16:55.881274 29383 tablet_bootstrap.cc:492] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.881479 29383 ts_tablet_manager.cc:1403] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.092s user 0.007s sys 0.014s
I20260617 20:16:55.882997 29383 raft_consensus.cc:359] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.883198 29383 raft_consensus.cc:385] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.883270 29383 raft_consensus.cc:740] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.883500 29383 consensus_queue.cc:260] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.884107 29383 ts_tablet_manager.cc:1434] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:16:55.884675 30018 raft_consensus.cc:515] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.885664 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd999d88d954e50810cc01b297a27a9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:55.885857 28987 raft_consensus.cc:3060] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.887707 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet dd89c8452c444af99d8bce0c7cbf8ce1
I20260617 20:16:55.888327 28987 raft_consensus.cc:2468] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:55.888618 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5d147a20f3c047e2b5a9c4d61739120a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.889164 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d147a20f3c047e2b5a9c4d61739120a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.889385 29383 tablet_bootstrap.cc:492] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:55.889777 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a7ae2b556b104787bb92a47f706bc91a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.890280 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7ae2b556b104787bb92a47f706bc91a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.890786 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a725364bb9646e6bc80fc4f67d04a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.891165 29377 tablet_replica.cc:333] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:55.891381 29377 raft_consensus.cc:2243] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.891558 29377 raft_consensus.cc:2272] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.891531 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9a7ec2d038854bc8a0dc81693ad4c0d7" } new_table_name: "default.Table_4186d04aa9cf40c481d3436773b1b119" modify_external_catalogs: true
I20260617 20:16:55.891860 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5309bfd681fb429ca8e543eb2f52fada" } new_table_name: "default.Table_fe54346acedc4aee9fe8151c12a389fc" modify_external_catalogs: true
I20260617 20:16:55.892150 29377 ts_tablet_manager.cc:1916] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.892869 29383 tablet_bootstrap.cc:654] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.893036 28662 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet e7f822e3f4ca4946a116ee172e83628b (table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]). Expected version 1 got 0
I20260617 20:16:55.896723 29378 tablet_bootstrap.cc:492] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:55.896976 29378 ts_tablet_manager.cc:1403] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.002s
I20260617 20:16:55.897104 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet dd89c8452c444af99d8bce0c7cbf8ce1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.898682 29377 ts_tablet_manager.cc:1929] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:55.898802 29377 log.cc:1199] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/1a725364bb9646e6bc80fc4f67d04a16
I20260617 20:16:55.898939 29197 leader_election.cc:304] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:55.898890 29378 raft_consensus.cc:359] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.899185 29378 raft_consensus.cc:385] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.899286 30061 raft_consensus.cc:2804] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:55.899194 29377 ts_tablet_manager.cc:1950] T 1a725364bb9646e6bc80fc4f67d04a16 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:55.899335 29378 raft_consensus.cc:740] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.899436 30061 raft_consensus.cc:697] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:55.899716 30061 consensus_queue.cc:237] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.899930 29378 consensus_queue.cc:260] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.900326 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 1a725364bb9646e6bc80fc4f67d04a16 (table default.Table_8c70a2be0e4b406880787a57850701ca [id=a8259ff095ae4a3e99259235698d998f]) successfully deleted
I20260617 20:16:55.901145 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 08911643f3ca451d80e2471b1b5b2342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:55.901430 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet dd89c8452c444af99d8bce0c7cbf8ce1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd89c8452c444af99d8bce0c7cbf8ce1 already in progress: creating tablet
I20260617 20:16:55.901007 29378 ts_tablet_manager.cc:1434] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260617 20:16:55.903374 29378 tablet_bootstrap.cc:492] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:55.902854 28662 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet a857c28d94f04dabb9a57aeca662b836 (table default.Table_1d1b3b6470e146c189f41d0e2fcd63c5 [id=3201002f51ca4f788cc1e153333862d4]). Expected version 1 got 0
I20260617 20:16:55.904119 28662 catalog_manager.cc:5696] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:55.905627 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 19f1c625d26747579b5e3a14cafa05ae (DEFAULT_TABLE table=default.Table_2bb5f77d341647ff9184094cb26eb790 [id=6e83cc5f778f46de8d9d7d8aa2c4512d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.905726 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 174cb0af57d64742a49070a5a44e2292 (DEFAULT_TABLE table=default.Table_bb7b4e5ce3324565ab3f5893c46299d5 [id=ec77c3ad28074d489fc33acbb85fab04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.905857 29378 tablet_bootstrap.cc:654] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.906035 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f1c625d26747579b5e3a14cafa05ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.906244 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174cb0af57d64742a49070a5a44e2292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.837153 29375 rpcz_store.cc:276] 0617 20:16:53.738220 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:53.738570 (+ 350us) service_pool.cc:224] Handling call
0617 20:16:55.836880 (+2098310us) ts_tablet_manager.cc:1151] Deleting tablet 9f9844fab126448895c4c9d4c3c78d76
0617 20:16:55.836891 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.836998 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2098181}
I20260617 20:16:55.909584 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet dd89c8452c444af99d8bce0c7cbf8ce1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:55.909785 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 9f9844fab126448895c4c9d4c3c78d76 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9f9844fab126448895c4c9d4c3c78d76 already in progress: creating tablet
I20260617 20:16:55.910280 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 464) took 1899 ms. Trace:
I20260617 20:16:55.910286 28662 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet a8eefc4f3c7d4f468c0adca837b73bb2 (table default.Table_a41d5a63ab0c47adafaeff2f42205397 [id=405880e9419e43449f08e705aab0ba7c]). Expected version 3 got 0
I20260617 20:16:55.910419 29375 rpcz_store.cc:276] 0617 20:16:54.011040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.011109 (+ 69us) service_pool.cc:224] Handling call
0617 20:16:55.909982 (+1898873us) ts_tablet_manager.cc:1151] Deleting tablet 08911643f3ca451d80e2471b1b5b2342
0617 20:16:55.909996 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.910245 (+ 249us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1884241}
I20260617 20:16:55.910619 29383 tablet_bootstrap.cc:492] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:55.910772 29383 ts_tablet_manager.cc:1403] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
W20260617 20:16:55.910866 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 08911643f3ca451d80e2471b1b5b2342 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08911643f3ca451d80e2471b1b5b2342 already in progress: creating tablet
I20260617 20:16:55.911438 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 471) took 1847 ms. Trace:
I20260617 20:16:55.911561 29375 rpcz_store.cc:276] 0617 20:16:54.064090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.064927 (+ 837us) service_pool.cc:224] Handling call
0617 20:16:55.911135 (+1846208us) ts_tablet_manager.cc:1151] Deleting tablet 5df6af49cb484f59ad1f32235753e1db
0617 20:16:55.911145 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.911232 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1833613}
I20260617 20:16:55.911681 29383 raft_consensus.cc:359] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.911875 29383 raft_consensus.cc:385] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 20:16:55.911989 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5df6af49cb484f59ad1f32235753e1db because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5df6af49cb484f59ad1f32235753e1db already in progress: creating tablet
I20260617 20:16:55.912314 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 473) took 1821 ms. Trace:
I20260617 20:16:55.837827 29379 tablet_bootstrap.cc:492] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.912672 29379 ts_tablet_manager.cc:1403] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.149s user 0.003s sys 0.000s
I20260617 20:16:55.913493 29379 raft_consensus.cc:359] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.913683 29379 raft_consensus.cc:385] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.913744 29379 raft_consensus.cc:740] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.913970 29379 consensus_queue.cc:260] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.914481 29379 ts_tablet_manager.cc:1434] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:55.914844 29379 tablet_bootstrap.cc:492] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.915846 29378 tablet_bootstrap.cc:492] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:55.915974 29378 ts_tablet_manager.cc:1403] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260617 20:16:55.916745 29378 raft_consensus.cc:359] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.916914 29378 raft_consensus.cc:385] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.916986 29379 tablet_bootstrap.cc:654] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.916998 29378 raft_consensus.cc:740] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.855402 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd999d88d954e50810cc01b297a27a9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:55.917725 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 174cb0af57d64742a49070a5a44e2292 (DEFAULT_TABLE table=default.Table_bb7b4e5ce3324565ab3f5893c46299d5 [id=ec77c3ad28074d489fc33acbb85fab04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.918097 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174cb0af57d64742a49070a5a44e2292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.860131 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738ab2f8c784c76947a3a76bd040219" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:55.868160 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f47e81154eb48fb9e891cfff5250af2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.868302 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet fee909c8988d49779612e98f5cd82972 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.876864 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 27bc0aa8024c48c5974ea2d8a292c2cb (DEFAULT_TABLE table=default.Table_be5429b8220b4c0abce2d16b0dea29a9 [id=390c6d1236a3439ea3efc34e561174a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.919610 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27bc0aa8024c48c5974ea2d8a292c2cb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:55.919639 29198 leader_election.cc:343] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:55.919746 29198 leader_election.cc:304] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:55.919958 29957 raft_consensus.cc:493] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.920075 29957 raft_consensus.cc:515] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.920682 29957 leader_election.cc:290] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.920792 29957 raft_consensus.cc:2749] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:55.921638 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1a416f802948d5bc150855d82b54c1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:55.921837 29126 raft_consensus.cc:2468] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:16:55.921851 29197 leader_election.cc:343] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 0d1a416f802948d5bc150855d82b54c1
I20260617 20:16:55.922209 29198 leader_election.cc:304] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:55.922403 29957 raft_consensus.cc:2804] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:55.922464 29957 raft_consensus.cc:493] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:55.922528 29957 raft_consensus.cc:3060] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.922003 29378 consensus_queue.cc:260] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.923134 29378 ts_tablet_manager.cc:1434] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 20:16:55.923395 29378 tablet_bootstrap.cc:492] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:55.924892 29957 raft_consensus.cc:515] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.877135 29998 raft_consensus.cc:493] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:55.885802 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd999d88d954e50810cc01b297a27a9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:55.925418 29998 raft_consensus.cc:515] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.898384 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet dd89c8452c444af99d8bce0c7cbf8ce1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.925823 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1a416f802948d5bc150855d82b54c1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:55.925851 29957 leader_election.cc:290] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.905471 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 19f1c625d26747579b5e3a14cafa05ae (DEFAULT_TABLE table=default.Table_2bb5f77d341647ff9184094cb26eb790 [id=6e83cc5f778f46de8d9d7d8aa2c4512d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.925997 29126 raft_consensus.cc:3060] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.926096 29998 leader_election.cc:290] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.926332 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19f1c625d26747579b5e3a14cafa05ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.926934 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd999d88d954e50810cc01b297a27a9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:55.927423 29123 raft_consensus.cc:2468] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:55.928630 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcd999d88d954e50810cc01b297a27a9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:55.928884 29126 raft_consensus.cc:2468] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:55.929845 29198 leader_election.cc:304] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:55.930068 30060 raft_consensus.cc:2804] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:55.930193 30060 raft_consensus.cc:697] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:55.930429 30060 consensus_queue.cc:237] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.931519 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 174cb0af57d64742a49070a5a44e2292 (DEFAULT_TABLE table=default.Table_bb7b4e5ce3324565ab3f5893c46299d5 [id=ec77c3ad28074d489fc33acbb85fab04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.931886 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174cb0af57d64742a49070a5a44e2292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.933704 28987 raft_consensus.cc:2393] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:16:55.934238 29062 leader_election.cc:304] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:55.934646 29998 raft_consensus.cc:3060] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:55.937505 29998 raft_consensus.cc:2749] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:55.912415 29375 rpcz_store.cc:276] 0617 20:16:54.091025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.091083 (+ 58us) service_pool.cc:224] Handling call
0617 20:16:55.912180 (+1821097us) ts_tablet_manager.cc:1151] Deleting tablet c2c6d214816540ac90dc9b2ad3cdb89f
0617 20:16:55.912189 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.912272 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1814076}
W20260617 20:16:55.938575 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet c2c6d214816540ac90dc9b2ad3cdb89f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c2c6d214816540ac90dc9b2ad3cdb89f already in progress: creating tablet
I20260617 20:16:55.939039 29375 tablet_replica.cc:333] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:55.939287 29375 raft_consensus.cc:2243] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:55.939476 29375 raft_consensus.cc:2272] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.939651 29226 tablet_service.cc:1511] Processing CreateTablet for tablet f13c7d600d334e549a5abfe0040b3296 (DEFAULT_TABLE table=default.Table_9125c594bb904c249d84dd3b53caa011 [id=7624332255a94a1284659349088843a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.940061 29375 ts_tablet_manager.cc:1916] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.940186 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13c7d600d334e549a5abfe0040b3296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.946269 28955 tablet_service.cc:1511] Processing CreateTablet for tablet f13c7d600d334e549a5abfe0040b3296 (DEFAULT_TABLE table=default.Table_9125c594bb904c249d84dd3b53caa011 [id=7624332255a94a1284659349088843a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.946899 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13c7d600d334e549a5abfe0040b3296. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:55.949893 29197 leader_election.cc:343] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 0d1a416f802948d5bc150855d82b54c1
I20260617 20:16:55.952988 29379 tablet_bootstrap.cc:492] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.953186 29379 ts_tablet_manager.cc:1403] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.038s user 0.008s sys 0.001s
I20260617 20:16:55.954119 29379 raft_consensus.cc:359] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.954427 29379 raft_consensus.cc:385] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.954587 29379 raft_consensus.cc:740] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.954875 29379 consensus_queue.cc:260] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:55.955437 29378 tablet_bootstrap.cc:654] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.956341 30018 leader_election.cc:290] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:55.957134 29379 ts_tablet_manager.cc:1434] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:55.957525 29379 tablet_bootstrap.cc:492] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.958467 29376 ts_tablet_manager.cc:1929] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:55.958638 29376 log.cc:1199] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/5b65814c56424256b53d3c9f94c1b74a
I20260617 20:16:55.958966 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3df2d190c1234ac3b5950d348ed2c701
I20260617 20:16:55.959106 29376 ts_tablet_manager.cc:1950] T 5b65814c56424256b53d3c9f94c1b74a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:55.959198 29379 tablet_bootstrap.cc:654] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:55.960563 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cdd24a60a91b43cd9e31ecca3d21ec60 consensus state has no leader
I20260617 20:16:55.960774 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 3df2d190c1234ac3b5950d348ed2c701 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:55.963068 29379 tablet_bootstrap.cc:492] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.963073 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet a819956f29954a4dbbd1aa1dcccad3c0 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:55.963225 29379 ts_tablet_manager.cc:1403] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260617 20:16:55.964032 29379 raft_consensus.cc:359] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.964231 29379 raft_consensus.cc:385] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.964309 29379 raft_consensus.cc:740] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.964397 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:55.964570 29379 consensus_queue.cc:260] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.965065 29379 ts_tablet_manager.cc:1434] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:55.965806 29379 tablet_bootstrap.cc:492] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.966737 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 3df2d190c1234ac3b5950d348ed2c701 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:55.967022 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 3df2d190c1234ac3b5950d348ed2c701 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:55.967710 29379 tablet_bootstrap.cc:654] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:55.968477 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3df2d190c1234ac3b5950d348ed2c701 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3df2d190c1234ac3b5950d348ed2c701 already in progress: creating tablet
I20260617 20:16:55.970736 29102 tablet_service.cc:1511] Processing CreateTablet for tablet f13c7d600d334e549a5abfe0040b3296 (DEFAULT_TABLE table=default.Table_9125c594bb904c249d84dd3b53caa011 [id=7624332255a94a1284659349088843a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:55.971364 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13c7d600d334e549a5abfe0040b3296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:55.972661 29376 tablet_replica.cc:333] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:55.972823 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 5b65814c56424256b53d3c9f94c1b74a (table default.Table_a445cef5739e4885982b17bdd98216da [id=cb0d51091f8245b9b5a1468752343edc]) successfully deleted
I20260617 20:16:55.972874 29376 raft_consensus.cc:2243] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:55.973099 29376 pending_rounds.cc:70] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:55.973156 29376 pending_rounds.cc:77] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955493726924800 op_type: NO_OP noop_request { }
I20260617 20:16:55.973253 29376 raft_consensus.cc:2889] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:55.973369 29376 raft_consensus.cc:2272] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:55.979362 29376 ts_tablet_manager.cc:1916] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:55.979423 29375 ts_tablet_manager.cc:1929] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:55.979576 29375 log.cc:1199] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/dd4f190a1005433ebcfbfe3a86aa9e70
I20260617 20:16:55.980072 29375 ts_tablet_manager.cc:1950] T dd4f190a1005433ebcfbfe3a86aa9e70 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:55.980955 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 474) took 1886 ms. Trace:
I20260617 20:16:55.981060 29375 rpcz_store.cc:276] 0617 20:16:54.094665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.094743 (+ 78us) service_pool.cc:224] Handling call
0617 20:16:55.938846 (+1844103us) ts_tablet_manager.cc:1151] Deleting tablet dd4f190a1005433ebcfbfe3a86aa9e70
0617 20:16:55.938856 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:55.955934 (+ 17078us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.979356 (+ 23422us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:55.980900 (+ 1544us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1837314}
I20260617 20:16:55.982758 29379 tablet_bootstrap.cc:492] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:55.982959 29379 ts_tablet_manager.cc:1403] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s
I20260617 20:16:55.983260 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_00e6d18efea641ec906c6dc4d4d2b1c7" } new_table_name: "default.Table_5ad13ff5116e482e861209d7ef7ba196" modify_external_catalogs: true
I20260617 20:16:55.983769 29379 raft_consensus.cc:359] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.984043 29379 raft_consensus.cc:385] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:55.984154 29379 raft_consensus.cc:740] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:55.984602 29379 consensus_queue.cc:260] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:55.985391 29379 ts_tablet_manager.cc:1434] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:55.985715 29379 tablet_bootstrap.cc:492] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:55.987172 28661 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_7e36e71e8aca4a5e8813c465c31db50a [id=de24e09cee8e4f28998625c2697769b3]). Expected version 1 got 0
I20260617 20:16:55.987651 29379 tablet_bootstrap.cc:654] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:55.988009 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f7ba6da717cb4d2f9cce7ff504334ae0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:55.988574 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7ba6da717cb4d2f9cce7ff504334ae0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:55.998798 29378 tablet_bootstrap.cc:492] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:55.999002 29378 ts_tablet_manager.cc:1403] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.002s
I20260617 20:16:55.999864 29378 raft_consensus.cc:359] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.000089 29378 raft_consensus.cc:385] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.000170 29378 raft_consensus.cc:740] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.000407 29378 consensus_queue.cc:260] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.002127 29378 ts_tablet_manager.cc:1434] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:56.002463 29378 tablet_bootstrap.cc:492] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.010707 29378 tablet_bootstrap.cc:654] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:56.013406 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 07ec778da4c9467d90c7151f36ffaa79 consensus state has no leader
I20260617 20:16:56.015455 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_63d1c7b660324600bb6950041e28f284" } modify_external_catalogs: true
I20260617 20:16:56.015667 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_63d1c7b660324600bb6950041e28f284" } modify_external_catalogs: true
I20260617 20:16:55.984899 29383 raft_consensus.cc:740] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.017535 29383 consensus_queue.cc:260] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.022039 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet dd4f190a1005433ebcfbfe3a86aa9e70 (table default.Table_07f654ca505c4bc5bc80b432a51acaa8 [id=556d100af09b4115bb4acc3f5f4dfade]) successfully deleted
W20260617 20:16:56.022207 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb consensus state has no leader
I20260617 20:16:56.022506 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet 67a3124306094c72ad78e5473aa35bdb from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:56.023288 29383 ts_tablet_manager.cc:1434] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.112s user 0.016s sys 0.004s
I20260617 20:16:56.022992 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 472) took 1951 ms. Trace:
I20260617 20:16:56.023540 29375 rpcz_store.cc:276] 0617 20:16:54.071455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.071555 (+ 100us) service_pool.cc:224] Handling call
0617 20:16:56.022321 (+1950766us) ts_tablet_manager.cc:1151] Deleting tablet b427ba6320be4f2a929eaf18a56b4309
0617 20:16:56.022335 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.022923 (+ 588us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1920673}
I20260617 20:16:56.024863 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet b3ea76ad1ec64d22a64bdd4c97e288c6 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:56.029551 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 483) took 1887 ms. Trace:
I20260617 20:16:56.029675 29375 rpcz_store.cc:276] 0617 20:16:54.142467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.143664 (+ 1197us) service_pool.cc:224] Handling call
0617 20:16:56.028045 (+1884381us) ts_tablet_manager.cc:1151] Deleting tablet 89d79b7023ae478698a06562b2e4c578
0617 20:16:56.028057 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.029474 (+ 1417us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1871480}
W20260617 20:16:56.030208 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 89d79b7023ae478698a06562b2e4c578 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89d79b7023ae478698a06562b2e4c578 already in progress: creating tablet
I20260617 20:16:56.027087 29383 tablet_bootstrap.cc:492] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.032215 29383 tablet_bootstrap.cc:654] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.032616 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_01d83f6f43f542bab1b5d209557c8ff9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.033205 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01d83f6f43f542bab1b5d209557c8ff9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.034545 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 482) took 1892 ms. Trace:
I20260617 20:16:56.034657 29375 rpcz_store.cc:276] 0617 20:16:54.142386 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.143643 (+ 1257us) service_pool.cc:224] Handling call
0617 20:16:56.034370 (+1890727us) ts_tablet_manager.cc:1151] Deleting tablet 30f6dcc384154d41866cf8060cf05837
0617 20:16:56.034381 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.034488 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1870201}
W20260617 20:16:56.035130 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 30f6dcc384154d41866cf8060cf05837 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30f6dcc384154d41866cf8060cf05837 already in progress: creating tablet
I20260617 20:16:56.035557 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 492) took 1563 ms. Trace:
I20260617 20:16:56.035655 29375 rpcz_store.cc:276] 0617 20:16:54.472031 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.472167 (+ 136us) service_pool.cc:224] Handling call
0617 20:16:56.035375 (+1563208us) ts_tablet_manager.cc:1151] Deleting tablet c4b2d190dda24f0e800b6f75bc165a57
0617 20:16:56.035385 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.035486 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1562932}
W20260617 20:16:56.036130 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet c4b2d190dda24f0e800b6f75bc165a57 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4b2d190dda24f0e800b6f75bc165a57 already in progress: creating tablet
I20260617 20:16:56.041510 29375 tablet_replica.cc:333] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:56.041733 29375 raft_consensus.cc:2243] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.041941 29375 raft_consensus.cc:2272] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.042514 29375 ts_tablet_manager.cc:1916] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.045702 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 379ef43e02ec4bbbb03f2d6a53a66403 with delete_type TABLET_DATA_DELETED (replaced by tablet 80d778641c354c679ee9e7d7b3eae3b5) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.045621 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_18d04b2793af4915ac6a2f592f197b41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.046188 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:56.046216 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18d04b2793af4915ac6a2f592f197b41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.048039 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e48a4a827d44afca912dc8723be4542 with delete_type TABLET_DATA_DELETED (replaced by tablet 33b01c9c27904a1986e285477921ac4f) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.048223 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet d738ab2f8c784c76947a3a76bd040219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.051628 29379 tablet_bootstrap.cc:492] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:56.052094 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_68a5110f6e914dc5882d9f2cb6ab132d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.052603 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68a5110f6e914dc5882d9f2cb6ab132d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.054661 29379 ts_tablet_manager.cc:1403] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.069s user 0.014s sys 0.018s
I20260617 20:16:56.055471 29379 raft_consensus.cc:359] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:56.055761 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f544f486c144cd89ca7c5b83d252ee9 consensus state has no leader
I20260617 20:16:56.056763 28987 raft_consensus.cc:1275] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Refusing update from remote peer a8c0aea0206f44d683ed3b6b18c719f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:56.057526 30061 consensus_queue.cc:1048] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:56.064779 28667 catalog_manager.cc:5696] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:56.065404 28667 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet dcd999d88d954e50810cc01b297a27a9 (table default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a]). Expected version 1 got 0
I20260617 20:16:56.056663 29126 raft_consensus.cc:3060] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.066299 29379 raft_consensus.cc:385] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.066376 29379 raft_consensus.cc:740] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.067319 29379 consensus_queue.cc:260] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.067727 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a819956f29954a4dbbd1aa1dcccad3c0
I20260617 20:16:56.068214 28665 catalog_manager.cc:6784] ReplaceTablet: tablet a819956f29954a4dbbd1aa1dcccad3c0 deleted and replaced by tablet ccd6f76a201e40f8be224a93c701fea9
I20260617 20:16:56.068589 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet a819956f29954a4dbbd1aa1dcccad3c0 with delete_type TABLET_DATA_DELETED (replaced by tablet ccd6f76a201e40f8be224a93c701fea9) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.069118 29126 raft_consensus.cc:1275] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Refusing update from remote peer a8c0aea0206f44d683ed3b6b18c719f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:56.069550 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet a819956f29954a4dbbd1aa1dcccad3c0 with delete_type TABLET_DATA_DELETED (replaced by tablet ccd6f76a201e40f8be224a93c701fea9) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.070015 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet a819956f29954a4dbbd1aa1dcccad3c0 with delete_type TABLET_DATA_DELETED (replaced by tablet ccd6f76a201e40f8be224a93c701fea9) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.070063 29379 ts_tablet_manager.cc:1434] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260617 20:16:56.070349 29379 tablet_bootstrap.cc:492] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:56.070741 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet a819956f29954a4dbbd1aa1dcccad3c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a819956f29954a4dbbd1aa1dcccad3c0 already in progress: creating tablet
I20260617 20:16:56.071075 30061 consensus_queue.cc:1048] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:56.073275 29379 tablet_bootstrap.cc:654] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.076614 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb
I20260617 20:16:56.077158 28666 catalog_manager.cc:6784] ReplaceTablet: tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb deleted and replaced by tablet 77f685eeac48402888cbc8ef97fb4b94
I20260617 20:16:56.077414 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 7cafcade995b407f84f56b8cd3ab6892 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:56.077499 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb with delete_type TABLET_DATA_DELETED (replaced by tablet 77f685eeac48402888cbc8ef97fb4b94) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.078001 29378 tablet_bootstrap.cc:492] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.078083 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb with delete_type TABLET_DATA_DELETED (replaced by tablet 77f685eeac48402888cbc8ef97fb4b94) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.078272 29378 ts_tablet_manager.cc:1403] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.076s user 0.020s sys 0.000s
I20260617 20:16:56.078308 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb with delete_type TABLET_DATA_DELETED (replaced by tablet 77f685eeac48402888cbc8ef97fb4b94) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.082180 29378 raft_consensus.cc:359] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:56.082914 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb already in progress: creating tablet
I20260617 20:16:56.083673 29378 raft_consensus.cc:385] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.083906 29378 raft_consensus.cc:740] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.084373 29378 consensus_queue.cc:260] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.086163 29378 ts_tablet_manager.cc:1434] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:16:56.087134 29378 tablet_bootstrap.cc:492] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.087356 29376 ts_tablet_manager.cc:1929] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:56.094863 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bce9de9998f24268b102dad1f0842744" } new_table_name: "default.Table_d5047dfc8e9a4e96b1f0bc078965e6e7" modify_external_catalogs: true
I20260617 20:16:56.098201 29378 tablet_bootstrap.cc:654] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.101090 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 8a56191018d04a2881ee3e1a243c1a19
I20260617 20:16:56.102164 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a56191018d04a2881ee3e1a243c1a19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.102669 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a56191018d04a2881ee3e1a243c1a19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:56.103430 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 8a56191018d04a2881ee3e1a243c1a19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a56191018d04a2881ee3e1a243c1a19 already in progress: creating tablet
I20260617 20:16:56.103919 29375 ts_tablet_manager.cc:1929] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.105443 29378 tablet_bootstrap.cc:492] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.105631 29378 ts_tablet_manager.cc:1403] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.000s
I20260617 20:16:56.106386 29378 raft_consensus.cc:359] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.106639 29378 raft_consensus.cc:385] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.106745 29378 raft_consensus.cc:740] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.107059 29378 consensus_queue.cc:260] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.107056 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_322d72936e094dd184fd2d62cdb77743"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.107688 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_322d72936e094dd184fd2d62cdb77743 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.109982 29376 log.cc:1199] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/3e287ba95be7408b8fc75e6f0709d8f1
I20260617 20:16:56.088195 29383 tablet_bootstrap.cc:492] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.110535 29383 ts_tablet_manager.cc:1403] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.084s user 0.002s sys 0.010s
I20260617 20:16:56.102660 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a56191018d04a2881ee3e1a243c1a19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.111320 29383 raft_consensus.cc:359] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.111479 29383 raft_consensus.cc:385] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.111538 29383 raft_consensus.cc:740] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.111735 29383 consensus_queue.cc:260] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.112210 29383 ts_tablet_manager.cc:1434] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:56.112516 29383 tablet_bootstrap.cc:492] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.113969 30100 tablet.cc:1724] T e7f822e3f4ca4946a116ee172e83628b P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:56.114773 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b3ea76ad1ec64d22a64bdd4c97e288c6
I20260617 20:16:56.115239 28664 catalog_manager.cc:6784] ReplaceTablet: tablet b3ea76ad1ec64d22a64bdd4c97e288c6 deleted and replaced by tablet 6c75f2c8fab9468194d79c972692684e
I20260617 20:16:56.116962 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet b3ea76ad1ec64d22a64bdd4c97e288c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c75f2c8fab9468194d79c972692684e) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.118251 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a41d5a63ab0c47adafaeff2f42205397" } modify_external_catalogs: true
I20260617 20:16:56.118443 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a41d5a63ab0c47adafaeff2f42205397" } modify_external_catalogs: true
I20260617 20:16:56.119516 29376 ts_tablet_manager.cc:1950] T 3e287ba95be7408b8fc75e6f0709d8f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.120599 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 3e287ba95be7408b8fc75e6f0709d8f1 (table default.Table_20465bbedb344857a72376aa345ec532 [id=f673f240ab2341c39c57117ea2e4d92a]) successfully deleted
I20260617 20:16:56.121353 29383 tablet_bootstrap.cc:654] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.115604 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet b3ea76ad1ec64d22a64bdd4c97e288c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c75f2c8fab9468194d79c972692684e) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.133270 29377 tablet_replica.cc:333] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:56.133348 29916 raft_consensus.cc:493] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.133497 29377 raft_consensus.cc:2243] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.133463 29916 raft_consensus.cc:515] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.133617 29377 raft_consensus.cc:2272] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.134078 29916 leader_election.cc:290] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:56.134166 29377 ts_tablet_manager.cc:1916] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.134791 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d373f177494f1486fcae4a67a13041" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:56.135295 28925 leader_election.cc:343] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.136574 29378 ts_tablet_manager.cc:1434] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20260617 20:16:56.138193 29378 tablet_bootstrap.cc:492] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.138903 30060 raft_consensus.cc:493] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.139043 30060 raft_consensus.cc:515] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.139640 30060 leader_election.cc:290] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:56.140908 29197 leader_election.cc:343] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 7b00437fb76c4000ad89c99ab2da2261
I20260617 20:16:56.140959 29377 ts_tablet_manager.cc:1929] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.141044 29377 log.cc:1199] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/b3ea76ad1ec64d22a64bdd4c97e288c6
I20260617 20:16:56.141475 29377 ts_tablet_manager.cc:1950] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:56.114744 30102 tablet.cc:1724] T e7f822e3f4ca4946a116ee172e83628b P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:56.142566 29375 log.cc:1199] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/569e339c17764486a65a1c3b43c92adf
I20260617 20:16:56.142680 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet b3ea76ad1ec64d22a64bdd4c97e288c6 (table default.Table_1944004da2ec4937b26d524aa808d0b3 [id=295609419d07485fa5651914ddd75ce8]) successfully deleted
I20260617 20:16:56.116809 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet b3ea76ad1ec64d22a64bdd4c97e288c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c75f2c8fab9468194d79c972692684e) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.142879 29375 ts_tablet_manager.cc:1950] T 569e339c17764486a65a1c3b43c92adf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:56.143641 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 493) took 1671 ms. Trace:
W20260617 20:16:56.143658 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5faea831376646c1bdfcaf8fbbc7ca6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5faea831376646c1bdfcaf8fbbc7ca6d already in progress: creating tablet
W20260617 20:16:56.144445 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 33b01c9c27904a1986e285477921ac4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33b01c9c27904a1986e285477921ac4f already in progress: creating tablet
I20260617 20:16:56.144996 29916 raft_consensus.cc:493] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.145169 29376 tablet_replica.cc:333] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.145129 29916 raft_consensus.cc:515] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.145367 29376 raft_consensus.cc:2243] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:56.145578 29376 pending_rounds.cc:70] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:56.145622 29376 pending_rounds.cc:77] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955495653466112 op_type: NO_OP noop_request { }
I20260617 20:16:56.145697 29376 raft_consensus.cc:2889] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:56.145725 29916 leader_election.cc:290] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:56.145774 29376 raft_consensus.cc:2272] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.147193 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a17f7ef070d4879a520a3eb6bdf3d23" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:56.147238 29376 ts_tablet_manager.cc:1916] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:56.147671 28925 leader_election.cc:343] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.134742 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d373f177494f1486fcae4a67a13041" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.140040 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b00437fb76c4000ad89c99ab2da2261" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.151538 29375 rpcz_store.cc:276] 0617 20:16:54.472128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.481147 (+ 9019us) service_pool.cc:224] Handling call
0617 20:16:56.041410 (+1560263us) ts_tablet_manager.cc:1151] Deleting tablet 569e339c17764486a65a1c3b43c92adf
0617 20:16:56.041421 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.095220 (+ 53799us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.103864 (+ 8644us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.143617 (+ 39753us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1559961}
I20260617 20:16:56.146557 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a17f7ef070d4879a520a3eb6bdf3d23" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.152215 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 569e339c17764486a65a1c3b43c92adf (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]) successfully deleted
W20260617 20:16:56.152475 29198 leader_election.cc:343] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.152604 29198 leader_election.cc:304] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:16:56.153224 28925 leader_election.cc:343] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.153388 28925 leader_election.cc:304] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:56.153812 28925 leader_election.cc:343] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.153908 29375 tablet_replica.cc:333] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:56.153911 28925 leader_election.cc:304] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:56.154084 29375 raft_consensus.cc:2243] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:56.154506 30060 raft_consensus.cc:2749] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.119958 29379 tablet_bootstrap.cc:492] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:56.154883 29379 ts_tablet_manager.cc:1403] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.085s user 0.006s sys 0.006s
I20260617 20:16:56.155643 29379 raft_consensus.cc:359] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.155807 29379 raft_consensus.cc:385] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.155848 29379 raft_consensus.cc:740] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.156052 29379 consensus_queue.cc:260] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.156401 29916 raft_consensus.cc:2749] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.156559 29916 raft_consensus.cc:2749] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.156821 29376 ts_tablet_manager.cc:1929] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:56.159237 29379 ts_tablet_manager.cc:1434] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:16:56.159577 29379 tablet_bootstrap.cc:492] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:56.160169 29376 log.cc:1199] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/0d1a416f802948d5bc150855d82b54c1
I20260617 20:16:56.160884 29376 ts_tablet_manager.cc:1950] T 0d1a416f802948d5bc150855d82b54c1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.162518 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 0d1a416f802948d5bc150855d82b54c1 (table default.Table_77d3422ed47c4d68ae6f518500ea89b1 [id=071053dd948345bd9bc5d8b3cffe7935]) successfully deleted
I20260617 20:16:56.163410 29379 tablet_bootstrap.cc:654] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:56.164551 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet adbc3219639748d9a0d71d45ae22ab36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbc3219639748d9a0d71d45ae22ab36 already in progress: creating tablet
W20260617 20:16:56.164860 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet eb408723f7a346c3b5ea13cad237b44e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb408723f7a346c3b5ea13cad237b44e already in progress: creating tablet
W20260617 20:16:56.165136 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet fee909c8988d49779612e98f5cd82972 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fee909c8988d49779612e98f5cd82972 already in progress: creating tablet
W20260617 20:16:56.165422 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 7f47e81154eb48fb9e891cfff5250af2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f47e81154eb48fb9e891cfff5250af2 already in progress: creating tablet
I20260617 20:16:56.165742 29376 tablet_replica.cc:333] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.165932 29376 raft_consensus.cc:2243] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.166090 29376 raft_consensus.cc:2272] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.166612 29376 ts_tablet_manager.cc:1916] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.172451 29378 tablet_bootstrap.cc:654] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.174252 29383 tablet_bootstrap.cc:492] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.174463 29383 ts_tablet_manager.cc:1403] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.062s user 0.007s sys 0.003s
I20260617 20:16:56.174439 29998 raft_consensus.cc:493] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.174588 29998 raft_consensus.cc:515] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.175230 29998 leader_election.cc:290] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.175211 29383 raft_consensus.cc:359] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.175375 29383 raft_consensus.cc:385] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.175422 29383 raft_consensus.cc:740] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.175683 29383 consensus_queue.cc:260] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:56.177376 29062 leader_election.cc:343] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 2d0c245563fe44b59d32616bd35d3dae
I20260617 20:16:56.177650 29998 raft_consensus.cc:493] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.177754 29998 raft_consensus.cc:515] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.178293 29998 leader_election.cc:290] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:56.179229 29063 leader_election.cc:343] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 2d0c245563fe44b59d32616bd35d3dae
I20260617 20:16:56.179260 29376 ts_tablet_manager.cc:1929] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:16:56.179311 29062 leader_election.cc:343] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3e80e776263c4a91ae7fffa9d0f4ebd4
I20260617 20:16:56.179366 29376 log.cc:1199] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/08911643f3ca451d80e2471b1b5b2342
I20260617 20:16:56.179332 29063 leader_election.cc:304] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:56.179652 29376 ts_tablet_manager.cc:1950] T 08911643f3ca451d80e2471b1b5b2342 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.179979 29955 raft_consensus.cc:2749] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.180740 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e80e776263c4a91ae7fffa9d0f4ebd4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:56.180976 29263 raft_consensus.cc:2468] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
W20260617 20:16:56.181493 29062 consensus_peers.cc:597] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17917ffc3e8f43afb2a8bc413159137c. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:56.181463 29063 leader_election.cc:304] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:56.181955 29998 raft_consensus.cc:2804] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.182036 29998 raft_consensus.cc:493] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.182108 29998 raft_consensus.cc:3060] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.183082 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 08911643f3ca451d80e2471b1b5b2342 (table default.Table_1ce996ccf50542bfb287108b493eb4cc [id=c02a5e81598b47b9830a236256da4bba]) successfully deleted
W20260617 20:16:56.184229 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet dd89c8452c444af99d8bce0c7cbf8ce1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd89c8452c444af99d8bce0c7cbf8ce1 already in progress: creating tablet
I20260617 20:16:56.184954 29998 raft_consensus.cc:515] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:16:56.185221 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3df2d190c1234ac3b5950d348ed2c701 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3df2d190c1234ac3b5950d348ed2c701 already in progress: creating tablet
I20260617 20:16:56.185735 29376 tablet_replica.cc:333] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.186094 29998 leader_election.cc:290] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.186133 29376 raft_consensus.cc:2243] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.186537 29376 raft_consensus.cc:2272] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.154891 30103 tablet.cc:1724] T e7f822e3f4ca4946a116ee172e83628b P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:56.186753 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e80e776263c4a91ae7fffa9d0f4ebd4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:56.186971 29263 raft_consensus.cc:3060] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.187577 29375 raft_consensus.cc:2272] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.187767 29376 ts_tablet_manager.cc:1916] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.188370 29375 ts_tablet_manager.cc:1916] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:56.189554 29062 leader_election.cc:343] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3e80e776263c4a91ae7fffa9d0f4ebd4
I20260617 20:16:56.190018 29263 raft_consensus.cc:2468] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:56.190519 29063 leader_election.cc:304] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:56.191015 29998 raft_consensus.cc:2804] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:56.192246 29998 raft_consensus.cc:697] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:56.192543 29998 consensus_queue.cc:237] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.193325 29376 ts_tablet_manager.cc:1929] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.200693 29376 log.cc:1199] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/379ef43e02ec4bbbb03f2d6a53a66403
I20260617 20:16:56.201328 29376 ts_tablet_manager.cc:1950] T 379ef43e02ec4bbbb03f2d6a53a66403 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.202978 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 379ef43e02ec4bbbb03f2d6a53a66403 (table default.Table_0f2a772bda6e4476b8b5a42f9d0fb42f [id=de3384ef7984460abc15ca893a9f8c83]) successfully deleted
I20260617 20:16:56.203653 29376 tablet_replica.cc:333] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.203747 29383 ts_tablet_manager.cc:1434] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20260617 20:16:56.203878 29376 raft_consensus.cc:2243] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.204218 29379 tablet_bootstrap.cc:492] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:56.204159 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_636eb4922f27475dacee040515cd1500" } modify_external_catalogs: true
I20260617 20:16:56.204344 29379 ts_tablet_manager.cc:1403] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.045s user 0.009s sys 0.006s
I20260617 20:16:56.204375 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_636eb4922f27475dacee040515cd1500" } modify_external_catalogs: true
I20260617 20:16:56.205186 29379 raft_consensus.cc:359] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.205376 29379 raft_consensus.cc:385] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.205428 29379 raft_consensus.cc:740] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.205631 29379 consensus_queue.cc:260] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.206141 29379 ts_tablet_manager.cc:1434] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:56.207089 29379 tablet_bootstrap.cc:492] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:56.208827 29379 tablet_bootstrap.cc:654] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.214013 29376 raft_consensus.cc:2272] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.215245 29376 ts_tablet_manager.cc:1916] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.217922 29383 tablet_bootstrap.cc:492] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.219576 29383 tablet_bootstrap.cc:654] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.221091 29378 tablet_bootstrap.cc:492] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.221316 29378 ts_tablet_manager.cc:1403] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.001s
I20260617 20:16:56.222293 29378 raft_consensus.cc:359] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.222590 29378 raft_consensus.cc:385] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.222707 29378 raft_consensus.cc:740] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.223917 29378 consensus_queue.cc:260] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.224854 29378 ts_tablet_manager.cc:1434] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:56.227591 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 7cafcade995b407f84f56b8cd3ab6892
I20260617 20:16:56.228025 28666 catalog_manager.cc:6784] ReplaceTablet: tablet 7cafcade995b407f84f56b8cd3ab6892 deleted and replaced by tablet fb2a0578122c421ab45bf56edb7cffdb
W20260617 20:16:56.228637 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29a176d1f3b0446984af141e02bac329 consensus state has no leader
I20260617 20:16:56.229032 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cafcade995b407f84f56b8cd3ab6892 with delete_type TABLET_DATA_DELETED (replaced by tablet fb2a0578122c421ab45bf56edb7cffdb) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.229993 28665 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet a857c28d94f04dabb9a57aeca662b836 (table default.Table_1d1b3b6470e146c189f41d0e2fcd63c5 [id=3201002f51ca4f788cc1e153333862d4]). Expected version 1 got 0
I20260617 20:16:56.230602 29378 tablet_bootstrap.cc:492] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.231417 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 08911643f3ca451d80e2471b1b5b2342 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.233444 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.233961 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b00437fb76c4000ad89c99ab2da2261 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.235749 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cafcade995b407f84f56b8cd3ab6892 with delete_type TABLET_DATA_DELETED (replaced by tablet fb2a0578122c421ab45bf56edb7cffdb) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.236107 29378 tablet_bootstrap.cc:654] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:56.236377 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 7cafcade995b407f84f56b8cd3ab6892 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cafcade995b407f84f56b8cd3ab6892 already in progress: creating tablet
I20260617 20:16:56.239027 29375 ts_tablet_manager.cc:1929] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:56.239142 29375 log.cc:1199] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/86dd216fa0ab46f5bb16e1b7bf1ca4f9
I20260617 20:16:56.241940 29375 ts_tablet_manager.cc:1950] T 86dd216fa0ab46f5bb16e1b7bf1ca4f9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:56.243250 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 494) took 1761 ms. Trace:
I20260617 20:16:56.243671 29375 rpcz_store.cc:276] 0617 20:16:54.481604 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.481795 (+ 191us) service_pool.cc:224] Handling call
0617 20:16:56.153832 (+1672037us) ts_tablet_manager.cc:1151] Deleting tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9
0617 20:16:56.153851 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.225640 (+ 71789us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.238970 (+ 13330us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.243235 (+ 4265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1671738}
I20260617 20:16:56.244154 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 86dd216fa0ab46f5bb16e1b7bf1ca4f9 (table default.Table_baac68c808f240b481611d52f21d428e [id=e6d0b31f8a8c40e8a9c5bf4ee11ea293]) successfully deleted
I20260617 20:16:56.245605 29375 tablet_replica.cc:333] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:56.246910 29379 tablet_bootstrap.cc:492] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:56.250798 29379 ts_tablet_manager.cc:1403] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.011s
I20260617 20:16:56.251610 29379 raft_consensus.cc:359] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.251788 29379 raft_consensus.cc:385] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.251853 29379 raft_consensus.cc:740] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.252074 29379 consensus_queue.cc:260] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.252592 29379 ts_tablet_manager.cc:1434] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:56.254232 29379 tablet_bootstrap.cc:492] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:56.256278 29379 tablet_bootstrap.cc:654] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.261327 29375 raft_consensus.cc:2243] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.261325 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b5ce299906ed496b81dbaf936e215598"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.261502 29375 raft_consensus.cc:2272] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:56.261968 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5ce299906ed496b81dbaf936e215598 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.262023 29375 ts_tablet_manager.cc:1916] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.262645 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_479db691829f41f8a1c2b7082935d1ac" } modify_external_catalogs: true
I20260617 20:16:56.262837 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_479db691829f41f8a1c2b7082935d1ac" } modify_external_catalogs: true
I20260617 20:16:56.263299 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c9f56913d2c44e0ab075f05ddeb35442"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.263849 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9f56913d2c44e0ab075f05ddeb35442 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.263952 29998 raft_consensus.cc:493] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.264086 29998 raft_consensus.cc:515] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.264209 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_82cae984e6c341f18a7f783102a490f8" } new_table_name: "default.Table_a6787e5dc20a42b6812d3cd0acc6112c" modify_external_catalogs: true
I20260617 20:16:56.264726 29998 leader_election.cc:290] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.265096 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ee6d0ff0a92e42e59d1be2988aa3e5b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.265611 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee6d0ff0a92e42e59d1be2988aa3e5b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.266129 29378 tablet_bootstrap.cc:492] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.266063 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e48a4a827d44afca912dc8723be4542" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:56.266253 29378 ts_tablet_manager.cc:1403] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.002s
I20260617 20:16:56.266256 29263 raft_consensus.cc:2468] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:56.266665 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1944004da2ec4937b26d524aa808d0b3" } modify_external_catalogs: true
I20260617 20:16:56.266819 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1944004da2ec4937b26d524aa808d0b3" } modify_external_catalogs: true
W20260617 20:16:56.266871 29062 leader_election.cc:343] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 7e48a4a827d44afca912dc8723be4542
I20260617 20:16:56.267102 29063 leader_election.cc:304] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:56.267051 29378 raft_consensus.cc:359] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.267210 29378 raft_consensus.cc:385] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.267257 29378 raft_consensus.cc:740] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.267678 29998 raft_consensus.cc:2804] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.267748 29998 raft_consensus.cc:493] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.267803 29998 raft_consensus.cc:3060] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.267905 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_26c8b16b5bf24bda8bf9851b87f0bde0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.268335 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26c8b16b5bf24bda8bf9851b87f0bde0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.270370 29998 raft_consensus.cc:515] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.271270 29383 tablet_bootstrap.cc:492] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.271310 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e48a4a827d44afca912dc8723be4542" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:56.271402 29383 ts_tablet_manager.cc:1403] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.003s
I20260617 20:16:56.271462 29263 raft_consensus.cc:3060] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.272147 29383 raft_consensus.cc:359] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.272284 29383 raft_consensus.cc:385] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.272344 29383 raft_consensus.cc:740] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.272529 29383 consensus_queue.cc:260] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.273917 29263 raft_consensus.cc:2468] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:56.274214 29383 ts_tablet_manager.cc:1434] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:56.274500 29383 tablet_bootstrap.cc:492] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.274748 29063 leader_election.cc:304] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:56.275179 29955 raft_consensus.cc:2804] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:56.277428 30106 raft_consensus.cc:493] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.277554 30106 raft_consensus.cc:515] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.278182 30106 leader_election.cc:290] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:56.286756 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3278efaad07403ca0a2baecad46d0f1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.286979 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a8eefc4f3c7d4f468c0adca837b73bb2
W20260617 20:16:56.287570 28925 leader_election.cc:343] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.287639 29378 consensus_queue.cc:260] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.287879 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet a8eefc4f3c7d4f468c0adca837b73bb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.288055 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet a8eefc4f3c7d4f468c0adca837b73bb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.288133 29377 tablet_replica.cc:333] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:56.288303 29377 raft_consensus.cc:2243] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.288476 29377 raft_consensus.cc:2272] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.288560 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3278efaad07403ca0a2baecad46d0f1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:56.289004 29377 ts_tablet_manager.cc:1916] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.289096 30060 raft_consensus.cc:493] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.289197 30060 raft_consensus.cc:515] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.289758 30060 leader_election.cc:290] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:56.290097 28925 leader_election.cc:343] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.290182 28925 leader_election.cc:304] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:56.290629 30106 raft_consensus.cc:2749] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.291265 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bb6d176a4845eca312848ae5104647" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:56.291333 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bb6d176a4845eca312848ae5104647" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.291432 28987 raft_consensus.cc:2468] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:56.291846 29197 leader_election.cc:304] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:16:56.292002 29198 leader_election.cc:343] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.292279 30060 raft_consensus.cc:2804] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.292341 30060 raft_consensus.cc:493] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.292393 30060 raft_consensus.cc:3060] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.294198 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet e3897179e7724fdeb87a979ae4ef2091
I20260617 20:16:56.295433 29378 ts_tablet_manager.cc:1434] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.029s user 0.002s sys 0.000s
W20260617 20:16:56.296725 29062 leader_election.cc:343] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 7e48a4a827d44afca912dc8723be4542
I20260617 20:16:56.297149 29998 leader_election.cc:290] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.295747 29378 tablet_bootstrap.cc:492] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.295450 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet e3897179e7724fdeb87a979ae4ef2091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:56.299259 29063 consensus_peers.cc:597] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17917ffc3e8f43afb2a8bc413159137c. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:56.295168 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet e3897179e7724fdeb87a979ae4ef2091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.294811 30060 raft_consensus.cc:515] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.301029 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bb6d176a4845eca312848ae5104647" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:16:56.301565 29198 leader_election.cc:343] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.301910 30060 leader_election.cc:290] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.302399 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bb6d176a4845eca312848ae5104647" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:56.302543 28987 raft_consensus.cc:3060] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.302873 29377 ts_tablet_manager.cc:1929] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.302989 29377 log.cc:1199] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/a8eefc4f3c7d4f468c0adca837b73bb2
I20260617 20:16:56.305047 28987 raft_consensus.cc:2468] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:56.306075 29379 tablet_bootstrap.cc:492] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:56.306196 29379 ts_tablet_manager.cc:1403] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.002s
I20260617 20:16:56.306993 29379 raft_consensus.cc:359] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.307152 29379 raft_consensus.cc:385] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.307204 29379 raft_consensus.cc:740] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.307364 29379 consensus_queue.cc:260] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.307838 29379 ts_tablet_manager.cc:1434] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:56.308074 29379 tablet_bootstrap.cc:492] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:56.233670 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cafcade995b407f84f56b8cd3ab6892 with delete_type TABLET_DATA_DELETED (replaced by tablet fb2a0578122c421ab45bf56edb7cffdb) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.233814 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d1a416f802948d5bc150855d82b54c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.309764 29197 leader_election.cc:304] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:56.310353 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c237cdc555974e0e8a2bc336adf356a6" } new_table_name: "default.Table_4a5199c078ea4aa18d688909588c0a96" modify_external_catalogs: true
I20260617 20:16:56.310534 30060 raft_consensus.cc:2804] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:56.311018 30060 raft_consensus.cc:697] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:56.311270 30060 consensus_queue.cc:237] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.311695 29955 raft_consensus.cc:697] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:56.312110 29955 consensus_queue.cc:237] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.312592 29379 tablet_bootstrap.cc:654] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.313287 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_08034aa4f7de43169cb855082c050daa" } new_table_name: "default.Table_2ad82bac5fac4ab8964031a88138d64d" modify_external_catalogs: true
I20260617 20:16:56.316809 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet a8eefc4f3c7d4f468c0adca837b73bb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.316915 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet e3897179e7724fdeb87a979ae4ef2091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:56.322280 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a20867de1214c0fb4cb8504e8361c5b consensus state has no leader
I20260617 20:16:56.322786 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4f1e9321b3c548eeb322bd50ae32a077"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.322989 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_61769387a2da409d86a5ce7c83821992" } new_table_name: "default.Table_8d8166172c80424da57e5f348c59a32c" modify_external_catalogs: true
W20260617 20:16:56.323348 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f1e9321b3c548eeb322bd50ae32a077 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.330253 28667 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 6c75f2c8fab9468194d79c972692684e
I20260617 20:16:56.330644 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ecf2ff52cdbb4225b5543050fe111b98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.331121 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecf2ff52cdbb4225b5543050fe111b98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.294509 29383 tablet_bootstrap.cc:654] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:56.338563 29062 consensus_peers.cc:597] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57e19abe093a40f6886908a8a3a0cad4. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:56.339000 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1d1b3b6470e146c189f41d0e2fcd63c5" } modify_external_catalogs: true
I20260617 20:16:56.339171 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1d1b3b6470e146c189f41d0e2fcd63c5" } modify_external_catalogs: true
I20260617 20:16:56.221217 29376 ts_tablet_manager.cc:1929] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.341404 29376 log.cc:1199] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/3e80e776263c4a91ae7fffa9d0f4ebd4
I20260617 20:16:56.342806 29955 raft_consensus.cc:493] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.342932 29955 raft_consensus.cc:515] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.344089 29955 leader_election.cc:290] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.344579 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e53946c85ab4a8286a6e174cc411c5e" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:56.344853 28987 raft_consensus.cc:2468] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
W20260617 20:16:56.345109 29063 consensus_peers.cc:597] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b65814c56424256b53d3c9f94c1b74a. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:56.345283 29062 leader_election.cc:304] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:56.345834 29955 raft_consensus.cc:2804] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.345963 29955 raft_consensus.cc:493] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.346083 29955 raft_consensus.cc:3060] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.348134 29375 ts_tablet_manager.cc:1929] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.348253 29375 log.cc:1199] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/98467525f81f4a48878eae17e3a9c982
I20260617 20:16:56.348582 29375 ts_tablet_manager.cc:1950] T 98467525f81f4a48878eae17e3a9c982 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:56.348798 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_7e36e71e8aca4a5e8813c465c31db50a [id=de24e09cee8e4f28998625c2697769b3]). Expected version 1 got 0
I20260617 20:16:56.348879 29955 raft_consensus.cc:515] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.349030 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 495) took 1866 ms. Trace:
I20260617 20:16:56.350054 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f43bb549bf7345e1ad723086a9536f11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.350271 29379 tablet_bootstrap.cc:492] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:56.350380 29379 ts_tablet_manager.cc:1403] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.003s
W20260617 20:16:56.350692 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f43bb549bf7345e1ad723086a9536f11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.351220 29379 raft_consensus.cc:359] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.351357 29379 raft_consensus.cc:385] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.351408 29379 raft_consensus.cc:740] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.351632 29379 consensus_queue.cc:260] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.352473 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d373f177494f1486fcae4a67a13041 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.354539 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 5e53946c85ab4a8286a6e174cc411c5e (table default.Table_2ca839bde234444b97808d82d7974e3c [id=e682c8658ea84718a5e3909a6f6b7246]). Expected version 3 got 0
I20260617 20:16:56.354779 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 64bb6d176a4845eca312848ae5104647 (table default.Table_12cb16608a854819a7e0834654f128bb [id=6e89910c5d7a4969a79960d34eff437c]). Expected version 2 got 0
I20260617 20:16:56.356412 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 622ccfd80da446e98a0fedc1085b70d7 (DEFAULT_TABLE table=default.Table_354d9f3267f24461a3968a19cf2f5a70 [id=d1e8431e1f4645a4b58ec89f1974e04d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.356858 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622ccfd80da446e98a0fedc1085b70d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.343914 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e53946c85ab4a8286a6e174cc411c5e" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:56.352073 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e53946c85ab4a8286a6e174cc411c5e" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:56.356714 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 622ccfd80da446e98a0fedc1085b70d7 (DEFAULT_TABLE table=default.Table_354d9f3267f24461a3968a19cf2f5a70 [id=d1e8431e1f4645a4b58ec89f1974e04d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.357467 29263 raft_consensus.cc:2468] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:56.357648 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622ccfd80da446e98a0fedc1085b70d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.357841 29376 ts_tablet_manager.cc:1950] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.357843 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e53946c85ab4a8286a6e174cc411c5e" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:56.358013 28987 raft_consensus.cc:3060] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.358814 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 05494b097ba0480e91d338cf6b50ddc8 (DEFAULT_TABLE table=default.Table_a2f0e4601acf41bcb6c1eb2b630891d0 [id=10b741aa729248bba38640cfbbbb7271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.359746 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 (table default.Table_b50a2ea6dd054c8282ce507b0c871fb2 [id=7d0ccdf07bf14fd1b7fd55deb990bdae]) successfully deleted
I20260617 20:16:56.360780 28987 raft_consensus.cc:2468] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:56.357177 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 05494b097ba0480e91d338cf6b50ddc8 (DEFAULT_TABLE table=default.Table_a2f0e4601acf41bcb6c1eb2b630891d0 [id=10b741aa729248bba38640cfbbbb7271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.361192 28967 tablet_service.cc:1511] Processing CreateTablet for tablet e84c2f0be1ce4ac18f8964c2b717a8f8 (DEFAULT_TABLE table=default.Table_aa868f28a51b48dcbaa47027ea1ee54e [id=402dda6ba37a41cfa20933ed8152918e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.361603 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05494b097ba0480e91d338cf6b50ddc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.361393 30106 raft_consensus.cc:493] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.361711 30106 raft_consensus.cc:515] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.362428 30106 leader_election.cc:290] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:56.363081 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c99389d24d4a8d8c934f0a9b9c2825" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.363181 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c99389d24d4a8d8c934f0a9b9c2825" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:56.363667 28925 leader_election.cc:343] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:56.363871 28925 leader_election.cc:343] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.363950 28925 leader_election.cc:304] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:56.364315 30106 raft_consensus.cc:2749] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.364869 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05494b097ba0480e91d338cf6b50ddc8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:56.365101 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 083b8903abd646dc89717b9d2caf5647 consensus state has no leader
I20260617 20:16:56.365433 29062 leader_election.cc:304] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:56.365752 30117 raft_consensus.cc:493] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.366070 30117 raft_consensus.cc:515] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.367084 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738ab2f8c784c76947a3a76bd040219" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:56.367187 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 3 got 0
I20260617 20:16:56.367250 29263 raft_consensus.cc:2468] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:56.367329 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84c2f0be1ce4ac18f8964c2b717a8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.367442 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_f7130590729b49af9644f1ffa516fe05 [id=6a948594185b42128136770dbe3f0ffb]). Expected version 3 got 0
I20260617 20:16:56.367965 29063 leader_election.cc:304] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:56.370245 29998 raft_consensus.cc:2804] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:56.370770 29376 tablet_replica.cc:333] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.371019 29376 raft_consensus.cc:2243] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.371317 29376 raft_consensus.cc:2272] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:56.372730 29062 leader_election.cc:343] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d738ab2f8c784c76947a3a76bd040219
I20260617 20:16:56.373163 30117 leader_election.cc:290] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:56.374650 29062 consensus_peers.cc:597] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b65814c56424256b53d3c9f94c1b74a. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:56.375147 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 622ccfd80da446e98a0fedc1085b70d7 (DEFAULT_TABLE table=default.Table_354d9f3267f24461a3968a19cf2f5a70 [id=d1e8431e1f4645a4b58ec89f1974e04d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.375381 30117 raft_consensus.cc:2804] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.375458 30117 raft_consensus.cc:493] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.375555 30117 raft_consensus.cc:3060] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.376101 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 05494b097ba0480e91d338cf6b50ddc8 (DEFAULT_TABLE table=default.Table_a2f0e4601acf41bcb6c1eb2b630891d0 [id=10b741aa729248bba38640cfbbbb7271]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.376488 29377 ts_tablet_manager.cc:1950] T a8eefc4f3c7d4f468c0adca837b73bb2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:56.377784 29377 tablet_replica.cc:333] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:56.377995 29377 raft_consensus.cc:2243] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.377986 28669 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c] alter complete (version 1)
I20260617 20:16:56.378131 29377 raft_consensus.cc:2272] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.379181 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet a8eefc4f3c7d4f468c0adca837b73bb2 (table default.Table_a41d5a63ab0c47adafaeff2f42205397 [id=405880e9419e43449f08e705aab0ba7c]) successfully deleted
W20260617 20:16:56.379583 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet e3897179e7724fdeb87a979ae4ef2091 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3897179e7724fdeb87a979ae4ef2091 already in progress: creating tablet
I20260617 20:16:56.379662 29377 ts_tablet_manager.cc:1916] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.381151 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e27c5834baa48ed953fccef54e6c52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.381382 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 0859e56b5b7a483ea5e751f0468cbab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.381983 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet b3278efaad07403ca0a2baecad46d0f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 08290c23fff5449481789b29d15c4781) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.383915 28662 catalog_manager.cc:5696] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:56.384367 28662 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 64bb6d176a4845eca312848ae5104647 (table default.Table_12cb16608a854819a7e0834654f128bb [id=6e89910c5d7a4969a79960d34eff437c]). Expected version 2 got 0
I20260617 20:16:56.386487 29376 ts_tablet_manager.cc:1916] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.386785 29224 tablet_service.cc:1511] Processing CreateTablet for tablet e84c2f0be1ce4ac18f8964c2b717a8f8 (DEFAULT_TABLE table=default.Table_aa868f28a51b48dcbaa47027ea1ee54e [id=402dda6ba37a41cfa20933ed8152918e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.388622 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84c2f0be1ce4ac18f8964c2b717a8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.393251 29955 leader_election.cc:290] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:56.393736 30120 log.cc:927] Time spent T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
I20260617 20:16:56.394495 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622ccfd80da446e98a0fedc1085b70d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:56.394709 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ccd6f76a201e40f8be224a93c701fea9 has no consensus state
I20260617 20:16:56.395373 30117 raft_consensus.cc:515] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.395469 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05494b097ba0480e91d338cf6b50ddc8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:56.396704 29062 leader_election.cc:343] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d738ab2f8c784c76947a3a76bd040219
I20260617 20:16:56.400048 30117 leader_election.cc:290] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.402393 29998 raft_consensus.cc:697] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:56.402510 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet d738ab2f8c784c76947a3a76bd040219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.402745 29998 consensus_queue.cc:237] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.402984 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 379ef43e02ec4bbbb03f2d6a53a66403 with delete_type TABLET_DATA_DELETED (replaced by tablet 80d778641c354c679ee9e7d7b3eae3b5) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.404649 29377 ts_tablet_manager.cc:1929] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.404775 29377 log.cc:1199] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/c8d373f177494f1486fcae4a67a13041
I20260617 20:16:56.405087 29377 ts_tablet_manager.cc:1950] T c8d373f177494f1486fcae4a67a13041 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:56.406288 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet c8d373f177494f1486fcae4a67a13041 (table default.Table_fb580c3d4089464aa53ff2360464aaae [id=9abd27ea648b4d3f9fb79584fe4e9fb8]) successfully deleted
I20260617 20:16:56.406663 29377 tablet_replica.cc:333] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:56.406889 29377 raft_consensus.cc:2243] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.407081 29377 raft_consensus.cc:2272] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.407968 30060 raft_consensus.cc:493] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.408206 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e48a4a827d44afca912dc8723be4542 with delete_type TABLET_DATA_DELETED (replaced by tablet 33b01c9c27904a1986e285477921ac4f) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.408437 30060 raft_consensus.cc:515] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.409538 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 287ddfe1b0a9419aab328beeb579d61b (DEFAULT_TABLE table=default.Table_432834dd55704c4589b84bcfae673d03 [id=7a61e654611a483488b8efdf8c0197bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.409793 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 287ddfe1b0a9419aab328beeb579d61b (DEFAULT_TABLE table=default.Table_432834dd55704c4589b84bcfae673d03 [id=7a61e654611a483488b8efdf8c0197bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.410000 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287ddfe1b0a9419aab328beeb579d61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.410485 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287ddfe1b0a9419aab328beeb579d61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.415480 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f1bf6a12189741bc8144442a0121eb38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.416060 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1bf6a12189741bc8144442a0121eb38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.417327 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_af1725ce632d44719ed0ce47881b4102"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.417866 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af1725ce632d44719ed0ce47881b4102 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.419960 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a857c28d94f04dabb9a57aeca662b836" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:56.420193 28987 raft_consensus.cc:2468] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:56.420614 29197 leader_election.cc:304] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:56.420899 30018 raft_consensus.cc:2804] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.420980 30018 raft_consensus.cc:493] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.421056 30018 raft_consensus.cc:3060] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:56.421581 29063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 53631.9us
I20260617 20:16:56.421828 30060 leader_election.cc:290] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.429426 29378 tablet_bootstrap.cc:654] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.431210 30018 raft_consensus.cc:515] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.432242 30018 leader_election.cc:290] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.433638 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a857c28d94f04dabb9a57aeca662b836" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:56.433822 28987 raft_consensus.cc:3060] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.436776 28987 raft_consensus.cc:2468] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:56.437143 29197 leader_election.cc:304] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:56.437486 30018 raft_consensus.cc:2804] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:56.437598 30018 raft_consensus.cc:697] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:56.437852 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d738ab2f8c784c76947a3a76bd040219" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:56.437824 30018 consensus_queue.cc:237] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.437999 29263 raft_consensus.cc:3060] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.440382 29263 raft_consensus.cc:2468] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:56.440490 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 287ddfe1b0a9419aab328beeb579d61b (DEFAULT_TABLE table=default.Table_432834dd55704c4589b84bcfae673d03 [id=7a61e654611a483488b8efdf8c0197bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.440860 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 287ddfe1b0a9419aab328beeb579d61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.442500 28967 tablet_service.cc:1511] Processing CreateTablet for tablet fc7cb1160fe94c2baf9775a193ef4c77 (DEFAULT_TABLE table=default.Table_5d78d818040145bf9a37f06eac741648 [id=131251a635f34c98aea4d3cec4ebc122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.442909 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc7cb1160fe94c2baf9775a193ef4c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.443713 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 380ccd1d167744248a1ccad80788d0a0 (DEFAULT_TABLE table=default.Table_f2cdd74a01354e0597f1e2d7bc5458c6 [id=fff41f8d98b04f09bd771bb958129f49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.444059 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380ccd1d167744248a1ccad80788d0a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:56.446678 28657 consensus_peers.cc:597] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a -> Peer 87437cd320a4470fa0dedd43aa7ea3eb (127.27.245.253:38361): Couldn't send request to peer 87437cd320a4470fa0dedd43aa7ea3eb. Status: Network error: Client connection negotiation failed: client connection to 127.27.245.253:38361: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260617 20:16:56.447750 29102 tablet_service.cc:1511] Processing CreateTablet for tablet e84c2f0be1ce4ac18f8964c2b717a8f8 (DEFAULT_TABLE table=default.Table_aa868f28a51b48dcbaa47027ea1ee54e [id=402dda6ba37a41cfa20933ed8152918e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.448082 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84c2f0be1ce4ac18f8964c2b717a8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.450410 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a857c28d94f04dabb9a57aeca662b836" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.450613 29124 raft_consensus.cc:2468] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:56.454496 29379 ts_tablet_manager.cc:1434] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.104s user 0.001s sys 0.001s
I20260617 20:16:56.454609 29106 tablet_service.cc:1511] Processing CreateTablet for tablet fc7cb1160fe94c2baf9775a193ef4c77 (DEFAULT_TABLE table=default.Table_5d78d818040145bf9a37f06eac741648 [id=131251a635f34c98aea4d3cec4ebc122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.454905 29379 tablet_bootstrap.cc:492] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:56.454968 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc7cb1160fe94c2baf9775a193ef4c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.455991 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a857c28d94f04dabb9a57aeca662b836" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:56.456132 29124 raft_consensus.cc:3060] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.457671 29377 ts_tablet_manager.cc:1916] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.458559 29124 raft_consensus.cc:2468] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:56.460239 29063 leader_election.cc:304] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:56.460458 29998 raft_consensus.cc:493] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.460546 29998 raft_consensus.cc:515] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.461035 29998 leader_election.cc:290] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.461148 29998 raft_consensus.cc:2804] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:56.461241 29998 raft_consensus.cc:697] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:56.461516 29383 tablet_bootstrap.cc:492] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.461476 29998 consensus_queue.cc:237] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.461632 29383 ts_tablet_manager.cc:1403] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.187s user 0.001s sys 0.002s
I20260617 20:16:56.462374 29383 raft_consensus.cc:359] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.462610 29383 raft_consensus.cc:385] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.462670 29383 raft_consensus.cc:740] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.462900 29383 consensus_queue.cc:260] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:56.463145 29062 leader_election.cc:343] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 379ef43e02ec4bbbb03f2d6a53a66403
I20260617 20:16:56.463347 29383 ts_tablet_manager.cc:1434] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:56.463608 29383 tablet_bootstrap.cc:492] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.465193 29383 tablet_bootstrap.cc:654] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.465693 29378 tablet_bootstrap.cc:492] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.465829 29378 ts_tablet_manager.cc:1403] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.170s user 0.002s sys 0.001s
I20260617 20:16:56.466506 29378 raft_consensus.cc:359] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.466670 29378 raft_consensus.cc:385] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.466727 29378 raft_consensus.cc:740] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.466913 29378 consensus_queue.cc:260] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.467365 29378 ts_tablet_manager.cc:1434] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:16:56.467700 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 380ccd1d167744248a1ccad80788d0a0 (DEFAULT_TABLE table=default.Table_f2cdd74a01354e0597f1e2d7bc5458c6 [id=fff41f8d98b04f09bd771bb958129f49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.468168 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380ccd1d167744248a1ccad80788d0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.470268 29379 tablet_bootstrap.cc:654] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.472188 29378 tablet_bootstrap.cc:492] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.474133 28955 tablet_service.cc:1511] Processing CreateTablet for tablet d6c0e56493b948dfb531ef123d9e13fc (DEFAULT_TABLE table=default.Table_2ecc0415958749d2b7138a545e9b28c5 [id=84e2e8a1c775449282853c7e5a85b1e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.475353 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c0e56493b948dfb531ef123d9e13fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.475325 29231 tablet_service.cc:1511] Processing CreateTablet for tablet d6c0e56493b948dfb531ef123d9e13fc (DEFAULT_TABLE table=default.Table_2ecc0415958749d2b7138a545e9b28c5 [id=84e2e8a1c775449282853c7e5a85b1e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.475672 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c0e56493b948dfb531ef123d9e13fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.485663 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 380ccd1d167744248a1ccad80788d0a0 (DEFAULT_TABLE table=default.Table_f2cdd74a01354e0597f1e2d7bc5458c6 [id=fff41f8d98b04f09bd771bb958129f49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.349105 29375 rpcz_store.cc:276] 0617 20:16:54.482179 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.482345 (+ 166us) service_pool.cc:224] Handling call
0617 20:16:56.245254 (+1762909us) ts_tablet_manager.cc:1151] Deleting tablet 98467525f81f4a48878eae17e3a9c982
0617 20:16:56.245263 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.269957 (+ 24694us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.348080 (+ 78123us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.349014 (+ 934us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1762673}
I20260617 20:16:56.489059 28669 catalog_manager.cc:5696] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194). New cstate: current_term: 1 leader_uuid: "6d4ce30e1fce4591b64c398747f8d37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:56.489521 28669 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 5e53946c85ab4a8286a6e174cc411c5e (table default.Table_2ca839bde234444b97808d82d7974e3c [id=e682c8658ea84718a5e3909a6f6b7246]). Expected version 3 got 0
W20260617 20:16:56.490420 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6db7d5bf9a254b98b87ad25df1f51b3b consensus state has no leader
I20260617 20:16:56.491353 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4dc5fdaaee2d4b54bb54160933394175" } new_table_name: "default.Table_3d19c23664c34aff8fce1a199ca71ac9" modify_external_catalogs: true
I20260617 20:16:56.491655 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e321d26263a24a5a8e31793f2ff8ba59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.492331 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e321d26263a24a5a8e31793f2ff8ba59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.492791 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet dd7079ea860149f19227264b8507685b from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:56.493620 29224 tablet_service.cc:1511] Processing CreateTablet for tablet fc7cb1160fe94c2baf9775a193ef4c77 (DEFAULT_TABLE table=default.Table_5d78d818040145bf9a37f06eac741648 [id=131251a635f34c98aea4d3cec4ebc122]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.494010 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc7cb1160fe94c2baf9775a193ef4c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.495354 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3124306094c72ad78e5473aa35bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.498221 29378 tablet_bootstrap.cc:654] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:56.499122 29063 leader_election.cc:343] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 379ef43e02ec4bbbb03f2d6a53a66403
I20260617 20:16:56.500080 29063 leader_election.cc:304] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:56.500362 29998 raft_consensus.cc:2749] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.500711 29998 raft_consensus.cc:493] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:16:56.500799 29063 consensus_peers.cc:597] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fa15915b0ec44ff8b66920e4c207536. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:56.500838 29998 raft_consensus.cc:515] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.501518 29998 leader_election.cc:290] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.501799 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b00437fb76c4000ad89c99ab2da2261" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:56.501988 29259 raft_consensus.cc:2468] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:56.502396 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380ccd1d167744248a1ccad80788d0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.502511 29063 leader_election.cc:304] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:56.502708 29998 raft_consensus.cc:2804] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.502761 29998 raft_consensus.cc:493] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.502815 29998 raft_consensus.cc:3060] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.504148 29376 ts_tablet_manager.cc:1929] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.504237 29376 log.cc:1199] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/7e48a4a827d44afca912dc8723be4542
I20260617 20:16:56.504513 29376 ts_tablet_manager.cc:1950] T 7e48a4a827d44afca912dc8723be4542 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.505244 29998 raft_consensus.cc:515] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.505806 29998 leader_election.cc:290] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:56.505851 29062 leader_election.cc:343] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 7b00437fb76c4000ad89c99ab2da2261
I20260617 20:16:56.506364 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b00437fb76c4000ad89c99ab2da2261" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:56.506507 29259 raft_consensus.cc:3060] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:56.506896 29062 leader_election.cc:343] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 7b00437fb76c4000ad89c99ab2da2261
I20260617 20:16:56.512331 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 98467525f81f4a48878eae17e3a9c982 (table default.Table_b299a2d2bb2d43c0a27ba56bfd754a14 [id=7be1ef9796444187a095e577b3f29690]) successfully deleted
I20260617 20:16:56.517539 29375 tablet_replica.cc:333] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:56.517799 29375 raft_consensus.cc:2243] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.517732 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1265f7b4e2374fc9a3cbf51bdbf7f663"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.518314 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1265f7b4e2374fc9a3cbf51bdbf7f663 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.518527 29375 raft_consensus.cc:2272] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.519014 29375 ts_tablet_manager.cc:1916] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.519205 28963 tablet_service.cc:1511] Processing CreateTablet for tablet bc486f0c614c4bab94d923f2e7623a03 (DEFAULT_TABLE table=default.Table_6a198d41f58e40d29bb3325eb77c19f0 [id=ffd9c81736fc4d59bd16525e91bc6a59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.519624 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc486f0c614c4bab94d923f2e7623a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.521473 29102 tablet_service.cc:1511] Processing CreateTablet for tablet d6c0e56493b948dfb531ef123d9e13fc (DEFAULT_TABLE table=default.Table_2ecc0415958749d2b7138a545e9b28c5 [id=84e2e8a1c775449282853c7e5a85b1e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.521801 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6c0e56493b948dfb531ef123d9e13fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.525171 29383 tablet_bootstrap.cc:492] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.525357 29383 ts_tablet_manager.cc:1403] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.000s
I20260617 20:16:56.525960 29241 tablet_service.cc:1511] Processing CreateTablet for tablet bc486f0c614c4bab94d923f2e7623a03 (DEFAULT_TABLE table=default.Table_6a198d41f58e40d29bb3325eb77c19f0 [id=ffd9c81736fc4d59bd16525e91bc6a59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.526631 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc486f0c614c4bab94d923f2e7623a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.528685 29377 ts_tablet_manager.cc:1929] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.528806 29377 log.cc:1199] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/4e27c5834baa48ed953fccef54e6c52b
I20260617 20:16:56.530748 29376 tablet_replica.cc:333] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.530972 29376 raft_consensus.cc:2243] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.531142 29376 raft_consensus.cc:2272] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.531627 29376 ts_tablet_manager.cc:1916] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.532106 29259 raft_consensus.cc:2468] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:56.532454 29063 leader_election.cc:304] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:56.532732 29998 raft_consensus.cc:2804] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:56.532830 29998 raft_consensus.cc:697] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:56.533030 29998 consensus_queue.cc:237] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.529232 29377 ts_tablet_manager.cc:1950] T 4e27c5834baa48ed953fccef54e6c52b P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:56.536697 29375 ts_tablet_manager.cc:1929] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.536820 29375 log.cc:1199] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/65af976b808d42d4aeded71a00cf7252
I20260617 20:16:56.537181 29375 ts_tablet_manager.cc:1950] T 65af976b808d42d4aeded71a00cf7252 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:56.537518 29377 tablet_replica.cc:333] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:56.537552 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 496) took 2054 ms. Trace:
I20260617 20:16:56.537736 29377 raft_consensus.cc:2243] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.537653 29375 rpcz_store.cc:276] 0617 20:16:54.482716 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.482883 (+ 167us) service_pool.cc:224] Handling call
0617 20:16:56.486630 (+2003747us) ts_tablet_manager.cc:1151] Deleting tablet 65af976b808d42d4aeded71a00cf7252
0617 20:16:56.517327 (+ 30697us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.528742 (+ 11415us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.536642 (+ 7900us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.537534 (+ 892us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2003536}
I20260617 20:16:56.537901 29377 raft_consensus.cc:2272] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.538033 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 497) took 2054 ms. Trace:
I20260617 20:16:56.538112 29375 rpcz_store.cc:276] 0617 20:16:54.483258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.483296 (+ 38us) service_pool.cc:224] Handling call
0617 20:16:56.537921 (+2054625us) ts_tablet_manager.cc:1151] Deleting tablet 4d281eec19b34aaa8729d8891547b8e4
0617 20:16:56.537931 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.538018 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2049361}
I20260617 20:16:56.538343 29375 tablet_replica.cc:333] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:56.538506 29375 raft_consensus.cc:2243] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.538647 29375 raft_consensus.cc:2272] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.538703 29377 ts_tablet_manager.cc:1916] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.539110 29375 ts_tablet_manager.cc:1916] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.526082 29383 raft_consensus.cc:359] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.541635 29383 raft_consensus.cc:385] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.541785 29383 raft_consensus.cc:740] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.542183 29383 consensus_queue.cc:260] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.544901 29377 ts_tablet_manager.cc:1929] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.545004 29377 log.cc:1199] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/0859e56b5b7a483ea5e751f0468cbab8
I20260617 20:16:56.545995 29383 ts_tablet_manager.cc:1434] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260617 20:16:56.547821 29379 tablet_bootstrap.cc:492] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:56.547958 29379 ts_tablet_manager.cc:1403] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.093s user 0.015s sys 0.015s
I20260617 20:16:56.548624 29379 raft_consensus.cc:359] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.548786 29379 raft_consensus.cc:385] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.548842 29379 raft_consensus.cc:740] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.548872 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 4e27c5834baa48ed953fccef54e6c52b (table default.Table_56f5d206c3934a59a6ef16d7c15e3de6 [id=6c3209da79fb4c518d0583b668a9209e]) successfully deleted
I20260617 20:16:56.549021 29379 consensus_queue.cc:260] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.549486 29379 ts_tablet_manager.cc:1434] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260617 20:16:56.549744 29379 tablet_bootstrap.cc:492] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:56.550350 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a857c28d94f04dabb9a57aeca662b836
I20260617 20:16:56.551249 29379 tablet_bootstrap.cc:654] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.551673 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e6d2efb704e44c7a8ea2697ad784c448"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.552320 29383 tablet_bootstrap.cc:492] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.553244 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 519719a748f441c58689172dffb54394 (DEFAULT_TABLE table=default.Table_5c012c3bc3674a6a84abd599c0b09e5e [id=ccfda840d49f4f2b87501cd400c0efc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.553367 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 40845d7a668045ec9a40cb6d1d76137d
I20260617 20:16:56.553418 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet a857c28d94f04dabb9a57aeca662b836 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.553642 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519719a748f441c58689172dffb54394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.553889 29376 ts_tablet_manager.cc:1929] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.554136 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fcf0d313e34c4117a4d36e5638a1a4b4" } modify_external_catalogs: true
I20260617 20:16:56.556478 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet 40845d7a668045ec9a40cb6d1d76137d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.556510 29375 ts_tablet_manager.cc:1929] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.556597 29375 log.cc:1199] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/4da8b2c2ecd34b56a046ac3b32c0c5f1
I20260617 20:16:56.556859 29375 ts_tablet_manager.cc:1950] T 4da8b2c2ecd34b56a046ac3b32c0c5f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:56.556806 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 3b00d3c0adcf48a48ba3d7a3de018b80 (DEFAULT_TABLE table=default.Table_fb9bfca9839e45eab65f1350e50faa16 [id=b041ea39e57947919cb6744251af1ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.557130 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b00d3c0adcf48a48ba3d7a3de018b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.557549 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 498) took 2069 ms. Trace:
I20260617 20:16:56.557626 29375 rpcz_store.cc:276] 0617 20:16:54.488117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.488217 (+ 100us) service_pool.cc:224] Handling call
0617 20:16:56.538307 (+2050090us) ts_tablet_manager.cc:1151] Deleting tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1
0617 20:16:56.538314 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.552808 (+ 14494us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.556467 (+ 3659us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.557531 (+ 1064us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2049561}
I20260617 20:16:56.557971 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 501) took 2063 ms. Trace:
I20260617 20:16:56.558029 29375 rpcz_store.cc:276] 0617 20:16:54.495966 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.496028 (+ 62us) service_pool.cc:224] Handling call
0617 20:16:56.557851 (+2061823us) ts_tablet_manager.cc:1151] Deleting tablet 14a5e5917a414c99b25ea2efeab4063d
0617 20:16:56.557859 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.557958 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2061285}
I20260617 20:16:56.558322 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 502) took 2058 ms. Trace:
I20260617 20:16:56.558296 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 211d0b0897f14ff4929ed55cd2f27b94 (DEFAULT_TABLE table=default.Table_cc1b1d5f363341f89757851580c7be12 [id=56c7ef0d2f9b4f6f9265a1f64d01dc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.558394 29375 rpcz_store.cc:276] 0617 20:16:54.499571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.499618 (+ 47us) service_pool.cc:224] Handling call
0617 20:16:56.558219 (+2058601us) ts_tablet_manager.cc:1151] Deleting tablet 593d9de6a2fb47e18d86649e45ba80b9
0617 20:16:56.558229 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.558309 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2058416}
I20260617 20:16:56.558583 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211d0b0897f14ff4929ed55cd2f27b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.558706 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 509) took 1973 ms. Trace:
I20260617 20:16:56.558774 29375 rpcz_store.cc:276] 0617 20:16:54.584899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.584957 (+ 58us) service_pool.cc:224] Handling call
0617 20:16:56.558614 (+1973657us) ts_tablet_manager.cc:1151] Deleting tablet dee426100bb645f391be123aeb52e412
0617 20:16:56.558622 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.558693 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1960576}
I20260617 20:16:56.559058 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 510) took 1934 ms. Trace:
I20260617 20:16:56.559125 29375 rpcz_store.cc:276] 0617 20:16:54.624761 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.624819 (+ 58us) service_pool.cc:224] Handling call
0617 20:16:56.558977 (+1934158us) ts_tablet_manager.cc:1151] Deleting tablet 5eaddd6519dc490c8358be629b21a2d9
0617 20:16:56.558984 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.559045 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1933960}
I20260617 20:16:56.559360 29375 tablet_replica.cc:333] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:56.559528 29375 raft_consensus.cc:2243] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:56.559777 29375 pending_rounds.cc:70] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:56.559834 29375 pending_rounds.cc:77] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955493495795712 op_type: NO_OP noop_request { }
I20260617 20:16:56.559932 29375 raft_consensus.cc:2889] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:56.560019 29375 raft_consensus.cc:2272] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.560497 29375 ts_tablet_manager.cc:1916] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.562368 29383 tablet_bootstrap.cc:654] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.563485 28967 tablet_service.cc:1511] Processing CreateTablet for tablet de42ac9a05aa4c60a7d93c1236888d64 (DEFAULT_TABLE table=default.Table_60168eec2672477faf619c2033f3b5c7 [id=8b0b35107e334201892508576676c82b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.563835 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de42ac9a05aa4c60a7d93c1236888d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.567745 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fcf0d313e34c4117a4d36e5638a1a4b4" } modify_external_catalogs: true
I20260617 20:16:56.568451 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 7e48a4a827d44afca912dc8723be4542 (table default.Table_e6908a670d534e828a0770f48cace3db [id=b24f0a25c8574b62842179a4c9bbc2f8]) successfully deleted
I20260617 20:16:56.572758 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 65af976b808d42d4aeded71a00cf7252 (table default.Table_c68b49bfa2cd4215a6f0d6b34ecbbf40 [id=ac337efc4a324663a3863405b06b46fb]) successfully deleted
W20260617 20:16:56.573006 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4d281eec19b34aaa8729d8891547b8e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d281eec19b34aaa8729d8891547b8e4 already in progress: creating tablet
I20260617 20:16:56.573464 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 65747872eaac450cb3b8efb3a2d2694f (DEFAULT_TABLE table=default.Table_4c12d5e303de44a398302513b3d158ae [id=98ca88d8f9ee4ff3af738840a9d12a95]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:56.573559 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6d2efb704e44c7a8ea2697ad784c448 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.573798 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 4da8b2c2ecd34b56a046ac3b32c0c5f1 (table default.Table_0b2903f0c1204e4eacd6a8987e8b688a [id=8b2c257acdb0498f8c9c4e8e44535f31]) successfully deleted
W20260617 20:16:56.574019 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 14a5e5917a414c99b25ea2efeab4063d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14a5e5917a414c99b25ea2efeab4063d already in progress: creating tablet
I20260617 20:16:56.574255 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65747872eaac450cb3b8efb3a2d2694f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:56.574246 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 593d9de6a2fb47e18d86649e45ba80b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 593d9de6a2fb47e18d86649e45ba80b9 already in progress: creating tablet
W20260617 20:16:56.574466 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet dee426100bb645f391be123aeb52e412 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dee426100bb645f391be123aeb52e412 already in progress: creating tablet
W20260617 20:16:56.574720 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5eaddd6519dc490c8358be629b21a2d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eaddd6519dc490c8358be629b21a2d9 already in progress: creating tablet
I20260617 20:16:56.575822 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet a857c28d94f04dabb9a57aeca662b836 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.576702 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 519719a748f441c58689172dffb54394 (DEFAULT_TABLE table=default.Table_5c012c3bc3674a6a84abd599c0b09e5e [id=ccfda840d49f4f2b87501cd400c0efc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.578972 28987 raft_consensus.cc:1275] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Refusing update from remote peer a8c0aea0206f44d683ed3b6b18c719f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:56.580008 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 40845d7a668045ec9a40cb6d1d76137d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.580188 30018 consensus_queue.cc:1048] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:56.580778 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 65747872eaac450cb3b8efb3a2d2694f (DEFAULT_TABLE table=default.Table_4c12d5e303de44a398302513b3d158ae [id=98ca88d8f9ee4ff3af738840a9d12a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.581018 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet 379ef43e02ec4bbbb03f2d6a53a66403 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:56.581395 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2b5ab81def9b44fa8d7d148f7758ec63" } modify_external_catalogs: true
I20260617 20:16:56.581562 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2b5ab81def9b44fa8d7d148f7758ec63" } modify_external_catalogs: true
I20260617 20:16:56.582324 29124 raft_consensus.cc:1275] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Refusing update from remote peer a8c0aea0206f44d683ed3b6b18c719f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:56.582826 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet da50400f49e24ca589519e6ec823957d from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:56.583511 30018 consensus_queue.cc:1048] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:56.584645 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 3b00d3c0adcf48a48ba3d7a3de018b80 (DEFAULT_TABLE table=default.Table_fb9bfca9839e45eab65f1350e50faa16 [id=b041ea39e57947919cb6744251af1ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.585309 29228 tablet_service.cc:1511] Processing CreateTablet for tablet de42ac9a05aa4c60a7d93c1236888d64 (DEFAULT_TABLE table=default.Table_60168eec2672477faf619c2033f3b5c7 [id=8b0b35107e334201892508576676c82b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.586522 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 211d0b0897f14ff4929ed55cd2f27b94 (DEFAULT_TABLE table=default.Table_cc1b1d5f363341f89757851580c7be12 [id=56c7ef0d2f9b4f6f9265a1f64d01dc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.586900 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet 16d0360ec78844a1be3d5f51259bbcdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:16:56.587354 28654 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb (table default.Table_fe54346acedc4aee9fe8151c12a389fc [id=32c61aa9610e428fa8d5c794b078e0a1], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb consensus state has no leader
I20260617 20:16:56.589068 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519719a748f441c58689172dffb54394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.590103 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211d0b0897f14ff4929ed55cd2f27b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.590289 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b00d3c0adcf48a48ba3d7a3de018b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.594550 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65747872eaac450cb3b8efb3a2d2694f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.595589 29379 tablet_bootstrap.cc:492] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:56.595741 29379 ts_tablet_manager.cc:1403] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.002s
I20260617 20:16:56.596534 29379 raft_consensus.cc:359] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.596736 29379 raft_consensus.cc:385] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.596786 29379 raft_consensus.cc:740] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.597002 29379 consensus_queue.cc:260] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.598359 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de42ac9a05aa4c60a7d93c1236888d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.599750 29379 ts_tablet_manager.cc:1434] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:16:56.600065 29379 tablet_bootstrap.cc:492] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:56.602113 29379 tablet_bootstrap.cc:654] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.602152 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1600da5c434063a8458ebed1f6d4de (DEFAULT_TABLE table=default.Table_05dfcb6814c143ee9890aba309a96146 [id=d4b52b5f7b144e3e9c22e38c33ff0a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.602427 28953 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1600da5c434063a8458ebed1f6d4de (DEFAULT_TABLE table=default.Table_05dfcb6814c143ee9890aba309a96146 [id=d4b52b5f7b144e3e9c22e38c33ff0a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.602545 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1600da5c434063a8458ebed1f6d4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.602805 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1600da5c434063a8458ebed1f6d4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.603716 29383 tablet_bootstrap.cc:492] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.603879 29383 ts_tablet_manager.cc:1403] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.000s
I20260617 20:16:56.605017 29383 raft_consensus.cc:359] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.605221 29383 raft_consensus.cc:385] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.605268 29383 raft_consensus.cc:740] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.605595 29383 consensus_queue.cc:260] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.606702 29383 ts_tablet_manager.cc:1434] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 20:16:56.607029 29383 tablet_bootstrap.cc:492] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.608371 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 078875241c324538ad6f93de1169aeb8 (DEFAULT_TABLE table=default.Table_6073576da0f64d37bae015524bd119de [id=173e3b23db204721a1f091565549c7a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.609754 29383 tablet_bootstrap.cc:654] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.609874 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078875241c324538ad6f93de1169aeb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.618041 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_18e868cdbb12445fb4ae545f0bb0fe4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.618616 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18e868cdbb12445fb4ae545f0bb0fe4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.620350 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5ad13ff5116e482e861209d7ef7ba196" } modify_external_catalogs: true
I20260617 20:16:56.620555 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5ad13ff5116e482e861209d7ef7ba196" } modify_external_catalogs: true
I20260617 20:16:56.617154 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4a7f7c881fa94dccb545ca3370f59ec9" } new_table_name: "default.Table_58038c837b7247d3a630ff0893c70a21" modify_external_catalogs: true
I20260617 20:16:56.620822 28967 tablet_service.cc:1511] Processing CreateTablet for tablet f91951f4fffa4723aa4d8099fcedd50b (DEFAULT_TABLE table=default.Table_5d01dcb6629a40f2a3dc693bbb860d62 [id=75a5082717854698a606ad842b2f107d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.625097 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 70698bb6ff6f4fe0b465f2974fcc24ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.627254 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91951f4fffa4723aa4d8099fcedd50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.630693 29226 tablet_service.cc:1511] Processing CreateTablet for tablet f91951f4fffa4723aa4d8099fcedd50b (DEFAULT_TABLE table=default.Table_5d01dcb6629a40f2a3dc693bbb860d62 [id=75a5082717854698a606ad842b2f107d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.631117 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91951f4fffa4723aa4d8099fcedd50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.632064 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet d1654ae96ce041fa9b9b881af7dd342e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.635222 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 078875241c324538ad6f93de1169aeb8 (DEFAULT_TABLE table=default.Table_6073576da0f64d37bae015524bd119de [id=173e3b23db204721a1f091565549c7a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.635661 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078875241c324538ad6f93de1169aeb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.636540 29375 ts_tablet_manager.cc:1929] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:56.636659 29375 log.cc:1199] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/1fa15915b0ec44ff8b66920e4c207536
I20260617 20:16:56.636883 29376 log.cc:1199] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/d738ab2f8c784c76947a3a76bd040219
I20260617 20:16:56.637151 29375 ts_tablet_manager.cc:1950] T 1fa15915b0ec44ff8b66920e4c207536 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:56.637544 29376 ts_tablet_manager.cc:1950] T d738ab2f8c784c76947a3a76bd040219 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.641470 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet d738ab2f8c784c76947a3a76bd040219 (table default.Table_1bde48f5ad7a4a8194df9687d8971c33 [id=cde5899e2baa4b2b9fe34bb5d11ebe13]) successfully deleted
I20260617 20:16:56.643090 29231 tablet_service.cc:1511] Processing CreateTablet for tablet bd7d5f6b8bce44fa8e4065613989bda7 (DEFAULT_TABLE table=default.Table_a2798a47a5a746238dd22a3f89641417 [id=5cdd5fb7c9d044b580f8670847d3c60e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.643405 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet a857c28d94f04dabb9a57aeca662b836 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.643541 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7d5f6b8bce44fa8e4065613989bda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.644053 29102 tablet_service.cc:1511] Processing CreateTablet for tablet bc486f0c614c4bab94d923f2e7623a03 (DEFAULT_TABLE table=default.Table_6a198d41f58e40d29bb3325eb77c19f0 [id=ffd9c81736fc4d59bd16525e91bc6a59]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.644611 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc486f0c614c4bab94d923f2e7623a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.646065 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 511) took 2015 ms. Trace:
I20260617 20:16:56.646173 29375 rpcz_store.cc:276] 0617 20:16:54.630577 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.630626 (+ 49us) service_pool.cc:224] Handling call
0617 20:16:56.559322 (+1928696us) ts_tablet_manager.cc:1151] Deleting tablet 1fa15915b0ec44ff8b66920e4c207536
0617 20:16:56.559330 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.624236 (+ 64906us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.636484 (+ 12248us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.646037 (+ 9553us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1924695}
I20260617 20:16:56.646664 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 520) took 1978 ms. Trace:
I20260617 20:16:56.646747 29375 rpcz_store.cc:276] 0617 20:16:54.667733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.667783 (+ 50us) service_pool.cc:224] Handling call
0617 20:16:56.646519 (+1978736us) ts_tablet_manager.cc:1151] Deleting tablet 89f7b878728a495f83b6584f8a6aca67
0617 20:16:56.646531 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.646646 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1978534}
W20260617 20:16:56.647019 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet a819956f29954a4dbbd1aa1dcccad3c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a819956f29954a4dbbd1aa1dcccad3c0 already in progress: creating tablet
I20260617 20:16:56.647112 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 519) took 1979 ms. Trace:
I20260617 20:16:56.647185 29375 rpcz_store.cc:276] 0617 20:16:54.667601 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.669289 (+ 1688us) service_pool.cc:224] Handling call
0617 20:16:56.647007 (+1977718us) ts_tablet_manager.cc:1151] Deleting tablet cbeae97639fd4e6290768dae12f6a4ce
0617 20:16:56.647018 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.647098 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1961456}
I20260617 20:16:56.647487 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 518) took 1990 ms. Trace:
I20260617 20:16:56.647538 29375 rpcz_store.cc:276] 0617 20:16:54.657489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.657538 (+ 49us) service_pool.cc:224] Handling call
0617 20:16:56.647408 (+1989870us) ts_tablet_manager.cc:1151] Deleting tablet 4ceb3ae3c1a44442966ad37fbcbc658b
0617 20:16:56.647419 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.647476 (+ 57us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1955686}
I20260617 20:16:56.647776 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 529) took 1876 ms. Trace:
I20260617 20:16:56.647830 29375 rpcz_store.cc:276] 0617 20:16:54.771600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.771700 (+ 100us) service_pool.cc:224] Handling call
0617 20:16:56.647697 (+1875997us) ts_tablet_manager.cc:1151] Deleting tablet 7a89e42d091f423bb926f671797141ea
0617 20:16:56.647704 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.647765 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1875626}
W20260617 20:16:56.649920 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb already in progress: creating tablet
W20260617 20:16:56.651466 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 8a56191018d04a2881ee3e1a243c1a19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a56191018d04a2881ee3e1a243c1a19 already in progress: creating tablet
I20260617 20:16:56.651942 29376 tablet_replica.cc:333] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.652146 29376 raft_consensus.cc:2243] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.652313 29376 raft_consensus.cc:2272] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.653180 29376 ts_tablet_manager.cc:1916] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.658069 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 519719a748f441c58689172dffb54394 (DEFAULT_TABLE table=default.Table_5c012c3bc3674a6a84abd599c0b09e5e [id=ccfda840d49f4f2b87501cd400c0efc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.658733 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519719a748f441c58689172dffb54394. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.661823 29379 tablet_bootstrap.cc:492] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:56.662000 29379 ts_tablet_manager.cc:1403] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.008s
I20260617 20:16:56.662833 29377 ts_tablet_manager.cc:1950] T 0859e56b5b7a483ea5e751f0468cbab8 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:56.662938 29379 raft_consensus.cc:359] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.663166 29379 raft_consensus.cc:385] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.663241 29379 raft_consensus.cc:740] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.663476 29379 consensus_queue.cc:260] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.664356 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 530) took 1892 ms. Trace:
I20260617 20:16:56.666841 29377 tablet_replica.cc:333] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:56.665230 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 65747872eaac450cb3b8efb3a2d2694f (DEFAULT_TABLE table=default.Table_4c12d5e303de44a398302513b3d158ae [id=98ca88d8f9ee4ff3af738840a9d12a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.667057 29377 raft_consensus.cc:2243] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.667212 29377 raft_consensus.cc:2272] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.667415 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65747872eaac450cb3b8efb3a2d2694f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.668336 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 3b00d3c0adcf48a48ba3d7a3de018b80 (DEFAULT_TABLE table=default.Table_fb9bfca9839e45eab65f1350e50faa16 [id=b041ea39e57947919cb6744251af1ca7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.668738 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b00d3c0adcf48a48ba3d7a3de018b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.669230 29377 ts_tablet_manager.cc:1916] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.669270 29383 tablet_bootstrap.cc:492] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.669930 30142 tablet.cc:1724] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:56.670851 29383 ts_tablet_manager.cc:1403] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.064s user 0.015s sys 0.013s
I20260617 20:16:56.671680 29383 raft_consensus.cc:359] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.671835 29383 raft_consensus.cc:385] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.671881 29383 raft_consensus.cc:740] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.665695 29100 tablet_service.cc:1558] Processing DeleteTablet for tablet 40845d7a668045ec9a40cb6d1d76137d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.674153 29375 rpcz_store.cc:276] 0617 20:16:54.771944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:54.771993 (+ 49us) service_pool.cc:224] Handling call
0617 20:16:56.648009 (+1876016us) ts_tablet_manager.cc:1151] Deleting tablet cde88371f4454a4bb3053c6cd1afb801
0617 20:16:56.648016 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.664337 (+ 16321us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1875878}
I20260617 20:16:56.675182 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 533) took 1666 ms. Trace:
I20260617 20:16:56.675634 29375 rpcz_store.cc:276] 0617 20:16:55.009086 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.009316 (+ 230us) service_pool.cc:224] Handling call
0617 20:16:56.675040 (+1665724us) ts_tablet_manager.cc:1151] Deleting tablet 4d23acc051c34ebfb0edb790faec1b2b
0617 20:16:56.675050 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.675165 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1665161}
I20260617 20:16:56.676219 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 534) took 1666 ms. Trace:
I20260617 20:16:56.677405 29375 rpcz_store.cc:276] 0617 20:16:55.010021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.010105 (+ 84us) service_pool.cc:224] Handling call
0617 20:16:56.676089 (+1665984us) ts_tablet_manager.cc:1151] Deleting tablet 90ae9c63c8c541bc91ecedd798a7d60f
0617 20:16:56.676100 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.676201 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1661332}
I20260617 20:16:56.677942 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 536) took 1665 ms. Trace:
I20260617 20:16:56.678237 29097 tablet_service.cc:1511] Processing CreateTablet for tablet de42ac9a05aa4c60a7d93c1236888d64 (DEFAULT_TABLE table=default.Table_60168eec2672477faf619c2033f3b5c7 [id=8b0b35107e334201892508576676c82b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.678839 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de42ac9a05aa4c60a7d93c1236888d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.679262 30018 raft_consensus.cc:493] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.679452 30018 raft_consensus.cc:515] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.680362 30018 leader_election.cc:290] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.680491 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70698bb6ff6f4fe0b465f2974fcc24ea" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.680596 29383 consensus_queue.cc:260] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.681165 29383 ts_tablet_manager.cc:1434] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
W20260617 20:16:56.681143 29198 leader_election.cc:343] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.681550 29383 tablet_bootstrap.cc:492] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.683279 29383 tablet_bootstrap.cc:654] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.687741 29376 ts_tablet_manager.cc:1929] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.695546 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 211d0b0897f14ff4929ed55cd2f27b94 (DEFAULT_TABLE table=default.Table_cc1b1d5f363341f89757851580c7be12 [id=56c7ef0d2f9b4f6f9265a1f64d01dc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.696041 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211d0b0897f14ff4929ed55cd2f27b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.695981 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 1f1600da5c434063a8458ebed1f6d4de (DEFAULT_TABLE table=default.Table_05dfcb6814c143ee9890aba309a96146 [id=d4b52b5f7b144e3e9c22e38c33ff0a06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.696767 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 078875241c324538ad6f93de1169aeb8 (DEFAULT_TABLE table=default.Table_6073576da0f64d37bae015524bd119de [id=173e3b23db204721a1f091565549c7a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.697167 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 078875241c324538ad6f93de1169aeb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.702960 29096 tablet_service.cc:1511] Processing CreateTablet for tablet bd7d5f6b8bce44fa8e4065613989bda7 (DEFAULT_TABLE table=default.Table_a2798a47a5a746238dd22a3f89641417 [id=5cdd5fb7c9d044b580f8670847d3c60e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.703372 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7d5f6b8bce44fa8e4065613989bda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.695546 29095 tablet_service.cc:1511] Processing CreateTablet for tablet f91951f4fffa4723aa4d8099fcedd50b (DEFAULT_TABLE table=default.Table_5d01dcb6629a40f2a3dc693bbb860d62 [id=75a5082717854698a606ad842b2f107d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.704622 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f91951f4fffa4723aa4d8099fcedd50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.706373 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 1fa15915b0ec44ff8b66920e4c207536 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]) successfully deleted
W20260617 20:16:56.706852 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 89f7b878728a495f83b6584f8a6aca67 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 89f7b878728a495f83b6584f8a6aca67 already in progress: creating tablet
W20260617 20:16:56.707222 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet cbeae97639fd4e6290768dae12f6a4ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbeae97639fd4e6290768dae12f6a4ce already in progress: creating tablet
W20260617 20:16:56.707574 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4ceb3ae3c1a44442966ad37fbcbc658b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ceb3ae3c1a44442966ad37fbcbc658b already in progress: creating tablet
W20260617 20:16:56.707890 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 7a89e42d091f423bb926f671797141ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a89e42d091f423bb926f671797141ea already in progress: creating tablet
W20260617 20:16:56.708670 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet cde88371f4454a4bb3053c6cd1afb801 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cde88371f4454a4bb3053c6cd1afb801 already in progress: creating tablet
W20260617 20:16:56.709026 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4d23acc051c34ebfb0edb790faec1b2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d23acc051c34ebfb0edb790faec1b2b already in progress: creating tablet
W20260617 20:16:56.709631 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 90ae9c63c8c541bc91ecedd798a7d60f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90ae9c63c8c541bc91ecedd798a7d60f already in progress: creating tablet
I20260617 20:16:56.710891 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f1600da5c434063a8458ebed1f6d4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.713629 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b00437fb76c4000ad89c99ab2da2261 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.719017 29378 tablet_bootstrap.cc:492] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.719187 29378 ts_tablet_manager.cc:1403] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.247s user 0.006s sys 0.004s
I20260617 20:16:56.720860 28955 tablet_service.cc:1511] Processing CreateTablet for tablet bd7d5f6b8bce44fa8e4065613989bda7 (DEFAULT_TABLE table=default.Table_a2798a47a5a746238dd22a3f89641417 [id=5cdd5fb7c9d044b580f8670847d3c60e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:56.721237 29377 ts_tablet_manager.cc:1929] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.721241 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd7d5f6b8bce44fa8e4065613989bda7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:56.724560 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 0859e56b5b7a483ea5e751f0468cbab8 (table default.Table_1ee5913d94914aba95dc4be83307dbe1 [id=4052e9bb44674d6b9936c1c6f004488f]) successfully deleted
W20260617 20:16:56.724874 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 27c20f436b9b4a8cb659215f9579af04 consensus state has no leader
I20260617 20:16:56.725401 29377 log.cc:1199] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/b3278efaad07403ca0a2baecad46d0f1
I20260617 20:16:56.726464 29377 ts_tablet_manager.cc:1950] T b3278efaad07403ca0a2baecad46d0f1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:56.727159 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c535a6f896b94414b52c0265a60f4679"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.727407 29377 tablet_replica.cc:333] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:56.727581 29377 raft_consensus.cc:2243] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.727710 29377 raft_consensus.cc:2272] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:56.727743 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c535a6f896b94414b52c0265a60f4679 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.728845 29377 ts_tablet_manager.cc:1916] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.729027 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet dd7079ea860149f19227264b8507685b
I20260617 20:16:56.729487 28663 catalog_manager.cc:6784] ReplaceTablet: tablet dd7079ea860149f19227264b8507685b deleted and replaced by tablet f2c1fd3f325841c297d123ad1ac0fe9d
I20260617 20:16:56.729713 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 26ebcfc80ca64129a7ab939bfd853998 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:56.731037 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b1aa4707d2794652bd00fbbb2d66dc9b" } new_table_name: "default.Table_e7b17c557187475d91de751c47b28644" modify_external_catalogs: true
I20260617 20:16:56.732561 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f02529cd1e764a3886de27d86e9690e3
I20260617 20:16:56.733165 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet 269d2bb9f1fd45f89ab765b33a502baf from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:56.734511 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2d169273aef9434c86e36818639e3879" } new_table_name: "default.Table_eb56cf30fb6c4b82ac0476317efa6499" modify_external_catalogs: true
I20260617 20:16:56.735538 29377 ts_tablet_manager.cc:1929] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.735715 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f31bf7ed828f44b398f5bdac6b9b63e7
I20260617 20:16:56.736349 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cdca7e869e14460f90d0a273c55a4670"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.736922 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdca7e869e14460f90d0a273c55a4670 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.737277 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_813114f7354f4c1b9a3976e27bb3ef59" } new_table_name: "default.Table_a7326aeff93f42d09c7d454aeee0e601" modify_external_catalogs: true
I20260617 20:16:56.738338 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 6f544f486c144cd89ca7c5b83d252ee9
I20260617 20:16:56.739002 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0d22aedd54cb4c6ab005e382acec6456"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.739449 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d22aedd54cb4c6ab005e382acec6456 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:56.736698 29197 leader_election.cc:343] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 70698bb6ff6f4fe0b465f2974fcc24ea
I20260617 20:16:56.739768 29197 leader_election.cc:304] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:56.740077 30018 raft_consensus.cc:2749] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.740427 29376 log.cc:1199] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/b3ea76ad1ec64d22a64bdd4c97e288c6
I20260617 20:16:56.740769 29376 ts_tablet_manager.cc:1950] T b3ea76ad1ec64d22a64bdd4c97e288c6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.741808 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet b3278efaad07403ca0a2baecad46d0f1 (table default.Table_ec9b81dbecf641cf9110b33876e99612 [id=35f8afdc04fb4a1ebb52996f33d62d43]) successfully deleted
I20260617 20:16:56.743299 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet f02529cd1e764a3886de27d86e9690e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.743526 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet f31bf7ed828f44b398f5bdac6b9b63e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.744724 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet dd7079ea860149f19227264b8507685b with delete_type TABLET_DATA_DELETED (replaced by tablet f2c1fd3f325841c297d123ad1ac0fe9d) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.744894 29383 tablet_bootstrap.cc:492] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.745118 29383 ts_tablet_manager.cc:1403] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.064s user 0.011s sys 0.008s
I20260617 20:16:56.745815 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f544f486c144cd89ca7c5b83d252ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.746304 29383 raft_consensus.cc:359] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.746537 29383 raft_consensus.cc:385] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.746582 29383 raft_consensus.cc:740] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.746778 29383 consensus_queue.cc:260] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.747988 29383 ts_tablet_manager.cc:1434] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260617 20:16:56.748186 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f239f81c40743b2aaa70a361997db77 consensus state has no leader
I20260617 20:16:56.748485 29377 log.cc:1199] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/67a3124306094c72ad78e5473aa35bdb
I20260617 20:16:56.748885 29377 ts_tablet_manager.cc:1950] T 67a3124306094c72ad78e5473aa35bdb P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:16:56.749192 29198 consensus_peers.cc:597] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:56.748049 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c355818357334e2b98c839a655ef35eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.749794 29377 tablet_replica.cc:333] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:16:56.749765 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c355818357334e2b98c839a655ef35eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.749971 29377 raft_consensus.cc:2243] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.750123 29377 raft_consensus.cc:2272] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.750263 29378 raft_consensus.cc:359] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.750439 29378 raft_consensus.cc:385] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.750488 29378 raft_consensus.cc:740] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.750684 29377 ts_tablet_manager.cc:1916] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.750658 29378 consensus_queue.cc:260] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.753460 28990 raft_consensus.cc:1275] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Refusing update from remote peer a8c0aea0206f44d683ed3b6b18c719f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:16:56.754256 29378 ts_tablet_manager.cc:1434] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.035s user 0.001s sys 0.001s
I20260617 20:16:56.754227 30061 consensus_queue.cc:1048] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:56.754536 29378 tablet_bootstrap.cc:492] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.753284 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e5ae8ac84de5486e99a108e1e3f3d32f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.755153 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5ae8ac84de5486e99a108e1e3f3d32f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.755790 29376 tablet_replica.cc:333] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.756036 29376 raft_consensus.cc:2243] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.756243 29376 raft_consensus.cc:2272] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.756872 29376 ts_tablet_manager.cc:1916] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.757409 29383 tablet_bootstrap.cc:492] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.758654 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet dd7079ea860149f19227264b8507685b with delete_type TABLET_DATA_DELETED (replaced by tablet f2c1fd3f325841c297d123ad1ac0fe9d) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.759151 29383 tablet_bootstrap.cc:654] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:56.760758 29063 consensus_peers.cc:597] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57e19abe093a40f6886908a8a3a0cad4. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:56.761719 30143 tablet.cc:1724] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:56.766909 29376 ts_tablet_manager.cc:1929] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.767170 29376 log.cc:1199] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/7b00437fb76c4000ad89c99ab2da2261
I20260617 20:16:56.767652 29376 ts_tablet_manager.cc:1950] T 7b00437fb76c4000ad89c99ab2da2261 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.768988 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 7b00437fb76c4000ad89c99ab2da2261 (table default.Table_6f68970fea69478eba2df21752f2ea0a [id=40e28570c43d428b90d13ccc0123be2b]) successfully deleted
I20260617 20:16:56.769261 30117 raft_consensus.cc:493] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.769428 30117 raft_consensus.cc:515] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.770089 30117 leader_election.cc:290] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:56.770326 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 67a3124306094c72ad78e5473aa35bdb (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]) successfully deleted
I20260617 20:16:56.770747 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f544f486c144cd89ca7c5b83d252ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:56.772019 29063 leader_election.cc:343] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 08911643f3ca451d80e2471b1b5b2342
I20260617 20:16:56.772300 29378 tablet_bootstrap.cc:654] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.772548 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet f02529cd1e764a3886de27d86e9690e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.773097 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet f31bf7ed828f44b398f5bdac6b9b63e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.678335 29375 rpcz_store.cc:276] 0617 20:16:55.012017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.012110 (+ 93us) service_pool.cc:224] Handling call
0617 20:16:56.677824 (+1665714us) ts_tablet_manager.cc:1151] Deleting tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe
0617 20:16:56.677832 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.677927 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1661768}
I20260617 20:16:56.677199 29379 ts_tablet_manager.cc:1434] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260617 20:16:56.774976 29379 tablet_bootstrap.cc:492] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:56.776640 29379 tablet_bootstrap.cc:654] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.776978 30142 tablet.cc:1724] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:56.777601 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 535) took 1766 ms. Trace:
I20260617 20:16:56.777688 29375 rpcz_store.cc:276] 0617 20:16:55.010941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.011036 (+ 95us) service_pool.cc:224] Handling call
0617 20:16:56.777420 (+1766384us) ts_tablet_manager.cc:1151] Deleting tablet 4342e29fbc98442ea2e2d25c7aea8853
0617 20:16:56.777430 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.777546 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1761265}
I20260617 20:16:56.778039 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 537) took 1763 ms. Trace:
I20260617 20:16:56.778119 29375 rpcz_store.cc:276] 0617 20:16:55.014899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.015251 (+ 352us) service_pool.cc:224] Handling call
0617 20:16:56.777901 (+1762650us) ts_tablet_manager.cc:1151] Deleting tablet eba86bae9e91404185d248dfd722a413
0617 20:16:56.777910 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.777991 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1760875}
I20260617 20:16:56.778440 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 538) took 1761 ms. Trace:
I20260617 20:16:56.778517 29375 rpcz_store.cc:276] 0617 20:16:55.017166 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.017231 (+ 65us) service_pool.cc:224] Handling call
0617 20:16:56.778316 (+1761085us) ts_tablet_manager.cc:1151] Deleting tablet e35d84540ee74348a3222c5b928e002f
0617 20:16:56.778325 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.778390 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1760896}
I20260617 20:16:56.778834 29375 tablet_replica.cc:333] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:56.779037 29375 raft_consensus.cc:2243] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.779222 29375 raft_consensus.cc:2272] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.779742 29375 ts_tablet_manager.cc:1916] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:56.788564 29062 leader_election.cc:343] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 08911643f3ca451d80e2471b1b5b2342
I20260617 20:16:56.788736 29062 leader_election.cc:304] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:56.789390 30117 raft_consensus.cc:2749] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.790300 30061 raft_consensus.cc:493] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.790333 29383 tablet_bootstrap.cc:492] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.790486 30061 raft_consensus.cc:515] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.790575 29383 ts_tablet_manager.cc:1403] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.005s
I20260617 20:16:56.791159 30061 leader_election.cc:290] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.791541 29376 tablet_replica.cc:333] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.791497 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbef4cc28ef46288cfc7d1933c71710" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.791507 29383 raft_consensus.cc:359] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.791702 29123 raft_consensus.cc:2468] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:56.791761 30061 raft_consensus.cc:493] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.791769 29383 raft_consensus.cc:385] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.791920 29383 raft_consensus.cc:740] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.792129 29198 leader_election.cc:304] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:56.792158 29383 consensus_queue.cc:260] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.792347 30018 raft_consensus.cc:2804] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.792471 30018 raft_consensus.cc:493] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.792585 30018 raft_consensus.cc:3060] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.792843 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbef4cc28ef46288cfc7d1933c71710" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:56.792861 30061 raft_consensus.cc:515] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.793033 28988 raft_consensus.cc:2468] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:56.793493 30061 leader_election.cc:290] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.792594 29383 ts_tablet_manager.cc:1434] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:56.793893 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16d0360ec78844a1be3d5f51259bbcdf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:56.794474 29198 leader_election.cc:343] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.794867 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 26ebcfc80ca64129a7ab939bfd853998
I20260617 20:16:56.795212 30018 raft_consensus.cc:515] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.795433 28663 catalog_manager.cc:6784] ReplaceTablet: tablet 26ebcfc80ca64129a7ab939bfd853998 deleted and replaced by tablet a3013ecc095842f293f86f52f19510d0
W20260617 20:16:56.795629 29197 leader_election.cc:343] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 16d0360ec78844a1be3d5f51259bbcdf
I20260617 20:16:56.795758 29197 leader_election.cc:304] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:56.795855 30018 leader_election.cc:290] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.796023 30018 raft_consensus.cc:2749] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.796149 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbef4cc28ef46288cfc7d1933c71710" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:56.796336 29123 raft_consensus.cc:3060] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.798377 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 26ebcfc80ca64129a7ab939bfd853998 with delete_type TABLET_DATA_DELETED (replaced by tablet a3013ecc095842f293f86f52f19510d0) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.798619 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet dcd999d88d954e50810cc01b297a27a9 (table default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a]). Expected version 1 got 0
I20260617 20:16:56.798693 29376 raft_consensus.cc:2243] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:56.798967 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 26ebcfc80ca64129a7ab939bfd853998 with delete_type TABLET_DATA_DELETED (replaced by tablet a3013ecc095842f293f86f52f19510d0) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.798966 29376 pending_rounds.cc:70] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:56.799194 29123 raft_consensus.cc:2468] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:56.799302 29376 pending_rounds.cc:77] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955495181201408 op_type: NO_OP noop_request { }
I20260617 20:16:56.799485 29376 raft_consensus.cc:2889] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:56.799643 29376 raft_consensus.cc:2272] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.799850 29198 leader_election.cc:304] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:56.800161 30061 raft_consensus.cc:2804] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:56.800180 30149 tablet.cc:1724] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:56.800309 30061 raft_consensus.cc:697] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:56.800593 30061 consensus_queue.cc:237] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.800771 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bbef4cc28ef46288cfc7d1933c71710" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:56.800915 28988 raft_consensus.cc:3060] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.801776 29383 tablet_bootstrap.cc:492] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.802188 29376 ts_tablet_manager.cc:1916] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.803480 29383 tablet_bootstrap.cc:654] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.803622 28988 raft_consensus.cc:2468] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:16:56.806928 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe already in progress: creating tablet
W20260617 20:16:56.807166 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4342e29fbc98442ea2e2d25c7aea8853 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4342e29fbc98442ea2e2d25c7aea8853 already in progress: creating tablet
W20260617 20:16:56.807375 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet eba86bae9e91404185d248dfd722a413 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eba86bae9e91404185d248dfd722a413 already in progress: creating tablet
W20260617 20:16:56.807591 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet e35d84540ee74348a3222c5b928e002f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e35d84540ee74348a3222c5b928e002f already in progress: creating tablet
I20260617 20:16:56.813186 29376 ts_tablet_manager.cc:1929] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 20:16:56.813745 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9655a1164fa84f53bdb9fd31b2fcda78 consensus state has no leader
I20260617 20:16:56.814667 30106 raft_consensus.cc:493] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.814827 30106 raft_consensus.cc:515] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.815546 30106 leader_election.cc:290] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:56.816211 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d8a0d46294108a6b98a1a4b67fd6d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:56.816299 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d8a0d46294108a6b98a1a4b67fd6d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.816433 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_31d6e6d29ea341a9939708a6ca1ba7ee" } modify_external_catalogs: true
I20260617 20:16:56.816591 30117 raft_consensus.cc:493] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.816620 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_31d6e6d29ea341a9939708a6ca1ba7ee" } modify_external_catalogs: true
W20260617 20:16:56.816849 28925 leader_election.cc:343] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.816764 30117 raft_consensus.cc:515] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.817479 30117 leader_election.cc:290] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:56.818123 28925 leader_election.cc:343] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.818218 28925 leader_election.cc:304] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:56.818594 30106 raft_consensus.cc:2749] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:56.819144 29062 leader_election.cc:343] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b1b3565799894d82a3cc29ab2a19307c
I20260617 20:16:56.820461 30018 raft_consensus.cc:493] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.821547 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3565799894d82a3cc29ab2a19307c" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:56.821915 30018 raft_consensus.cc:515] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.822570 30018 leader_election.cc:290] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.823805 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3565799894d82a3cc29ab2a19307c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:56.823877 29197 leader_election.cc:343] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b1b3565799894d82a3cc29ab2a19307c
I20260617 20:16:56.824008 29124 raft_consensus.cc:2468] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:56.824239 29259 raft_consensus.cc:2468] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:56.824504 29198 leader_election.cc:304] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:56.825095 30018 raft_consensus.cc:2804] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.825187 30018 raft_consensus.cc:493] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.825202 29378 tablet_bootstrap.cc:492] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.825313 30018 raft_consensus.cc:3060] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.825361 29378 ts_tablet_manager.cc:1403] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.006s
I20260617 20:16:56.825399 29379 tablet_bootstrap.cc:492] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:56.825793 29383 tablet_bootstrap.cc:492] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.825526 29379 ts_tablet_manager.cc:1403] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.001s
I20260617 20:16:56.826124 29378 raft_consensus.cc:359] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.826264 29378 raft_consensus.cc:385] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.826308 29378 raft_consensus.cc:740] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.826581 29378 consensus_queue.cc:260] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.827109 29378 ts_tablet_manager.cc:1434] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:56.827401 29378 tablet_bootstrap.cc:492] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.827888 29063 leader_election.cc:304] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:56.828572 30117 raft_consensus.cc:2804] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.828651 30117 raft_consensus.cc:493] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.828704 30117 raft_consensus.cc:3060] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.828975 29378 tablet_bootstrap.cc:654] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.830989 30117 raft_consensus.cc:515] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.831521 30117 leader_election.cc:290] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:56.832314 29062 leader_election.cc:343] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b1b3565799894d82a3cc29ab2a19307c
I20260617 20:16:56.833408 30018 raft_consensus.cc:515] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.834442 30018 leader_election.cc:290] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:56.834738 29197 leader_election.cc:343] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b1b3565799894d82a3cc29ab2a19307c
I20260617 20:16:56.834589 29383 ts_tablet_manager.cc:1403] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.002s
I20260617 20:16:56.835665 29383 raft_consensus.cc:359] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.835843 29383 raft_consensus.cc:385] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.835903 29383 raft_consensus.cc:740] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.836086 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3565799894d82a3cc29ab2a19307c" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:56.836318 29263 raft_consensus.cc:2393] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:16:56.836437 29383 consensus_queue.cc:260] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.837884 29378 tablet_bootstrap.cc:492] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.838019 29378 ts_tablet_manager.cc:1403] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20260617 20:16:56.838035 29383 ts_tablet_manager.cc:1434] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:16:56.838076 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet f31bf7ed828f44b398f5bdac6b9b63e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.838328 29383 tablet_bootstrap.cc:492] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.838423 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f544f486c144cd89ca7c5b83d252ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.838732 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 26ebcfc80ca64129a7ab939bfd853998 with delete_type TABLET_DATA_DELETED (replaced by tablet a3013ecc095842f293f86f52f19510d0) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.840185 29383 tablet_bootstrap.cc:654] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.840371 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet f02529cd1e764a3886de27d86e9690e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.840583 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet dd7079ea860149f19227264b8507685b with delete_type TABLET_DATA_DELETED (replaced by tablet f2c1fd3f325841c297d123ad1ac0fe9d) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.843597 29063 leader_election.cc:304] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:56.844122 29998 raft_consensus.cc:2749] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.845655 29378 raft_consensus.cc:359] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.846354 29378 raft_consensus.cc:385] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.846675 29378 raft_consensus.cc:740] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.847258 29378 consensus_queue.cc:260] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.849642 30152 tablet.cc:1724] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:56.847405 29377 ts_tablet_manager.cc:1929] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.850688 29377 log.cc:1199] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/a857c28d94f04dabb9a57aeca662b836
I20260617 20:16:56.851271 29377 ts_tablet_manager.cc:1950] T a857c28d94f04dabb9a57aeca662b836 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:56.851372 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 269d2bb9f1fd45f89ab765b33a502baf
I20260617 20:16:56.852048 28664 catalog_manager.cc:6784] ReplaceTablet: tablet 269d2bb9f1fd45f89ab765b33a502baf deleted and replaced by tablet 9a4c040cfe4445bca51e302a98b40971
I20260617 20:16:56.854013 29378 ts_tablet_manager.cc:1434] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20260617 20:16:56.854081 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet a857c28d94f04dabb9a57aeca662b836 (table default.Table_1d1b3b6470e146c189f41d0e2fcd63c5 [id=3201002f51ca4f788cc1e153333862d4]) successfully deleted
I20260617 20:16:56.854421 29378 tablet_bootstrap.cc:492] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.854503 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 269d2bb9f1fd45f89ab765b33a502baf with delete_type TABLET_DATA_DELETED (replaced by tablet 9a4c040cfe4445bca51e302a98b40971) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.855041 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 269d2bb9f1fd45f89ab765b33a502baf with delete_type TABLET_DATA_DELETED (replaced by tablet 9a4c040cfe4445bca51e302a98b40971) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.855342 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 269d2bb9f1fd45f89ab765b33a502baf with delete_type TABLET_DATA_DELETED (replaced by tablet 9a4c040cfe4445bca51e302a98b40971) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.856448 29378 tablet_bootstrap.cc:654] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:56.865199 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 40845d7a668045ec9a40cb6d1d76137d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40845d7a668045ec9a40cb6d1d76137d already in progress: creating tablet
I20260617 20:16:56.866820 29383 tablet_bootstrap.cc:492] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.866984 29383 ts_tablet_manager.cc:1403] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.003s
I20260617 20:16:56.867820 29383 raft_consensus.cc:359] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.868011 29383 raft_consensus.cc:385] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.868096 29383 raft_consensus.cc:740] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.868332 29383 consensus_queue.cc:260] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.869226 29383 ts_tablet_manager.cc:1434] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:56.869745 29383 tablet_bootstrap.cc:492] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:56.870379 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b278ba32316c42d1b101e9803657af99 consensus state has no leader
W20260617 20:16:56.870627 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d19d34e3bbe3453ca6de6ed7e62f7af4 consensus state has no leader
I20260617 20:16:56.870826 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_42197450734d46538ca8460001e86a63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.870941 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_dec67a2333294dc6aa579c8eef5adacd" } modify_external_catalogs: true
I20260617 20:16:56.871093 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_dec67a2333294dc6aa579c8eef5adacd" } modify_external_catalogs: true
W20260617 20:16:56.871403 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42197450734d46538ca8460001e86a63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.871537 29383 tablet_bootstrap.cc:654] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.872761 29375 ts_tablet_manager.cc:1929] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:56.873045 29377 tablet_replica.cc:333] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:56.874413 29377 raft_consensus.cc:2243] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.874619 29375 log.cc:1199] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/3e287ba95be7408b8fc75e6f0709d8f1
I20260617 20:16:56.874872 29377 raft_consensus.cc:2272] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.875254 29375 ts_tablet_manager.cc:1950] T 3e287ba95be7408b8fc75e6f0709d8f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:56.874948 29378 tablet_bootstrap.cc:492] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.875599 29378 ts_tablet_manager.cc:1403] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.002s
I20260617 20:16:56.875896 29377 ts_tablet_manager.cc:1916] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.876426 29378 raft_consensus.cc:359] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.877128 29378 raft_consensus.cc:385] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.877239 29378 raft_consensus.cc:740] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.877748 29378 consensus_queue.cc:260] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.880445 29378 ts_tablet_manager.cc:1434] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:16:56.880774 29378 tablet_bootstrap.cc:492] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.882500 29378 tablet_bootstrap.cc:654] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.888012 29377 ts_tablet_manager.cc:1929] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:16:56.888130 29377 log.cc:1199] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/dd7079ea860149f19227264b8507685b
I20260617 20:16:56.888484 29377 ts_tablet_manager.cc:1950] T dd7079ea860149f19227264b8507685b P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:56.889575 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]) successfully deleted
I20260617 20:16:56.894712 30106 raft_consensus.cc:493] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.894894 30106 raft_consensus.cc:515] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.895709 30106 leader_election.cc:290] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:56.897058 30106 raft_consensus.cc:493] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.897177 30106 raft_consensus.cc:515] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.897750 30106 leader_election.cc:290] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:56.898113 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4130f3529ef4adaa4cedf12e53b6895" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:56.898603 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086bd3079e8f4a6d85ccc681a38a47b0" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:56.898612 28925 leader_election.cc:343] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:56.898998 28925 leader_election.cc:343] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.899509 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4130f3529ef4adaa4cedf12e53b6895" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.900117 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086bd3079e8f4a6d85ccc681a38a47b0" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:56.900539 28925 leader_election.cc:343] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.900635 28925 leader_election.cc:304] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:56.901157 28925 leader_election.cc:343] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.901250 28925 leader_election.cc:304] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:56.901953 30106 raft_consensus.cc:2749] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.902100 30106 raft_consensus.cc:2749] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.903424 30061 raft_consensus.cc:493] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.903594 30061 raft_consensus.cc:515] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.904201 30061 leader_election.cc:290] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.904258 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 544) took 1799 ms. Trace:
I20260617 20:16:56.904397 29375 rpcz_store.cc:276] 0617 20:16:55.104307 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.109356 (+ 5049us) service_pool.cc:224] Handling call
0617 20:16:56.778757 (+1669401us) ts_tablet_manager.cc:1151] Deleting tablet 3e287ba95be7408b8fc75e6f0709d8f1
0617 20:16:56.778766 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.842913 (+ 64147us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.872687 (+ 29774us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:56.904237 (+ 31550us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1669184}
I20260617 20:16:56.904959 29375 tablet_replica.cc:333] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:56.905181 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 3e287ba95be7408b8fc75e6f0709d8f1 (table default.Table_20465bbedb344857a72376aa345ec532 [id=f673f240ab2341c39c57117ea2e4d92a]) successfully deleted
W20260617 20:16:56.905355 29197 leader_election.cc:343] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 0859e56b5b7a483ea5e751f0468cbab8
I20260617 20:16:56.904522 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0859e56b5b7a483ea5e751f0468cbab8" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.905663 29375 raft_consensus.cc:2243] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
W20260617 20:16:56.905869 29198 leader_election.cc:343] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:56.906046 29198 leader_election.cc:304] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:56.905972 29375 pending_rounds.cc:70] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:56.906219 29375 pending_rounds.cc:77] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955493564067840 op_type: NO_OP noop_request { }
I20260617 20:16:56.906304 29375 raft_consensus.cc:2889] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:56.906347 30061 raft_consensus.cc:2749] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.906383 29375 raft_consensus.cc:2272] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.907002 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac
I20260617 20:16:56.908169 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:56.909097 29378 tablet_bootstrap.cc:492] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.909317 29378 ts_tablet_manager.cc:1403] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.002s
I20260617 20:16:56.909968 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:56.910159 29378 raft_consensus.cc:359] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.910343 29378 raft_consensus.cc:385] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.910398 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:56.910405 29378 raft_consensus.cc:740] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.910646 29378 consensus_queue.cc:260] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.912794 29378 ts_tablet_manager.cc:1434] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:56.913318 29378 tablet_bootstrap.cc:492] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.915156 29378 tablet_bootstrap.cc:654] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.917196 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3565799894d82a3cc29ab2a19307c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:56.919602 29124 raft_consensus.cc:2393] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 6d4ce30e1fce4591b64c398747f8d37a in this term.
I20260617 20:16:56.920253 29198 leader_election.cc:304] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:56.920661 30061 raft_consensus.cc:2749] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:16:56.922875 29376 log.cc:1199] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/a8eefc4f3c7d4f468c0adca837b73bb2
I20260617 20:16:56.923027 29375 ts_tablet_manager.cc:1916] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.923552 29376 ts_tablet_manager.cc:1950] T a8eefc4f3c7d4f468c0adca837b73bb2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.930364 29376 tablet_replica.cc:333] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.930799 29376 raft_consensus.cc:2243] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:56.931340 29376 pending_rounds.cc:70] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:56.931552 29376 pending_rounds.cc:77] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955497732136960 op_type: NO_OP noop_request { }
I20260617 20:16:56.931865 29376 raft_consensus.cc:2889] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:56.932281 29376 raft_consensus.cc:2272] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.934872 29383 tablet_bootstrap.cc:492] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.935032 29383 ts_tablet_manager.cc:1403] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.065s user 0.009s sys 0.016s
I20260617 20:16:56.935279 29376 ts_tablet_manager.cc:1916] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.935777 29383 raft_consensus.cc:359] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.935979 29383 raft_consensus.cc:385] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.936050 29383 raft_consensus.cc:740] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.936280 30061 raft_consensus.cc:493] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:56.936396 30061 raft_consensus.cc:515] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.936996 30061 leader_election.cc:290] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.937144 29378 tablet_bootstrap.cc:492] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:56.925279 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet a8eefc4f3c7d4f468c0adca837b73bb2 (table default.Table_a41d5a63ab0c47adafaeff2f42205397 [id=405880e9419e43449f08e705aab0ba7c]) successfully deleted
I20260617 20:16:56.937384 29383 consensus_queue.cc:260] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:56.937744 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet e3897179e7724fdeb87a979ae4ef2091 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3897179e7724fdeb87a979ae4ef2091 already in progress: creating tablet
I20260617 20:16:56.938172 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1654ae96ce041fa9b9b881af7dd342e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:56.938355 29124 raft_consensus.cc:2468] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:16:56.938344 29197 leader_election.cc:343] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d1654ae96ce041fa9b9b881af7dd342e
I20260617 20:16:56.938604 29383 ts_tablet_manager.cc:1434] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:56.938804 29198 leader_election.cc:304] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:56.939060 30061 raft_consensus.cc:2804] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:56.939157 30061 raft_consensus.cc:493] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:56.939236 30061 raft_consensus.cc:3060] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:56.940017 29378 ts_tablet_manager.cc:1403] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
W20260617 20:16:56.938014 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 7cafcade995b407f84f56b8cd3ab6892 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cafcade995b407f84f56b8cd3ab6892 already in progress: creating tablet
W20260617 20:16:56.941649 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 0d1a416f802948d5bc150855d82b54c1 because the tablet was not found. No further retry: Not found: Tablet not found: 0d1a416f802948d5bc150855d82b54c1
I20260617 20:16:56.941900 30061 raft_consensus.cc:515] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.941957 29378 raft_consensus.cc:359] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.942245 29378 raft_consensus.cc:385] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.942348 29378 raft_consensus.cc:740] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.942653 29378 consensus_queue.cc:260] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.943236 29378 ts_tablet_manager.cc:1434] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:56.943981 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0f2a772bda6e4476b8b5a42f9d0fb42f" } new_table_name: "default.Table_abaa4ebadc654b7a85405d8114046356" modify_external_catalogs: true
I20260617 20:16:56.945135 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1654ae96ce041fa9b9b881af7dd342e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:56.945312 29124 raft_consensus.cc:3060] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:56.947094 29197 leader_election.cc:343] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d1654ae96ce041fa9b9b881af7dd342e
I20260617 20:16:56.947925 29124 raft_consensus.cc:2468] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:56.948141 30061 leader_election.cc:290] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:56.948272 29383 tablet_bootstrap.cc:492] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:56.949776 29378 tablet_bootstrap.cc:492] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:56.951728 29383 tablet_bootstrap.cc:654] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:56.952199 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80d778641c354c679ee9e7d7b3eae3b5 consensus state has no leader
I20260617 20:16:56.945166 29379 raft_consensus.cc:359] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.953996 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e260ca83764a418697982bac8c69b880"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.954380 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_354d9f3267f24461a3968a19cf2f5a70" } modify_external_catalogs: true
I20260617 20:16:56.954581 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_354d9f3267f24461a3968a19cf2f5a70" } modify_external_catalogs: true
I20260617 20:16:56.954790 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_80559e5b402d45f3965620a4955011f7" } modify_external_catalogs: true
I20260617 20:16:56.954948 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_80559e5b402d45f3965620a4955011f7" } modify_external_catalogs: true
I20260617 20:16:56.955164 29198 leader_election.cc:304] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:56.955148 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_874c5733c8264dda8206652cd4019646"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.954089 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5927f45d8048449fa563d499f1df55a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.956176 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_01d83f6f43f542bab1b5d209557c8ff9" } modify_external_catalogs: true
I20260617 20:16:56.956323 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_01d83f6f43f542bab1b5d209557c8ff9" } modify_external_catalogs: true
I20260617 20:16:56.956514 30061 raft_consensus.cc:2804] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:56.957468 29378 tablet_bootstrap.cc:654] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:56.958244 30061 raft_consensus.cc:697] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:56.958688 30061 consensus_queue.cc:237] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:56.962680 28665 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet a3013ecc095842f293f86f52f19510d0
I20260617 20:16:56.963130 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e16e58f45a3b41f88b43f9d3c29a222f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:56.953688 29379 raft_consensus.cc:385] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:56.965000 29379 raft_consensus.cc:740] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:56.965627 29379 consensus_queue.cc:260] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:56.968328 29379 ts_tablet_manager.cc:1434] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.142s user 0.016s sys 0.000s
I20260617 20:16:56.969959 29379 tablet_bootstrap.cc:492] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:56.974282 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e16e58f45a3b41f88b43f9d3c29a222f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:56.975471 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_874c5733c8264dda8206652cd4019646 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:56.975594 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e260ca83764a418697982bac8c69b880 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:56.976562 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5927f45d8048449fa563d499f1df55a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.983014 29376 ts_tablet_manager.cc:1929] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:56.983788 29376 log.cc:1199] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/a857c28d94f04dabb9a57aeca662b836
I20260617 20:16:56.984416 29376 ts_tablet_manager.cc:1950] T a857c28d94f04dabb9a57aeca662b836 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:56.986951 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet a857c28d94f04dabb9a57aeca662b836 (table default.Table_1d1b3b6470e146c189f41d0e2fcd63c5 [id=3201002f51ca4f788cc1e153333862d4]) successfully deleted
W20260617 20:16:56.988049 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 40845d7a668045ec9a40cb6d1d76137d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40845d7a668045ec9a40cb6d1d76137d already in progress: creating tablet
I20260617 20:16:56.989073 29376 tablet_replica.cc:333] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:56.989624 29376 raft_consensus.cc:2243] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:56.990104 29376 raft_consensus.cc:2272] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:56.991132 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_33a8edd5534942789db0e5c0b7361654" } new_table_name: "default.Table_9ff46b3a183c48f8b7111d7d5651879e" modify_external_catalogs: true
I20260617 20:16:56.991595 29376 ts_tablet_manager.cc:1916] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:56.994410 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_989f55b85a3e4108a400df034266ff62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:56.995016 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_989f55b85a3e4108a400df034266ff62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:56.996218 29383 tablet_bootstrap.cc:492] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:56.996356 29383 ts_tablet_manager.cc:1403] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.007s
I20260617 20:16:56.997581 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet 4a6bf28f4e434da794db9391ca7ad738 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:56.997640 29383 raft_consensus.cc:359] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.001396 29383 raft_consensus.cc:385] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.003603 29383 raft_consensus.cc:740] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.004115 29383 consensus_queue.cc:260] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.004693 30158 raft_consensus.cc:493] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.004853 30158 raft_consensus.cc:515] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.005646 30158 leader_election.cc:290] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.005977 29383 ts_tablet_manager.cc:1434] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20260617 20:16:57.007069 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9c687fe56f42af82dd4728ca53cd32" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:57.007254 29383 tablet_bootstrap.cc:492] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:57.007680 28925 leader_election.cc:343] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.008658 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9c687fe56f42af82dd4728ca53cd32" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:57.009379 28925 leader_election.cc:343] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.009521 28925 leader_election.cc:304] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:57.009886 30158 raft_consensus.cc:2749] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:57.012257 29376 ts_tablet_manager.cc:1929] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:57.012395 29376 log.cc:1199] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/16d0360ec78844a1be3d5f51259bbcdf
I20260617 20:16:57.014968 29383 tablet_bootstrap.cc:654] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:57.016516 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4fa767d4abdb49e2acdc4f6af75d35e4 consensus state has no leader
I20260617 20:16:57.017380 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2ecc0415958749d2b7138a545e9b28c5" } new_table_name: "default.Table_4290f341cd6741dd921290be5d1e3032" modify_external_catalogs: true
I20260617 20:16:57.019413 29383 tablet_bootstrap.cc:492] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.019969 29383 ts_tablet_manager.cc:1403] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260617 20:16:57.024565 29383 raft_consensus.cc:359] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.025671 29383 raft_consensus.cc:385] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.025838 29383 raft_consensus.cc:740] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.026139 29383 consensus_queue.cc:260] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:57.027374 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6c0e56493b948dfb531ef123d9e13fc consensus state has no leader
I20260617 20:16:57.027807 29383 ts_tablet_manager.cc:1434] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260617 20:16:57.029026 29383 tablet_bootstrap.cc:492] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.031834 29383 tablet_bootstrap.cc:654] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:57.034251 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 6f544f486c144cd89ca7c5b83d252ee9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f544f486c144cd89ca7c5b83d252ee9 already in progress: creating tablet
W20260617 20:16:57.035173 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f02529cd1e764a3886de27d86e9690e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f02529cd1e764a3886de27d86e9690e3 already in progress: creating tablet
W20260617 20:16:57.036005 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f31bf7ed828f44b398f5bdac6b9b63e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f31bf7ed828f44b398f5bdac6b9b63e7 already in progress: creating tablet
W20260617 20:16:57.037365 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 269d2bb9f1fd45f89ab765b33a502baf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 269d2bb9f1fd45f89ab765b33a502baf already in progress: creating tablet
W20260617 20:16:57.038067 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac already in progress: creating tablet
I20260617 20:16:57.039602 29375 ts_tablet_manager.cc:1929] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:57.039783 29375 log.cc:1199] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/17917ffc3e8f43afb2a8bc413159137c
I20260617 20:16:57.040205 29375 ts_tablet_manager.cc:1950] T 17917ffc3e8f43afb2a8bc413159137c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:57.040558 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 547) took 1884 ms. Trace:
I20260617 20:16:57.040694 29375 rpcz_store.cc:276] 0617 20:16:55.156018 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.156067 (+ 49us) service_pool.cc:224] Handling call
0617 20:16:56.904913 (+1748846us) ts_tablet_manager.cc:1151] Deleting tablet 17917ffc3e8f43afb2a8bc413159137c
0617 20:16:56.904924 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:56.926802 (+ 21878us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:57.039530 (+112728us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:57.040541 (+ 1011us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1748530}
I20260617 20:16:57.041198 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 17917ffc3e8f43afb2a8bc413159137c (table default.Table_ac0c318d8f1947d99a30561f61ebb675 [id=8d93392a8f2d47608dc8535439b92c72]) successfully deleted
I20260617 20:16:57.042235 29383 tablet_bootstrap.cc:492] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.042899 29383 ts_tablet_manager.cc:1403] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260617 20:16:57.043828 29383 raft_consensus.cc:359] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.044950 29383 raft_consensus.cc:385] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.045113 29383 raft_consensus.cc:740] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.045554 29383 consensus_queue.cc:260] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.045733 29379 tablet_bootstrap.cc:654] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.045650 29376 ts_tablet_manager.cc:1950] T 16d0360ec78844a1be3d5f51259bbcdf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:57.047158 29383 ts_tablet_manager.cc:1434] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 20:16:57.048319 29383 tablet_bootstrap.cc:492] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.048506 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 16d0360ec78844a1be3d5f51259bbcdf (table default.Table_160815abfba040f29bfce92cd08c5e46 [id=a27723f7b3f545288e30fe60ff87669b]) successfully deleted
I20260617 20:16:57.049767 29376 tablet_replica.cc:333] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:57.050192 29376 raft_consensus.cc:2243] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:57.050621 29376 raft_consensus.cc:2272] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.051345 29376 ts_tablet_manager.cc:1916] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:57.057519 29376 ts_tablet_manager.cc:1929] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:57.059021 29375 tablet_replica.cc:333] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:57.059427 29375 raft_consensus.cc:2243] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:57.059854 29375 pending_rounds.cc:70] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:57.063027 29375 pending_rounds.cc:77] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955493954277376 op_type: NO_OP noop_request { }
I20260617 20:16:57.063285 29375 raft_consensus.cc:2889] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:57.063874 29376 log.cc:1199] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/70698bb6ff6f4fe0b465f2974fcc24ea
I20260617 20:16:57.064112 29375 raft_consensus.cc:2272] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.064209 29376 ts_tablet_manager.cc:1950] T 70698bb6ff6f4fe0b465f2974fcc24ea P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:57.065240 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 70698bb6ff6f4fe0b465f2974fcc24ea (table default.Table_324930e6680749aeb68583d56acef5eb [id=b997135a77454a3b83cbd538427aa2f1]) successfully deleted
I20260617 20:16:57.067081 29375 ts_tablet_manager.cc:1916] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:57.068216 29063 consensus_peers.cc:597] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e80e776263c4a91ae7fffa9d0f4ebd4. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:57.066946 29376 tablet_replica.cc:333] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:57.069598 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet 58213ec0a9364a91a15fc0329f28605b from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:57.070628 29378 tablet_bootstrap.cc:492] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:57.070819 29378 ts_tablet_manager.cc:1403] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.121s user 0.024s sys 0.016s
I20260617 20:16:57.071671 29378 raft_consensus.cc:359] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.071910 29378 raft_consensus.cc:385] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.072026 29378 raft_consensus.cc:740] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.072306 29378 consensus_queue.cc:260] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.072855 29378 ts_tablet_manager.cc:1434] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:57.073392 29378 tablet_bootstrap.cc:492] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:57.076417 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fb5094632cbf4d34a3d5dee9d133483a" } new_table_name: "default.Table_87c7eb0a5f3843a4ae45931a17a7b234" modify_external_catalogs: true
I20260617 20:16:57.076349 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e4eb4ddc78ad49f8b8b28c441d0ca39f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.076958 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4eb4ddc78ad49f8b8b28c441d0ca39f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.077991 29383 tablet_bootstrap.cc:654] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.081771 29376 raft_consensus.cc:2243] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:57.082243 29376 pending_rounds.cc:70] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:57.082350 29376 pending_rounds.cc:77] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955499866566656 op_type: NO_OP noop_request { }
I20260617 20:16:57.082494 29376 raft_consensus.cc:2889] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:57.082623 29376 raft_consensus.cc:2272] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.083487 29376 ts_tablet_manager.cc:1916] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:57.083777 29378 tablet_bootstrap.cc:654] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.088852 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2420afe282984f72ab42715fbc33380a" } new_table_name: "default.Table_724f440ee4704ab9b73c964377608058" modify_external_catalogs: true
I20260617 20:16:57.093104 29376 ts_tablet_manager.cc:1929] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:57.093220 29376 log.cc:1199] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/d1654ae96ce041fa9b9b881af7dd342e
I20260617 20:16:57.095594 29376 ts_tablet_manager.cc:1950] T d1654ae96ce041fa9b9b881af7dd342e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:57.096678 29378 tablet_bootstrap.cc:492] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:57.096910 29378 ts_tablet_manager.cc:1403] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.001s
I20260617 20:16:57.097908 29378 raft_consensus.cc:359] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.098188 29378 raft_consensus.cc:385] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.098305 29378 raft_consensus.cc:740] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:16:57.098533 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 086bd3079e8f4a6d85ccc681a38a47b0 consensus state has no leader
I20260617 20:16:57.098613 29378 consensus_queue.cc:260] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.099694 29378 ts_tablet_manager.cc:1434] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:57.100039 29378 tablet_bootstrap.cc:492] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:57.103410 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet d1654ae96ce041fa9b9b881af7dd342e (table default.Table_1d839677a1834e13914e3c77a8f38f01 [id=82e506e43d294d23988395ecdb33cffd]) successfully deleted
I20260617 20:16:57.103703 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d98a23fa3bd844be97030f42b77ce612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.104209 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f02529cd1e764a3886de27d86e9690e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f02529cd1e764a3886de27d86e9690e3 already in progress: creating tablet
W20260617 20:16:57.104350 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d98a23fa3bd844be97030f42b77ce612 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.104480 29378 tablet_bootstrap.cc:654] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:57.105880 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f31bf7ed828f44b398f5bdac6b9b63e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f31bf7ed828f44b398f5bdac6b9b63e7 already in progress: creating tablet
I20260617 20:16:57.106458 29376 tablet_replica.cc:333] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:57.106704 29376 raft_consensus.cc:2243] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:57.106890 29383 tablet_bootstrap.cc:492] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.106959 29376 raft_consensus.cc:2272] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.107133 29383 ts_tablet_manager.cc:1403] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.000s
I20260617 20:16:57.107523 29376 ts_tablet_manager.cc:1916] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:57.107882 29383 raft_consensus.cc:359] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.108095 29383 raft_consensus.cc:385] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.108179 29383 raft_consensus.cc:740] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.108449 29383 consensus_queue.cc:260] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.112838 29383 ts_tablet_manager.cc:1434] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
W20260617 20:16:57.114897 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 87d0e2ecc16e4285a1d8337a5336caf2 consensus state has no leader
I20260617 20:16:57.116178 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_33c8a66e7ef746d4ad74e64b0e4a656d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.116446 29383 tablet_bootstrap.cc:492] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:57.116962 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33c8a66e7ef746d4ad74e64b0e4a656d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.118367 29376 ts_tablet_manager.cc:1929] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:16:57.118489 29376 log.cc:1199] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/dd7079ea860149f19227264b8507685b
I20260617 20:16:57.118837 29376 ts_tablet_manager.cc:1950] T dd7079ea860149f19227264b8507685b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:57.119798 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]) successfully deleted
I20260617 20:16:57.120751 29378 tablet_bootstrap.cc:492] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:57.120889 29378 ts_tablet_manager.cc:1403] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.004s
I20260617 20:16:57.121781 29378 raft_consensus.cc:359] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.121937 29378 raft_consensus.cc:385] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.121985 29378 raft_consensus.cc:740] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.122247 29378 consensus_queue.cc:260] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.122897 29378 ts_tablet_manager.cc:1434] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:57.123538 29378 tablet_bootstrap.cc:492] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:57.125468 29378 tablet_bootstrap.cc:654] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:57.126916 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 6f544f486c144cd89ca7c5b83d252ee9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f544f486c144cd89ca7c5b83d252ee9 already in progress: creating tablet
W20260617 20:16:57.128072 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 269d2bb9f1fd45f89ab765b33a502baf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 269d2bb9f1fd45f89ab765b33a502baf already in progress: creating tablet
I20260617 20:16:57.129132 29379 tablet_bootstrap.cc:492] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
W20260617 20:16:57.129524 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac already in progress: creating tablet
I20260617 20:16:57.130000 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3096a1f9adc14b65b52421fada209eb9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.130844 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3096a1f9adc14b65b52421fada209eb9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.130952 30061 raft_consensus.cc:493] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.131089 30061 raft_consensus.cc:515] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.131620 30061 leader_election.cc:290] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.132428 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a17f7ef070d4879a520a3eb6bdf3d23" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:57.132640 28987 raft_consensus.cc:2468] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:57.133165 29197 leader_election.cc:304] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:57.133445 30061 raft_consensus.cc:2804] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:57.133514 30061 raft_consensus.cc:493] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:57.132614 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a17f7ef070d4879a520a3eb6bdf3d23" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.133564 30061 raft_consensus.cc:3060] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:57.134037 29198 leader_election.cc:343] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.134338 29378 tablet_bootstrap.cc:492] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:57.134405 29379 ts_tablet_manager.cc:1403] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.165s user 0.004s sys 0.000s
I20260617 20:16:57.134459 29378 ts_tablet_manager.cc:1403] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.005s
I20260617 20:16:57.135280 29378 raft_consensus.cc:359] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.135462 29378 raft_consensus.cc:385] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.135576 29378 raft_consensus.cc:740] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.135831 29378 consensus_queue.cc:260] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.136375 30061 raft_consensus.cc:515] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.136492 29378 ts_tablet_manager.cc:1434] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:57.136831 29378 tablet_bootstrap.cc:492] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:57.137274 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a17f7ef070d4879a520a3eb6bdf3d23" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:16:57.137746 29198 leader_election.cc:343] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.138569 30061 leader_election.cc:290] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.138746 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a17f7ef070d4879a520a3eb6bdf3d23" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:57.138924 28987 raft_consensus.cc:3060] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:57.139034 29378 tablet_bootstrap.cc:654] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.142441 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet 13ba94ec9e27403b974e5e6fea46e59e from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:57.142895 28987 raft_consensus.cc:2468] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:57.143236 29197 leader_election.cc:304] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.143573 30061 raft_consensus.cc:2804] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:57.144367 30061 raft_consensus.cc:697] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:57.144761 30061 consensus_queue.cc:237] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.144964 29379 raft_consensus.cc:359] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.145262 29379 raft_consensus.cc:385] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.145421 29379 raft_consensus.cc:740] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.145802 29379 consensus_queue.cc:260] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.147346 29383 tablet_bootstrap.cc:654] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.147989 29378 tablet_bootstrap.cc:492] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:57.149824 29378 ts_tablet_manager.cc:1403] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20260617 20:16:57.150933 29378 raft_consensus.cc:359] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.151122 29378 raft_consensus.cc:385] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.151191 29378 raft_consensus.cc:740] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.151446 29378 consensus_queue.cc:260] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.151585 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b2bc5d281977451a9a9ba94e2a6af6d0" } modify_external_catalogs: true
I20260617 20:16:57.151988 29378 ts_tablet_manager.cc:1434] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:57.151788 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b2bc5d281977451a9a9ba94e2a6af6d0" } modify_external_catalogs: true
I20260617 20:16:57.152324 29378 tablet_bootstrap.cc:492] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:57.154309 29378 tablet_bootstrap.cc:654] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.154579 29379 ts_tablet_manager.cc:1434] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260617 20:16:57.156087 29379 tablet_bootstrap.cc:492] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:57.160086 29379 tablet_bootstrap.cc:654] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.164027 29375 ts_tablet_manager.cc:1929] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:57.164213 29375 log.cc:1199] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/57e19abe093a40f6886908a8a3a0cad4
I20260617 20:16:57.164649 29375 ts_tablet_manager.cc:1950] T 57e19abe093a40f6886908a8a3a0cad4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:57.166476 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 548) took 1944 ms. Trace:
I20260617 20:16:57.166693 30018 raft_consensus.cc:493] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.166851 30018 raft_consensus.cc:515] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.167429 30018 leader_election.cc:290] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.168043 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3278efaad07403ca0a2baecad46d0f1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:57.168560 29198 leader_election.cc:343] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:57.169528 29197 leader_election.cc:343] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b3278efaad07403ca0a2baecad46d0f1
I20260617 20:16:57.169622 29197 leader_election.cc:304] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.170071 30018 raft_consensus.cc:2749] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:57.171381 30018 raft_consensus.cc:493] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.171499 30018 raft_consensus.cc:515] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.171590 28664 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 0bbef4cc28ef46288cfc7d1933c71710 (table default.Table_e01af13e5b514cca8b4cfc05a15a949d [id=9850785700a84b33a30caf29ab508aea]). Expected version 1 got 0
I20260617 20:16:57.171829 28664 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet dcd999d88d954e50810cc01b297a27a9 (table default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a]). Expected version 1 got 0
I20260617 20:16:57.171980 30018 leader_election.cc:290] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.172600 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d8a0d46294108a6b98a1a4b67fd6d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.172787 28661 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a] alter complete (version 1)
W20260617 20:16:57.173105 29198 leader_election.cc:343] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.173650 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_11103f92f9184eae915572b6fcf56089"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.173786 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d8a0d46294108a6b98a1a4b67fd6d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:57.174046 28987 raft_consensus.cc:2468] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:16:57.174206 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11103f92f9184eae915572b6fcf56089 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.174434 29197 leader_election.cc:304] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.173655 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet f62c5a2071dd46dfbde504459508b069 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:57.174850 30018 raft_consensus.cc:2804] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:57.174911 30018 raft_consensus.cc:493] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:57.174962 30018 raft_consensus.cc:3060] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:57.177577 30018 raft_consensus.cc:515] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.177731 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet d1654ae96ce041fa9b9b881af7dd342e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.178506 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d8a0d46294108a6b98a1a4b67fd6d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:16:57.179013 29198 leader_election.cc:343] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.179495 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 8880f8eadaa44887a49adf0ef157965e with delete_type TABLET_DATA_DELETED (replaced by tablet f02529cd1e764a3886de27d86e9690e3) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.179656 30018 leader_election.cc:290] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.179725 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet b1b3565799894d82a3cc29ab2a19307c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.179857 29376 tablet_replica.cc:333] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:57.180056 29376 raft_consensus.cc:2243] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:57.180346 29376 raft_consensus.cc:2272] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.180860 29376 ts_tablet_manager.cc:1916] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:57.181237 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d8a0d46294108a6b98a1a4b67fd6d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:57.181492 28987 raft_consensus.cc:3060] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:57.181521 30158 raft_consensus.cc:493] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.181681 30158 raft_consensus.cc:515] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.182296 30158 leader_election.cc:290] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.184062 28987 raft_consensus.cc:2468] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:57.185596 29197 leader_election.cc:304] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.185923 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6cee209a5a44d6b35eb50e9c33228f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.186162 30018 raft_consensus.cc:2804] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:57.186163 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6cee209a5a44d6b35eb50e9c33228f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:57.186486 30018 raft_consensus.cc:697] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
W20260617 20:16:57.186563 28925 leader_election.cc:343] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.187004 30018 consensus_queue.cc:237] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.189278 29376 ts_tablet_manager.cc:1929] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:57.189452 29376 log.cc:1199] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/8880f8eadaa44887a49adf0ef157965e
W20260617 20:16:57.189452 28925 leader_election.cc:343] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.189607 28925 leader_election.cc:304] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:57.189802 29376 ts_tablet_manager.cc:1950] T 8880f8eadaa44887a49adf0ef157965e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:57.190356 30158 raft_consensus.cc:2749] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:57.190743 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 8880f8eadaa44887a49adf0ef157965e (table default.Table_fcf0d313e34c4117a4d36e5638a1a4b4 [id=7a4a3c7360114f72b54f5dd645215114]) successfully deleted
I20260617 20:16:57.198371 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 58213ec0a9364a91a15fc0329f28605b
I20260617 20:16:57.198939 28665 catalog_manager.cc:6784] ReplaceTablet: tablet 58213ec0a9364a91a15fc0329f28605b deleted and replaced by tablet 43462cf7003747d08e6b0e5db5999b3f
I20260617 20:16:57.199255 28661 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 0bbef4cc28ef46288cfc7d1933c71710 (table default.Table_e01af13e5b514cca8b4cfc05a15a949d [id=9850785700a84b33a30caf29ab508aea]). Expected version 1 got 0
I20260617 20:16:57.199502 28661 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 64bb6d176a4845eca312848ae5104647 (table default.Table_12cb16608a854819a7e0834654f128bb [id=6e89910c5d7a4969a79960d34eff437c]). Expected version 2 got 0
I20260617 20:16:57.199609 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 58213ec0a9364a91a15fc0329f28605b with delete_type TABLET_DATA_DELETED (replaced by tablet 43462cf7003747d08e6b0e5db5999b3f) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.199735 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3defb7ba4604412597316f8e5c8d5ccd
I20260617 20:16:57.200486 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6a198d41f58e40d29bb3325eb77c19f0" } modify_external_catalogs: true
I20260617 20:16:57.200667 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6a198d41f58e40d29bb3325eb77c19f0" } modify_external_catalogs: true
I20260617 20:16:57.200700 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 3defb7ba4604412597316f8e5c8d5ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.200867 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4a6bf28f4e434da794db9391ca7ad738
I20260617 20:16:57.201632 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a6bf28f4e434da794db9391ca7ad738 with delete_type TABLET_DATA_DELETED (replaced by tablet a522f064b9f944d1802f8b730f208ed0) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.201910 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 3defb7ba4604412597316f8e5c8d5ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.202159 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a6bf28f4e434da794db9391ca7ad738 with delete_type TABLET_DATA_DELETED (replaced by tablet a522f064b9f944d1802f8b730f208ed0) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.202446 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 58213ec0a9364a91a15fc0329f28605b with delete_type TABLET_DATA_DELETED (replaced by tablet 43462cf7003747d08e6b0e5db5999b3f) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.203186 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 3defb7ba4604412597316f8e5c8d5ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.203289 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 70698bb6ff6f4fe0b465f2974fcc24ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.203302 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 58213ec0a9364a91a15fc0329f28605b with delete_type TABLET_DATA_DELETED (replaced by tablet 43462cf7003747d08e6b0e5db5999b3f) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.203466 28670 catalog_manager.cc:6784] ReplaceTablet: tablet 4a6bf28f4e434da794db9391ca7ad738 deleted and replaced by tablet a522f064b9f944d1802f8b730f208ed0
I20260617 20:16:57.203532 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a6bf28f4e434da794db9391ca7ad738 with delete_type TABLET_DATA_DELETED (replaced by tablet a522f064b9f944d1802f8b730f208ed0) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:57.203589 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3defb7ba4604412597316f8e5c8d5ccd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3defb7ba4604412597316f8e5c8d5ccd already in progress: creating tablet
I20260617 20:16:57.203801 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a0abac57842c430484585d01d659001e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.204373 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0abac57842c430484585d01d659001e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:57.204674 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4a6bf28f4e434da794db9391ca7ad738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a6bf28f4e434da794db9391ca7ad738 already in progress: creating tablet
I20260617 20:16:57.205937 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8de2d6a5ba0a4db08a56a40d929e5d4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.206542 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8de2d6a5ba0a4db08a56a40d929e5d4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.209357 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 622ccfd80da446e98a0fedc1085b70d7
I20260617 20:16:57.210229 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_45015af27e294c6f9d0fd6e04ea3865f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.210516 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 622ccfd80da446e98a0fedc1085b70d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:57.210698 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45015af27e294c6f9d0fd6e04ea3865f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.212064 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 8d7a76853e334a4081aa8ccc28361aca
I20260617 20:16:57.212848 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d7a76853e334a4081aa8ccc28361aca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.212865 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_657118477519461f9cc86b131622bc53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.219092 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 622ccfd80da446e98a0fedc1085b70d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.219352 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d7a76853e334a4081aa8ccc28361aca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.221119 29383 tablet_bootstrap.cc:492] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.221350 29383 ts_tablet_manager.cc:1403] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.105s user 0.002s sys 0.006s
I20260617 20:16:57.222167 29383 raft_consensus.cc:359] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.223393 29383 raft_consensus.cc:385] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.223520 29383 raft_consensus.cc:740] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.223755 29383 consensus_queue.cc:260] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.224287 29383 ts_tablet_manager.cc:1434] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:16:57.224692 29383 tablet_bootstrap.cc:492] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.226522 29378 tablet_bootstrap.cc:492] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:57.226715 29383 tablet_bootstrap.cc:654] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.226732 29378 ts_tablet_manager.cc:1403] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.075s user 0.012s sys 0.004s
I20260617 20:16:57.227563 29378 raft_consensus.cc:359] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.227819 29378 raft_consensus.cc:385] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.227964 29378 raft_consensus.cc:740] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.228919 29378 consensus_queue.cc:260] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.229858 29378 ts_tablet_manager.cc:1434] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260617 20:16:57.230046 29062 consensus_peers.cc:597] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e80e776263c4a91ae7fffa9d0f4ebd4. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:57.231539 29378 tablet_bootstrap.cc:492] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:57.233536 29378 tablet_bootstrap.cc:654] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.233879 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f62c5a2071dd46dfbde504459508b069
I20260617 20:16:57.234457 28663 catalog_manager.cc:6784] ReplaceTablet: tablet f62c5a2071dd46dfbde504459508b069 deleted and replaced by tablet 4885f685cdcd4f01adea4819f09ef51e
I20260617 20:16:57.237774 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet f62c5a2071dd46dfbde504459508b069 with delete_type TABLET_DATA_DELETED (replaced by tablet 4885f685cdcd4f01adea4819f09ef51e) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.239344 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet f62c5a2071dd46dfbde504459508b069 with delete_type TABLET_DATA_DELETED (replaced by tablet 4885f685cdcd4f01adea4819f09ef51e) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.199255 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e5ae8ac84de5486e99a108e1e3f3d32f" } new_table_name: "default.Table_c924b0d8446c4a9a98e9f94a926c3fc9" modify_external_catalogs: true
I20260617 20:16:57.240782 29383 tablet_bootstrap.cc:492] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.240913 29383 ts_tablet_manager.cc:1403] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260617 20:16:57.241451 29378 tablet_bootstrap.cc:492] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:57.241629 29378 ts_tablet_manager.cc:1403] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20260617 20:16:57.241724 29383 raft_consensus.cc:359] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.241916 29383 raft_consensus.cc:385] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.241998 29383 raft_consensus.cc:740] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.242108 30158 raft_consensus.cc:493] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.242254 30158 raft_consensus.cc:515] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.242276 29383 consensus_queue.cc:260] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.242858 29383 ts_tablet_manager.cc:1434] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:57.242908 30158 leader_election.cc:290] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.243119 29383 tablet_bootstrap.cc:492] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.243242 29378 raft_consensus.cc:359] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.243424 29378 raft_consensus.cc:385] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.243510 29378 raft_consensus.cc:740] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.243752 29378 consensus_queue.cc:260] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.243867 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ba94ec9e27403b974e5e6fea46e59e" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.244361 29378 ts_tablet_manager.cc:1434] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20260617 20:16:57.244494 28925 leader_election.cc:343] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.244660 29383 tablet_bootstrap.cc:654] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.244678 29378 tablet_bootstrap.cc:492] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:57.246171 29378 tablet_bootstrap.cc:654] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:57.246538 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_657118477519461f9cc86b131622bc53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.250056 30117 raft_consensus.cc:493] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.250239 30117 raft_consensus.cc:515] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:57.251052 30117 leader_election.cc:290] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.252149 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bb6d176a4845eca312848ae5104647" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:57.255340 29378 tablet_bootstrap.cc:492] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:57.255498 29378 ts_tablet_manager.cc:1403] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20260617 20:16:57.256320 29378 raft_consensus.cc:359] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.256522 29378 raft_consensus.cc:385] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.256613 29378 raft_consensus.cc:740] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.256853 29378 consensus_queue.cc:260] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:57.256918 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3defb7ba4604412597316f8e5c8d5ccd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3defb7ba4604412597316f8e5c8d5ccd already in progress: creating tablet
W20260617 20:16:57.257169 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 58213ec0a9364a91a15fc0329f28605b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58213ec0a9364a91a15fc0329f28605b already in progress: creating tablet
I20260617 20:16:57.257491 29378 ts_tablet_manager.cc:1434] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:57.257772 29378 tablet_bootstrap.cc:492] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:57.259303 29378 tablet_bootstrap.cc:654] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.259789 29383 tablet_bootstrap.cc:492] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.259907 29383 ts_tablet_manager.cc:1403] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.003s
I20260617 20:16:57.260552 29383 raft_consensus.cc:359] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.260716 29383 raft_consensus.cc:385] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.260757 29383 raft_consensus.cc:740] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.260924 29383 consensus_queue.cc:260] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.261319 29383 ts_tablet_manager.cc:1434] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260617 20:16:57.261575 29383 tablet_bootstrap.cc:492] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:16:57.262358 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 4a6bf28f4e434da794db9391ca7ad738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a6bf28f4e434da794db9391ca7ad738 already in progress: creating tablet
W20260617 20:16:57.262646 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 622ccfd80da446e98a0fedc1085b70d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 622ccfd80da446e98a0fedc1085b70d7 already in progress: creating tablet
W20260617 20:16:57.262877 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 8d7a76853e334a4081aa8ccc28361aca because the tablet was not found. No further retry: Not found: Tablet not found: 8d7a76853e334a4081aa8ccc28361aca
I20260617 20:16:57.263093 29383 tablet_bootstrap.cc:654] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:57.263120 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f62c5a2071dd46dfbde504459508b069 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f62c5a2071dd46dfbde504459508b069 already in progress: creating tablet
W20260617 20:16:57.265550 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 58213ec0a9364a91a15fc0329f28605b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58213ec0a9364a91a15fc0329f28605b already in progress: creating tablet
I20260617 20:16:57.266538 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ba94ec9e27403b974e5e6fea46e59e" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:57.266934 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 622ccfd80da446e98a0fedc1085b70d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.266934 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d7a76853e334a4081aa8ccc28361aca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.267146 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet f62c5a2071dd46dfbde504459508b069 with delete_type TABLET_DATA_DELETED (replaced by tablet 4885f685cdcd4f01adea4819f09ef51e) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.267601 29263 raft_consensus.cc:3060] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:57.267817 28925 leader_election.cc:343] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.267987 28925 leader_election.cc:304] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:57.268437 30158 raft_consensus.cc:2749] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:57.269012 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 622ccfd80da446e98a0fedc1085b70d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 622ccfd80da446e98a0fedc1085b70d7 already in progress: creating tablet
W20260617 20:16:57.269423 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 8d7a76853e334a4081aa8ccc28361aca because the tablet was not found. No further retry: Not found: Tablet not found: 8d7a76853e334a4081aa8ccc28361aca
W20260617 20:16:57.269784 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f62c5a2071dd46dfbde504459508b069 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f62c5a2071dd46dfbde504459508b069 already in progress: creating tablet
I20260617 20:16:57.270619 30158 raft_consensus.cc:493] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.270761 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bb6d176a4845eca312848ae5104647" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:57.270785 30158 raft_consensus.cc:515] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.271551 30158 leader_election.cc:290] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.272715 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2db0467c5e64e38961d3b0e66375544" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:57.273658 28925 leader_election.cc:343] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.274506 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 13ba94ec9e27403b974e5e6fea46e59e
I20260617 20:16:57.274842 29383 tablet_bootstrap.cc:492] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.274971 29383 ts_tablet_manager.cc:1403] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.005s
I20260617 20:16:57.275465 28667 catalog_manager.cc:6784] ReplaceTablet: tablet 13ba94ec9e27403b974e5e6fea46e59e deleted and replaced by tablet 2b91a692a9c245cc897842ac29c210b3
I20260617 20:16:57.275671 29383 raft_consensus.cc:359] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.275820 29383 raft_consensus.cc:385] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.275868 29383 raft_consensus.cc:740] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.276031 29383 consensus_queue.cc:260] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.276259 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_989f55b85a3e4108a400df034266ff62" } new_table_name: "default.Table_6878f9bd771944d8be106fbf847f8baa" modify_external_catalogs: true
I20260617 20:16:57.276551 29383 ts_tablet_manager.cc:1434] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:57.277179 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 13ba94ec9e27403b974e5e6fea46e59e with delete_type TABLET_DATA_DELETED (replaced by tablet 2b91a692a9c245cc897842ac29c210b3) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.277618 29383 tablet_bootstrap.cc:492] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.279345 29383 tablet_bootstrap.cc:654] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.279706 30158 raft_consensus.cc:493] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.279907 30158 raft_consensus.cc:515] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.280825 30158 leader_election.cc:290] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.282850 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75519f97f1ce49ceb3a739ba7c7bc239" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:57.283464 28925 leader_election.cc:343] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.284384 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 13ba94ec9e27403b974e5e6fea46e59e with delete_type TABLET_DATA_DELETED (replaced by tablet 2b91a692a9c245cc897842ac29c210b3) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.292104 30117 raft_consensus.cc:493] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.292261 30117 raft_consensus.cc:515] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.292831 30117 leader_election.cc:290] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.293653 29377 tablet_replica.cc:333] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:57.293867 29377 raft_consensus.cc:2243] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:57.294040 29377 raft_consensus.cc:2272] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.294229 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a350456a8eb143838de58a05c76c9056
I20260617 20:16:57.295104 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet a350456a8eb143838de58a05c76c9056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.295161 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_712380b8c25e4e81a05694199000e983"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.295879 29062 leader_election.cc:343] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b3ea76ad1ec64d22a64bdd4c97e288c6
I20260617 20:16:57.296306 29377 ts_tablet_manager.cc:1916] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:57.296319 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_712380b8c25e4e81a05694199000e983 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.300534 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3121147010e14b9d8075f2104b757524" } new_table_name: "default.Table_60e1d64970554bb3abb8978936794bad" modify_external_catalogs: true
I20260617 20:16:57.301849 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet 5b2797384f7845969ee9744b444f1acc from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:57.302157 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e271ce7263b74cbfadbee5ec752a965d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.302651 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e271ce7263b74cbfadbee5ec752a965d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.303040 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet bc486f0c614c4bab94d923f2e7623a03
I20260617 20:16:57.303766 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_98c28a595ada4fc4b45db63ce655aa58" } new_table_name: "default.Table_110205cd8f114a17b34c7a409cd777dd" modify_external_catalogs: true
I20260617 20:16:57.305734 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet bc486f0c614c4bab94d923f2e7623a03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.307628 29377 ts_tablet_manager.cc:1929] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:57.307821 29377 log.cc:1199] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/13ba94ec9e27403b974e5e6fea46e59e
I20260617 20:16:57.308274 29377 ts_tablet_manager.cc:1950] T 13ba94ec9e27403b974e5e6fea46e59e P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:57.309656 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet bc486f0c614c4bab94d923f2e7623a03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.310207 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 13ba94ec9e27403b974e5e6fea46e59e (table default.Table_6791b989125046d893a9c24ae1e65c12 [id=e495b17f9a99422e9e29cf49befb762a]) successfully deleted
I20260617 20:16:57.310412 29383 tablet_bootstrap.cc:492] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.310549 29383 ts_tablet_manager.cc:1403] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.007s
I20260617 20:16:57.310593 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet a350456a8eb143838de58a05c76c9056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.311390 29383 raft_consensus.cc:359] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.311573 29383 raft_consensus.cc:385] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.311673 29383 raft_consensus.cc:740] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.311931 29383 consensus_queue.cc:260] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.312580 29383 ts_tablet_manager.cc:1434] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:57.312844 29383 tablet_bootstrap.cc:492] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.314491 29383 tablet_bootstrap.cc:654] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:57.320060 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f08bdd9c769403db89c20aabdc58d59 has no consensus state
I20260617 20:16:57.320586 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0e5594d587744a97a20c6887115d761f" } new_table_name: "default.Table_5818420ded12484fb2b9e6dea664ff12" modify_external_catalogs: true
I20260617 20:16:57.323578 29383 tablet_bootstrap.cc:492] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.323709 29383 ts_tablet_manager.cc:1403] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
I20260617 20:16:57.324391 29383 raft_consensus.cc:359] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.324532 29383 raft_consensus.cc:385] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.324576 29383 raft_consensus.cc:740] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.324745 29383 consensus_queue.cc:260] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.325723 29383 ts_tablet_manager.cc:1434] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260617 20:16:57.325896 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd8a7096a09147789ac203c150a19419 consensus state has no leader
I20260617 20:16:57.325995 29383 tablet_bootstrap.cc:492] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.328001 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5b2797384f7845969ee9744b444f1acc
I20260617 20:16:57.328663 28669 catalog_manager.cc:6784] ReplaceTablet: tablet 5b2797384f7845969ee9744b444f1acc deleted and replaced by tablet 9dad85a23c0a45218fcd6ac04c12831a
I20260617 20:16:57.329197 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2797384f7845969ee9744b444f1acc with delete_type TABLET_DATA_DELETED (replaced by tablet 9dad85a23c0a45218fcd6ac04c12831a) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:57.330830 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1bf654918dc148cdbca0e420e337478b consensus state has no leader
I20260617 20:16:57.331688 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2797384f7845969ee9744b444f1acc with delete_type TABLET_DATA_DELETED (replaced by tablet 9dad85a23c0a45218fcd6ac04c12831a) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.328447 29383 tablet_bootstrap.cc:654] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.332083 29063 leader_election.cc:304] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:57.332418 30117 raft_consensus.cc:2749] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:57.332772 30117 consensus_queue.cc:1048] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:57.333889 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 13ba94ec9e27403b974e5e6fea46e59e with delete_type TABLET_DATA_DELETED (replaced by tablet 2b91a692a9c245cc897842ac29c210b3) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.334340 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet a350456a8eb143838de58a05c76c9056 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.334743 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet bc486f0c614c4bab94d923f2e7623a03 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.335180 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2797384f7845969ee9744b444f1acc with delete_type TABLET_DATA_DELETED (replaced by tablet 9dad85a23c0a45218fcd6ac04c12831a) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.335635 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2db0467c5e64e38961d3b0e66375544" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:57.335711 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75519f97f1ce49ceb3a739ba7c7bc239" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:57.336059 29063 leader_election.cc:343] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: b3ea76ad1ec64d22a64bdd4c97e288c6
I20260617 20:16:57.336189 29063 leader_election.cc:304] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:57.336587 30117 raft_consensus.cc:2749] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:57.337087 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 13ba94ec9e27403b974e5e6fea46e59e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 13ba94ec9e27403b974e5e6fea46e59e already in progress: creating tablet
W20260617 20:16:57.337594 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet a350456a8eb143838de58a05c76c9056 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a350456a8eb143838de58a05c76c9056 already in progress: creating tablet
I20260617 20:16:57.340730 29383 tablet_bootstrap.cc:492] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.340893 29383 ts_tablet_manager.cc:1403] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.000s
I20260617 20:16:57.341895 29383 raft_consensus.cc:359] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.342054 29383 raft_consensus.cc:385] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.342113 29383 raft_consensus.cc:740] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.342437 29383 consensus_queue.cc:260] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.342859 28663 catalog_manager.cc:5696] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:16:57.343387 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 0bbef4cc28ef46288cfc7d1933c71710 (table default.Table_e01af13e5b514cca8b4cfc05a15a949d [id=9850785700a84b33a30caf29ab508aea]). Expected version 1 got 0
I20260617 20:16:57.343859 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_7e36e71e8aca4a5e8813c465c31db50a [id=de24e09cee8e4f28998625c2697769b3]). Expected version 1 got 0
I20260617 20:16:57.344372 29383 ts_tablet_manager.cc:1434] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 20:16:57.344722 29383 tablet_bootstrap.cc:492] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.344369 28663 catalog_manager.cc:5696] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:16:57.345942 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5ba1cc04120f480096f12966b301a7ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.346603 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ba1cc04120f480096f12966b301a7ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.347383 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fbeeaf93389f4790acf4f3353d0952d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.347929 29383 tablet_bootstrap.cc:654] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:57.348057 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbeeaf93389f4790acf4f3353d0952d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.353143 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_766764a313d042c290c82395b15fcbfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.353760 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_766764a313d042c290c82395b15fcbfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:57.357781 29062 consensus_peers.cc:597] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d738ab2f8c784c76947a3a76bd040219. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:16:57.360092 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bcecdba377334298b883d80a9e192acd consensus state has no leader
W20260617 20:16:57.367427 28925 leader_election.cc:343] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.367568 28925 leader_election.cc:304] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:57.367908 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet bc486f0c614c4bab94d923f2e7623a03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc486f0c614c4bab94d923f2e7623a03 already in progress: creating tablet
W20260617 20:16:57.368170 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5b2797384f7845969ee9744b444f1acc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b2797384f7845969ee9744b444f1acc already in progress: creating tablet
I20260617 20:16:57.369412 30158 raft_consensus.cc:2749] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:57.369843 28925 leader_election.cc:343] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.370008 28925 leader_election.cc:304] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:57.371124 30158 raft_consensus.cc:2749] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:57.372851 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7b14f846015b4e82b2c3bdebc21b07b9 has no consensus state
W20260617 20:16:57.373940 29062 consensus_peers.cc:597] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e48a4a827d44afca912dc8723be4542. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:16:57.392295 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet bc486f0c614c4bab94d923f2e7623a03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc486f0c614c4bab94d923f2e7623a03 already in progress: creating tablet
W20260617 20:16:57.392798 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet a350456a8eb143838de58a05c76c9056 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a350456a8eb143838de58a05c76c9056 already in progress: creating tablet
W20260617 20:16:57.393146 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5b2797384f7845969ee9744b444f1acc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b2797384f7845969ee9744b444f1acc already in progress: creating tablet
I20260617 20:16:57.393800 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 086bd3079e8f4a6d85ccc681a38a47b0 (table default.Table_87c7eb0a5f3843a4ae45931a17a7b234 [id=cb568e8af2da4807b99a6d07c57afca9]). Expected version 3 got 0
I20260617 20:16:57.394106 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:16:57.394577 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 97541af7c02d46b98106692d92778741 (table default.Table_f427fc2304b34f1eb97b537b8239504f [id=f608d4e53a0f4d37af562e6ce53576d8]). Expected version 2 got 0
I20260617 20:16:57.394805 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet e58fbec4a9f14ddda42b5a4c0263972c (table default.Table_efb89ae603ed4713a25716af39bf03c3 [id=cd4abe077ee04673bad87834b3af273b]). Expected version 3 got 0
I20260617 20:16:57.401506 30117 consensus_queue.cc:1048] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:57.402403 28881 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 8d7a76853e334a4081aa8ccc28361aca
I20260617 20:16:57.403478 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d7a76853e334a4081aa8ccc28361aca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.404672 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e321d26263a24a5a8e31793f2ff8ba59" } modify_external_catalogs: true
I20260617 20:16:57.404927 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e321d26263a24a5a8e31793f2ff8ba59" } modify_external_catalogs: true
I20260617 20:16:57.406680 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d7a76853e334a4081aa8ccc28361aca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.407559 29379 tablet_bootstrap.cc:492] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:57.407758 29379 ts_tablet_manager.cc:1403] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.252s user 0.003s sys 0.000s
I20260617 20:16:57.408723 29379 raft_consensus.cc:359] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.409411 29379 raft_consensus.cc:385] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.409538 29379 raft_consensus.cc:740] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.409837 29379 consensus_queue.cc:260] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.410629 28664 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_12cb16608a854819a7e0834654f128bb [id=6e89910c5d7a4969a79960d34eff437c] alter complete (version 2)
I20260617 20:16:57.415714 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 8880f8eadaa44887a49adf0ef157965e with delete_type TABLET_DATA_DELETED (replaced by tablet f02529cd1e764a3886de27d86e9690e3) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.420888 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d7a76853e334a4081aa8ccc28361aca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.420950 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 75519f97f1ce49ceb3a739ba7c7bc239 with delete_type TABLET_DATA_DELETED (replaced by tablet c73bdcc1cefd48f3b99e0c059c3a7467) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.421094 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f9844fab126448895c4c9d4c3c78d76 with delete_type TABLET_DATA_DELETED (replaced by tablet cdd24a60a91b43cd9e31ecca3d21ec60) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.421262 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet d2db0467c5e64e38961d3b0e66375544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.421304 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet 13ba94ec9e27403b974e5e6fea46e59e with delete_type TABLET_DATA_DELETED (replaced by tablet 2b91a692a9c245cc897842ac29c210b3) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.421442 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet af9c687fe56f42af82dd4728ca53cd32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.421507 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet b19bce310bd24294b063b3b4f76b9f99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.422322 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e6cee209a5a44d6b35eb50e9c33228f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.427634 30158 raft_consensus.cc:493] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.427774 30158 raft_consensus.cc:515] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.428484 30158 leader_election.cc:290] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.429267 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97541af7c02d46b98106692d92778741" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.429701 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e35e0d6dd4344daa9725abfc5e70192b" } modify_external_catalogs: true
W20260617 20:16:57.429957 28925 leader_election.cc:343] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.429991 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e35e0d6dd4344daa9725abfc5e70192b" } modify_external_catalogs: true
I20260617 20:16:57.431285 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5973c3b62d2d4c1e9242f5a432e17719"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.431519 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 8d7a76853e334a4081aa8ccc28361aca because the tablet was not found. No further retry: Not found: Tablet not found: 8d7a76853e334a4081aa8ccc28361aca
W20260617 20:16:57.431907 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5973c3b62d2d4c1e9242f5a432e17719 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.432322 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97541af7c02d46b98106692d92778741" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:57.432560 29259 raft_consensus.cc:2468] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:57.432808 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 640f53137c21443cbfc274c084ce13ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.433068 29376 tablet_replica.cc:333] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:57.433290 29376 raft_consensus.cc:2243] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:57.433519 29376 raft_consensus.cc:2272] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.434146 29376 ts_tablet_manager.cc:1916] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:57.437444 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2ca839bde234444b97808d82d7974e3c" } modify_external_catalogs: true
I20260617 20:16:57.437673 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2ca839bde234444b97808d82d7974e3c" } modify_external_catalogs: true
I20260617 20:16:57.441694 29124 raft_consensus.cc:3060] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:57.441751 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 6c0aa4861a51488db2d1a7041c25ae22
I20260617 20:16:57.442458 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c0aa4861a51488db2d1a7041c25ae22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.442971 29377 tablet_replica.cc:333] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:57.443158 29377 raft_consensus.cc:2243] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:57.443317 29377 raft_consensus.cc:2272] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.443861 29377 ts_tablet_manager.cc:1916] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:57.448434 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5e53946c85ab4a8286a6e174cc411c5e
I20260617 20:16:57.449501 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e53946c85ab4a8286a6e174cc411c5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.453951 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c0aa4861a51488db2d1a7041c25ae22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.454911 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e53946c85ab4a8286a6e174cc411c5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.460850 28881 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 6c0aa4861a51488db2d1a7041c25ae22
I20260617 20:16:57.462230 29376 ts_tablet_manager.cc:1929] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:57.462376 29376 log.cc:1199] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/640f53137c21443cbfc274c084ce13ef
I20260617 20:16:57.462697 29376 ts_tablet_manager.cc:1950] T 640f53137c21443cbfc274c084ce13ef P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:57.462916 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c0aa4861a51488db2d1a7041c25ae22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.465001 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c0aa4861a51488db2d1a7041c25ae22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.465832 28963 tablet_service.cc:1511] Processing CreateTablet for tablet ccd6f76a201e40f8be224a93c701fea9 (DEFAULT_TABLE table=default.Table_2ad82bac5fac4ab8964031a88138d64d [id=6a0c1850d45b4e53b04c59905d2d5692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.466223 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd6f76a201e40f8be224a93c701fea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.469705 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet b1b3565799894d82a3cc29ab2a19307c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:47 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.470419 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c0aa4861a51488db2d1a7041c25ae22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.471112 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e53946c85ab4a8286a6e174cc411c5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.471769 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet c21b585707b146ed9c015d150d858681 with delete_type TABLET_DATA_DELETED (replaced by tablet 3726e55ed36f420ab63bcfb5a81c5aab) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.472270 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet b3278efaad07403ca0a2baecad46d0f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 08290c23fff5449481789b29d15c4781) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.472801 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.473310 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 0859e56b5b7a483ea5e751f0468cbab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.473845 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c0aa4861a51488db2d1a7041c25ae22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.474280 28925 leader_election.cc:304] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.475191 30158 raft_consensus.cc:2804] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:57.475286 30158 raft_consensus.cc:493] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:57.475344 30158 raft_consensus.cc:3060] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:57.477788 30158 raft_consensus.cc:515] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.478367 30158 leader_election.cc:290] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.480235 29377 ts_tablet_manager.cc:1929] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:57.480334 29377 log.cc:1199] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/75519f97f1ce49ceb3a739ba7c7bc239
I20260617 20:16:57.480580 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5477576e46c84bb6b8a8c7053c61641c
I20260617 20:16:57.482120 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97541af7c02d46b98106692d92778741" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:57.483917 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 5477576e46c84bb6b8a8c7053c61641c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:57.484447 29063 consensus_peers.cc:597] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e48a4a827d44afca912dc8723be4542. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:57.485270 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 5477576e46c84bb6b8a8c7053c61641c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.485800 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97541af7c02d46b98106692d92778741" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:57.485862 29379 ts_tablet_manager.cc:1434] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.078s user 0.002s sys 0.000s
I20260617 20:16:57.485975 29259 raft_consensus.cc:3060] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:57.486196 29379 tablet_bootstrap.cc:492] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:57.486760 29376 tablet_replica.cc:333] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:57.487090 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 640f53137c21443cbfc274c084ce13ef (table default.Table_7d193ca323a14554af974ae3b173fa07 [id=2d1a8cb755fb4625b83e93bca0e70898]) successfully deleted
I20260617 20:16:57.487865 29376 raft_consensus.cc:2243] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:57.488372 29376 raft_consensus.cc:2272] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.488517 29379 tablet_bootstrap.cc:654] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.488551 29259 raft_consensus.cc:2468] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:57.489327 29376 ts_tablet_manager.cc:1916] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:57.166613 29375 rpcz_store.cc:276] 0617 20:16:55.221628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.221732 (+ 104us) service_pool.cc:224] Handling call
0617 20:16:57.041242 (+1819510us) ts_tablet_manager.cc:1151] Deleting tablet 57e19abe093a40f6886908a8a3a0cad4
0617 20:16:57.041252 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:57.157920 (+116668us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:57.163972 (+ 6052us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:57.166460 (+ 2488us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1819203}
I20260617 20:16:57.490097 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 57e19abe093a40f6886908a8a3a0cad4 (table default.Table_bf43c1c307304b35a6b33eb8fb011be2 [id=c36f4aec7e564c10b3782a48ecdafef7]) successfully deleted
I20260617 20:16:57.490224 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 554) took 2140 ms. Trace:
I20260617 20:16:57.490305 29375 rpcz_store.cc:276] 0617 20:16:55.349618 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.349677 (+ 59us) service_pool.cc:224] Handling call
0617 20:16:57.490092 (+2140415us) ts_tablet_manager.cc:1151] Deleting tablet 85633d391613474db52dd2f86210a659
0617 20:16:57.490104 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:57.490207 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2140020}
W20260617 20:16:57.490796 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 85633d391613474db52dd2f86210a659 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 85633d391613474db52dd2f86210a659 already in progress: creating tablet
I20260617 20:16:57.494552 30061 raft_consensus.cc:493] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.494707 30061 raft_consensus.cc:515] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.495436 30061 leader_election.cc:290] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.496587 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c99389d24d4a8d8c934f0a9b9c2825" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:57.497264 29198 leader_election.cc:343] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.497938 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8388a2681a87463b92758e227df2b510" } modify_external_catalogs: true
I20260617 20:16:57.498327 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8388a2681a87463b92758e227df2b510" } modify_external_catalogs: true
I20260617 20:16:57.498473 29383 tablet_bootstrap.cc:492] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.498605 29383 ts_tablet_manager.cc:1403] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.154s user 0.039s sys 0.038s
I20260617 20:16:57.498941 29096 tablet_service.cc:1511] Processing CreateTablet for tablet ccd6f76a201e40f8be224a93c701fea9 (DEFAULT_TABLE table=default.Table_2ad82bac5fac4ab8964031a88138d64d [id=6a0c1850d45b4e53b04c59905d2d5692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.499408 29383 raft_consensus.cc:359] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.499508 30061 raft_consensus.cc:493] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.499553 29383 raft_consensus.cc:385] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.499620 29383 raft_consensus.cc:740] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.499644 30061 raft_consensus.cc:515] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.499780 29383 consensus_queue.cc:260] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.500237 30061 leader_election.cc:290] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:57.500479 29383 ts_tablet_manager.cc:1434] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:57.500614 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a3124306094c72ad78e5473aa35bdb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.501360 29375 tablet_replica.cc:333] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:57.501619 29375 raft_consensus.cc:2243] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:57.502130 29375 raft_consensus.cc:2272] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:57.502157 29198 leader_election.cc:343] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.504420 29383 tablet_bootstrap.cc:492] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.505479 30061 raft_consensus.cc:493] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.505597 30061 raft_consensus.cc:515] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.505894 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet a52873eade4048af81a8e51233b9d079
I20260617 20:16:57.506079 29383 tablet_bootstrap.cc:654] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.506132 30061 leader_election.cc:290] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.506690 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c21b585707b146ed9c015d150d858681" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.506758 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_35da9942c88b483c842bd60a4e136618"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.507576 29198 leader_election.cc:343] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.505987 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d71ffcb31abf48718dffc393996e7ebd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.509040 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a7326aeff93f42d09c7d454aeee0e601" } modify_external_catalogs: true
I20260617 20:16:57.509114 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet a52873eade4048af81a8e51233b9d079 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.509217 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a7326aeff93f42d09c7d454aeee0e601" } modify_external_catalogs: true
I20260617 20:16:57.509666 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_17f5f997158040c293ab63c2bd96216e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.510687 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17f5f997158040c293ab63c2bd96216e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:57.511646 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d71ffcb31abf48718dffc393996e7ebd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:57.507679 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35da9942c88b483c842bd60a4e136618 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.518548 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 97541af7c02d46b98106692d92778741 (table default.Table_f427fc2304b34f1eb97b537b8239504f [id=f608d4e53a0f4d37af562e6ce53576d8]). Expected version 2 got 0
I20260617 20:16:57.519089 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 3 got 0
I20260617 20:16:57.519922 29226 tablet_service.cc:1511] Processing CreateTablet for tablet ccd6f76a201e40f8be224a93c701fea9 (DEFAULT_TABLE table=default.Table_2ad82bac5fac4ab8964031a88138d64d [id=6a0c1850d45b4e53b04c59905d2d5692]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.520120 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d19d34e3bbe3453ca6de6ed7e62f7af4
I20260617 20:16:57.520396 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd6f76a201e40f8be224a93c701fea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.522030 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_beb2513cd34e4d5ebfadfcf15dfb3ad9" } new_table_name: "default.Table_59e33a772ea84e4286330690b0973bf4" modify_external_catalogs: true
I20260617 20:16:57.522207 29375 ts_tablet_manager.cc:1916] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:57.529017 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 (DEFAULT_TABLE table=default.Table_f1bf6a12189741bc8144442a0121eb38 [id=e60c0236ff6e436cb51cef3b9ef21106]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:57.529906 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74c73ae1007d44ce958ad02fa5787651 consensus state has no leader
I20260617 20:16:57.523823 28669 catalog_manager.cc:5696] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:16:57.531787 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f251f69819b7456a9a108dfefb1414bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.532469 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f251f69819b7456a9a108dfefb1414bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.533516 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a19dcdf8816f4caf9cf0d25a9aa3094d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.534026 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_58038c837b7247d3a630ff0893c70a21" } new_table_name: "default.Table_2880530e29494f939769447dfb05fd16" modify_external_catalogs: true
I20260617 20:16:57.534803 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c410bd335d1b42b09ad898a66eae6438" } new_table_name: "default.Table_07b69bc96042426b925d4a1072ec0d08" modify_external_catalogs: true
W20260617 20:16:57.535616 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a19dcdf8816f4caf9cf0d25a9aa3094d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.538841 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_7e36e71e8aca4a5e8813c465c31db50a [id=de24e09cee8e4f28998625c2697769b3]). Expected version 1 got 0
W20260617 20:16:57.544123 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f239f81c40743b2aaa70a361997db77 consensus state has no leader
I20260617 20:16:57.544584 29379 tablet_bootstrap.cc:492] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:57.544883 29379 ts_tablet_manager.cc:1403] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.000s
I20260617 20:16:57.546130 29379 raft_consensus.cc:359] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:57.546494 29379 raft_consensus.cc:385] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.546653 29379 raft_consensus.cc:740] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.547081 29379 consensus_queue.cc:260] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:57.548040 29379 ts_tablet_manager.cc:1434] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:57.548635 29379 tablet_bootstrap.cc:492] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:57.549674 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f43549813e294796baca2a1a64dbcfb9 consensus state has no leader
I20260617 20:16:57.552817 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet d19d34e3bbe3453ca6de6ed7e62f7af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.553534 29102 tablet_service.cc:1511] Processing CreateTablet for tablet cd67273fdfcb49dc82dd401f63e92663 (DEFAULT_TABLE table=default.Table_18e868cdbb12445fb4ae545f0bb0fe4a [id=ab13b375103549b4b6a7d6f05f1d23f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.556806 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_f7130590729b49af9644f1ffa516fe05 [id=6a948594185b42128136770dbe3f0ffb]). Expected version 3 got 0
I20260617 20:16:57.557792 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet a52873eade4048af81a8e51233b9d079 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.558940 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 (DEFAULT_TABLE table=default.Table_f1bf6a12189741bc8144442a0121eb38 [id=e60c0236ff6e436cb51cef3b9ef21106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.559337 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.567588 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e6e71aa967a248a3a1c006d77527f64c" } new_table_name: "default.Table_e92a88d95d63479491b84cc8ead2dc24" modify_external_catalogs: true
I20260617 20:16:57.567543 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_78825a839a2a4027a81301d589c4691f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.568114 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78825a839a2a4027a81301d589c4691f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.568863 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 8d7a76853e334a4081aa8ccc28361aca (DEFAULT_TABLE table=default.Table_01d83f6f43f542bab1b5d209557c8ff9 [id=dd29aab53b114df6a1fed6114863fdcb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:57.482762 28925 leader_election.cc:343] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:57.571832 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 89077.8us
I20260617 20:16:57.572115 29377 ts_tablet_manager.cc:1950] T 75519f97f1ce49ceb3a739ba7c7bc239 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:57.572085 28925 leader_election.cc:304] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.485435 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 5477576e46c84bb6b8a8c7053c61641c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.498198 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c99389d24d4a8d8c934f0a9b9c2825" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:57.572713 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 75519f97f1ce49ceb3a739ba7c7bc239 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]) successfully deleted
I20260617 20:16:57.504796 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 (DEFAULT_TABLE table=default.Table_f1bf6a12189741bc8144442a0121eb38 [id=e60c0236ff6e436cb51cef3b9ef21106]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.573143 29377 tablet_replica.cc:333] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:57.508616 30158 raft_consensus.cc:493] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.573371 30158 raft_consensus.cc:515] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.573532 29377 raft_consensus.cc:2243] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:57.573755 29377 raft_consensus.cc:2272] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.574011 30158 leader_election.cc:290] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.574216 30158 raft_consensus.cc:2804] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:57.574331 30158 raft_consensus.cc:697] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:57.574563 30158 consensus_queue.cc:237] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.574833 29377 ts_tablet_manager.cc:1916] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:57.520771 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet d19d34e3bbe3453ca6de6ed7e62f7af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.532166 28951 tablet_service.cc:1511] Processing CreateTablet for tablet cd67273fdfcb49dc82dd401f63e92663 (DEFAULT_TABLE table=default.Table_18e868cdbb12445fb4ae545f0bb0fe4a [id=ab13b375103549b4b6a7d6f05f1d23f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.553676 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 8d7a76853e334a4081aa8ccc28361aca (DEFAULT_TABLE table=default.Table_01d83f6f43f542bab1b5d209557c8ff9 [id=dd29aab53b114df6a1fed6114863fdcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.558671 29378 tablet_bootstrap.cc:492] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:57.573191 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.576100 28990 raft_consensus.cc:2468] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:16:57.578706 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9af3af6bc87843cfa6cd74e3d5e230f4 consensus state has no leader
I20260617 20:16:57.506527 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet a52873eade4048af81a8e51233b9d079 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.581553 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d7a76853e334a4081aa8ccc28361aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.585140 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd67273fdfcb49dc82dd401f63e92663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.589243 30189 raft_consensus.cc:493] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.589424 30189 raft_consensus.cc:515] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.590077 30189 leader_election.cc:290] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:57.591363 29062 leader_election.cc:343] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 8880f8eadaa44887a49adf0ef157965e
W20260617 20:16:57.593155 28655 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 13ba94ec9e27403b974e5e6fea46e59e (table default.Table_6791b989125046d893a9c24ae1e65c12 [id=e495b17f9a99422e9e29cf49befb762a], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 13ba94ec9e27403b974e5e6fea46e59e consensus state has no leader
W20260617 20:16:57.596797 29062 consensus_peers.cc:597] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b00437fb76c4000ad89c99ab2da2261. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:57.598662 29378 ts_tablet_manager.cc:1403] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.341s user 0.022s sys 0.035s
I20260617 20:16:57.599961 29378 raft_consensus.cc:359] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.600193 29378 raft_consensus.cc:385] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.600263 29378 raft_consensus.cc:740] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.600499 29378 consensus_queue.cc:260] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.601118 29378 ts_tablet_manager.cc:1434] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:16:57.601500 29378 tablet_bootstrap.cc:492] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:57.603440 29378 tablet_bootstrap.cc:654] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.607015 29231 tablet_service.cc:1511] Processing CreateTablet for tablet cd67273fdfcb49dc82dd401f63e92663 (DEFAULT_TABLE table=default.Table_18e868cdbb12445fb4ae545f0bb0fe4a [id=ab13b375103549b4b6a7d6f05f1d23f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.607484 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd67273fdfcb49dc82dd401f63e92663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.614717 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet d19d34e3bbe3453ca6de6ed7e62f7af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.614739 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_642cc41f3bdf4f4892418e1b130fc953" } new_table_name: "default.Table_2e2690c2f00244619623efaab2c222f4" modify_external_catalogs: true
I20260617 20:16:57.616261 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a85f39b0bb4a487098a661b4eca8de9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.616770 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a85f39b0bb4a487098a661b4eca8de9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.617949 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_52b729f02c4d498794d81ba38d3b5364"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.618409 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52b729f02c4d498794d81ba38d3b5364 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.619421 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d1285d94ca754303ba4dedcdaae5af7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.619846 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1285d94ca754303ba4dedcdaae5af7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.619923 29383 tablet_bootstrap.cc:492] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.619982 30197 tablet.cc:1724] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:16:57.620769 29383 ts_tablet_manager.cc:1403] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.116s user 0.007s sys 0.019s
I20260617 20:16:57.623742 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a725364bb9646e6bc80fc4f67d04a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.624179 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 8d7a76853e334a4081aa8ccc28361aca (DEFAULT_TABLE table=default.Table_01d83f6f43f542bab1b5d209557c8ff9 [id=dd29aab53b114df6a1fed6114863fdcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.624547 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d7a76853e334a4081aa8ccc28361aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.625425 29379 tablet_bootstrap.cc:654] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.628527 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 26be48e94e504f489743b58516257e84 (DEFAULT_TABLE table=default.Table_322d72936e094dd184fd2d62cdb77743 [id=bebb09bca83942438374ea8a0a0b978a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.628875 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26be48e94e504f489743b58516257e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.628317 29383 raft_consensus.cc:359] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.629518 29383 raft_consensus.cc:385] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.630095 29383 raft_consensus.cc:740] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.632251 29383 consensus_queue.cc:260] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:57.636075 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 consensus state has no leader
I20260617 20:16:57.637409 29383 ts_tablet_manager.cc:1434] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260617 20:16:57.640113 29383 tablet_bootstrap.cc:492] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.644124 28952 tablet_service.cc:1511] Processing CreateTablet for tablet aeb3bfc1983e406dbf48407a58aa3a43 (DEFAULT_TABLE table=default.Table_f43bb549bf7345e1ad723086a9536f11 [id=f94ce78782ee4bb1955c515b945a4279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.644770 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb3bfc1983e406dbf48407a58aa3a43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:57.648742 29197 leader_election.cc:343] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 67a3124306094c72ad78e5473aa35bdb
I20260617 20:16:57.649044 29197 leader_election.cc:304] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.649184 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd6f76a201e40f8be224a93c701fea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.649626 30061 raft_consensus.cc:2749] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:57.649938 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d7a76853e334a4081aa8ccc28361aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.653471 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd67273fdfcb49dc82dd401f63e92663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.654047 29383 tablet_bootstrap.cc:654] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.654472 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 26be48e94e504f489743b58516257e84 (DEFAULT_TABLE table=default.Table_322d72936e094dd184fd2d62cdb77743 [id=bebb09bca83942438374ea8a0a0b978a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.659428 30061 raft_consensus.cc:493] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.659596 30061 raft_consensus.cc:515] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.660336 30061 leader_election.cc:290] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.664126 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_48c2b283a7174f7abb91a866c98b1165"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.665380 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_eb56cf30fb6c4b82ac0476317efa6499" } modify_external_catalogs: true
I20260617 20:16:57.665601 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_eb56cf30fb6c4b82ac0476317efa6499" } modify_external_catalogs: true
I20260617 20:16:57.666786 30061 consensus_queue.cc:1048] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:57.666915 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1fb8413c68b4473abb8ca1748b6a3209" } modify_external_catalogs: true
I20260617 20:16:57.667111 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1fb8413c68b4473abb8ca1748b6a3209" } modify_external_catalogs: true
I20260617 20:16:57.667285 29383 tablet_bootstrap.cc:492] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.667407 29383 ts_tablet_manager.cc:1403] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.000s
I20260617 20:16:57.672931 29378 tablet_bootstrap.cc:492] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:57.673152 29378 ts_tablet_manager.cc:1403] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.001s
I20260617 20:16:57.668129 29383 raft_consensus.cc:359] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.673275 29383 raft_consensus.cc:385] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.673856 29383 raft_consensus.cc:740] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.673954 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b278ba32316c42d1b101e9803657af99
I20260617 20:16:57.674330 29383 consensus_queue.cc:260] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.674618 29378 raft_consensus.cc:359] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.674875 29378 raft_consensus.cc:385] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.674960 29378 raft_consensus.cc:740] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.675282 29378 consensus_queue.cc:260] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.676175 29378 ts_tablet_manager.cc:1434] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:57.676693 29378 tablet_bootstrap.cc:492] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:57.677754 29383 ts_tablet_manager.cc:1434] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260617 20:16:57.680454 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3180f1336fd841d8b4cf7fdf94015955
W20260617 20:16:57.680984 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 108918us
I20260617 20:16:57.682073 29383 tablet_bootstrap.cc:492] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.683969 29383 tablet_bootstrap.cc:654] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.685067 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d45c5dfa81904202b64c8dee6eb00b24" } modify_external_catalogs: true
I20260617 20:16:57.685269 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d45c5dfa81904202b64c8dee6eb00b24" } modify_external_catalogs: true
W20260617 20:16:57.686483 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48c2b283a7174f7abb91a866c98b1165 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:57.685664 29197 leader_election.cc:343] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c21b585707b146ed9c015d150d858681
I20260617 20:16:57.687984 29197 leader_election.cc:304] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.688076 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:16:57.688225 30061 raft_consensus.cc:2749] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:57.688752 29197 leader_election.cc:304] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.689006 30061 raft_consensus.cc:2804] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:57.689091 30061 raft_consensus.cc:493] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:57.689168 30061 raft_consensus.cc:3060] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:57.691848 30061 raft_consensus.cc:515] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.692021 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 9574c6f0765b4329af28d72c8e94240a
I20260617 20:16:57.692440 30061 leader_election.cc:290] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.697389 28953 tablet_service.cc:1511] Processing CreateTablet for tablet b333d38847aa462e98640a49d46c8cb4 (DEFAULT_TABLE table=default.Table_ecf2ff52cdbb4225b5543050fe111b98 [id=0a2de017443647cfb80f0d4906471adb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.697783 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b333d38847aa462e98640a49d46c8cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.698561 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d076991ad9fb4498a11fd22fa8339889" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:57.698719 29259 raft_consensus.cc:2468] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:57.699205 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e27c5834baa48ed953fccef54e6c52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.699934 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c99389d24d4a8d8c934f0a9b9c2825" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:57.700094 28988 raft_consensus.cc:3060] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:57.700636 29383 tablet_bootstrap.cc:492] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.700745 29383 ts_tablet_manager.cc:1403] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.002s
I20260617 20:16:57.701443 29383 raft_consensus.cc:359] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.701579 29383 raft_consensus.cc:385] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.701627 29383 raft_consensus.cc:740] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.701629 28955 tablet_service.cc:1511] Processing CreateTablet for tablet e2f906eb1286493ab134c4b959cd1b6a (DEFAULT_TABLE table=default.Table_af1725ce632d44719ed0ce47881b4102 [id=f5d1fae02fa1431d9913117bbef77d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.701807 29383 consensus_queue.cc:260] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.701984 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f906eb1286493ab134c4b959cd1b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.702670 28988 raft_consensus.cc:2468] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:57.703366 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3124306094c72ad78e5473aa35bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.703666 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d373f177494f1486fcae4a67a13041 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.703939 28925 leader_election.cc:304] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:57.704176 30158 raft_consensus.cc:2804] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:57.704239 30158 raft_consensus.cc:493] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:57.704308 30158 raft_consensus.cc:3060] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:57.705624 28961 tablet_service.cc:1511] Processing CreateTablet for tablet b7a26cb68df548f9b716c72e36b11647 (DEFAULT_TABLE table=default.Table_5d147a20f3c047e2b5a9c4d61739120a [id=ff9b735065df47379156d27f2aff8700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.705966 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a26cb68df548f9b716c72e36b11647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.706856 30158 raft_consensus.cc:515] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.707470 30158 leader_election.cc:290] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.708803 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ae4ab5348d244f92a3ecd4fac3ca86b2" } modify_external_catalogs: true
I20260617 20:16:57.708984 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ae4ab5348d244f92a3ecd4fac3ca86b2" } modify_external_catalogs: true
I20260617 20:16:57.709619 28960 tablet_service.cc:1511] Processing CreateTablet for tablet f57d1591442045d6bda930d8993ae4db (DEFAULT_TABLE table=default.Table_26c8b16b5bf24bda8bf9851b87f0bde0 [id=bf02335abe5b47bb8251b52c6dc5ab81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.710039 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57d1591442045d6bda930d8993ae4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.713276 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d076991ad9fb4498a11fd22fa8339889" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:57.713469 29259 raft_consensus.cc:3060] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:57.713567 28968 tablet_service.cc:1511] Processing CreateTablet for tablet f2c1fd3f325841c297d123ad1ac0fe9d (DEFAULT_TABLE table=default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.713863 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c1fd3f325841c297d123ad1ac0fe9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.716015 29259 raft_consensus.cc:2468] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:57.716384 29376 ts_tablet_manager.cc:1929] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:57.716483 29376 log.cc:1199] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/b1b3565799894d82a3cc29ab2a19307c
I20260617 20:16:57.716734 29376 ts_tablet_manager.cc:1950] T b1b3565799894d82a3cc29ab2a19307c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:57.717758 29197 leader_election.cc:304] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:57.717837 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 26be48e94e504f489743b58516257e84 (DEFAULT_TABLE table=default.Table_322d72936e094dd184fd2d62cdb77743 [id=bebb09bca83942438374ea8a0a0b978a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.718146 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26be48e94e504f489743b58516257e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.718194 30061 raft_consensus.cc:2804] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:57.718276 30061 raft_consensus.cc:697] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:57.718468 30061 consensus_queue.cc:237] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.722322 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 9574c6f0765b4329af28d72c8e94240a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:57.723815 29197 leader_election.cc:343] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 46ea43994a0a42fe9e16d7bc6a2118e6
I20260617 20:16:57.724829 29228 tablet_service.cc:1511] Processing CreateTablet for tablet b333d38847aa462e98640a49d46c8cb4 (DEFAULT_TABLE table=default.Table_ecf2ff52cdbb4225b5543050fe111b98 [id=0a2de017443647cfb80f0d4906471adb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.724920 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 9574c6f0765b4329af28d72c8e94240a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.724829 29241 tablet_service.cc:1511] Processing CreateTablet for tablet aeb3bfc1983e406dbf48407a58aa3a43 (DEFAULT_TABLE table=default.Table_f43bb549bf7345e1ad723086a9536f11 [id=f94ce78782ee4bb1955c515b945a4279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.725116 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet af9c687fe56f42af82dd4728ca53cd32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.725183 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b333d38847aa462e98640a49d46c8cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.725325 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb3bfc1983e406dbf48407a58aa3a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.725867 29383 ts_tablet_manager.cc:1434] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20260617 20:16:57.726141 29383 tablet_bootstrap.cc:492] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.726315 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet b278ba32316c42d1b101e9803657af99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.727028 30018 raft_consensus.cc:493] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.727152 30018 raft_consensus.cc:515] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.727779 30018 leader_election.cc:290] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.728572 28925 leader_election.cc:304] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:57.729555 29238 tablet_service.cc:1511] Processing CreateTablet for tablet e2f906eb1286493ab134c4b959cd1b6a (DEFAULT_TABLE table=default.Table_af1725ce632d44719ed0ce47881b4102 [id=f5d1fae02fa1431d9913117bbef77d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.729655 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 75519f97f1ce49ceb3a739ba7c7bc239 with delete_type TABLET_DATA_DELETED (replaced by tablet c73bdcc1cefd48f3b99e0c059c3a7467) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.729887 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f906eb1286493ab134c4b959cd1b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.727789 29383 tablet_bootstrap.cc:654] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.733661 29234 tablet_service.cc:1511] Processing CreateTablet for tablet b7a26cb68df548f9b716c72e36b11647 (DEFAULT_TABLE table=default.Table_5d147a20f3c047e2b5a9c4d61739120a [id=ff9b735065df47379156d27f2aff8700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.734078 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a26cb68df548f9b716c72e36b11647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.734483 30203 raft_consensus.cc:2804] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:57.734637 30203 raft_consensus.cc:697] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:57.734877 30203 consensus_queue.cc:237] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.736133 29383 tablet_bootstrap.cc:492] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.736248 29383 ts_tablet_manager.cc:1403] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260617 20:16:57.736902 29383 raft_consensus.cc:359] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.737054 29383 raft_consensus.cc:385] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.737100 29383 raft_consensus.cc:740] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.737289 29383 consensus_queue.cc:260] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.737612 29242 tablet_service.cc:1511] Processing CreateTablet for tablet f57d1591442045d6bda930d8993ae4db (DEFAULT_TABLE table=default.Table_26c8b16b5bf24bda8bf9851b87f0bde0 [id=bf02335abe5b47bb8251b52c6dc5ab81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.737936 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57d1591442045d6bda930d8993ae4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.738628 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_aead2dfbc56e41b09cb8d70dd31f9fe7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.739177 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aead2dfbc56e41b09cb8d70dd31f9fe7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:57.739880 29197 leader_election.cc:343] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 4e27c5834baa48ed953fccef54e6c52b
I20260617 20:16:57.740392 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c6631ee4b2694bfaba80e0e44c938698" } new_table_name: "default.Table_50f2b58acf40426e91582284e4435525" modify_external_catalogs: true
I20260617 20:16:57.743007 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_39641ab506b845759f012df286383321"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.743485 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39641ab506b845759f012df286383321 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.745654 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_aa868f28a51b48dcbaa47027ea1ee54e" } new_table_name: "default.Table_dd291560b73540e38b18bf2c933613e3" modify_external_catalogs: true
I20260617 20:16:57.745739 29383 ts_tablet_manager.cc:1434] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260617 20:16:57.746004 29383 tablet_bootstrap.cc:492] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.747820 30201 raft_consensus.cc:493] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.748026 30201 raft_consensus.cc:515] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.748739 30201 leader_election.cc:290] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.749151 29383 tablet_bootstrap.cc:654] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.750164 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c9d59b6b5a4dee8ca970247f613e53" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:57.752866 28925 leader_election.cc:343] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.753671 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_69cc8ac4971244b09b6fec4788813e2c" } new_table_name: "default.Table_1e06b58a614b4e83af282cace8749f39" modify_external_catalogs: true
I20260617 20:16:57.754186 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c3d29f5e898a4d2bba6e56851b4aebc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.754683 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3d29f5e898a4d2bba6e56851b4aebc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.754824 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet 3180f1336fd841d8b4cf7fdf94015955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.754982 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4efc16d51f0249de859da13faef23f7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.755455 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4efc16d51f0249de859da13faef23f7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:57.755831 30026 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 20:16:57.756232 30026 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 20:16:57.756364 30026 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260617 20:16:57.756460 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_de502b1f036f4436bb0991e0b6720e6a" } modify_external_catalogs: true
I20260617 20:16:57.756596 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_de502b1f036f4436bb0991e0b6720e6a" } modify_external_catalogs: true
I20260617 20:16:57.734093 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 3180f1336fd841d8b4cf7fdf94015955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.765635 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet b278ba32316c42d1b101e9803657af99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.768503 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6f140c50b6434bcebd5021f6519a66fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.768667 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59a3766053144e6c9ee680f099ff1766 consensus state has no leader
W20260617 20:16:57.769447 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f140c50b6434bcebd5021f6519a66fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.770396 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 6afb3ed704bb4a269d92f1741455161b
I20260617 20:16:57.772708 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 6afb3ed704bb4a269d92f1741455161b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:57.773279 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet b1b3565799894d82a3cc29ab2a19307c (table default.Table_2f2534b9a19341bdb7f92a6da5470fea [id=2133bdb470c34a7dbc0508a2d780094b]) successfully deleted
I20260617 20:16:57.660261 29375 ts_tablet_manager.cc:1929] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:57.773804 29375 log.cc:1199] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/5b65814c56424256b53d3c9f94c1b74a
I20260617 20:16:57.661118 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea43994a0a42fe9e16d7bc6a2118e6" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.679064 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet b278ba32316c42d1b101e9803657af99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.681586 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d076991ad9fb4498a11fd22fa8339889" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.767002 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 9574c6f0765b4329af28d72c8e94240a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.766203 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 3180f1336fd841d8b4cf7fdf94015955 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.771154 29091 tablet_service.cc:1511] Processing CreateTablet for tablet b7a26cb68df548f9b716c72e36b11647 (DEFAULT_TABLE table=default.Table_5d147a20f3c047e2b5a9c4d61739120a [id=ff9b735065df47379156d27f2aff8700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.771253 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 6afb3ed704bb4a269d92f1741455161b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.771390 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c99389d24d4a8d8c934f0a9b9c2825" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:57.771715 29093 tablet_service.cc:1511] Processing CreateTablet for tablet aeb3bfc1983e406dbf48407a58aa3a43 (DEFAULT_TABLE table=default.Table_f43bb549bf7345e1ad723086a9536f11 [id=f94ce78782ee4bb1955c515b945a4279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.771742 29105 tablet_service.cc:1511] Processing CreateTablet for tablet e2f906eb1286493ab134c4b959cd1b6a (DEFAULT_TABLE table=default.Table_af1725ce632d44719ed0ce47881b4102 [id=f5d1fae02fa1431d9913117bbef77d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.771816 29094 tablet_service.cc:1511] Processing CreateTablet for tablet b333d38847aa462e98640a49d46c8cb4 (DEFAULT_TABLE table=default.Table_ecf2ff52cdbb4225b5543050fe111b98 [id=0a2de017443647cfb80f0d4906471adb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.771914 29098 tablet_service.cc:1511] Processing CreateTablet for tablet f57d1591442045d6bda930d8993ae4db (DEFAULT_TABLE table=default.Table_26c8b16b5bf24bda8bf9851b87f0bde0 [id=bf02335abe5b47bb8251b52c6dc5ab81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.660995 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.775920 29375 ts_tablet_manager.cc:1950] T 5b65814c56424256b53d3c9f94c1b74a P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:16:57.777482 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6efb29f2e56c4838b0efd0171229088a consensus state has no leader
W20260617 20:16:57.779271 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e84c2f0be1ce4ac18f8964c2b717a8f8 consensus state has no leader
W20260617 20:16:57.697963 29063 consensus_peers.cc:597] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b00437fb76c4000ad89c99ab2da2261. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:16:57.779522 29063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 81603us
W20260617 20:16:57.780417 29063 leader_election.cc:343] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 8880f8eadaa44887a49adf0ef157965e
I20260617 20:16:57.780521 29063 leader_election.cc:304] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:57.780870 29063 consensus_peers.cc:597] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d738ab2f8c784c76947a3a76bd040219. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:16:57.781266 29198 leader_election.cc:343] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.781388 29198 leader_election.cc:304] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.781687 30061 raft_consensus.cc:2749] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:57.781728 29198 leader_election.cc:343] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.782598 30189 raft_consensus.cc:2749] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:57.782855 29379 tablet_bootstrap.cc:492] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:57.782975 29379 ts_tablet_manager.cc:1403] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.234s user 0.002s sys 0.001s
I20260617 20:16:57.783430 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d076991ad9fb4498a11fd22fa8339889" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:57.783751 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e27c5834baa48ed953fccef54e6c52b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.783700 29379 raft_consensus.cc:359] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.783854 29379 raft_consensus.cc:385] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.783905 29379 raft_consensus.cc:740] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.784089 29379 consensus_queue.cc:260] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.784487 29379 ts_tablet_manager.cc:1434] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:16:57.784618 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d2c0988a73d547d08d0924784bff9222
W20260617 20:16:57.784833 28925 leader_election.cc:343] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.785216 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet d2c0988a73d547d08d0924784bff9222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:16:57.788137 29198 leader_election.cc:343] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.788254 29198 leader_election.cc:304] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:57.788604 30018 raft_consensus.cc:2749] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:57.790001 28925 leader_election.cc:343] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.790791 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c9d59b6b5a4dee8ca970247f613e53" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:57.791252 28925 leader_election.cc:343] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.791352 28925 leader_election.cc:304] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:57.792040 29107 tablet_service.cc:1511] Processing CreateTablet for tablet f2c1fd3f325841c297d123ad1ac0fe9d (DEFAULT_TABLE table=default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.799413 29106 tablet_service.cc:1511] Processing CreateTablet for tablet aad5d2ab3e7d4453b4e1aa27acf7683d (DEFAULT_TABLE table=default.Table_f7ba6da717cb4d2f9cce7ff504334ae0 [id=18a104f3bd504674bc8543d24dffbf1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.802397 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26be48e94e504f489743b58516257e84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.802589 28667 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 64bb6d176a4845eca312848ae5104647 (table default.Table_12cb16608a854819a7e0834654f128bb [id=6e89910c5d7a4969a79960d34eff437c]). Expected version 2 got 0
I20260617 20:16:57.804755 29383 tablet_bootstrap.cc:492] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.804888 29383 ts_tablet_manager.cc:1403] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.059s user 0.008s sys 0.002s
I20260617 20:16:57.805682 29383 raft_consensus.cc:359] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.805842 29383 raft_consensus.cc:385] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.805805 29092 tablet_service.cc:1511] Processing CreateTablet for tablet dc11f416bf5647c78a5ab687cad53792 (DEFAULT_TABLE table=default.Table_ee6d0ff0a92e42e59d1be2988aa3e5b1 [id=e24801a55bc8441891995304c46d0e57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.805888 29383 raft_consensus.cc:740] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.806094 29383 consensus_queue.cc:260] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.806568 29383 ts_tablet_manager.cc:1434] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:57.806849 29383 tablet_bootstrap.cc:492] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.808064 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 77f685eeac48402888cbc8ef97fb4b94 (DEFAULT_TABLE table=default.Table_fe54346acedc4aee9fe8151c12a389fc [id=32c61aa9610e428fa8d5c794b078e0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.810316 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc11f416bf5647c78a5ab687cad53792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.810936 29383 tablet_bootstrap.cc:654] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.810845 29108 tablet_service.cc:1511] Processing CreateTablet for tablet fb2a0578122c421ab45bf56edb7cffdb (DEFAULT_TABLE table=default.Table_6cb2486917764383bc50fe8b80d84a07 [id=28482c1294b7476d96b490f73d8b9d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.813979 28667 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 0bbef4cc28ef46288cfc7d1933c71710 (table default.Table_e01af13e5b514cca8b4cfc05a15a949d [id=9850785700a84b33a30caf29ab508aea]). Expected version 1 got 0
I20260617 20:16:57.817502 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 16d0360ec78844a1be3d5f51259bbcdf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.817648 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fe1f37f396474ba18d08423d29d9ff62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.818213 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb2a0578122c421ab45bf56edb7cffdb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:57.818230 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe1f37f396474ba18d08423d29d9ff62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.819401 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d10766d3246d4cfdaa6a36d63033318a" } new_table_name: "default.Table_94b332516c584687b839358618c3a83f" modify_external_catalogs: true
I20260617 20:16:57.821203 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.822302 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a26cb68df548f9b716c72e36b11647. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:57.822533 30026 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
I20260617 20:16:57.822535 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb3bfc1983e406dbf48407a58aa3a43. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:57.825670 30026 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 20:16:57.825862 30026 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260617 20:16:57.826016 30026 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 20:16:57.826335 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f906eb1286493ab134c4b959cd1b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.829895 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57d1591442045d6bda930d8993ae4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.830152 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b333d38847aa462e98640a49d46c8cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.835919 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 555) took 2448 ms. Trace:
I20260617 20:16:57.836036 29375 rpcz_store.cc:276] 0617 20:16:55.387276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.388153 (+ 877us) service_pool.cc:224] Handling call
0617 20:16:57.501258 (+2113105us) ts_tablet_manager.cc:1151] Deleting tablet 5b65814c56424256b53d3c9f94c1b74a
0617 20:16:57.501267 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:57.657356 (+156089us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:57.660212 (+ 2856us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:57.835894 (+175682us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2112078}
I20260617 20:16:57.836526 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 557) took 2430 ms. Trace:
I20260617 20:16:57.836594 29375 rpcz_store.cc:276] 0617 20:16:55.406487 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.406812 (+ 325us) service_pool.cc:224] Handling call
0617 20:16:57.836368 (+2429556us) ts_tablet_manager.cc:1151] Deleting tablet 5faea831376646c1bdfcaf8fbbc7ca6d
0617 20:16:57.836380 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:57.836511 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2429359}
I20260617 20:16:57.836938 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 558) took 2382 ms. Trace:
I20260617 20:16:57.836997 29375 rpcz_store.cc:276] 0617 20:16:55.454042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.454098 (+ 56us) service_pool.cc:224] Handling call
0617 20:16:57.836845 (+2382747us) ts_tablet_manager.cc:1151] Deleting tablet 33b01c9c27904a1986e285477921ac4f
0617 20:16:57.836852 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:57.836923 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2382538}
I20260617 20:16:57.837204 29375 tablet_replica.cc:333] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:57.837438 29375 raft_consensus.cc:2243] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:57.837590 29375 raft_consensus.cc:2272] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.837750 29383 tablet_bootstrap.cc:492] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.837870 29383 ts_tablet_manager.cc:1403] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.001s
I20260617 20:16:57.838068 29375 ts_tablet_manager.cc:1916] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:57.838574 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 5b65814c56424256b53d3c9f94c1b74a (table default.Table_a445cef5739e4885982b17bdd98216da [id=cb0d51091f8245b9b5a1468752343edc]) successfully deleted
I20260617 20:16:57.838804 29379 tablet_bootstrap.cc:492] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:16:57.838840 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5faea831376646c1bdfcaf8fbbc7ca6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5faea831376646c1bdfcaf8fbbc7ca6d already in progress: creating tablet
W20260617 20:16:57.839051 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 33b01c9c27904a1986e285477921ac4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33b01c9c27904a1986e285477921ac4f already in progress: creating tablet
I20260617 20:16:57.839931 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 6afb3ed704bb4a269d92f1741455161b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:57.841156 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d673bc9892c94725b270ef3b9dc768f4 consensus state has no leader
I20260617 20:16:57.843227 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cdb4c1e8ce7042bc828e729ef36aba9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.843792 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdb4c1e8ce7042bc828e729ef36aba9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.845696 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fe1f37f396474ba18d08423d29d9ff62" } new_table_name: "default.Table_41576d8b3a1d4789ab70d3afb1cd0fbe" modify_external_catalogs: true
I20260617 20:16:57.846963 30018 raft_consensus.cc:493] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.846943 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c816a44858d34b368a1e701cdbebd429"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.847100 30018 raft_consensus.cc:515] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:57.847447 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c816a44858d34b368a1e701cdbebd429 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.847705 30018 leader_election.cc:290] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:57.840346 30203 raft_consensus.cc:2749] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:57.850740 29383 raft_consensus.cc:359] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.851317 29383 raft_consensus.cc:385] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.851581 29383 raft_consensus.cc:740] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.851997 29383 consensus_queue.cc:260] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.853046 30018 raft_consensus.cc:493] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.853207 30018 raft_consensus.cc:515] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.853814 30018 leader_election.cc:290] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:57.854526 29383 ts_tablet_manager.cc:1434] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20260617 20:16:57.856594 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 2bdc7552bcf44fec9abfad002903b624 (DEFAULT_TABLE table=default.Table_18d04b2793af4915ac6a2f592f197b41 [id=4fa0724d031447898614e9f9f1ce16ec]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:57.857069 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c9b99132b80406cb860b679bfdd782c has no consensus state
I20260617 20:16:57.859081 29383 tablet_bootstrap.cc:492] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.860836 29383 tablet_bootstrap.cc:654] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.862247 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 33d9cafa9d7c4a3f91f738e4654058b4 (DEFAULT_TABLE table=default.Table_68a5110f6e914dc5882d9f2cb6ab132d [id=65adc0eb88a64becba5954a5b839b3fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.858174 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4130f3529ef4adaa4cedf12e53b6895" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:57.863202 29198 leader_election.cc:343] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.864779 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad5d2ab3e7d4453b4e1aa27acf7683d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.869314 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c1fd3f325841c297d123ad1ac0fe9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.869603 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f685eeac48402888cbc8ef97fb4b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.869885 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdc7552bcf44fec9abfad002903b624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.871809 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f847106ae8c04ab0ace089e9e123c60b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.872414 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f847106ae8c04ab0ace089e9e123c60b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.875746 30203 raft_consensus.cc:493] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.875941 30203 raft_consensus.cc:515] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.876936 30203 leader_election.cc:290] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.880895 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0aa4861a51488db2d1a7041c25ae22 (DEFAULT_TABLE table=default.Table_e321d26263a24a5a8e31793f2ff8ba59 [id=c8277a7f96084f65b3fefab7897e3608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.887655 30201 raft_consensus.cc:493] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.887856 30201 raft_consensus.cc:515] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.888669 30026 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.245.212:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.253:38361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.27.245.253
--webserver_port=44941
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 17 Jun 2026 19:49:13 UTC on bdcb31816ec0
build id 12442
ASAN enabled
I20260617 20:16:57.889454 30201 leader_election.cc:290] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.889667 30201 raft_consensus.cc:493] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.889799 30201 raft_consensus.cc:515] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.890282 30201 leader_election.cc:290] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.890853 30026 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260617 20:16:57.893183 30026 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260617 20:16:57.901607 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 5da9fa5bc3b3478487aab3949b547e09 (DEFAULT_TABLE table=default.Table_a7ae2b556b104787bb92a47f706bc91a [id=31199bd88feb40559cb20211be2ec3c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.904438 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7ccf01ded0f84e49b3d9791d7ba4096a" } modify_external_catalogs: true
I20260617 20:16:57.904676 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7ccf01ded0f84e49b3d9791d7ba4096a" } modify_external_catalogs: true
I20260617 20:16:57.907121 29102 tablet_service.cc:1511] Processing CreateTablet for tablet e9ea2f6574d44d1a80fd4787fb6ca0e1 (DEFAULT_TABLE table=default.Table_c9f56913d2c44e0ab075f05ddeb35442 [id=b0fa314282564343aee5bef0442f7ee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.907442 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3096a1f9adc14b65b52421fada209eb9" } modify_external_catalogs: true
I20260617 20:16:57.907644 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3096a1f9adc14b65b52421fada209eb9" } modify_external_catalogs: true
I20260617 20:16:57.908631 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet 5faea831376646c1bdfcaf8fbbc7ca6d from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:57.911161 29377 ts_tablet_manager.cc:1929] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:57.911281 29377 log.cc:1199] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/9f9844fab126448895c4c9d4c3c78d76
I20260617 20:16:57.911572 29377 ts_tablet_manager.cc:1950] T 9f9844fab126448895c4c9d4c3c78d76 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:57.911996 29377 tablet_replica.cc:333] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:57.912181 29377 raft_consensus.cc:2243] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:57.912320 29377 raft_consensus.cc:2272] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:57.912606 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f24954093a45411a9cbe39415fb1adb7
I20260617 20:16:57.912900 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet d2c0988a73d547d08d0924784bff9222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.914762 28955 tablet_service.cc:1511] Processing CreateTablet for tablet aad5d2ab3e7d4453b4e1aa27acf7683d (DEFAULT_TABLE table=default.Table_f7ba6da717cb4d2f9cce7ff504334ae0 [id=18a104f3bd504674bc8543d24dffbf1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.915264 28953 tablet_service.cc:1511] Processing CreateTablet for tablet dc11f416bf5647c78a5ab687cad53792 (DEFAULT_TABLE table=default.Table_ee6d0ff0a92e42e59d1be2988aa3e5b1 [id=e24801a55bc8441891995304c46d0e57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.915634 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc11f416bf5647c78a5ab687cad53792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.916393 28960 tablet_service.cc:1511] Processing CreateTablet for tablet fb2a0578122c421ab45bf56edb7cffdb (DEFAULT_TABLE table=default.Table_6cb2486917764383bc50fe8b80d84a07 [id=28482c1294b7476d96b490f73d8b9d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.916477 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 33d9cafa9d7c4a3f91f738e4654058b4 (DEFAULT_TABLE table=default.Table_68a5110f6e914dc5882d9f2cb6ab132d [id=65adc0eb88a64becba5954a5b839b3fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.916716 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad5d2ab3e7d4453b4e1aa27acf7683d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.917138 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 3656e8549ea543e3b7a7cc1490aad71c (DEFAULT_TABLE table=default.Table_4f1e9321b3c548eeb322bd50ae32a077 [id=4b3cdb2f571542888c313ddae66d4c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.917599 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_70137395fd5347969cead58202834395" } modify_external_catalogs: true
I20260617 20:16:57.917725 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 2bdc7552bcf44fec9abfad002903b624 (DEFAULT_TABLE table=default.Table_18d04b2793af4915ac6a2f592f197b41 [id=4fa0724d031447898614e9f9f1ce16ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.917798 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_70137395fd5347969cead58202834395" } modify_external_catalogs: true
I20260617 20:16:57.920109 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet f24954093a45411a9cbe39415fb1adb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.920605 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 93daae49ea3b4abd8623f64bffdd1f6a (DEFAULT_TABLE table=default.Table_1265f7b4e2374fc9a3cbf51bdbf7f663 [id=ab050767c0744002b8fd0cb464edcd0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.921320 29375 ts_tablet_manager.cc:1929] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:57.921418 29375 log.cc:1199] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/0d1a416f802948d5bc150855d82b54c1
I20260617 20:16:57.921677 29375 ts_tablet_manager.cc:1950] T 0d1a416f802948d5bc150855d82b54c1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:57.922516 28666 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 751e91954ae7479eae595ba74de3c0fc
I20260617 20:16:57.925323 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 9370421288e2449fae454aec32883810
I20260617 20:16:57.927347 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet 9370421288e2449fae454aec32883810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:57.927953 29089 tablet_service.cc:1511] Processing CreateTablet for tablet ec871f7502c24af6920ce16f4b62330a (DEFAULT_TABLE table=default.Table_e6d2efb704e44c7a8ea2697ad784c448 [id=8e71ae5eb0e44723af7609769009a976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.931102 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d9cafa9d7c4a3f91f738e4654058b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.932075 29092 tablet_service.cc:1511] Processing CreateTablet for tablet f5387e3c30b24cb285ea5cc657981321 (DEFAULT_TABLE table=default.Table_b5ce299906ed496b81dbaf936e215598 [id=a8cb67eb32c243979b86be5f86be29cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.930358 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a725364bb9646e6bc80fc4f67d04a16" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.930406 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58fbec4a9f14ddda42b5a4c0263972c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.933729 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe079091784d7e8035659edd442ba6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.935977 29379 tablet_bootstrap.cc:654] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:57.936872 28970 tablet_service.cc:1511] Processing CreateTablet for tablet e9ea2f6574d44d1a80fd4787fb6ca0e1 (DEFAULT_TABLE table=default.Table_c9f56913d2c44e0ab075f05ddeb35442 [id=b0fa314282564343aee5bef0442f7ee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.937152 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 9370421288e2449fae454aec32883810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.937815 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0aa4861a51488db2d1a7041c25ae22 (DEFAULT_TABLE table=default.Table_e321d26263a24a5a8e31793f2ff8ba59 [id=c8277a7f96084f65b3fefab7897e3608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.938128 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 5da9fa5bc3b3478487aab3949b547e09 (DEFAULT_TABLE table=default.Table_a7ae2b556b104787bb92a47f706bc91a [id=31199bd88feb40559cb20211be2ec3c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.938383 28963 tablet_service.cc:1511] Processing CreateTablet for tablet f5387e3c30b24cb285ea5cc657981321 (DEFAULT_TABLE table=default.Table_b5ce299906ed496b81dbaf936e215598 [id=a8cb67eb32c243979b86be5f86be29cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.938661 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 3656e8549ea543e3b7a7cc1490aad71c (DEFAULT_TABLE table=default.Table_4f1e9321b3c548eeb322bd50ae32a077 [id=4b3cdb2f571542888c313ddae66d4c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.938912 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 93daae49ea3b4abd8623f64bffdd1f6a (DEFAULT_TABLE table=default.Table_1265f7b4e2374fc9a3cbf51bdbf7f663 [id=ab050767c0744002b8fd0cb464edcd0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.939078 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet f24954093a45411a9cbe39415fb1adb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:57.939350 28969 tablet_service.cc:1511] Processing CreateTablet for tablet ec871f7502c24af6920ce16f4b62330a (DEFAULT_TABLE table=default.Table_e6d2efb704e44c7a8ea2697ad784c448 [id=8e71ae5eb0e44723af7609769009a976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.939924 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 9f9844fab126448895c4c9d4c3c78d76 (table default.Table_5293e9d7c6ad4868b54d0aa5d41958b9 [id=8b51ca1875e847c5b75b682be93e6107]) successfully deleted
W20260617 20:16:57.940582 29062 consensus_peers.cc:597] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd7079ea860149f19227264b8507685b. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:57.941174 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb2a0578122c421ab45bf56edb7cffdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.944870 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 77f685eeac48402888cbc8ef97fb4b94 (DEFAULT_TABLE table=default.Table_fe54346acedc4aee9fe8151c12a389fc [id=32c61aa9610e428fa8d5c794b078e0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:57.948557 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7b878728a495f83b6584f8a6aca67" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:57.952699 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0aa4861a51488db2d1a7041c25ae22. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:57.956059 29198 leader_election.cc:343] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:57.956653 28925 leader_election.cc:343] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:57.957022 28925 leader_election.cc:343] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:57.957232 28925 leader_election.cc:343] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:57.961998 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3656e8549ea543e3b7a7cc1490aad71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.963968 30201 raft_consensus.cc:493] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.964165 30201 raft_consensus.cc:515] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.965114 30201 leader_election.cc:290] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.965623 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_95eb640bc73740e7b1c9475c7f7bcbe4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.965948 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d9cafa9d7c4a3f91f738e4654058b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:57.966374 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_95eb640bc73740e7b1c9475c7f7bcbe4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.968189 30193 raft_consensus.cc:493] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.968313 30193 raft_consensus.cc:515] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.968904 30193 leader_election.cc:290] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.969523 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93daae49ea3b4abd8623f64bffdd1f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.970880 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3656e8549ea543e3b7a7cc1490aad71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.973500 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5387e3c30b24cb285ea5cc657981321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.975172 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5387e3c30b24cb285ea5cc657981321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.975718 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da9fa5bc3b3478487aab3949b547e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.975958 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec871f7502c24af6920ce16f4b62330a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.976564 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93daae49ea3b4abd8623f64bffdd1f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.980002 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ea2f6574d44d1a80fd4787fb6ca0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.984157 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec871f7502c24af6920ce16f4b62330a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:57.986982 29383 tablet_bootstrap.cc:492] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:57.987116 29383 ts_tablet_manager.cc:1403] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.132s user 0.003s sys 0.015s
I20260617 20:16:57.987833 29383 raft_consensus.cc:359] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.988008 29383 raft_consensus.cc:385] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:57.988081 29383 raft_consensus.cc:740] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:57.988260 29383 consensus_queue.cc:260] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.988710 29383 ts_tablet_manager.cc:1434] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:57.989024 29383 tablet_bootstrap.cc:492] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:57.989615 30193 raft_consensus.cc:493] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:57.989723 30193 raft_consensus.cc:515] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:57.990274 30193 leader_election.cc:290] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:57.990864 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8c876d1d42224f5e83e8b62167dc4368"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.991222 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c3d29f5e898a4d2bba6e56851b4aebc9" } new_table_name: "default.Table_500d59e85d2c4e8187ce78b975eacfa3" modify_external_catalogs: true
W20260617 20:16:57.991446 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c876d1d42224f5e83e8b62167dc4368 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.992605 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e01af13e5b514cca8b4cfc05a15a949d" } modify_external_catalogs: true
I20260617 20:16:57.992558 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_dda62b1a76fb4bc894057fc310d8cf31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.992733 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e01af13e5b514cca8b4cfc05a15a949d" } modify_external_catalogs: true
W20260617 20:16:57.993074 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dda62b1a76fb4bc894057fc310d8cf31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.993441 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet c2c6d214816540ac90dc9b2ad3cdb89f from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:57.994035 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c19457bc061d40ccb5a93ffbd622589e" } new_table_name: "default.Table_4d054537f4144ed9bc9b35c7da51932d" modify_external_catalogs: true
I20260617 20:16:57.994102 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1d22b434bff34f6da7ebe3e45e5bbee2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.994568 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d22b434bff34f6da7ebe3e45e5bbee2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:57.994830 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_78825a839a2a4027a81301d589c4691f" } new_table_name: "default.Table_d545ddbe325840ff8bcb2ab57f727e55" modify_external_catalogs: true
I20260617 20:16:57.995769 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8767b23f3baa41c883f4884d81573ee8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:57.995929 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_74a72450663a45a99d4b9e8a250bd9db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:57.996201 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8767b23f3baa41c883f4884d81573ee8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:57.996286 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74a72450663a45a99d4b9e8a250bd9db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:57.997779 29062 leader_election.cc:343] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 70698bb6ff6f4fe0b465f2974fcc24ea
W20260617 20:16:57.998008 29062 leader_election.cc:343] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 46ea43994a0a42fe9e16d7bc6a2118e6
I20260617 20:16:57.999831 29379 tablet_bootstrap.cc:492] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.000034 29379 ts_tablet_manager.cc:1403] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.161s user 0.003s sys 0.007s
I20260617 20:16:58.000897 29379 raft_consensus.cc:359] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.001144 29379 raft_consensus.cc:385] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.001255 29379 raft_consensus.cc:740] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.001685 29379 consensus_queue.cc:260] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.001925 30193 raft_consensus.cc:493] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.002039 30193 raft_consensus.cc:515] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.002604 30193 leader_election.cc:290] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.007138 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 0bbef4cc28ef46288cfc7d1933c71710
I20260617 20:16:58.006984 29379 ts_tablet_manager.cc:1434] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 20:16:58.009240 29383 tablet_bootstrap.cc:654] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.012751 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ea2f6574d44d1a80fd4787fb6ca0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.014451 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a17f7ef070d4879a520a3eb6bdf3d23" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.014708 28990 raft_consensus.cc:2393] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:16:58.015872 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f685eeac48402888cbc8ef97fb4b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.017319 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdc7552bcf44fec9abfad002903b624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.018909 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 559) took 2539 ms. Trace:
I20260617 20:16:58.019006 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da9fa5bc3b3478487aab3949b547e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.019443 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bbef4cc28ef46288cfc7d1933c71710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.019007 29375 rpcz_store.cc:276] 0617 20:16:55.479866 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.479909 (+ 43us) service_pool.cc:224] Handling call
0617 20:16:57.837168 (+2357259us) ts_tablet_manager.cc:1151] Deleting tablet 0d1a416f802948d5bc150855d82b54c1
0617 20:16:57.837175 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:57.875022 (+ 37847us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:57.921252 (+ 46230us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.018886 (+ 97634us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2357015}
I20260617 20:16:58.019954 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 560) took 2518 ms. Trace:
I20260617 20:16:58.020040 29375 rpcz_store.cc:276] 0617 20:16:55.501123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.501602 (+ 479us) service_pool.cc:224] Handling call
0617 20:16:58.019830 (+2518228us) ts_tablet_manager.cc:1151] Deleting tablet adbc3219639748d9a0d71d45ae22ab36
0617 20:16:58.019839 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.019939 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2517952}
I20260617 20:16:58.020342 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 561) took 2338 ms. Trace:
I20260617 20:16:58.020421 29375 rpcz_store.cc:276] 0617 20:16:55.681518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.681746 (+ 228us) service_pool.cc:224] Handling call
0617 20:16:58.020254 (+2338508us) ts_tablet_manager.cc:1151] Deleting tablet eb408723f7a346c3b5ea13cad237b44e
0617 20:16:58.020262 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.020330 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2333776}
I20260617 20:16:58.020658 29375 tablet_replica.cc:333] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:58.020848 29375 raft_consensus.cc:2243] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.020993 29375 raft_consensus.cc:2272] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.021571 29375 ts_tablet_manager.cc:1916] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.023603 29379 tablet_bootstrap.cc:492] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.025956 29379 tablet_bootstrap.cc:654] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.027947 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d5047dfc8e9a4e96b1f0bc078965e6e7" } modify_external_catalogs: true
I20260617 20:16:58.028152 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d5047dfc8e9a4e96b1f0bc078965e6e7" } modify_external_catalogs: true
I20260617 20:16:58.031638 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet 67a3124306094c72ad78e5473aa35bdb from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:58.032408 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 0d1a416f802948d5bc150855d82b54c1 (table default.Table_77d3422ed47c4d68ae6f518500ea89b1 [id=071053dd948345bd9bc5d8b3cffe7935]) successfully deleted
W20260617 20:16:58.032829 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet adbc3219639748d9a0d71d45ae22ab36 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet adbc3219639748d9a0d71d45ae22ab36 already in progress: creating tablet
W20260617 20:16:58.033241 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet eb408723f7a346c3b5ea13cad237b44e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb408723f7a346c3b5ea13cad237b44e already in progress: creating tablet
W20260617 20:16:58.037866 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 900aed4f54934151be309160585cf9c6 has no consensus state
I20260617 20:16:58.039345 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0aa4861a51488db2d1a7041c25ae22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.043869 29383 tablet_bootstrap.cc:492] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:58.039116 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bbef4cc28ef46288cfc7d1933c71710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:58.047465 29383 ts_tablet_manager.cc:1403] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.003s
I20260617 20:16:58.050092 29383 raft_consensus.cc:359] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.051761 30203 raft_consensus.cc:493] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.052017 30203 raft_consensus.cc:515] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:58.052989 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 37214b955d63478088b9f723bcbc588a consensus state has no leader
I20260617 20:16:58.053328 29383 raft_consensus.cc:385] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.053473 29383 raft_consensus.cc:740] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.055429 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fc1d88f958a0469686a6eb2def4897dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:58.055750 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7b904ff553254117afb61cd5048f33a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.056010 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc1d88f958a0469686a6eb2def4897dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:58.056185 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b904ff553254117afb61cd5048f33a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.057387 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_552ce9d68419437fafcd73d16413fb03" } new_table_name: "default.Table_5cade3ff9a7c4aff96c14e548284f6ac" modify_external_catalogs: true
I20260617 20:16:58.059871 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3ad8de250a47da9c9a31dff7f495b5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.060098 29383 consensus_queue.cc:260] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.060498 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a1db08a35ad14d90b6f54df2495fa076"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:58.060819 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c3a4c3bee5444697f5d53d51c62894" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:58.060984 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1db08a35ad14d90b6f54df2495fa076 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:58.061444 28925 leader_election.cc:343] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.061507 29383 ts_tablet_manager.cc:1434] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
W20260617 20:16:58.061771 28925 leader_election.cc:343] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.063067 29383 tablet_bootstrap.cc:492] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:58.067047 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0d22aedd54cb4c6ab005e382acec6456" } new_table_name: "default.Table_307ffbdd67584561a453682d4cda44ca" modify_external_catalogs: true
I20260617 20:16:58.073657 30018 raft_consensus.cc:493] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.073872 30018 raft_consensus.cc:515] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.074208 29379 tablet_bootstrap.cc:492] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.074345 29379 ts_tablet_manager.cc:1403] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.051s user 0.018s sys 0.002s
I20260617 20:16:58.074916 30018 leader_election.cc:290] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.075640 29379 raft_consensus.cc:359] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.075897 29379 raft_consensus.cc:385] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.076016 29379 raft_consensus.cc:740] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.076290 29379 consensus_queue.cc:260] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.077724 29383 tablet_bootstrap.cc:654] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.078981 29379 ts_tablet_manager.cc:1434] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:16:58.079437 29379 tablet_bootstrap.cc:492] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.083494 29379 tablet_bootstrap.cc:654] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.088590 29383 tablet_bootstrap.cc:492] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:58.088835 29383 ts_tablet_manager.cc:1403] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
W20260617 20:16:58.088891 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2e2c1655df34edab115e64de53e22b7 has no consensus state
I20260617 20:16:58.089565 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d373f177494f1486fcae4a67a13041 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.090098 29383 raft_consensus.cc:359] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.090365 29383 raft_consensus.cc:385] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.090505 29383 raft_consensus.cc:740] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.090848 29383 consensus_queue.cc:260] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.092674 29383 ts_tablet_manager.cc:1434] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:58.092872 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet dee426100bb645f391be123aeb52e412 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:58.093822 29383 tablet_bootstrap.cc:492] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:58.053349 30203 leader_election.cc:290] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.095863 30018 raft_consensus.cc:493] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.096083 30018 raft_consensus.cc:515] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.096692 30018 leader_election.cc:290] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.097999 30018 raft_consensus.cc:493] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.098186 30018 raft_consensus.cc:515] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.098341 29383 tablet_bootstrap.cc:654] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.099515 29379 tablet_bootstrap.cc:492] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.099694 29379 ts_tablet_manager.cc:1403] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.001s
I20260617 20:16:58.100747 29379 raft_consensus.cc:359] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.100994 29379 raft_consensus.cc:385] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.101099 29379 raft_consensus.cc:740] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.101400 29379 consensus_queue.cc:260] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.105773 29379 ts_tablet_manager.cc:1434] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 20:16:58.106101 29379 tablet_bootstrap.cc:492] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.109025 29378 tablet_bootstrap.cc:654] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.107548 29379 tablet_bootstrap.cc:654] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.098773 30018 leader_election.cc:290] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.112080 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea43994a0a42fe9e16d7bc6a2118e6" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.112154 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a17f7ef070d4879a520a3eb6bdf3d23" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.112319 29258 raft_consensus.cc:2468] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:58.112399 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7b878728a495f83b6584f8a6aca67" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.113049 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58fbec4a9f14ddda42b5a4c0263972c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.113212 29259 raft_consensus.cc:2468] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:58.113327 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe079091784d7e8035659edd442ba6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.113543 29260 raft_consensus.cc:2468] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:58.113912 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3ad8de250a47da9c9a31dff7f495b5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.114209 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet d2c0988a73d547d08d0924784bff9222 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.114538 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086bd3079e8f4a6d85ccc681a38a47b0" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.114761 28985 raft_consensus.cc:2468] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:58.114976 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4130f3529ef4adaa4cedf12e53b6895" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.115127 28988 raft_consensus.cc:2468] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:58.116154 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c3a4c3bee5444697f5d53d51c62894" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:58.118757 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5eedf2442f964048b7a3a460b6b22f2a consensus state has no leader
I20260617 20:16:58.122949 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8a1228ed97634cd7a2eecc5b659406c3" } modify_external_catalogs: true
I20260617 20:16:58.123155 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8a1228ed97634cd7a2eecc5b659406c3" } modify_external_catalogs: true
I20260617 20:16:58.123951 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f786ef7bfe62418fac5124168a78cac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.124627 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f786ef7bfe62418fac5124168a78cac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.125191 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b5ce299906ed496b81dbaf936e215598" } modify_external_catalogs: true
I20260617 20:16:58.125401 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b5ce299906ed496b81dbaf936e215598" } modify_external_catalogs: true
I20260617 20:16:58.130982 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4c12d5e303de44a398302513b3d158ae" } modify_external_catalogs: true
I20260617 20:16:58.131167 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4c12d5e303de44a398302513b3d158ae" } modify_external_catalogs: true
I20260617 20:16:58.133702 29383 tablet_bootstrap.cc:492] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:58.133934 29383 ts_tablet_manager.cc:1403] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.041s user 0.006s sys 0.000s
I20260617 20:16:58.134758 29383 raft_consensus.cc:359] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.135037 29383 raft_consensus.cc:385] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.135154 29383 raft_consensus.cc:740] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.135867 29383 consensus_queue.cc:260] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.136934 29383 ts_tablet_manager.cc:1434] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:58.137954 29383 tablet_bootstrap.cc:492] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:58.139273 29379 tablet_bootstrap.cc:492] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.139459 29379 ts_tablet_manager.cc:1403] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.002s
I20260617 20:16:58.140182 29379 raft_consensus.cc:359] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.140403 29379 raft_consensus.cc:385] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.140493 29379 raft_consensus.cc:740] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.140780 29379 consensus_queue.cc:260] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.145030 29379 ts_tablet_manager.cc:1434] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 20:16:58.145439 29379 tablet_bootstrap.cc:492] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.147459 29379 tablet_bootstrap.cc:654] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:58.153617 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91fac788a74346e28f7b7e5939459325 has no consensus state
I20260617 20:16:58.155081 30203 raft_consensus.cc:493] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:16:58.156005 28987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s user 0.051s sys 0.085s
W20260617 20:16:58.156154 28987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s user 0.051s sys 0.085s
I20260617 20:16:58.158957 29379 tablet_bootstrap.cc:492] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.159332 29379 ts_tablet_manager.cc:1403] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.003s
I20260617 20:16:58.160040 29379 raft_consensus.cc:359] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.160254 29379 raft_consensus.cc:385] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.160343 29379 raft_consensus.cc:740] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.160631 29379 consensus_queue.cc:260] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.161607 29379 ts_tablet_manager.cc:1434] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:58.162356 29379 tablet_bootstrap.cc:492] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.163781 29379 tablet_bootstrap.cc:654] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.155238 30203 raft_consensus.cc:515] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.168927 29379 tablet_bootstrap.cc:492] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.169266 29379 ts_tablet_manager.cc:1403] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20260617 20:16:58.169445 29376 tablet_replica.cc:333] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:58.169812 30203 leader_election.cc:290] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.170563 29379 raft_consensus.cc:359] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.170871 29379 raft_consensus.cc:385] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.170987 29379 raft_consensus.cc:740] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.171312 29379 consensus_queue.cc:260] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.172351 29379 ts_tablet_manager.cc:1434] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:16:58.173075 29379 tablet_bootstrap.cc:492] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.172892 29376 raft_consensus.cc:2243] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.173573 29376 pending_rounds.cc:70] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:16:58.174984 29379 tablet_bootstrap.cc:654] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.177129 30018 raft_consensus.cc:493] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.177321 30018 raft_consensus.cc:515] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.178013 30018 leader_election.cc:290] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.182070 29375 ts_tablet_manager.cc:1929] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.182228 29375 log.cc:1199] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/2d0c245563fe44b59d32616bd35d3dae
I20260617 20:16:58.182614 29375 ts_tablet_manager.cc:1950] T 2d0c245563fe44b59d32616bd35d3dae P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:58.184376 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 8880f8eadaa44887a49adf0ef157965e from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:58.185958 29379 tablet_bootstrap.cc:492] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.186158 29379 ts_tablet_manager.cc:1403] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20260617 20:16:58.186822 29379 raft_consensus.cc:359] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.187059 29379 raft_consensus.cc:385] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.187153 29379 raft_consensus.cc:740] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.187422 29379 consensus_queue.cc:260] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.173645 29376 pending_rounds.cc:77] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7297955504271859712 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "5e53946c85ab4a8286a6e174cc411c5e" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 3 new_table_name: "default.Table_2ca839bde234444b97808d82d7974e3c" dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" new_extra_config { } }
I20260617 20:16:58.188902 29379 ts_tablet_manager.cc:1434] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:58.189703 29379 tablet_bootstrap.cc:492] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.191785 29379 tablet_bootstrap.cc:654] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.192245 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_30b5cd8576724dfa808a3b3da40ff3e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.192874 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30b5cd8576724dfa808a3b3da40ff3e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.194056 29232 tablet_service.cc:1511] Processing CreateTablet for tablet f2c1fd3f325841c297d123ad1ac0fe9d (DEFAULT_TABLE table=default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.194593 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2c1fd3f325841c297d123ad1ac0fe9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.200114 29379 tablet_bootstrap.cc:492] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.200354 29379 ts_tablet_manager.cc:1403] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260617 20:16:58.201125 29379 raft_consensus.cc:359] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.201390 29379 raft_consensus.cc:385] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.201488 29379 raft_consensus.cc:740] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.201783 29379 consensus_queue.cc:260] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.202423 29379 ts_tablet_manager.cc:1434] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:58.202312 29238 tablet_service.cc:1511] Processing CreateTablet for tablet fb2a0578122c421ab45bf56edb7cffdb (DEFAULT_TABLE table=default.Table_6cb2486917764383bc50fe8b80d84a07 [id=28482c1294b7476d96b490f73d8b9d28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.202883 29376 raft_consensus.cc:2272] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.202780 29379 tablet_bootstrap.cc:492] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.203711 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb2a0578122c421ab45bf56edb7cffdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.205341 29379 tablet_bootstrap.cc:654] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.206638 29228 tablet_service.cc:1511] Processing CreateTablet for tablet dc11f416bf5647c78a5ab687cad53792 (DEFAULT_TABLE table=default.Table_ee6d0ff0a92e42e59d1be2988aa3e5b1 [id=e24801a55bc8441891995304c46d0e57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.207012 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc11f416bf5647c78a5ab687cad53792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.209662 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 77f685eeac48402888cbc8ef97fb4b94 (DEFAULT_TABLE table=default.Table_fe54346acedc4aee9fe8151c12a389fc [id=32c61aa9610e428fa8d5c794b078e0a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.210008 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f685eeac48402888cbc8ef97fb4b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.208938 30197 tablet.cc:1724] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:16:58.215536 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19bce310bd24294b063b3b4f76b9f99" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.216147 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086bd3079e8f4a6d85ccc681a38a47b0" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.217227 29378 tablet_bootstrap.cc:492] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:58.217433 29378 ts_tablet_manager.cc:1403] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.541s user 0.006s sys 0.000s
I20260617 20:16:58.218664 29378 raft_consensus.cc:359] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.218901 29378 raft_consensus.cc:385] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.219013 29378 raft_consensus.cc:740] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.219310 29378 consensus_queue.cc:260] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.220728 29377 ts_tablet_manager.cc:1916] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.221390 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8c61ed13b3864bfe8dc750eb3d6accd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.222028 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c61ed13b3864bfe8dc750eb3d6accd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.223695 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c00e7d6f133c42eeb8b0ced7774c79ea" } modify_external_catalogs: true
I20260617 20:16:58.223897 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c00e7d6f133c42eeb8b0ced7774c79ea" } modify_external_catalogs: true
I20260617 20:16:58.224220 29379 tablet_bootstrap.cc:492] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.224341 29379 ts_tablet_manager.cc:1403] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260617 20:16:58.224864 29376 ts_tablet_manager.cc:1916] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.225118 29379 raft_consensus.cc:359] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.225317 29379 raft_consensus.cc:385] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.225387 29379 raft_consensus.cc:740] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.225658 29379 consensus_queue.cc:260] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.226184 29379 ts_tablet_manager.cc:1434] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:58.227279 29379 tablet_bootstrap.cc:492] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.229171 29379 tablet_bootstrap.cc:654] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.231526 30018 raft_consensus.cc:493] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.231706 30018 raft_consensus.cc:515] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.232402 30018 leader_election.cc:290] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.233861 30117 raft_consensus.cc:493] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.233991 30117 raft_consensus.cc:515] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.234524 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 562) took 2475 ms. Trace:
I20260617 20:16:58.234591 30117 leader_election.cc:290] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.234944 29124 raft_consensus.cc:3060] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:58.240945 29062 leader_election.cc:343] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 0859e56b5b7a483ea5e751f0468cbab8
I20260617 20:16:58.234593 29375 rpcz_store.cc:276] 0617 20:16:55.759327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.759752 (+ 425us) service_pool.cc:224] Handling call
0617 20:16:58.020605 (+2260853us) ts_tablet_manager.cc:1151] Deleting tablet 2d0c245563fe44b59d32616bd35d3dae
0617 20:16:58.020614 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.025604 (+ 4990us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.029268 (+ 3664us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.234503 (+205235us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2259219}
I20260617 20:16:58.242862 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 567) took 2374 ms. Trace:
I20260617 20:16:58.242906 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 2d0c245563fe44b59d32616bd35d3dae (table default.Table_df31bee3761040b9973aa917f8f1e0a0 [id=aba28f2e637d403fb4225835adef96cd]) successfully deleted
I20260617 20:16:58.243016 29375 rpcz_store.cc:276] 0617 20:16:55.867982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.868078 (+ 96us) service_pool.cc:224] Handling call
0617 20:16:58.242726 (+2374648us) ts_tablet_manager.cc:1151] Deleting tablet 7f47e81154eb48fb9e891cfff5250af2
0617 20:16:58.242739 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.242843 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2323463}
I20260617 20:16:58.243377 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9844fab126448895c4c9d4c3c78d76" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.243505 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 568) took 2375 ms. Trace:
I20260617 20:16:58.243577 29375 rpcz_store.cc:276] 0617 20:16:55.868119 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.868257 (+ 138us) service_pool.cc:224] Handling call
0617 20:16:58.243407 (+2375150us) ts_tablet_manager.cc:1151] Deleting tablet fee909c8988d49779612e98f5cd82972
0617 20:16:58.243415 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.243490 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2324087}
W20260617 20:16:58.243634 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 7f47e81154eb48fb9e891cfff5250af2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7f47e81154eb48fb9e891cfff5250af2 already in progress: creating tablet
I20260617 20:16:58.243857 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 570) took 2345 ms. Trace:
I20260617 20:16:58.243948 29375 rpcz_store.cc:276] 0617 20:16:55.898228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.898286 (+ 58us) service_pool.cc:224] Handling call
0617 20:16:58.243770 (+2345484us) ts_tablet_manager.cc:1151] Deleting tablet dd89c8452c444af99d8bce0c7cbf8ce1
0617 20:16:58.243778 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.243843 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2317896}
W20260617 20:16:58.244041 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet fee909c8988d49779612e98f5cd82972 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fee909c8988d49779612e98f5cd82972 already in progress: creating tablet
I20260617 20:16:58.244122 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_56be7326decb482f8c632474abe1fba3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:58.244251 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 573) took 2282 ms. Trace:
I20260617 20:16:58.244316 29375 rpcz_store.cc:276] 0617 20:16:55.961889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:55.966607 (+ 4718us) service_pool.cc:224] Handling call
0617 20:16:58.244146 (+2277539us) ts_tablet_manager.cc:1151] Deleting tablet 3df2d190c1234ac3b5950d348ed2c701
0617 20:16:58.244156 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.244236 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2277288}
W20260617 20:16:58.244418 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet dd89c8452c444af99d8bce0c7cbf8ce1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd89c8452c444af99d8bce0c7cbf8ce1 already in progress: creating tablet
I20260617 20:16:58.244586 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 575) took 2176 ms. Trace:
I20260617 20:16:58.244649 29375 rpcz_store.cc:276] 0617 20:16:56.068451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.068503 (+ 52us) service_pool.cc:224] Handling call
0617 20:16:58.244504 (+2176001us) ts_tablet_manager.cc:1151] Deleting tablet a819956f29954a4dbbd1aa1dcccad3c0
0617 20:16:58.244511 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.244573 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2175796}
W20260617 20:16:58.244748 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56be7326decb482f8c632474abe1fba3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:58.244771 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3df2d190c1234ac3b5950d348ed2c701 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3df2d190c1234ac3b5950d348ed2c701 already in progress: creating tablet
W20260617 20:16:58.245173 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet a819956f29954a4dbbd1aa1dcccad3c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a819956f29954a4dbbd1aa1dcccad3c0 already in progress: creating tablet
I20260617 20:16:58.246766 29379 tablet_bootstrap.cc:492] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.246889 29379 ts_tablet_manager.cc:1403] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.002s
I20260617 20:16:58.247102 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 6c0aa4861a51488db2d1a7041c25ae22 (DEFAULT_TABLE table=default.Table_e321d26263a24a5a8e31793f2ff8ba59 [id=c8277a7f96084f65b3fefab7897e3608]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.247538 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c0aa4861a51488db2d1a7041c25ae22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.247565 29379 raft_consensus.cc:359] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.247704 29379 raft_consensus.cc:385] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.247756 29379 raft_consensus.cc:740] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.247934 29379 consensus_queue.cc:260] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.248348 29379 ts_tablet_manager.cc:1434] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:16:58.250687 29379 tablet_bootstrap.cc:492] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.251855 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 576) took 2174 ms. Trace:
I20260617 20:16:58.252317 29375 rpcz_store.cc:276] 0617 20:16:56.077390 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.077447 (+ 57us) service_pool.cc:224] Handling call
0617 20:16:58.250262 (+2172815us) ts_tablet_manager.cc:1151] Deleting tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb
0617 20:16:58.251757 (+ 1495us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.251838 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2172663}
I20260617 20:16:58.253063 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 577) took 2151 ms. Trace:
W20260617 20:16:58.253197 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb already in progress: creating tablet
I20260617 20:16:58.252462 29379 tablet_bootstrap.cc:654] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.253783 29375 rpcz_store.cc:276] 0617 20:16:56.102058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.102115 (+ 57us) service_pool.cc:224] Handling call
0617 20:16:58.252970 (+2150855us) ts_tablet_manager.cc:1151] Deleting tablet 8a56191018d04a2881ee3e1a243c1a19
0617 20:16:58.252979 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.253049 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2150675}
I20260617 20:16:58.254524 29375 tablet_replica.cc:333] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
W20260617 20:16:58.254691 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 8a56191018d04a2881ee3e1a243c1a19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a56191018d04a2881ee3e1a243c1a19 already in progress: creating tablet
I20260617 20:16:58.254731 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9c687fe56f42af82dd4728ca53cd32" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.255074 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6cee209a5a44d6b35eb50e9c33228f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.255362 29375 raft_consensus.cc:2243] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.256017 29375 raft_consensus.cc:2272] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:58.255990 28925 leader_election.cc:343] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:58.256433 29198 leader_election.cc:343] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.255537 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c9d59b6b5a4dee8ca970247f613e53" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.256949 29375 ts_tablet_manager.cc:1916] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.257253 30018 consensus_queue.cc:1048] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:16:58.258095 29198 leader_election.cc:343] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:58.258481 29198 leader_election.cc:343] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:58.258802 29198 leader_election.cc:343] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.260093 30236 tablet.cc:1724] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:16:58.268307 29379 tablet_bootstrap.cc:492] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.268446 29379 ts_tablet_manager.cc:1403] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20260617 20:16:58.269387 29379 raft_consensus.cc:359] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.269547 29379 raft_consensus.cc:385] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.269594 29379 raft_consensus.cc:740] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.270006 29241 tablet_service.cc:1511] Processing CreateTablet for tablet e9ea2f6574d44d1a80fd4787fb6ca0e1 (DEFAULT_TABLE table=default.Table_c9f56913d2c44e0ab075f05ddeb35442 [id=b0fa314282564343aee5bef0442f7ee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.270095 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet f24954093a45411a9cbe39415fb1adb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.270181 29224 tablet_service.cc:1511] Processing CreateTablet for tablet f5387e3c30b24cb285ea5cc657981321 (DEFAULT_TABLE table=default.Table_b5ce299906ed496b81dbaf936e215598 [id=a8cb67eb32c243979b86be5f86be29cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.270435 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ea2f6574d44d1a80fd4787fb6ca0e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.270619 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5387e3c30b24cb285ea5cc657981321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.270586 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 93daae49ea3b4abd8623f64bffdd1f6a (DEFAULT_TABLE table=default.Table_1265f7b4e2374fc9a3cbf51bdbf7f663 [id=ab050767c0744002b8fd0cb464edcd0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.271145 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93daae49ea3b4abd8623f64bffdd1f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.273368 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 3656e8549ea543e3b7a7cc1490aad71c (DEFAULT_TABLE table=default.Table_4f1e9321b3c548eeb322bd50ae32a077 [id=4b3cdb2f571542888c313ddae66d4c8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.273682 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3656e8549ea543e3b7a7cc1490aad71c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.275249 29375 ts_tablet_manager.cc:1929] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.275344 29375 log.cc:1199] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/b3ea76ad1ec64d22a64bdd4c97e288c6
I20260617 20:16:58.275648 29375 ts_tablet_manager.cc:1950] T b3ea76ad1ec64d22a64bdd4c97e288c6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:58.275926 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 578) took 2159 ms. Trace:
I20260617 20:16:58.275995 29375 rpcz_store.cc:276] 0617 20:16:56.116117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.116757 (+ 640us) service_pool.cc:224] Handling call
0617 20:16:58.254486 (+2137729us) ts_tablet_manager.cc:1151] Deleting tablet b3ea76ad1ec64d22a64bdd4c97e288c6
0617 20:16:58.254495 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.263658 (+ 9163us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.275200 (+ 11542us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.275899 (+ 699us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2111569}
I20260617 20:16:58.278232 30117 raft_consensus.cc:493] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.278362 30117 raft_consensus.cc:515] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.270001 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 5da9fa5bc3b3478487aab3949b547e09 (DEFAULT_TABLE table=default.Table_a7ae2b556b104787bb92a47f706bc91a [id=31199bd88feb40559cb20211be2ec3c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.278975 30117 leader_election.cc:290] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.279019 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da9fa5bc3b3478487aab3949b547e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.279099 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 33d9cafa9d7c4a3f91f738e4654058b4 (DEFAULT_TABLE table=default.Table_68a5110f6e914dc5882d9f2cb6ab132d [id=65adc0eb88a64becba5954a5b839b3fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.279381 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33d9cafa9d7c4a3f91f738e4654058b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.279524 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4130f3529ef4adaa4cedf12e53b6895" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.279731 28987 raft_consensus.cc:2468] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:58.280138 29062 leader_election.cc:304] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:58.280380 30117 raft_consensus.cc:2804] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.280460 30117 raft_consensus.cc:493] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.280534 30117 raft_consensus.cc:3060] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.282853 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 2bdc7552bcf44fec9abfad002903b624 (DEFAULT_TABLE table=default.Table_18d04b2793af4915ac6a2f592f197b41 [id=4fa0724d031447898614e9f9f1ce16ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.283162 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdc7552bcf44fec9abfad002903b624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.283564 30117 raft_consensus.cc:515] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.284972 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4130f3529ef4adaa4cedf12e53b6895" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:58.285156 28987 raft_consensus.cc:3060] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.269768 29379 consensus_queue.cc:260] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.289067 29379 ts_tablet_manager.cc:1434] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20260617 20:16:58.289415 29379 tablet_bootstrap.cc:492] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.289451 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 9370421288e2449fae454aec32883810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.290877 29226 tablet_service.cc:1511] Processing CreateTablet for tablet ec871f7502c24af6920ce16f4b62330a (DEFAULT_TABLE table=default.Table_e6d2efb704e44c7a8ea2697ad784c448 [id=8e71ae5eb0e44723af7609769009a976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.291088 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_45015af27e294c6f9d0fd6e04ea3865f" } new_table_name: "default.Table_71381d2e3aa94861a116255689215461" modify_external_catalogs: true
I20260617 20:16:58.291635 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec871f7502c24af6920ce16f4b62330a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.291980 30117 leader_election.cc:290] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.292678 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5970f728d64e408e83358eb27947ecc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:58.292853 29379 tablet_bootstrap.cc:654] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:58.293383 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5970f728d64e408e83358eb27947ecc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.293915 28987 raft_consensus.cc:2468] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:58.295099 29062 leader_election.cc:304] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:16:58.295472 30117 raft_consensus.cc:2804] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:58.295712 30117 raft_consensus.cc:697] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:58.295977 30117 consensus_queue.cc:237] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.302044 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bbef4cc28ef46288cfc7d1933c71710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.303843 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 579) took 2075 ms. Trace:
I20260617 20:16:58.304563 29375 rpcz_store.cc:276] 0617 20:16:56.228702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.228976 (+ 274us) service_pool.cc:224] Handling call
0617 20:16:58.303717 (+2074741us) ts_tablet_manager.cc:1151] Deleting tablet 7cafcade995b407f84f56b8cd3ab6892
0617 20:16:58.303727 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.303823 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2074556}
W20260617 20:16:58.305445 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 7cafcade995b407f84f56b8cd3ab6892 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7cafcade995b407f84f56b8cd3ab6892 already in progress: creating tablet
I20260617 20:16:58.306664 29375 tablet_replica.cc:333] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
W20260617 20:16:58.306663 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5bf67f3f62714cd3bb9cce3f207cc3b8 has no consensus state
W20260617 20:16:58.306752 29198 leader_election.cc:343] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.306937 29375 raft_consensus.cc:2243] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.307062 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8d82152eac954df48c864d5ee8ae87c3" } new_table_name: "default.Table_0833862700c248bd97ebd638a1e1868b" modify_external_catalogs: true
I20260617 20:16:58.307128 29375 raft_consensus.cc:2272] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.307507 29383 tablet_bootstrap.cc:654] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.307641 29375 ts_tablet_manager.cc:1916] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.309154 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3099db3fe67f428d9b61e60303d756f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:58.309425 30117 raft_consensus.cc:493] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.309536 30117 raft_consensus.cc:515] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:58.309993 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3099db3fe67f428d9b61e60303d756f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.310509 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c99389d24d4a8d8c934f0a9b9c2825" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.310748 28987 raft_consensus.cc:2393] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:16:58.311342 30117 leader_election.cc:290] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.319733 29378 ts_tablet_manager.cc:1434] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.102s user 0.002s sys 0.000s
I20260617 20:16:58.320204 29378 tablet_bootstrap.cc:492] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:58.322364 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9c687fe56f42af82dd4728ca53cd32" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.322597 28990 raft_consensus.cc:2468] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:16:58.323483 28925 leader_election.cc:343] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.323612 28925 leader_election.cc:304] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:58.324055 30203 raft_consensus.cc:2749] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:58.329982 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f3032155e4e4ea8a23984f547d78752 consensus state has no leader
I20260617 20:16:58.330507 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_47b418c88d02450e9238113d4fc932de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.331300 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47b418c88d02450e9238113d4fc932de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:58.331590 29063 consensus_peers.cc:597] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd7079ea860149f19227264b8507685b. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:16:58.331844 29063 leader_election.cc:343] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 70698bb6ff6f4fe0b465f2974fcc24ea
I20260617 20:16:58.332031 29063 leader_election.cc:304] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:58.332320 30117 raft_consensus.cc:2749] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.332487 29063 leader_election.cc:304] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:58.332630 30117 raft_consensus.cc:493] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.332741 30117 raft_consensus.cc:515] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.332861 29063 leader_election.cc:304] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:58.333267 30117 leader_election.cc:290] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.333420 30117 raft_consensus.cc:2749] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.333536 30117 raft_consensus.cc:2804] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.333585 30117 raft_consensus.cc:493] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.333635 30117 raft_consensus.cc:3060] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.336050 30117 raft_consensus.cc:515] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.336536 30117 leader_election.cc:290] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.338300 28661 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_f7130590729b49af9644f1ffa516fe05 [id=6a948594185b42128136770dbe3f0ffb]). Expected version 3 got 0
I20260617 20:16:58.338585 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d8a0d46294108a6b98a1a4b67fd6d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.338809 28987 raft_consensus.cc:2393] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:16:58.339326 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f427fc2304b34f1eb97b537b8239504f" } new_table_name: "default.Table_702d2d2262b845b68b13e005c388d10b" modify_external_catalogs: true
W20260617 20:16:58.339419 29062 leader_election.cc:343] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 46ea43994a0a42fe9e16d7bc6a2118e6
I20260617 20:16:58.341097 28669 catalog_manager.cc:5696] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:16:58.341655 28925 leader_election.cc:304] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.341967 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_f7130590729b49af9644f1ffa516fe05 [id=6a948594185b42128136770dbe3f0ffb]). Expected version 3 got 0
I20260617 20:16:58.342173 30203 raft_consensus.cc:2804] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.342274 30203 raft_consensus.cc:493] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.342361 30203 raft_consensus.cc:3060] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.346431 30203 raft_consensus.cc:515] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.347630 30203 leader_election.cc:290] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:58.348191 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 6c0aa4861a51488db2d1a7041c25ae22 because the tablet was not found. No further retry: Not found: Tablet not found: 6c0aa4861a51488db2d1a7041c25ae22
I20260617 20:16:58.348686 28925 leader_election.cc:304] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:16:58.349367 28925 leader_election.cc:343] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.349575 28925 leader_election.cc:304] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:58.350039 30202 raft_consensus.cc:2804] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.350198 30202 raft_consensus.cc:493] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.350397 30202 raft_consensus.cc:3060] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.353590 30202 raft_consensus.cc:515] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.354800 30202 leader_election.cc:290] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.355031 30202 raft_consensus.cc:2749] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.358160 29377 ts_tablet_manager.cc:1929] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.358387 29377 log.cc:1199] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/d2db0467c5e64e38961d3b0e66375544
I20260617 20:16:58.358973 29377 ts_tablet_manager.cc:1950] T d2db0467c5e64e38961d3b0e66375544 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:58.359058 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58fbec4a9f14ddda42b5a4c0263972c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:58.359233 29124 raft_consensus.cc:3060] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.359798 29232 tablet_service.cc:1511] Processing CreateTablet for tablet aad5d2ab3e7d4453b4e1aa27acf7683d (DEFAULT_TABLE table=default.Table_f7ba6da717cb4d2f9cce7ff504334ae0 [id=18a104f3bd504674bc8543d24dffbf1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.360169 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad5d2ab3e7d4453b4e1aa27acf7683d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.361835 29124 raft_consensus.cc:2468] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:58.363068 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe079091784d7e8035659edd442ba6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:58.384548 28662 catalog_manager.cc:5696] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:58.385123 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:16:58.385432 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 7efe079091784d7e8035659edd442ba6 (table default.Table_6bb71611d01f469a95325bc9bbcd5251 [id=f0df4d60a326473a8fc3d040ed7324d7]). Expected version 1 got 0
I20260617 20:16:58.385700 28662 catalog_manager.cc:5696] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:58.386175 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 97541af7c02d46b98106692d92778741 (table default.Table_f427fc2304b34f1eb97b537b8239504f [id=f608d4e53a0f4d37af562e6ce53576d8]). Expected version 2 got 0
I20260617 20:16:58.386380 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 32c3a4c3bee5444697f5d53d51c62894 (table default.Table_675137d48e694996a1fbfc31e4fd7c9b [id=7a5ce2f1ca114a508611d15c5a7c18c4]). Expected version 2 got 0
I20260617 20:16:58.386631 28662 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet ba3ad8de250a47da9c9a31dff7f495b5 (table default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]). Expected version 2 got 0
I20260617 20:16:58.392164 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba37157424248b6abbb1db9d3d6ab33 (DEFAULT_TABLE table=default.Table_f847106ae8c04ab0ace089e9e123c60b [id=b057fddf626d4168909b6102afc67f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.392599 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba37157424248b6abbb1db9d3d6ab33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.393333 29104 tablet_service.cc:1511] Processing CreateTablet for tablet ee5b41c446444389821a2ebb85c1bf8b (DEFAULT_TABLE table=default.Table_c816a44858d34b368a1e701cdbebd429 [id=d4618abed4d0489187b4d138ed28867a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.399338 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5b41c446444389821a2ebb85c1bf8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.402701 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 0916139a64df436fafa18c7e86fbf91c
I20260617 20:16:58.405478 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 0916139a64df436fafa18c7e86fbf91c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.406050 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_66545ee179e84436aea66f777fb80da9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.406816 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66545ee179e84436aea66f777fb80da9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.407941 29375 ts_tablet_manager.cc:1929] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.408509 29375 log.cc:1199] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/08911643f3ca451d80e2471b1b5b2342
I20260617 20:16:58.408509 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_31050496cd7e4fcebe468daf037802af" } new_table_name: "default.Table_daffb8813d634b3aa74a7b834732a833" modify_external_catalogs: true
I20260617 20:16:58.408872 29375 ts_tablet_manager.cc:1950] T 08911643f3ca451d80e2471b1b5b2342 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:58.409198 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 580) took 2178 ms. Trace:
W20260617 20:16:58.409279 29197 leader_election.cc:343] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1a725364bb9646e6bc80fc4f67d04a16
I20260617 20:16:58.409474 29197 leader_election.cc:304] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.409829 29197 leader_election.cc:304] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.410175 30018 raft_consensus.cc:493] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.410347 30018 raft_consensus.cc:515] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.411172 30018 leader_election.cc:290] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.411756 30018 raft_consensus.cc:2749] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.412014 30018 raft_consensus.cc:2804] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.412137 30018 raft_consensus.cc:493] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.412256 30018 raft_consensus.cc:3060] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.414877 30018 raft_consensus.cc:515] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.415872 30018 leader_election.cc:290] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.417200 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 0eaa60028a1647e580a987c3a0836a24
I20260617 20:16:58.415876 30193 raft_consensus.cc:493] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.417467 30193 raft_consensus.cc:515] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.418035 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet 4a6bf28f4e434da794db9391ca7ad738 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:58.418186 30193 leader_election.cc:290] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:58.419267 29062 leader_election.cc:343] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1a725364bb9646e6bc80fc4f67d04a16
I20260617 20:16:58.409277 29375 rpcz_store.cc:276] 0617 20:16:56.231208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.231372 (+ 164us) service_pool.cc:224] Handling call
0617 20:16:58.306609 (+2075237us) ts_tablet_manager.cc:1151] Deleting tablet 08911643f3ca451d80e2471b1b5b2342
0617 20:16:58.306620 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.396080 (+ 89460us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.407877 (+ 11797us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.409183 (+ 1306us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2075073}
I20260617 20:16:58.419958 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 08911643f3ca451d80e2471b1b5b2342 (table default.Table_1ce996ccf50542bfb287108b493eb4cc [id=c02a5e81598b47b9830a236256da4bba]) successfully deleted
I20260617 20:16:58.420246 29375 tablet_replica.cc:333] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:58.420449 29375 raft_consensus.cc:2243] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:58.420745 29375 pending_rounds.cc:70] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:58.420809 29375 pending_rounds.cc:77] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955496727949312 op_type: NO_OP noop_request { }
I20260617 20:16:58.420897 29375 raft_consensus.cc:2889] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:58.420994 29375 raft_consensus.cc:2272] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.421527 29375 ts_tablet_manager.cc:1916] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.422115 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d373f177494f1486fcae4a67a13041" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.422266 29124 raft_consensus.cc:2468] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:58.423343 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086bd3079e8f4a6d85ccc681a38a47b0" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:58.424356 29198 leader_election.cc:304] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:16:58.425618 29198 leader_election.cc:343] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.426277 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 0eaa60028a1647e580a987c3a0836a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.426388 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a2e469f758544195aa0ea203437c6a11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.427085 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2e469f758544195aa0ea203437c6a11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:58.427147 30218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:16:58.359413 28925 leader_election.cc:343] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.430091 28925 leader_election.cc:304] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:16:58.430472 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 71060.1us
I20260617 20:16:58.430850 28925 leader_election.cc:304] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
W20260617 20:16:58.431121 28925 leader_election.cc:343] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.372339 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6cee209a5a44d6b35eb50e9c33228f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.431348 28987 raft_consensus.cc:2468] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:58.432096 30202 raft_consensus.cc:2749] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.432307 30202 raft_consensus.cc:2804] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:58.432531 30202 raft_consensus.cc:697] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:58.432785 30202 consensus_queue.cc:237] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.434450 29375 ts_tablet_manager.cc:1929] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:58.380103 29378 tablet_bootstrap.cc:654] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.382213 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c9d59b6b5a4dee8ca970247f613e53" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.391553 28952 tablet_service.cc:1511] Processing CreateTablet for tablet ee5b41c446444389821a2ebb85c1bf8b (DEFAULT_TABLE table=default.Table_c816a44858d34b368a1e701cdbebd429 [id=d4618abed4d0489187b4d138ed28867a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.434798 28990 raft_consensus.cc:2468] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:58.435070 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5b41c446444389821a2ebb85c1bf8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.438344 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 29a176d1f3b0446984af141e02bac329
I20260617 20:16:58.439180 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 628) took 1018 ms. Trace:
I20260617 20:16:58.439284 29377 rpcz_store.cc:276] 0617 20:16:57.421038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.421223 (+ 185us) service_pool.cc:224] Handling call
0617 20:16:57.911954 (+490731us) ts_tablet_manager.cc:1151] Deleting tablet d2db0467c5e64e38961d3b0e66375544
0617 20:16:57.911961 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.223735 (+311774us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.358098 (+134363us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.439131 (+ 81033us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":490581}
I20260617 20:16:58.439572 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet 29a176d1f3b0446984af141e02bac329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:58.439754 30247 raft_consensus.cc:2804] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.439766 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet d2db0467c5e64e38961d3b0e66375544 (table default.Table_3a768181eca84e2f9d6eb43239795801 [id=d18d30df8d4644899355b7c8c2f387e6]) successfully deleted
I20260617 20:16:58.439843 30247 raft_consensus.cc:493] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.439915 30247 raft_consensus.cc:3060] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.440289 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 629) took 1019 ms. Trace:
I20260617 20:16:58.440375 29377 rpcz_store.cc:276] 0617 20:16:57.421122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.421217 (+ 95us) service_pool.cc:224] Handling call
0617 20:16:58.440164 (+1018947us) ts_tablet_manager.cc:1151] Deleting tablet 13ba94ec9e27403b974e5e6fea46e59e
0617 20:16:58.440176 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.440247 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1018735}
I20260617 20:16:58.404479 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 0916139a64df436fafa18c7e86fbf91c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:58.440685 29377 tablet_replica.cc:333] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:58.418957 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 0eaa60028a1647e580a987c3a0836a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:58.441428 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 13ba94ec9e27403b974e5e6fea46e59e because the tablet was not found. No further retry: Not found: Tablet not found: 13ba94ec9e27403b974e5e6fea46e59e
I20260617 20:16:58.442118 29197 leader_election.cc:304] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.442587 29197 leader_election.cc:304] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:16:58.442860 29197 leader_election.cc:343] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 9f9844fab126448895c4c9d4c3c78d76
I20260617 20:16:58.442938 29197 leader_election.cc:304] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.443001 29383 tablet_bootstrap.cc:492] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:58.442890 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_041e671cc057444e808fc948556269c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:58.443120 29383 ts_tablet_manager.cc:1403] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.305s user 0.030s sys 0.013s
I20260617 20:16:58.443239 30248 raft_consensus.cc:2804] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.443316 30248 raft_consensus.cc:493] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.443382 30248 raft_consensus.cc:3060] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:58.443508 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_041e671cc057444e808fc948556269c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.443799 29383 raft_consensus.cc:359] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.443940 29383 raft_consensus.cc:385] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.444017 29383 raft_consensus.cc:740] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.444214 29383 consensus_queue.cc:260] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.405247 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba37157424248b6abbb1db9d3d6ab33 (DEFAULT_TABLE table=default.Table_f847106ae8c04ab0ace089e9e123c60b [id=b057fddf626d4168909b6102afc67f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.445546 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba37157424248b6abbb1db9d3d6ab33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.446110 30245 consensus_queue.cc:1048] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:58.446702 30245 raft_consensus.cc:2804] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.446862 30245 raft_consensus.cc:493] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.447006 30245 raft_consensus.cc:3060] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.449026 28957 tablet_service.cc:1511] Processing CreateTablet for tablet e224d4ecd45040cfabcdbc347cfa62cb (DEFAULT_TABLE table=default.Table_cdb4c1e8ce7042bc828e729ef36aba9b [id=1fb4a405d43541e4bc7d9dc251a2c25e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.449441 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e224d4ecd45040cfabcdbc347cfa62cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.449601 30250 raft_consensus.cc:2749] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.449939 29376 ts_tablet_manager.cc:1929] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:58.450026 29376 log.cc:1199] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/5e53946c85ab4a8286a6e174cc411c5e
I20260617 20:16:58.450333 29376 ts_tablet_manager.cc:1950] T 5e53946c85ab4a8286a6e174cc411c5e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:58.452951 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 65747872eaac450cb3b8efb3a2d2694f
I20260617 20:16:58.458076 29376 tablet_replica.cc:333] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:58.458072 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5d78d818040145bf9a37f06eac741648" } new_table_name: "default.Table_491c157766b745998a68831e0c610a6b" modify_external_catalogs: true
I20260617 20:16:58.458290 29376 raft_consensus.cc:2243] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.458422 29376 raft_consensus.cc:2272] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.458896 29376 ts_tablet_manager.cc:1916] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.469651 30247 raft_consensus.cc:515] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.474398 29375 log.cc:1199] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/3e80e776263c4a91ae7fffa9d0f4ebd4
I20260617 20:16:58.474772 29375 ts_tablet_manager.cc:1950] T 3e80e776263c4a91ae7fffa9d0f4ebd4 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:58.475078 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 581) took 2243 ms. Trace:
I20260617 20:16:58.475144 29375 rpcz_store.cc:276] 0617 20:16:56.231328 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.233401 (+ 2073us) service_pool.cc:224] Handling call
0617 20:16:58.420198 (+2186797us) ts_tablet_manager.cc:1151] Deleting tablet 3e80e776263c4a91ae7fffa9d0f4ebd4
0617 20:16:58.420209 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.431597 (+ 11388us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.434399 (+ 2802us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.475063 (+ 40664us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2186641}
I20260617 20:16:58.475454 29375 tablet_replica.cc:333] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:58.475628 29375 raft_consensus.cc:2243] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.475766 29375 raft_consensus.cc:2272] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.440017 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 29a176d1f3b0446984af141e02bac329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.449095 29104 tablet_service.cc:1511] Processing CreateTablet for tablet e224d4ecd45040cfabcdbc347cfa62cb (DEFAULT_TABLE table=default.Table_cdb4c1e8ce7042bc828e729ef36aba9b [id=1fb4a405d43541e4bc7d9dc251a2c25e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.457080 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 65747872eaac450cb3b8efb3a2d2694f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.468293 29379 tablet_bootstrap.cc:492] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.472793 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8d373f177494f1486fcae4a67a13041" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:58.477170 29126 raft_consensus.cc:3060] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.479843 29126 raft_consensus.cc:2468] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:58.472424 30247 leader_election.cc:290] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.480074 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 (table default.Table_b50a2ea6dd054c8282ce507b0c871fb2 [id=7d0ccdf07bf14fd1b7fd55deb990bdae]) successfully deleted
I20260617 20:16:58.480665 29198 leader_election.cc:304] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:58.481547 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 5a0462db75104cd6bdf54ba9777f792b (DEFAULT_TABLE table=default.Table_6f140c50b6434bcebd5021f6519a66fb [id=a06591d34596487a9191e5f06f2572da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.481693 29379 ts_tablet_manager.cc:1403] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.192s user 0.023s sys 0.046s
I20260617 20:16:58.482030 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a0462db75104cd6bdf54ba9777f792b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.482378 30247 raft_consensus.cc:2804] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:58.482482 30247 raft_consensus.cc:697] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:58.482267 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e224d4ecd45040cfabcdbc347cfa62cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.482720 30247 consensus_queue.cc:237] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.483258 29383 ts_tablet_manager.cc:1434] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.040s user 0.003s sys 0.011s
I20260617 20:16:58.483568 29383 tablet_bootstrap.cc:492] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:58.487110 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 65747872eaac450cb3b8efb3a2d2694f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:58.487543 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 5a0462db75104cd6bdf54ba9777f792b (DEFAULT_TABLE table=default.Table_6f140c50b6434bcebd5021f6519a66fb [id=a06591d34596487a9191e5f06f2572da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.487927 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a0462db75104cd6bdf54ba9777f792b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:58.496030 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 97541af7c02d46b98106692d92778741 consensus state has no leader
I20260617 20:16:58.496526 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8556e2b7c18a49e09b7a01b9683d4f58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.497190 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8556e2b7c18a49e09b7a01b9683d4f58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.497797 29383 tablet_bootstrap.cc:654] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.498032 29377 raft_consensus.cc:2243] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.498227 29377 raft_consensus.cc:2272] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.498842 29377 ts_tablet_manager.cc:1916] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.499240 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f8f0f1f6368e4ae786c176f3dbc29a8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.499771 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8f0f1f6368e4ae786c176f3dbc29a8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.507982 30248 raft_consensus.cc:515] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.508383 30254 raft_consensus.cc:493] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.508618 30254 raft_consensus.cc:515] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.510459 29379 raft_consensus.cc:359] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.510638 29379 raft_consensus.cc:385] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.510694 29379 raft_consensus.cc:740] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.510896 29379 consensus_queue.cc:260] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.511366 29379 ts_tablet_manager.cc:1434] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.030s user 0.000s sys 0.000s
I20260617 20:16:58.511605 29379 tablet_bootstrap.cc:492] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.512158 28969 tablet_service.cc:1511] Processing CreateTablet for tablet e2e2c1655df34edab115e64de53e22b7 (DEFAULT_TABLE table=default.Table_500d59e85d2c4e8187ce78b975eacfa3 [id=bfdb2fa2c6914b33ac9d1aa90be0d8b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.512547 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2e2c1655df34edab115e64de53e22b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.513213 29379 tablet_bootstrap.cc:654] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.514016 29378 tablet_bootstrap.cc:492] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:58.514183 29378 ts_tablet_manager.cc:1403] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.194s user 0.004s sys 0.002s
I20260617 20:16:58.514731 29375 ts_tablet_manager.cc:1916] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.514946 29378 raft_consensus.cc:359] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.515134 29378 raft_consensus.cc:385] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.515209 29378 raft_consensus.cc:740] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.515619 29378 consensus_queue.cc:260] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.518657 30245 raft_consensus.cc:515] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:58.518843 28925 consensus_peers.cc:597] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:58.520056 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9c687fe56f42af82dd4728ca53cd32" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:16:58.520589 29198 leader_election.cc:343] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.521096 30245 leader_election.cc:290] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.523313 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f5387e3c30b24cb285ea5cc657981321
I20260617 20:16:58.523942 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet 8a56191018d04a2881ee3e1a243c1a19 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:58.524047 30248 leader_election.cc:290] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:58.524355 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4130f3529ef4adaa4cedf12e53b6895" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:58.524859 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet f5387e3c30b24cb285ea5cc657981321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:58.529134 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet f5387e3c30b24cb285ea5cc657981321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.530282 29092 tablet_service.cc:1511] Processing CreateTablet for tablet e2e2c1655df34edab115e64de53e22b7 (DEFAULT_TABLE table=default.Table_500d59e85d2c4e8187ce78b975eacfa3 [id=bfdb2fa2c6914b33ac9d1aa90be0d8b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.530682 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2e2c1655df34edab115e64de53e22b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.531329 29376 ts_tablet_manager.cc:1929] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.531445 29376 log.cc:1199] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/c21b585707b146ed9c015d150d858681
I20260617 20:16:58.531744 29376 ts_tablet_manager.cc:1950] T c21b585707b146ed9c015d150d858681 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:58.532560 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 635) took 1061 ms. Trace:
I20260617 20:16:58.532656 29376 rpcz_store.cc:276] 0617 20:16:57.471536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.471731 (+ 195us) service_pool.cc:224] Handling call
0617 20:16:58.458022 (+986291us) ts_tablet_manager.cc:1151] Deleting tablet c21b585707b146ed9c015d150d858681
0617 20:16:58.458032 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.498450 (+ 40418us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.531259 (+ 32809us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.532538 (+ 1279us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":986136}
I20260617 20:16:58.533044 29376 tablet_replica.cc:333] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:58.533936 29126 raft_consensus.cc:3060] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.538350 30247 consensus_queue.cc:1048] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:58.541600 30254 leader_election.cc:290] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:58.543942 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d4ddf99bf0e44da4bd61741ec0ac2065"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.544588 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4ddf99bf0e44da4bd61741ec0ac2065 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.544849 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75519f97f1ce49ceb3a739ba7c7bc239" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.544919 30193 raft_consensus.cc:493] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.545038 30193 raft_consensus.cc:515] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:58.545629 30193 leader_election.cc:290] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.545848 29375 ts_tablet_manager.cc:1929] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:16:58.546061 29198 leader_election.cc:343] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.546407 29375 log.cc:1199] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/a8eefc4f3c7d4f468c0adca837b73bb2
W20260617 20:16:58.546707 29062 leader_election.cc:343] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 16d0360ec78844a1be3d5f51259bbcdf
I20260617 20:16:58.546715 29375 ts_tablet_manager.cc:1950] T a8eefc4f3c7d4f468c0adca837b73bb2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:58.548452 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 582) took 2231 ms. Trace:
I20260617 20:16:58.548991 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 160dbee15c874758b461f9a7b7ee5d59 (DEFAULT_TABLE table=default.Table_4efc16d51f0249de859da13faef23f7a [id=99881d02691245928c6b1ffb48a5b11b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.549449 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160dbee15c874758b461f9a7b7ee5d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.549424 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 160dbee15c874758b461f9a7b7ee5d59 (DEFAULT_TABLE table=default.Table_4efc16d51f0249de859da13faef23f7a [id=99881d02691245928c6b1ffb48a5b11b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.550776 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160dbee15c874758b461f9a7b7ee5d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.556398 29375 rpcz_store.cc:276] 0617 20:16:56.316711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.316761 (+ 50us) service_pool.cc:224] Handling call
0617 20:16:58.475411 (+2158650us) ts_tablet_manager.cc:1151] Deleting tablet a8eefc4f3c7d4f468c0adca837b73bb2
0617 20:16:58.475420 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.532058 (+ 56638us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.545783 (+ 13725us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.548432 (+ 2649us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34050,"tablet-delete.queue_time_us":2158473}
I20260617 20:16:58.560017 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 583) took 2243 ms. Trace:
W20260617 20:16:58.563906 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 121035us
I20260617 20:16:58.564030 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_f7130590729b49af9644f1ffa516fe05 [id=6a948594185b42128136770dbe3f0ffb]). Expected version 3 got 0
I20260617 20:16:58.564307 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_7e36e71e8aca4a5e8813c465c31db50a [id=de24e09cee8e4f28998625c2697769b3]). Expected version 1 got 0
I20260617 20:16:58.564121 29375 rpcz_store.cc:276] 0617 20:16:56.316839 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.316886 (+ 47us) service_pool.cc:224] Handling call
0617 20:16:58.559892 (+2243006us) ts_tablet_manager.cc:1151] Deleting tablet e3897179e7724fdeb87a979ae4ef2091
0617 20:16:58.559903 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.559999 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2242883}
I20260617 20:16:58.564388 29197 leader_election.cc:304] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.564757 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet e58fbec4a9f14ddda42b5a4c0263972c (table default.Table_efb89ae603ed4713a25716af39bf03c3 [id=cd4abe077ee04673bad87834b3af273b]). Expected version 3 got 0
I20260617 20:16:58.565158 29375 tablet_replica.cc:333] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:58.565608 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet a8eefc4f3c7d4f468c0adca837b73bb2 (table default.Table_a41d5a63ab0c47adafaeff2f42205397 [id=405880e9419e43449f08e705aab0ba7c]) successfully deleted
W20260617 20:16:58.565995 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet e3897179e7724fdeb87a979ae4ef2091 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e3897179e7724fdeb87a979ae4ef2091 already in progress: creating tablet
I20260617 20:16:58.564986 28666 catalog_manager.cc:5696] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194). New cstate: current_term: 1 leader_uuid: "6d4ce30e1fce4591b64c398747f8d37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:58.566424 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 3 got 0
I20260617 20:16:58.567239 30253 consensus_queue.cc:1048] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:58.567452 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f7b878728a495f83b6584f8a6aca67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:58.567693 29375 raft_consensus.cc:2243] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:58.568050 29375 pending_rounds.cc:70] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:58.568068 30253 raft_consensus.cc:2804] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.568169 30253 raft_consensus.cc:493] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.568254 30253 raft_consensus.cc:3060] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.568195 29375 pending_rounds.cc:77] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955497828302848 op_type: NO_OP noop_request { }
I20260617 20:16:58.568421 29375 raft_consensus.cc:2889] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:58.568573 29375 raft_consensus.cc:2272] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.569216 29375 ts_tablet_manager.cc:1916] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.570261 29092 tablet_service.cc:1511] Processing CreateTablet for tablet d5e5d246ea0e474e81edfc7e88001321 (DEFAULT_TABLE table=default.Table_d1285d94ca754303ba4dedcdaae5af7a [id=55af0ff96c834f30bd05121d07c9d632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.570894 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e5d246ea0e474e81edfc7e88001321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.571203 28969 tablet_service.cc:1511] Processing CreateTablet for tablet d5e5d246ea0e474e81edfc7e88001321 (DEFAULT_TABLE table=default.Table_d1285d94ca754303ba4dedcdaae5af7a [id=55af0ff96c834f30bd05121d07c9d632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.571415 30193 raft_consensus.cc:493] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.571521 30193 raft_consensus.cc:515] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.571658 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e5d246ea0e474e81edfc7e88001321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.572140 30193 leader_election.cc:290] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.571203 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 44ee3364741d445880281da93d13f400 (DEFAULT_TABLE table=default.Table_a85f39b0bb4a487098a661b4eca8de9f [id=bd35b542e6d84cf3bf32977390914403]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.572497 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ee3364741d445880281da93d13f400. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:58.581542 29062 leader_election.cc:343] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b3278efaad07403ca0a2baecad46d0f1
I20260617 20:16:58.582612 29197 leader_election.cc:304] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.583046 30247 raft_consensus.cc:2804] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.583135 30247 raft_consensus.cc:493] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.583201 30247 raft_consensus.cc:3060] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.583455 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0859e56b5b7a483ea5e751f0468cbab8" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.583640 29262 raft_consensus.cc:2468] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:58.583879 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4130f3529ef4adaa4cedf12e53b6895" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.584059 29258 raft_consensus.cc:2393] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:16:58.584228 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a725364bb9646e6bc80fc4f67d04a16" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.584295 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4130f3529ef4adaa4cedf12e53b6895" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:58.584395 29256 raft_consensus.cc:2468] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:58.584482 29261 raft_consensus.cc:2393] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:16:58.584735 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c99389d24d4a8d8c934f0a9b9c2825" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.584833 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3278efaad07403ca0a2baecad46d0f1" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.583650 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "227d8a0d46294108a6b98a1a4b67fd6d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.585392 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19bce310bd24294b063b3b4f76b9f99" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.585448 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46ea43994a0a42fe9e16d7bc6a2118e6" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:58.585564 29259 raft_consensus.cc:2468] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:58.585579 29257 raft_consensus.cc:3060] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.586052 30247 raft_consensus.cc:515] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.586624 30247 leader_election.cc:290] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.586938 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c9d59b6b5a4dee8ca970247f613e53" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:16:58.587373 29198 leader_election.cc:343] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.587792 30253 raft_consensus.cc:515] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.588299 29257 raft_consensus.cc:2468] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:58.588565 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6cee209a5a44d6b35eb50e9c33228f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:58.588462 30253 leader_election.cc:290] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.588569 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58fbec4a9f14ddda42b5a4c0263972c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:58.589636 29260 raft_consensus.cc:3060] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:58.591840 28925 consensus_peers.cc:597] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:58.592105 29260 raft_consensus.cc:2468] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:58.588642 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe079091784d7e8035659edd442ba6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:58.592396 29261 raft_consensus.cc:3060] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.593503 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086bd3079e8f4a6d85ccc681a38a47b0" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:58.593694 28990 raft_consensus.cc:3060] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.593848 29375 ts_tablet_manager.cc:1929] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:58.593954 29375 log.cc:1199] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/d738ab2f8c784c76947a3a76bd040219
I20260617 20:16:58.594277 29375 ts_tablet_manager.cc:1950] T d738ab2f8c784c76947a3a76bd040219 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:58.594844 29261 raft_consensus.cc:2468] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
W20260617 20:16:58.588913 29198 leader_election.cc:343] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.595028 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 587) took 2192 ms. Trace:
I20260617 20:16:58.595095 29375 rpcz_store.cc:276] 0617 20:16:56.402377 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.402428 (+ 51us) service_pool.cc:224] Handling call
0617 20:16:58.565109 (+2162681us) ts_tablet_manager.cc:1151] Deleting tablet d738ab2f8c784c76947a3a76bd040219
0617 20:16:58.565121 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.590971 (+ 25850us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.593799 (+ 2828us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.595011 (+ 1212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2233,"tablet-delete.queue_time_us":2162203}
I20260617 20:16:58.595827 29378 ts_tablet_manager.cc:1434] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.082s user 0.001s sys 0.001s
I20260617 20:16:58.596662 28990 raft_consensus.cc:2468] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:16:58.598371 28636 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 133611us
I20260617 20:16:58.604415 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 5e53946c85ab4a8286a6e174cc411c5e (table default.Table_2ca839bde234444b97808d82d7974e3c [id=e682c8658ea84718a5e3909a6f6b7246]) successfully deleted
I20260617 20:16:58.606216 29383 tablet_bootstrap.cc:492] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:58.606451 29383 ts_tablet_manager.cc:1403] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.123s user 0.003s sys 0.023s
I20260617 20:16:58.606917 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9c687fe56f42af82dd4728ca53cd32" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:58.607419 29383 raft_consensus.cc:359] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.607617 29383 raft_consensus.cc:385] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.607668 29383 raft_consensus.cc:740] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.533252 29376 raft_consensus.cc:2243] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.607939 29376 raft_consensus.cc:2272] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.608455 29376 ts_tablet_manager.cc:1916] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.608740 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4130f3529ef4adaa4cedf12e53b6895" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:58.608971 28987 raft_consensus.cc:2393] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 6d4ce30e1fce4591b64c398747f8d37a in this term.
W20260617 20:16:58.609177 28654 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 083b8903abd646dc89717b9d2caf5647 (table default.Table_4a5199c078ea4aa18d688909588c0a96 [id=2b30d550d0e445e882179d01fb066334], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 083b8903abd646dc89717b9d2caf5647 consensus state has no leader
W20260617 20:16:58.609858 30246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:58.609920 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet c21b585707b146ed9c015d150d858681 (table default.Table_fbaeb71321364cca9f5c971ee3419519 [id=cd2fab71637e4b968e9957070c30c936]) successfully deleted
I20260617 20:16:58.612428 29383 consensus_queue.cc:260] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.613036 29383 ts_tablet_manager.cc:1434] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
W20260617 20:16:58.613582 30257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:16:58.614821 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet d738ab2f8c784c76947a3a76bd040219 (table default.Table_1bde48f5ad7a4a8194df9687d8971c33 [id=cde5899e2baa4b2b9fe34bb5d11ebe13]) successfully deleted
I20260617 20:16:58.615242 29375 tablet_replica.cc:333] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:58.615471 29375 raft_consensus.cc:2243] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.611491 29379 tablet_bootstrap.cc:492] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.618577 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 44ee3364741d445880281da93d13f400 (DEFAULT_TABLE table=default.Table_a85f39b0bb4a487098a661b4eca8de9f [id=bd35b542e6d84cf3bf32977390914403]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.620324 29379 ts_tablet_manager.cc:1403] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.109s user 0.002s sys 0.018s
I20260617 20:16:58.620678 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ee3364741d445880281da93d13f400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.621344 29375 raft_consensus.cc:2272] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.621230 29379 raft_consensus.cc:359] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.621737 29379 raft_consensus.cc:385] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.621796 29379 raft_consensus.cc:740] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.622339 29379 consensus_queue.cc:260] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.622541 30026 server_base.cc:1061] running on GCE node
I20260617 20:16:58.622979 29379 ts_tablet_manager.cc:1434] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:58.623232 29379 tablet_bootstrap.cc:492] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.623771 30026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 20:16:58.625613 29383 tablet_bootstrap.cc:492] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:58.626063 29063 leader_election.cc:304] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:58.626449 30193 raft_consensus.cc:2804] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.626525 30193 raft_consensus.cc:493] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.626583 30193 raft_consensus.cc:3060] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.626941 29375 ts_tablet_manager.cc:1916] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.629087 30193 raft_consensus.cc:515] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.630357 30193 leader_election.cc:290] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:58.630955 29062 leader_election.cc:343] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 0859e56b5b7a483ea5e751f0468cbab8
I20260617 20:16:58.635560 29376 ts_tablet_manager.cc:1929] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.635682 29376 log.cc:1199] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/b3278efaad07403ca0a2baecad46d0f1
I20260617 20:16:58.635967 29376 ts_tablet_manager.cc:1950] T b3278efaad07403ca0a2baecad46d0f1 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:58.636740 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 636) took 1164 ms. Trace:
I20260617 20:16:58.636822 29376 rpcz_store.cc:276] 0617 20:16:57.472054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.472235 (+ 181us) service_pool.cc:224] Handling call
0617 20:16:58.532992 (+1060757us) ts_tablet_manager.cc:1151] Deleting tablet b3278efaad07403ca0a2baecad46d0f1
0617 20:16:58.533003 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.611430 (+ 78427us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.635486 (+ 24056us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.636721 (+ 1235us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1060609}
I20260617 20:16:58.637140 29376 tablet_replica.cc:333] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:16:58.637218 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet debb84d5e57b4bc9ba37b0fab2d6698b consensus state has no leader
W20260617 20:16:58.637765 29063 consensus_peers.cc:597] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e53946c85ab4a8286a6e174cc411c5e. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:58.638157 29063 leader_election.cc:304] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:58.638545 30193 raft_consensus.cc:2804] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.638648 30193 raft_consensus.cc:493] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.638758 30193 raft_consensus.cc:3060] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.640677 29383 tablet_bootstrap.cc:654] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.640801 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b9517f8356cc47a1b60d232b6cca9dc2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:58.641336 30193 raft_consensus.cc:515] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:58.641568 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9517f8356cc47a1b60d232b6cca9dc2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:58.642655 29062 leader_election.cc:343] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 1a725364bb9646e6bc80fc4f67d04a16
I20260617 20:16:58.643108 30193 leader_election.cc:290] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.625008 29379 tablet_bootstrap.cc:654] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.645813 29375 ts_tablet_manager.cc:1929] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.645979 29375 log.cc:1199] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/379ef43e02ec4bbbb03f2d6a53a66403
I20260617 20:16:58.646255 29383 tablet_bootstrap.cc:492] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:58.646320 29375 ts_tablet_manager.cc:1950] T 379ef43e02ec4bbbb03f2d6a53a66403 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:58.646641 29383 ts_tablet_manager.cc:1403] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20260617 20:16:58.646755 28968 tablet_service.cc:1511] Processing CreateTablet for tablet efdf2ae366924eaeaf9d4b9d21eb1142 (DEFAULT_TABLE table=default.Table_52b729f02c4d498794d81ba38d3b5364 [id=ab1ca24d24264ec7a935227ddc98d5a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.647011 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 588) took 2244 ms. Trace:
I20260617 20:16:58.647079 29375 rpcz_store.cc:276] 0617 20:16:56.402868 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.402915 (+ 47us) service_pool.cc:224] Handling call
0617 20:16:58.615179 (+2212264us) ts_tablet_manager.cc:1151] Deleting tablet 379ef43e02ec4bbbb03f2d6a53a66403
0617 20:16:58.615191 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.631393 (+ 16202us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.645757 (+ 14364us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.646994 (+ 1237us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2212043}
I20260617 20:16:58.647193 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdf2ae366924eaeaf9d4b9d21eb1142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.647372 29375 tablet_replica.cc:333] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:58.647542 29375 raft_consensus.cc:2243] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:58.647557 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 379ef43e02ec4bbbb03f2d6a53a66403 (table default.Table_abaa4ebadc654b7a85405d8114046356 [id=de3384ef7984460abc15ca893a9f8c83]) successfully deleted
I20260617 20:16:58.647567 29383 raft_consensus.cc:359] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.647715 29383 raft_consensus.cc:385] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.647794 29383 raft_consensus.cc:740] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.647814 29375 pending_rounds.cc:70] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:58.647861 29375 pending_rounds.cc:77] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955497218768896 op_type: NO_OP noop_request { }
I20260617 20:16:58.647957 29375 raft_consensus.cc:2889] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:58.648034 29375 raft_consensus.cc:2272] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.648005 29383 consensus_queue.cc:260] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.648439 29383 ts_tablet_manager.cc:1434] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:58.648541 29375 ts_tablet_manager.cc:1916] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.655570 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c535a6f896b94414b52c0265a60f4679" } new_table_name: "default.Table_db8214a5a3c246d294d340b09774568d" modify_external_catalogs: true
I20260617 20:16:58.656651 29063 leader_election.cc:304] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:58.657187 30193 raft_consensus.cc:2749] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.657804 29063 leader_election.cc:304] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:58.657893 29379 tablet_bootstrap.cc:492] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.658092 29379 ts_tablet_manager.cc:1403] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.002s
I20260617 20:16:58.658329 30193 raft_consensus.cc:3060] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.658903 29379 raft_consensus.cc:359] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.659075 29379 raft_consensus.cc:385] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.659142 29379 raft_consensus.cc:740] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.659332 29379 consensus_queue.cc:260] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.659776 29379 ts_tablet_manager.cc:1434] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:58.660063 29379 tablet_bootstrap.cc:492] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.661633 30193 raft_consensus.cc:2749] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.661739 29383 tablet_bootstrap.cc:492] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:58.662313 29379 tablet_bootstrap.cc:654] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:58.662784 29063 leader_election.cc:343] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 16d0360ec78844a1be3d5f51259bbcdf
I20260617 20:16:58.662953 29063 leader_election.cc:304] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:58.663338 30193 raft_consensus.cc:2749] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.663385 29383 tablet_bootstrap.cc:654] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.665503 28925 leader_election.cc:304] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.665987 30202 raft_consensus.cc:2804] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.666126 30202 raft_consensus.cc:493] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.666270 30202 raft_consensus.cc:3060] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.670787 29376 raft_consensus.cc:2243] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.670795 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c9d59b6b5a4dee8ca970247f613e53" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:58.670987 29376 raft_consensus.cc:2272] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.670996 28988 raft_consensus.cc:3060] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.671986 29063 leader_election.cc:304] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:58.672422 30193 raft_consensus.cc:2804] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:58.672791 30193 raft_consensus.cc:697] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:58.673453 30193 consensus_queue.cc:237] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.675000 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6cee209a5a44d6b35eb50e9c33228f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:58.675181 28985 raft_consensus.cc:3060] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.675999 29379 tablet_bootstrap.cc:492] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.676131 29379 ts_tablet_manager.cc:1403] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260617 20:16:58.671566 29376 ts_tablet_manager.cc:1916] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.676815 29379 raft_consensus.cc:359] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.677985 29375 ts_tablet_manager.cc:1929] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:58.678208 29375 log.cc:1199] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/7e48a4a827d44afca912dc8723be4542
I20260617 20:16:58.678480 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba37157424248b6abbb1db9d3d6ab33 (DEFAULT_TABLE table=default.Table_f847106ae8c04ab0ace089e9e123c60b [id=b057fddf626d4168909b6102afc67f7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.678633 29375 ts_tablet_manager.cc:1950] T 7e48a4a827d44afca912dc8723be4542 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:58.678107 29379 raft_consensus.cc:385] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.678853 29379 raft_consensus.cc:740] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.679076 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba37157424248b6abbb1db9d3d6ab33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.679101 29379 consensus_queue.cc:260] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.679627 29379 ts_tablet_manager.cc:1434] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:16:58.679620 30247 consensus_queue.cc:1048] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:58.679949 29379 tablet_bootstrap.cc:492] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.681454 29379 tablet_bootstrap.cc:654] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.690675 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 900aed4f54934151be309160585cf9c6 (DEFAULT_TABLE table=default.Table_d545ddbe325840ff8bcb2ab57f727e55 [id=f4d29aefa68d44c68fc90dd0f1d0bcdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.693677 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_102ea82c80b64c00b6f6a79a87b687f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:58.693876 30247 raft_consensus.cc:493] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.694010 30247 raft_consensus.cc:515] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.694526 30247 leader_election.cc:290] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:16:58.694588 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_102ea82c80b64c00b6f6a79a87b687f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.698980 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 586) took 2296 ms. Trace:
I20260617 20:16:58.699093 29375 rpcz_store.cc:276] 0617 20:16:56.402268 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.408152 (+ 5884us) service_pool.cc:224] Handling call
0617 20:16:58.647329 (+2239177us) ts_tablet_manager.cc:1151] Deleting tablet 7e48a4a827d44afca912dc8723be4542
0617 20:16:58.647340 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.663259 (+ 15919us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.677925 (+ 14666us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.698955 (+ 21030us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2238630}
I20260617 20:16:58.699383 30026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 20:16:58.699544 29375 tablet_replica.cc:333] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:58.699729 29375 raft_consensus.cc:2243] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.699884 29375 raft_consensus.cc:2272] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.700445 29375 ts_tablet_manager.cc:1916] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.700448 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 0eaa60028a1647e580a987c3a0836a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.701398 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c3a4c3bee5444697f5d53d51c62894" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.701790 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 0916139a64df436fafa18c7e86fbf91c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.702750 30026 hybrid_clock.cc:648] HybridClock initialized: now 1781727418702663 us; error 82 us; skew 500 ppm
I20260617 20:16:58.703212 30026 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 20:16:58.703401 28988 raft_consensus.cc:2468] T f6c9d59b6b5a4dee8ca970247f613e53 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:58.705762 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 7e48a4a827d44afca912dc8723be4542 (table default.Table_e6908a670d534e828a0770f48cace3db [id=b24f0a25c8574b62842179a4c9bbc2f8]) successfully deleted
W20260617 20:16:58.706465 29198 leader_election.cc:343] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.707271 30202 raft_consensus.cc:515] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.708455 30202 leader_election.cc:290] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.709040 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19bce310bd24294b063b3b4f76b9f99" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:16:58.710069 28925 leader_election.cc:343] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.715420 30026 webserver.cc:533] Webserver started at http://127.27.245.253:44941/ using document root <none> and password file <none>
I20260617 20:16:58.716426 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 65747872eaac450cb3b8efb3a2d2694f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.716702 29226 tablet_service.cc:1511] Processing CreateTablet for tablet e224d4ecd45040cfabcdbc347cfa62cb (DEFAULT_TABLE table=default.Table_cdb4c1e8ce7042bc828e729ef36aba9b [id=1fb4a405d43541e4bc7d9dc251a2c25e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.717501 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f9844fab126448895c4c9d4c3c78d76 with delete_type TABLET_DATA_DELETED (replaced by tablet cdd24a60a91b43cd9e31ecca3d21ec60) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.717492 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 5a0462db75104cd6bdf54ba9777f792b (DEFAULT_TABLE table=default.Table_6f140c50b6434bcebd5021f6519a66fb [id=a06591d34596487a9191e5f06f2572da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.717824 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet f5387e3c30b24cb285ea5cc657981321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.717888 30026 fs_manager.cc:362] Metadata directory not provided
I20260617 20:16:58.717918 29234 tablet_service.cc:1511] Processing CreateTablet for tablet d5e5d246ea0e474e81edfc7e88001321 (DEFAULT_TABLE table=default.Table_d1285d94ca754303ba4dedcdaae5af7a [id=55af0ff96c834f30bd05121d07c9d632]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.718045 30026 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 20:16:58.717968 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 44ee3364741d445880281da93d13f400 (DEFAULT_TABLE table=default.Table_a85f39b0bb4a487098a661b4eca8de9f [id=bd35b542e6d84cf3bf32977390914403]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.718130 29225 tablet_service.cc:1511] Processing CreateTablet for tablet e2e2c1655df34edab115e64de53e22b7 (DEFAULT_TABLE table=default.Table_500d59e85d2c4e8187ce78b975eacfa3 [id=bfdb2fa2c6914b33ac9d1aa90be0d8b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.718575 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 160dbee15c874758b461f9a7b7ee5d59 (DEFAULT_TABLE table=default.Table_4efc16d51f0249de859da13faef23f7a [id=99881d02691245928c6b1ffb48a5b11b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.718916 28925 leader_election.cc:304] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.719337 30202 raft_consensus.cc:2804] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:58.719298 29241 tablet_service.cc:1511] Processing CreateTablet for tablet efdf2ae366924eaeaf9d4b9d21eb1142 (DEFAULT_TABLE table=default.Table_52b729f02c4d498794d81ba38d3b5364 [id=ab1ca24d24264ec7a935227ddc98d5a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.719591 30202 raft_consensus.cc:697] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:58.719919 30202 consensus_queue.cc:237] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.721638 29377 ts_tablet_manager.cc:1929] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.721781 29377 log.cc:1199] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/af9c687fe56f42af82dd4728ca53cd32
I20260617 20:16:58.722115 29377 ts_tablet_manager.cc:1950] T af9c687fe56f42af82dd4728ca53cd32 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:58.719336 30247 raft_consensus.cc:493] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.723534 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900aed4f54934151be309160585cf9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.723495 30247 raft_consensus.cc:515] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.724313 30247 leader_election.cc:290] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.724622 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 29a176d1f3b0446984af141e02bac329 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.726747 30203 consensus_queue.cc:1048] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:58.728155 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c3a4c3bee5444697f5d53d51c62894" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.728338 28988 raft_consensus.cc:2468] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:58.729195 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet b3278efaad07403ca0a2baecad46d0f1 (table default.Table_ec9b81dbecf641cf9110b33876e99612 [id=35f8afdc04fb4a1ebb52996f33d62d43]) successfully deleted
I20260617 20:16:58.729413 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0859e56b5b7a483ea5e751f0468cbab8" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:58.729611 29256 raft_consensus.cc:3060] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.732429 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a725364bb9646e6bc80fc4f67d04a16" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
W20260617 20:16:58.732478 29197 leader_election.cc:343] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c8d373f177494f1486fcae4a67a13041
I20260617 20:16:58.732592 29257 raft_consensus.cc:3060] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.732777 29197 leader_election.cc:304] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:16:58.732254 29063 leader_election.cc:343] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.733505 29063 leader_election.cc:304] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:58.733932 30117 raft_consensus.cc:2749] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.735049 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3ad8de250a47da9c9a31dff7f495b5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.735524 30117 raft_consensus.cc:493] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.735636 30117 raft_consensus.cc:515] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.736296 30117 leader_election.cc:290] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.736821 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 900aed4f54934151be309160585cf9c6 (DEFAULT_TABLE table=default.Table_d545ddbe325840ff8bcb2ab57f727e55 [id=f4d29aefa68d44c68fc90dd0f1d0bcdf]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:58.737664 29062 leader_election.cc:343] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 640f53137c21443cbfc274c084ce13ef
I20260617 20:16:58.739188 29378 tablet_bootstrap.cc:492] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:58.739957 29238 tablet_service.cc:1511] Processing CreateTablet for tablet ee5b41c446444389821a2ebb85c1bf8b (DEFAULT_TABLE table=default.Table_c816a44858d34b368a1e701cdbebd429 [id=d4618abed4d0489187b4d138ed28867a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.740577 29092 tablet_service.cc:1511] Processing CreateTablet for tablet efdf2ae366924eaeaf9d4b9d21eb1142 (DEFAULT_TABLE table=default.Table_52b729f02c4d498794d81ba38d3b5364 [id=ab1ca24d24264ec7a935227ddc98d5a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.741005 29378 tablet_bootstrap.cc:654] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.743029 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee67832c2b54aa181c1c2ac5b6c5f82 (DEFAULT_TABLE table=default.Table_a19dcdf8816f4caf9cf0d25a9aa3094d [id=8ef73a8dfb464790947b7bf43986d370]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.743122 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee67832c2b54aa181c1c2ac5b6c5f82 (DEFAULT_TABLE table=default.Table_a19dcdf8816f4caf9cf0d25a9aa3094d [id=8ef73a8dfb464790947b7bf43986d370]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.743557 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee67832c2b54aa181c1c2ac5b6c5f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.745440 30247 raft_consensus.cc:2804] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:58.745570 30247 raft_consensus.cc:697] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
W20260617 20:16:58.745632 29198 leader_election.cc:343] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.745820 30247 consensus_queue.cc:237] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:58.748351 29197 leader_election.cc:343] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c8d373f177494f1486fcae4a67a13041
W20260617 20:16:58.748755 29197 leader_election.cc:343] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Illegal state: Tablet not RUNNING: STOPPED
I20260617 20:16:58.748847 29197 leader_election.cc:304] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.749101 30018 raft_consensus.cc:2749] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.749256 29197 leader_election.cc:304] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.750733 30018 raft_consensus.cc:2749] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.751070 29383 tablet_bootstrap.cc:492] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:58.751271 29383 ts_tablet_manager.cc:1403] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.091s user 0.001s sys 0.009s
W20260617 20:16:58.751708 29197 leader_election.cc:343] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 75519f97f1ce49ceb3a739ba7c7bc239
I20260617 20:16:58.751804 29197 leader_election.cc:304] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.753013 29378 tablet_bootstrap.cc:492] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:58.753190 29378 ts_tablet_manager.cc:1403] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.009s
I20260617 20:16:58.755008 30189 raft_consensus.cc:493] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.755148 30189 raft_consensus.cc:515] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.755714 30189 leader_election.cc:290] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:58.756845 29062 leader_election.cc:343] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c21b585707b146ed9c015d150d858681
I20260617 20:16:58.757346 30018 raft_consensus.cc:2749] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.757691 29383 raft_consensus.cc:359] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.757968 29383 raft_consensus.cc:385] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.758116 29383 raft_consensus.cc:740] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.758081 30018 consensus_queue.cc:1048] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:58.758659 29383 consensus_queue.cc:260] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.758735 29197 leader_election.cc:304] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.759506 29383 ts_tablet_manager.cc:1434] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 20:16:58.759688 30248 raft_consensus.cc:2804] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:58.759800 30248 raft_consensus.cc:697] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:58.759935 29383 tablet_bootstrap.cc:492] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:58.760039 30248 consensus_queue.cc:237] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.762020 29383 tablet_bootstrap.cc:654] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.772814 29375 ts_tablet_manager.cc:1929] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.772944 29375 log.cc:1199] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/a857c28d94f04dabb9a57aeca662b836
I20260617 20:16:58.772957 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e224d4ecd45040cfabcdbc347cfa62cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.773187 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ee3364741d445880281da93d13f400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.773208 29375 ts_tablet_manager.cc:1950] T a857c28d94f04dabb9a57aeca662b836 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:58.773555 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdf2ae366924eaeaf9d4b9d21eb1142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.773792 29376 ts_tablet_manager.cc:1929] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.773926 29376 log.cc:1199] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/46ea43994a0a42fe9e16d7bc6a2118e6
I20260617 20:16:58.774278 29376 ts_tablet_manager.cc:1950] T 46ea43994a0a42fe9e16d7bc6a2118e6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:58.777225 29197 leader_election.cc:304] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.777734 30248 raft_consensus.cc:2804] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.777818 30248 raft_consensus.cc:493] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.777895 30248 raft_consensus.cc:3060] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.778294 29383 tablet_bootstrap.cc:492] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:58.778450 29383 ts_tablet_manager.cc:1403] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.003s
I20260617 20:16:58.778398 30247 consensus_queue.cc:1048] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:58.778774 28985 raft_consensus.cc:2468] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:58.779260 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900aed4f54934151be309160585cf9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.779158 29383 raft_consensus.cc:359] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.779322 29383 raft_consensus.cc:385] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.779373 29383 raft_consensus.cc:740] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.779914 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3ad8de250a47da9c9a31dff7f495b5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:58.780082 28985 raft_consensus.cc:2468] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:16:58.783839 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5e5d246ea0e474e81edfc7e88001321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.784379 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdf2ae366924eaeaf9d4b9d21eb1142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.784760 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 160dbee15c874758b461f9a7b7ee5d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.785123 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2e2c1655df34edab115e64de53e22b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.785498 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a0462db75104cd6bdf54ba9777f792b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.786186 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19bce310bd24294b063b3b4f76b9f99" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:58.786355 29260 raft_consensus.cc:3060] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.787272 29383 consensus_queue.cc:260] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.788266 29256 raft_consensus.cc:2468] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
W20260617 20:16:58.796667 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc7cb1160fe94c2baf9775a193ef4c77 consensus state has no leader
I20260617 20:16:58.788507 29383 ts_tablet_manager.cc:1434] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260617 20:16:58.802789 30026 fs_manager.cc:714] Time spent opening directory manager: real 0.071s user 0.002s sys 0.003s
I20260617 20:16:58.798504 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 900aed4f54934151be309160585cf9c6 (DEFAULT_TABLE table=default.Table_d545ddbe325840ff8bcb2ab57f727e55 [id=f4d29aefa68d44c68fc90dd0f1d0bcdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.805733 29383 tablet_bootstrap.cc:492] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:58.808508 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 7ee67832c2b54aa181c1c2ac5b6c5f82 (DEFAULT_TABLE table=default.Table_a19dcdf8816f4caf9cf0d25a9aa3094d [id=8ef73a8dfb464790947b7bf43986d370]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.808631 29197 leader_election.cc:304] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.809463 29383 tablet_bootstrap.cc:654] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.812618 30247 raft_consensus.cc:2804] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:58.812776 30247 raft_consensus.cc:697] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:58.813081 30247 consensus_queue.cc:237] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.815742 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee67832c2b54aa181c1c2ac5b6c5f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.816922 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee5b41c446444389821a2ebb85c1bf8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.820264 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 594) took 2177 ms. Trace:
I20260617 20:16:58.820399 29375 rpcz_store.cc:276] 0617 20:16:56.643297 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.643352 (+ 55us) service_pool.cc:224] Handling call
0617 20:16:58.699456 (+2056104us) ts_tablet_manager.cc:1151] Deleting tablet a857c28d94f04dabb9a57aeca662b836
0617 20:16:58.699470 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.704442 (+ 4972us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.772741 (+ 68299us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.820240 (+ 47499us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2055917}
I20260617 20:16:58.820902 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 598) took 2155 ms. Trace:
I20260617 20:16:58.821002 29375 rpcz_store.cc:276] 0617 20:16:56.665578 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.665647 (+ 69us) service_pool.cc:224] Handling call
0617 20:16:58.820753 (+2155106us) ts_tablet_manager.cc:1151] Deleting tablet 40845d7a668045ec9a40cb6d1d76137d
0617 20:16:58.820762 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.820859 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2147340}
I20260617 20:16:58.821280 29375 tablet_replica.cc:333] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:58.822927 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 791580f2131c424a87878723205864b5 (DEFAULT_TABLE table=default.Table_f251f69819b7456a9a108dfefb1414bd [id=659fc9e914b14c72b7d2a3571a01608a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.823053 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 791580f2131c424a87878723205864b5 (DEFAULT_TABLE table=default.Table_f251f69819b7456a9a108dfefb1414bd [id=659fc9e914b14c72b7d2a3571a01608a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.823359 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791580f2131c424a87878723205864b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.823397 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791580f2131c424a87878723205864b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.823812 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 48cfb5fe21bc477cab8df011b6bee2d5 (DEFAULT_TABLE table=default.Table_d71ffcb31abf48718dffc393996e7ebd [id=00fdc977a27c4d2b909589cea193d5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.824162 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cfb5fe21bc477cab8df011b6bee2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.826079 29378 raft_consensus.cc:359] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.826241 29378 raft_consensus.cc:385] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.826283 29378 raft_consensus.cc:740] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.826510 29378 consensus_queue.cc:260] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.827081 29378 ts_tablet_manager.cc:1434] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:58.827378 29378 tablet_bootstrap.cc:492] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:58.828794 29378 tablet_bootstrap.cc:654] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.830229 29379 tablet_bootstrap.cc:492] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:58.830463 29379 ts_tablet_manager.cc:1403] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.151s user 0.017s sys 0.017s
I20260617 20:16:58.831386 29379 raft_consensus.cc:359] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.831642 29379 raft_consensus.cc:385] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.831795 29379 raft_consensus.cc:740] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.833177 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet a857c28d94f04dabb9a57aeca662b836 (table default.Table_1d1b3b6470e146c189f41d0e2fcd63c5 [id=3201002f51ca4f788cc1e153333862d4]) successfully deleted
W20260617 20:16:58.833596 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 40845d7a668045ec9a40cb6d1d76137d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40845d7a668045ec9a40cb6d1d76137d already in progress: creating tablet
I20260617 20:16:58.833562 29379 consensus_queue.cc:260] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.834800 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_dda62b1a76fb4bc894057fc310d8cf31" } modify_external_catalogs: true
I20260617 20:16:58.834995 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_dda62b1a76fb4bc894057fc310d8cf31" } modify_external_catalogs: true
I20260617 20:16:58.836180 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ee67832c2b54aa181c1c2ac5b6c5f82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.836372 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 637) took 1363 ms. Trace:
I20260617 20:16:58.836452 29376 rpcz_store.cc:276] 0617 20:16:57.472583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.472767 (+ 184us) service_pool.cc:224] Handling call
0617 20:16:58.637080 (+1164313us) ts_tablet_manager.cc:1151] Deleting tablet 46ea43994a0a42fe9e16d7bc6a2118e6
0617 20:16:58.637092 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.705481 (+ 68389us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.773728 (+ 68247us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.836351 (+ 62623us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1164166}
I20260617 20:16:58.836755 29376 tablet_replica.cc:333] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:58.836916 29376 raft_consensus.cc:2243] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.836850 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_287b99d05553492ea2ef943ec6e829b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:58.837037 29376 raft_consensus.cc:2272] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:16:58.837452 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_287b99d05553492ea2ef943ec6e829b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:58.837541 29376 ts_tablet_manager.cc:1916] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.839886 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e16e58f45a3b41f88b43f9d3c29a222f" } new_table_name: "default.Table_560c145ddbd849009a37389bcd5428eb" modify_external_catalogs: true
I20260617 20:16:58.849153 28662 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 086bd3079e8f4a6d85ccc681a38a47b0 (table default.Table_87c7eb0a5f3843a4ae45931a17a7b234 [id=cb568e8af2da4807b99a6d07c57afca9]). Expected version 3 got 0
I20260617 20:16:58.849570 28662 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet e58fbec4a9f14ddda42b5a4c0263972c (table default.Table_efb89ae603ed4713a25716af39bf03c3 [id=cd4abe077ee04673bad87834b3af273b]). Expected version 3 got 0
I20260617 20:16:58.850824 28662 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 7efe079091784d7e8035659edd442ba6 (table default.Table_6bb71611d01f469a95325bc9bbcd5251 [id=f0df4d60a326473a8fc3d040ed7324d7]). Expected version 1 got 0
I20260617 20:16:58.853757 28665 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet c3014c93d6804f3896f452f041cbedc9 (table default.Table_f805dba72b97480f827f702d8de0ae6b [id=0a278273a6004aa7947a19674e45d123]). Expected version 2 got 0
I20260617 20:16:58.854103 28665 catalog_manager.cc:5696] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:58.854458 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900aed4f54934151be309160585cf9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.854632 28665 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet e58fbec4a9f14ddda42b5a4c0263972c (table default.Table_efb89ae603ed4713a25716af39bf03c3 [id=cd4abe077ee04673bad87834b3af273b]). Expected version 3 got 0
W20260617 20:16:58.868589 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 59989.9us
I20260617 20:16:58.868818 29197 leader_election.cc:304] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:58.872574 30018 raft_consensus.cc:2804] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:58.872680 30018 raft_consensus.cc:493] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:58.872752 30018 raft_consensus.cc:3060] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:58.878029 29378 tablet_bootstrap.cc:492] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:58.878160 29378 ts_tablet_manager.cc:1403] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.051s user 0.006s sys 0.000s
I20260617 20:16:58.878856 29378 raft_consensus.cc:359] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.879030 29378 raft_consensus.cc:385] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.879082 29378 raft_consensus.cc:740] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.879258 29378 consensus_queue.cc:260] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.879670 29378 ts_tablet_manager.cc:1434] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:16:58.879946 29378 tablet_bootstrap.cc:492] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:58.881563 29378 tablet_bootstrap.cc:654] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.882347 29257 raft_consensus.cc:2468] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
W20260617 20:16:58.888525 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61d5e895c4604795bb49a2ac99afdbf9 consensus state has no leader
I20260617 20:16:58.889789 30292 tablet.cc:1724] T 97541af7c02d46b98106692d92778741 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:16:58.896648 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 46ea43994a0a42fe9e16d7bc6a2118e6 (table default.Table_c7a5b7a15b93440a82590a995e13b32c [id=efd2f4062eb343f491281fdab6875c9e]) successfully deleted
I20260617 20:16:58.840065 29375 raft_consensus.cc:2243] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:58.864463 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet c21b585707b146ed9c015d150d858681 with delete_type TABLET_DATA_DELETED (replaced by tablet 3726e55ed36f420ab63bcfb5a81c5aab) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.864612 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet b3278efaad07403ca0a2baecad46d0f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 08290c23fff5449481789b29d15c4781) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.864693 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a725364bb9646e6bc80fc4f67d04a16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.864795 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 640f53137c21443cbfc274c084ce13ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.864902 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 0859e56b5b7a483ea5e751f0468cbab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.897818 29375 pending_rounds.cc:70] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:16:58.865017 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e48a4a827d44afca912dc8723be4542 with delete_type TABLET_DATA_DELETED (replaced by tablet 33b01c9c27904a1986e285477921ac4f) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.865151 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet d738ab2f8c784c76947a3a76bd040219 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.865262 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.897919 29375 pending_rounds.cc:77] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955498121904128 op_type: NO_OP noop_request { }
I20260617 20:16:58.898039 29375 raft_consensus.cc:2889] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:16:58.898162 29375 raft_consensus.cc:2272] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.867209 30193 raft_consensus.cc:493] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.873802 30189 raft_consensus.cc:493] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.898509 30189 raft_consensus.cc:515] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.898728 29375 ts_tablet_manager.cc:1916] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:58.899127 30189 leader_election.cc:290] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.875442 29063 leader_election.cc:304] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
W20260617 20:16:58.899658 29063 leader_election.cc:343] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: c21b585707b146ed9c015d150d858681
I20260617 20:16:58.899796 29063 leader_election.cc:304] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:58.888863 30117 raft_consensus.cc:493] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.900288 30117 raft_consensus.cc:515] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.900820 30117 leader_election.cc:290] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.900977 30117 raft_consensus.cc:2804] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:58.901073 30117 raft_consensus.cc:697] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:58.901336 30117 consensus_queue.cc:237] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.902930 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_12eedf674e4d4de99a03e816f2b6475c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:58.903296 29062 leader_election.cc:343] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 4e27c5834baa48ed953fccef54e6c52b
W20260617 20:16:58.903564 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12eedf674e4d4de99a03e816f2b6475c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:58.903936 29062 leader_election.cc:343] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 67a3124306094c72ad78e5473aa35bdb
I20260617 20:16:58.904172 30189 raft_consensus.cc:2749] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.904971 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fb9bfca9839e45eab65f1350e50faa16" } modify_external_catalogs: true
I20260617 20:16:58.905153 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fb9bfca9839e45eab65f1350e50faa16" } modify_external_catalogs: true
I20260617 20:16:58.907387 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_307ffbdd67584561a453682d4cda44ca" } modify_external_catalogs: true
I20260617 20:16:58.907578 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_307ffbdd67584561a453682d4cda44ca" } modify_external_catalogs: true
I20260617 20:16:58.909198 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5cade3ff9a7c4aff96c14e548284f6ac" } modify_external_catalogs: true
I20260617 20:16:58.909457 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5cade3ff9a7c4aff96c14e548284f6ac" } modify_external_catalogs: true
I20260617 20:16:58.913774 28662 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_7e36e71e8aca4a5e8813c465c31db50a [id=de24e09cee8e4f28998625c2697769b3]). Expected version 1 got 0
I20260617 20:16:58.914047 28662 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_f7130590729b49af9644f1ffa516fe05 [id=6a948594185b42128136770dbe3f0ffb]). Expected version 3 got 0
W20260617 20:16:58.914999 29063 leader_election.cc:343] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 640f53137c21443cbfc274c084ce13ef
I20260617 20:16:58.915180 29063 leader_election.cc:304] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:58.915550 30294 raft_consensus.cc:2749] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:58.915863 30193 raft_consensus.cc:515] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.916489 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet af9c687fe56f42af82dd4728ca53cd32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.917237 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9c687fe56f42af82dd4728ca53cd32" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
W20260617 20:16:58.917928 29062 leader_election.cc:343] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Illegal state: Tablet not RUNNING: STOPPED
I20260617 20:16:58.919866 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet fe6c261318b24a6caa3a376215f44f0f from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:58.923118 28669 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet f7d2fc2bfc7a48258f356151013c6cf2
I20260617 20:16:58.925488 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b60299a5315d44ca846c6b09fdc0ae03" } new_table_name: "default.Table_33cfc094d5004faab8f883e15663eac5" modify_external_catalogs: true
I20260617 20:16:58.927037 30202 raft_consensus.cc:493] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.927166 30202 raft_consensus.cc:515] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.927807 30202 leader_election.cc:290] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.928987 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3014c93d6804f3896f452f041cbedc9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:58.929477 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1c209b8f8876488a874cdef8f86e4a15" } modify_external_catalogs: true
W20260617 20:16:58.929659 28925 leader_election.cc:343] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.929692 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1c209b8f8876488a874cdef8f86e4a15" } modify_external_catalogs: true
I20260617 20:16:58.938971 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f9844fab126448895c4c9d4c3c78d76 with delete_type TABLET_DATA_DELETED (replaced by tablet cdd24a60a91b43cd9e31ecca3d21ec60) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.939837 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3124306094c72ad78e5473aa35bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.940933 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 48cfb5fe21bc477cab8df011b6bee2d5 (DEFAULT_TABLE table=default.Table_d71ffcb31abf48718dffc393996e7ebd [id=00fdc977a27c4d2b909589cea193d5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.942101 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 791580f2131c424a87878723205864b5 (DEFAULT_TABLE table=default.Table_f251f69819b7456a9a108dfefb1414bd [id=659fc9e914b14c72b7d2a3571a01608a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.942360 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e27c5834baa48ed953fccef54e6c52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:58.942782 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e6cee209a5a44d6b35eb50e9c33228f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.943222 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 13ba94ec9e27403b974e5e6fea46e59e with delete_type TABLET_DATA_DELETED (replaced by tablet 2b91a692a9c245cc897842ac29c210b3) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.943608 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet d2db0467c5e64e38961d3b0e66375544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.944121 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet b19bce310bd24294b063b3b4f76b9f99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:58.944653 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 2dc25c0259c2414f86594418d7e92e18 (DEFAULT_TABLE table=default.Table_5973c3b62d2d4c1e9242f5a432e17719 [id=bc5bc55a1e904cefa6910c6519f0d8a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.944681 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 48cfb5fe21bc477cab8df011b6bee2d5 (DEFAULT_TABLE table=default.Table_d71ffcb31abf48718dffc393996e7ebd [id=00fdc977a27c4d2b909589cea193d5ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.945128 30203 raft_consensus.cc:493] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.945356 30203 raft_consensus.cc:515] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.946386 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 2dc25c0259c2414f86594418d7e92e18 (DEFAULT_TABLE table=default.Table_5973c3b62d2d4c1e9242f5a432e17719 [id=bc5bc55a1e904cefa6910c6519f0d8a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.946463 30203 leader_election.cc:290] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.946637 30286 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260617 20:16:58.946828 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc36f62aa0bf46278cb84ec8cb7eef55" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:58.947324 28925 leader_election.cc:343] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.951270 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 3369727329a74fa5bab98deb507f0d06 (DEFAULT_TABLE table=default.Table_712380b8c25e4e81a05694199000e983 [id=1389c47aaaba4a9196cfaa09cde5da44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.956061 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 3369727329a74fa5bab98deb507f0d06 (DEFAULT_TABLE table=default.Table_712380b8c25e4e81a05694199000e983 [id=1389c47aaaba4a9196cfaa09cde5da44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.957562 30026 fs_manager.cc:730] Time spent opening block manager: real 0.153s user 0.013s sys 0.024s
I20260617 20:16:58.957844 30026 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data,/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal
uuid: "87437cd320a4470fa0dedd43aa7ea3eb"
format_stamp: "Formatted at 2026-06-17 20:16:40 on dist-test-slave-dvcr"
I20260617 20:16:58.959144 30026 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 20:16:58.960670 29063 leader_election.cc:304] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:58.960666 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 952dd29df20f451e8d47baf3026d3008 (DEFAULT_TABLE table=default.Table_5ba1cc04120f480096f12966b301a7ac [id=27dd87e5a02e40c08b5e66d0d47aafcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.960834 29378 tablet_bootstrap.cc:492] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:58.961453 29378 ts_tablet_manager.cc:1403] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.082s user 0.005s sys 0.005s
I20260617 20:16:58.961679 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a3124306094c72ad78e5473aa35bdb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.961758 29383 tablet_bootstrap.cc:492] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:58.961792 30253 raft_consensus.cc:493] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.961894 29257 raft_consensus.cc:2468] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:58.961908 29383 ts_tablet_manager.cc:1403] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.156s user 0.008s sys 0.025s
I20260617 20:16:58.961895 30253 raft_consensus.cc:515] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.962172 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e27c5834baa48ed953fccef54e6c52b" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:58.962352 29259 raft_consensus.cc:2468] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:58.962505 29378 raft_consensus.cc:359] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.962605 30253 leader_election.cc:290] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.962746 29383 raft_consensus.cc:359] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.962960 29383 raft_consensus.cc:385] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.963022 29379 ts_tablet_manager.cc:1434] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.132s user 0.002s sys 0.000s
I20260617 20:16:58.963060 29383 raft_consensus.cc:740] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.963361 29383 consensus_queue.cc:260] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.963449 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ba94ec9e27403b974e5e6fea46e59e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:58.963929 29198 leader_election.cc:343] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.964216 29378 raft_consensus.cc:385] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:58.964298 29378 raft_consensus.cc:740] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:58.964497 29378 consensus_queue.cc:260] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.964607 29383 ts_tablet_manager.cc:1434] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:16:58.964942 29378 ts_tablet_manager.cc:1434] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260617 20:16:58.965247 29378 tablet_bootstrap.cc:492] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:58.968135 29379 tablet_bootstrap.cc:492] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:58.970109 30203 raft_consensus.cc:493] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:58.970300 29379 tablet_bootstrap.cc:654] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.970330 30203 raft_consensus.cc:515] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.971349 30203 leader_election.cc:290] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:58.971822 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e0c5d20a4548cc8124302aa38bcb21" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:58.972560 28925 leader_election.cc:343] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.972996 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 952dd29df20f451e8d47baf3026d3008 (DEFAULT_TABLE table=default.Table_5ba1cc04120f480096f12966b301a7ac [id=27dd87e5a02e40c08b5e66d0d47aafcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.973570 29383 tablet_bootstrap.cc:492] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:58.975695 30248 raft_consensus.cc:515] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:58.976270 30248 leader_election.cc:290] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:58.977239 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc25c0259c2414f86594418d7e92e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.977735 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3369727329a74fa5bab98deb507f0d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.978065 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952dd29df20f451e8d47baf3026d3008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.981451 29376 ts_tablet_manager.cc:1929] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:58.981570 29376 log.cc:1199] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/0859e56b5b7a483ea5e751f0468cbab8
I20260617 20:16:58.981859 29376 ts_tablet_manager.cc:1950] T 0859e56b5b7a483ea5e751f0468cbab8 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:58.982194 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 630) took 1560 ms. Trace:
I20260617 20:16:58.982276 29377 rpcz_store.cc:276] 0617 20:16:57.421214 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.421402 (+ 188us) service_pool.cc:224] Handling call
0617 20:16:58.440623 (+1019221us) ts_tablet_manager.cc:1151] Deleting tablet af9c687fe56f42af82dd4728ca53cd32
0617 20:16:58.440631 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.539950 (+ 99319us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.721549 (+181599us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.982155 (+260606us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16793,"tablet-delete.queue_time_us":1019090}
I20260617 20:16:58.982515 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791580f2131c424a87878723205864b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.975386 28957 tablet_service.cc:1511] Processing CreateTablet for tablet a590289e6b4e495cb551523ccbfd9989 (DEFAULT_TABLE table=default.Table_766764a313d042c290c82395b15fcbfa [id=71a8746b74234cc5998761b1a5f7c85a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.982599 29377 tablet_replica.cc:333] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:58.982745 29377 raft_consensus.cc:2243] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:58.982808 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a590289e6b4e495cb551523ccbfd9989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.982872 29377 raft_consensus.cc:2272] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:58.983028 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cfb5fe21bc477cab8df011b6bee2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.983392 29377 ts_tablet_manager.cc:1916] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:58.983656 28657 consensus_peers.cc:597] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a -> Peer 87437cd320a4470fa0dedd43aa7ea3eb (127.27.245.253:38361): Couldn't send request to peer 87437cd320a4470fa0dedd43aa7ea3eb. Status: Network error: Client connection negotiation failed: client connection to 127.27.245.253:38361: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260617 20:16:58.983990 29383 tablet_bootstrap.cc:654] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.985061 29378 tablet_bootstrap.cc:654] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:58.985899 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48cfb5fe21bc477cab8df011b6bee2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.986352 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc25c0259c2414f86594418d7e92e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.986693 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3369727329a74fa5bab98deb507f0d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.987042 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952dd29df20f451e8d47baf3026d3008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:58.987915 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c3a4c3bee5444697f5d53d51c62894" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:58.988121 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet af9c687fe56f42af82dd4728ca53cd32 (table default.Table_b69715660a0e44959e855ca44fb09056 [id=6fe28533c9a445a88d8bcb86636c4905]) successfully deleted
W20260617 20:16:58.988406 29198 leader_election.cc:343] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:58.996500 29096 tablet_service.cc:1511] Processing CreateTablet for tablet a590289e6b4e495cb551523ccbfd9989 (DEFAULT_TABLE table=default.Table_766764a313d042c290c82395b15fcbfa [id=71a8746b74234cc5998761b1a5f7c85a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:58.998770 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3b00d3c0adcf48a48ba3d7a3de018b80
I20260617 20:16:59.001016 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet fc36f62aa0bf46278cb84ec8cb7eef55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.002765 30296 raft_consensus.cc:2804] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
W20260617 20:16:59.005169 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a122f01420334404a3ffe711c6f10bf4 consensus state has no leader
I20260617 20:16:59.005507 30296 raft_consensus.cc:697] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:16:59.005985 30296 consensus_queue.cc:237] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.006781 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3014c93d6804f3896f452f041cbedc9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:59.006964 29257 raft_consensus.cc:2468] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:59.011197 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_64b68bdc9cc04e1eb9ccc1ce83bf1035"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.011418 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a09fbb3e8eb4b66acba0d6b572713ef consensus state has no leader
W20260617 20:16:59.011827 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64b68bdc9cc04e1eb9ccc1ce83bf1035 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.012064 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f805dba72b97480f827f702d8de0ae6b" } new_table_name: "default.Table_01fded33682b4e3f91e9f6e6e92031f6" modify_external_catalogs: true
I20260617 20:16:59.011199 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet fe6c261318b24a6caa3a376215f44f0f
I20260617 20:16:59.014000 28670 catalog_manager.cc:6784] ReplaceTablet: tablet fe6c261318b24a6caa3a376215f44f0f deleted and replaced by tablet 5d93449f5d5d41fb9883db3bce10f969
I20260617 20:16:59.014320 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet dcd999d88d954e50810cc01b297a27a9 from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:59.016328 28664 catalog_manager.cc:5696] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:16:59.011801 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_81c229ec2c314f8c8f4fa879c0470861"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:59.016960 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 7efe079091784d7e8035659edd442ba6 (table default.Table_6bb71611d01f469a95325bc9bbcd5251 [id=f0df4d60a326473a8fc3d040ed7324d7]). Expected version 1 got 0
I20260617 20:16:59.017246 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_7e36e71e8aca4a5e8813c465c31db50a [id=de24e09cee8e4f28998625c2697769b3]). Expected version 1 got 0
W20260617 20:16:59.017361 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81c229ec2c314f8c8f4fa879c0470861 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.017450 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_f7130590729b49af9644f1ffa516fe05 [id=6a948594185b42128136770dbe3f0ffb]). Expected version 3 got 0
I20260617 20:16:59.018307 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5eedf2442f964048b7a3a460b6b22f2a
I20260617 20:16:59.019397 28952 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eedf2442f964048b7a3a460b6b22f2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.020047 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b00d3c0adcf48a48ba3d7a3de018b80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.020661 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet fe6c261318b24a6caa3a376215f44f0f with delete_type TABLET_DATA_DELETED (replaced by tablet 5d93449f5d5d41fb9883db3bce10f969) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.021677 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e6cee209a5a44d6b35eb50e9c33228f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.022289 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet fe6c261318b24a6caa3a376215f44f0f with delete_type TABLET_DATA_DELETED (replaced by tablet 5d93449f5d5d41fb9883db3bce10f969) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.022919 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eedf2442f964048b7a3a460b6b22f2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.023556 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cd10b4e7345244ee8825544af6b6add1" } new_table_name: "default.Table_9cd011070f8848eeb76b111f2e64f60f" modify_external_catalogs: true
I20260617 20:16:59.024098 30193 leader_election.cc:290] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.025331 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 91fac788a74346e28f7b7e5939459325
I20260617 20:16:59.027519 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 91fac788a74346e28f7b7e5939459325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.027966 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc36f62aa0bf46278cb84ec8cb7eef55" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:59.028168 29257 raft_consensus.cc:2468] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:59.028779 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1b519a3c00d6483097bb906c3bb288dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.030237 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b519a3c00d6483097bb906c3bb288dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.032078 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 2dc25c0259c2414f86594418d7e92e18 (DEFAULT_TABLE table=default.Table_5973c3b62d2d4c1e9242f5a432e17719 [id=bc5bc55a1e904cefa6910c6519f0d8a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.032490 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dc25c0259c2414f86594418d7e92e18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.033465 30253 raft_consensus.cc:493] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.033638 30253 raft_consensus.cc:515] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.034480 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 91fac788a74346e28f7b7e5939459325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.035281 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8a75e972290d447da9487d018bf2f205"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.036036 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a75e972290d447da9487d018bf2f205 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.036237 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e0c5d20a4548cc8124302aa38bcb21" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:59.036665 30253 leader_election.cc:290] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:59.037348 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2db0467c5e64e38961d3b0e66375544" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:59.037788 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b00d3c0adcf48a48ba3d7a3de018b80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:16:59.037976 29198 leader_election.cc:343] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:59.040828 28969 tablet_service.cc:1511] Processing CreateTablet for tablet cbd8b00391f046b694000c9dc8a8de5d (DEFAULT_TABLE table=default.Table_657118477519461f9cc86b131622bc53 [id=9823363011cb4dd18410323e0f58b7b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.042260 29106 tablet_service.cc:1511] Processing CreateTablet for tablet cbd8b00391f046b694000c9dc8a8de5d (DEFAULT_TABLE table=default.Table_657118477519461f9cc86b131622bc53 [id=9823363011cb4dd18410323e0f58b7b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.045362 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 3369727329a74fa5bab98deb507f0d06 (DEFAULT_TABLE table=default.Table_712380b8c25e4e81a05694199000e983 [id=1389c47aaaba4a9196cfaa09cde5da44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.045889 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3369727329a74fa5bab98deb507f0d06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.046422 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3ca6d6dfbe4ec9be48ea43db907676 (DEFAULT_TABLE table=default.Table_8de2d6a5ba0a4db08a56a40d929e5d4a [id=d3e9fc87749f46a3a6a2e222cbff718d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.048296 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 952dd29df20f451e8d47baf3026d3008 (DEFAULT_TABLE table=default.Table_5ba1cc04120f480096f12966b301a7ac [id=27dd87e5a02e40c08b5e66d0d47aafcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.049588 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3ca6d6dfbe4ec9be48ea43db907676 (DEFAULT_TABLE table=default.Table_8de2d6a5ba0a4db08a56a40d929e5d4a [id=d3e9fc87749f46a3a6a2e222cbff718d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.050614 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 952dd29df20f451e8d47baf3026d3008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.050657 29379 tablet_bootstrap.cc:492] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:59.050786 29379 ts_tablet_manager.cc:1403] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.002s
I20260617 20:16:59.051613 29379 raft_consensus.cc:359] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.051905 29379 raft_consensus.cc:385] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.052161 29379 raft_consensus.cc:740] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.052491 29379 consensus_queue.cc:260] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.056895 29383 tablet_bootstrap.cc:492] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.057093 29383 ts_tablet_manager.cc:1403] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.084s user 0.014s sys 0.022s
I20260617 20:16:59.057641 29379 ts_tablet_manager.cc:1434] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20260617 20:16:59.057967 29379 tablet_bootstrap.cc:492] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:59.059159 29383 raft_consensus.cc:359] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.059867 29379 tablet_bootstrap.cc:654] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.062180 29383 raft_consensus.cc:385] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.062312 29383 raft_consensus.cc:740] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.061164 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b00d3c0adcf48a48ba3d7a3de018b80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.061673 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet fe6c261318b24a6caa3a376215f44f0f with delete_type TABLET_DATA_DELETED (replaced by tablet 5d93449f5d5d41fb9883db3bce10f969) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.062662 29383 consensus_queue.cc:260] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.063742 29383 ts_tablet_manager.cc:1434] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 20:16:59.063869 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eedf2442f964048b7a3a460b6b22f2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.064087 29383 tablet_bootstrap.cc:492] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.065927 29383 tablet_bootstrap.cc:654] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.067673 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet 91fac788a74346e28f7b7e5939459325 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.068614 29243 tablet_service.cc:1511] Processing CreateTablet for tablet a590289e6b4e495cb551523ccbfd9989 (DEFAULT_TABLE table=default.Table_766764a313d042c290c82395b15fcbfa [id=71a8746b74234cc5998761b1a5f7c85a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.068913 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet ebd98889d08f4683ba4b2ee98a74254d
I20260617 20:16:59.069097 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a590289e6b4e495cb551523ccbfd9989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.069547 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf67f3f62714cd3bb9cce3f207cc3b8 (DEFAULT_TABLE table=default.Table_71381d2e3aa94861a116255689215461 [id=13717f883a3449dd9014fff544ad7d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.071049 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet ebd98889d08f4683ba4b2ee98a74254d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.071127 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet ebd98889d08f4683ba4b2ee98a74254d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.071842 29378 tablet_bootstrap.cc:492] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:59.072242 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf67f3f62714cd3bb9cce3f207cc3b8 (DEFAULT_TABLE table=default.Table_71381d2e3aa94861a116255689215461 [id=13717f883a3449dd9014fff544ad7d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.072804 29378 ts_tablet_manager.cc:1403] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.108s user 0.005s sys 0.009s
I20260617 20:16:59.073598 29378 raft_consensus.cc:359] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.073784 29378 raft_consensus.cc:385] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.073853 29378 raft_consensus.cc:740] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.074064 29378 consensus_queue.cc:260] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.074520 29378 ts_tablet_manager.cc:1434] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:59.074800 29378 tablet_bootstrap.cc:492] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:59.075927 29260 raft_consensus.cc:2468] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:59.076359 29378 tablet_bootstrap.cc:654] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.076366 29375 ts_tablet_manager.cc:1929] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:16:59.076485 29375 log.cc:1199] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/7b00437fb76c4000ad89c99ab2da2261
I20260617 20:16:59.076853 29375 ts_tablet_manager.cc:1950] T 7b00437fb76c4000ad89c99ab2da2261 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:59.091886 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3ca6d6dfbe4ec9be48ea43db907676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.093231 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a590289e6b4e495cb551523ccbfd9989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.093807 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd8b00391f046b694000c9dc8a8de5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.094303 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3ca6d6dfbe4ec9be48ea43db907676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.094666 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf67f3f62714cd3bb9cce3f207cc3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.096827 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 638) took 1623 ms. Trace:
I20260617 20:16:59.096941 29376 rpcz_store.cc:276] 0617 20:16:57.473089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.473257 (+ 168us) service_pool.cc:224] Handling call
0617 20:16:58.836712 (+1363455us) ts_tablet_manager.cc:1151] Deleting tablet 0859e56b5b7a483ea5e751f0468cbab8
0617 20:16:58.836720 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.878547 (+ 41827us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:58.981374 (+102827us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.096802 (+115428us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1363289}
I20260617 20:16:59.097450 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 639) took 1623 ms. Trace:
I20260617 20:16:59.097549 29376 rpcz_store.cc:276] 0617 20:16:57.473615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.473810 (+ 195us) service_pool.cc:224] Handling call
0617 20:16:59.097251 (+1623441us) ts_tablet_manager.cc:1151] Deleting tablet 6c0aa4861a51488db2d1a7041c25ae22
0617 20:16:59.097262 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.097431 (+ 169us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1623304}
I20260617 20:16:59.097941 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 640) took 1613 ms. Trace:
I20260617 20:16:59.098034 29376 rpcz_store.cc:276] 0617 20:16:57.484928 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.485220 (+ 292us) service_pool.cc:224] Handling call
0617 20:16:59.097810 (+1612590us) ts_tablet_manager.cc:1151] Deleting tablet 5477576e46c84bb6b8a8c7053c61641c
0617 20:16:59.097821 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.097896 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1612373}
I20260617 20:16:59.098376 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 642) took 1541 ms. Trace:
I20260617 20:16:59.098466 29376 rpcz_store.cc:276] 0617 20:16:57.557399 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.557700 (+ 301us) service_pool.cc:224] Handling call
0617 20:16:59.098263 (+1540563us) ts_tablet_manager.cc:1151] Deleting tablet a52873eade4048af81a8e51233b9d079
0617 20:16:59.098274 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.098344 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1540341}
I20260617 20:16:59.098804 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 644) took 1492 ms. Trace:
I20260617 20:16:59.098889 29376 rpcz_store.cc:276] 0617 20:16:57.606317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.614512 (+ 8195us) service_pool.cc:224] Handling call
0617 20:16:59.098686 (+1484174us) ts_tablet_manager.cc:1151] Deleting tablet d19d34e3bbe3453ca6de6ed7e62f7af4
0617 20:16:59.098695 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.098768 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1483588}
I20260617 20:16:59.099174 29376 tablet_replica.cc:333] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:59.099356 29376 raft_consensus.cc:2243] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:59.099522 29376 raft_consensus.cc:2272] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:59.099614 29383 tablet_bootstrap.cc:492] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.099732 29383 ts_tablet_manager.cc:1403] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.006s
I20260617 20:16:59.100054 29376 ts_tablet_manager.cc:1916] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:59.100581 29383 raft_consensus.cc:359] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.100749 29383 raft_consensus.cc:385] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.100811 29383 raft_consensus.cc:740] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.101064 29383 consensus_queue.cc:260] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.101727 29383 ts_tablet_manager.cc:1434] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:59.101997 29383 tablet_bootstrap.cc:492] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.102015 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf67f3f62714cd3bb9cce3f207cc3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.106474 29383 tablet_bootstrap.cc:654] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.113010 29226 tablet_service.cc:1511] Processing CreateTablet for tablet cbd8b00391f046b694000c9dc8a8de5d (DEFAULT_TABLE table=default.Table_657118477519461f9cc86b131622bc53 [id=9823363011cb4dd18410323e0f58b7b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.114024 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 1f3ca6d6dfbe4ec9be48ea43db907676 (DEFAULT_TABLE table=default.Table_8de2d6a5ba0a4db08a56a40d929e5d4a [id=d3e9fc87749f46a3a6a2e222cbff718d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.114810 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet ebd98889d08f4683ba4b2ee98a74254d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.115285 29063 leader_election.cc:304] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:59.115996 29063 leader_election.cc:304] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:59.116319 30294 raft_consensus.cc:2804] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:59.116396 30294 raft_consensus.cc:493] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:59.116469 30294 raft_consensus.cc:3060] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.119974 30193 raft_consensus.cc:2804] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:59.120061 30193 raft_consensus.cc:493] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:59.120117 30193 raft_consensus.cc:3060] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.126235 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32c3a4c3bee5444697f5d53d51c62894" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:59.126464 28990 raft_consensus.cc:3060] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.130126 30203 consensus_queue.cc:1048] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:59.131177 28925 leader_election.cc:304] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:59.131860 30203 raft_consensus.cc:2804] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:59.131959 30203 raft_consensus.cc:493] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:59.132045 30203 raft_consensus.cc:3060] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.134241 28925 leader_election.cc:304] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:59.134722 30202 raft_consensus.cc:2804] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:59.134801 30202 raft_consensus.cc:493] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:59.134873 30202 raft_consensus.cc:3060] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:59.135625 28925 leader_election.cc:343] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:59.135751 28925 leader_election.cc:304] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:59.136139 30201 raft_consensus.cc:2749] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:59.138564 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd8b00391f046b694000c9dc8a8de5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.138804 28925 leader_election.cc:304] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:16:59.139065 28925 raft_consensus.cc:2686] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:16:59.141330 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af9c687fe56f42af82dd4728ca53cd32" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:16:59.141623 29197 leader_election.cc:343] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 13ba94ec9e27403b974e5e6fea46e59e
I20260617 20:16:59.141702 29260 raft_consensus.cc:2393] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:16:59.141782 29197 leader_election.cc:304] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:59.142982 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 5bf67f3f62714cd3bb9cce3f207cc3b8 (DEFAULT_TABLE table=default.Table_71381d2e3aa94861a116255689215461 [id=13717f883a3449dd9014fff544ad7d7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.143422 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 0859e56b5b7a483ea5e751f0468cbab8 (table default.Table_1ee5913d94914aba95dc4be83307dbe1 [id=4052e9bb44674d6b9936c1c6f004488f]) successfully deleted
W20260617 20:16:59.143749 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 6c0aa4861a51488db2d1a7041c25ae22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c0aa4861a51488db2d1a7041c25ae22 already in progress: creating tablet
W20260617 20:16:59.144034 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5477576e46c84bb6b8a8c7053c61641c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5477576e46c84bb6b8a8c7053c61641c already in progress: creating tablet
W20260617 20:16:59.144289 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet a52873eade4048af81a8e51233b9d079 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a52873eade4048af81a8e51233b9d079 already in progress: creating tablet
W20260617 20:16:59.144529 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d19d34e3bbe3453ca6de6ed7e62f7af4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d19d34e3bbe3453ca6de6ed7e62f7af4 already in progress: creating tablet
I20260617 20:16:59.147089 30253 raft_consensus.cc:2749] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:16:59.148496 29197 leader_election.cc:343] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d2db0467c5e64e38961d3b0e66375544
I20260617 20:16:59.148653 29197 leader_election.cc:304] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:59.149183 30248 raft_consensus.cc:2749] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:59.149428 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 159bd65d4f05426d9297ee6755a7ed67 (DEFAULT_TABLE table=default.Table_a0abac57842c430484585d01d659001e [id=2c08c48fb49b49b0bd0fc07ce29b460b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.150084 30305 tablet.cc:1724] T 97541af7c02d46b98106692d92778741 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:16:59.153702 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_883b608d1f174bd19a9e3d10a4c6ee3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.157490 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_883b608d1f174bd19a9e3d10a4c6ee3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.159057 29379 tablet_bootstrap.cc:492] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:59.159219 29379 ts_tablet_manager.cc:1403] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.101s user 0.001s sys 0.001s
I20260617 20:16:59.159956 29379 raft_consensus.cc:359] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.160133 29379 raft_consensus.cc:385] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.160207 29379 raft_consensus.cc:740] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.160416 29379 consensus_queue.cc:260] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.160926 29379 ts_tablet_manager.cc:1434] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:59.162717 29063 leader_election.cc:304] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:59.164031 29379 tablet_bootstrap.cc:492] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:59.166091 29379 tablet_bootstrap.cc:654] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.169546 29379 tablet_bootstrap.cc:492] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:59.169746 29379 ts_tablet_manager.cc:1403] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260617 20:16:59.170725 29379 raft_consensus.cc:359] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.171378 30296 raft_consensus.cc:3060] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.171535 29379 raft_consensus.cc:385] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.171739 29379 raft_consensus.cc:740] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.171950 29379 consensus_queue.cc:260] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.173103 29379 ts_tablet_manager.cc:1434] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:16:59.174806 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e3dc5d6e636a48dcb8ea35c12167a65c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.175402 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3dc5d6e636a48dcb8ea35c12167a65c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.177541 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet dcd999d88d954e50810cc01b297a27a9
I20260617 20:16:59.178972 29379 tablet_bootstrap.cc:492] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:59.179633 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 601) took 2484 ms. Trace:
I20260617 20:16:59.179632 28665 catalog_manager.cc:5696] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:16:59.179718 29375 rpcz_store.cc:276] 0617 20:16:56.694942 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.695036 (+ 94us) service_pool.cc:224] Handling call
0617 20:16:58.821220 (+2126184us) ts_tablet_manager.cc:1151] Deleting tablet 7b00437fb76c4000ad89c99ab2da2261
0617 20:16:58.821230 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:58.985512 (+164282us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.076299 (+ 90787us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.179606 (+103307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18516,"tablet-delete.queue_time_us":2107421}
I20260617 20:16:59.180140 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 609) took 2342 ms. Trace:
I20260617 20:16:59.180212 29375 rpcz_store.cc:276] 0617 20:16:56.837974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.838023 (+ 49us) service_pool.cc:224] Handling call
0617 20:16:59.180005 (+2341982us) ts_tablet_manager.cc:1151] Deleting tablet f31bf7ed828f44b398f5bdac6b9b63e7
0617 20:16:59.180016 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.180124 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2341801}
I20260617 20:16:59.180362 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 086bd3079e8f4a6d85ccc681a38a47b0 (table default.Table_87c7eb0a5f3843a4ae45931a17a7b234 [id=cb568e8af2da4807b99a6d07c57afca9]). Expected version 3 got 0
I20260617 20:16:59.180536 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 610) took 2342 ms. Trace:
I20260617 20:16:59.180600 29375 rpcz_store.cc:276] 0617 20:16:56.838338 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.838385 (+ 47us) service_pool.cc:224] Handling call
0617 20:16:59.180428 (+2342043us) ts_tablet_manager.cc:1151] Deleting tablet 6f544f486c144cd89ca7c5b83d252ee9
0617 20:16:59.180436 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.180521 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2341892}
I20260617 20:16:59.180660 28665 catalog_manager.cc:5696] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:16:59.180950 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 611) took 2342 ms. Trace:
I20260617 20:16:59.180856 29377 ts_tablet_manager.cc:1929] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:59.181062 29377 log.cc:1199] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/b19bce310bd24294b063b3b4f76b9f99
I20260617 20:16:59.181017 29375 rpcz_store.cc:276] 0617 20:16:56.838658 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.838698 (+ 40us) service_pool.cc:224] Handling call
0617 20:16:59.180846 (+2342148us) ts_tablet_manager.cc:1151] Deleting tablet 26ebcfc80ca64129a7ab939bfd853998
0617 20:16:59.180854 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.180935 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2342012}
I20260617 20:16:59.181327 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 608) took 2343 ms. Trace:
I20260617 20:16:59.181380 29377 ts_tablet_manager.cc:1950] T b19bce310bd24294b063b3b4f76b9f99 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:59.181389 29375 rpcz_store.cc:276] 0617 20:16:56.837889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.840334 (+ 2445us) service_pool.cc:224] Handling call
0617 20:16:59.181196 (+2340862us) ts_tablet_manager.cc:1151] Deleting tablet f02529cd1e764a3886de27d86e9690e3
0617 20:16:59.181206 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.181280 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2340723}
I20260617 20:16:59.181622 29375 tablet_replica.cc:333] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:59.181841 29375 raft_consensus.cc:2243] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:16:59.182106 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet ba3ad8de250a47da9c9a31dff7f495b5 (table default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]). Expected version 2 got 0
I20260617 20:16:59.182164 29375 raft_consensus.cc:2272] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:59.182297 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 32c3a4c3bee5444697f5d53d51c62894 (table default.Table_675137d48e694996a1fbfc31e4fd7c9b [id=7a5ce2f1ca114a508611d15c5a7c18c4]). Expected version 2 got 0
I20260617 20:16:59.182718 29375 ts_tablet_manager.cc:1916] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:59.182647 30294 raft_consensus.cc:515] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:59.182849 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 consensus state has no leader
I20260617 20:16:59.183248 30294 leader_election.cc:290] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.184896 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d4a84bed29104bb3a86225b6af000f69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:59.186270 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 97541af7c02d46b98106692d92778741 (table default.Table_702d2d2262b845b68b13e005c388d10b [id=f608d4e53a0f4d37af562e6ce53576d8]). Expected version 3 got 0
I20260617 20:16:59.186445 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet c3014c93d6804f3896f452f041cbedc9 (table default.Table_f805dba72b97480f827f702d8de0ae6b [id=0a278273a6004aa7947a19674e45d123]). Expected version 2 got 0
I20260617 20:16:59.186635 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_f7130590729b49af9644f1ffa516fe05 [id=6a948594185b42128136770dbe3f0ffb]). Expected version 3 got 0
I20260617 20:16:59.186820 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_7e36e71e8aca4a5e8813c465c31db50a [id=de24e09cee8e4f28998625c2697769b3]). Expected version 1 got 0
I20260617 20:16:59.186995 28670 catalog_manager.cc:6784] ReplaceTablet: tablet dcd999d88d954e50810cc01b297a27a9 deleted and replaced by tablet 403095586c704ecaa2a9931295bd1330
I20260617 20:16:59.187281 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_50f2b58acf40426e91582284e4435525" } new_table_name: "default.Table_5568c77256244c37989abf62aea01e5e" modify_external_catalogs: true
W20260617 20:16:59.188472 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4a84bed29104bb3a86225b6af000f69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:16:59.190018 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c3014c93d6804f3896f452f041cbedc9 consensus state has no leader
I20260617 20:16:59.190368 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fd65529645494ac38960b878c8dce40a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.190860 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd65529645494ac38960b878c8dce40a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.191192 28970 tablet_service.cc:1558] Processing DeleteTablet for tablet dcd999d88d954e50810cc01b297a27a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 403095586c704ecaa2a9931295bd1330) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.191493 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159bd65d4f05426d9297ee6755a7ed67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.194568 28970 tablet_service.cc:1511] Processing CreateTablet for tablet c141dde259d44f4c88db5236190259a7 (DEFAULT_TABLE table=default.Table_11103f92f9184eae915572b6fcf56089 [id=ba4269f0c0574906ad7b8d7e0fb533d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.194921 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c141dde259d44f4c88db5236190259a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.195633 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet dcd999d88d954e50810cc01b297a27a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 403095586c704ecaa2a9931295bd1330) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.180600 29379 tablet_bootstrap.cc:654] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.198143 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 7b00437fb76c4000ad89c99ab2da2261 (table default.Table_6f68970fea69478eba2df21752f2ea0a [id=40e28570c43d428b90d13ccc0123be2b]) successfully deleted
W20260617 20:16:59.198405 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet f31bf7ed828f44b398f5bdac6b9b63e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f31bf7ed828f44b398f5bdac6b9b63e7 already in progress: creating tablet
W20260617 20:16:59.198580 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 6f544f486c144cd89ca7c5b83d252ee9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f544f486c144cd89ca7c5b83d252ee9 already in progress: creating tablet
W20260617 20:16:59.198812 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet f02529cd1e764a3886de27d86e9690e3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f02529cd1e764a3886de27d86e9690e3 already in progress: creating tablet
I20260617 20:16:59.201516 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 159bd65d4f05426d9297ee6755a7ed67 (DEFAULT_TABLE table=default.Table_a0abac57842c430484585d01d659001e [id=2c08c48fb49b49b0bd0fc07ce29b460b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.202059 28990 raft_consensus.cc:2468] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:59.202243 29379 tablet_bootstrap.cc:492] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:59.202397 29379 ts_tablet_manager.cc:1403] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20260617 20:16:59.203192 29379 raft_consensus.cc:359] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.203452 29379 raft_consensus.cc:385] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.203563 29379 raft_consensus.cc:740] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.203830 29379 consensus_queue.cc:260] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.204578 29379 ts_tablet_manager.cc:1434] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:59.204919 29379 tablet_bootstrap.cc:492] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:59.204979 28957 tablet_service.cc:1511] Processing CreateTablet for tablet be96f417f6614e569555f37c2838369d (DEFAULT_TABLE table=default.Table_d98a23fa3bd844be97030f42b77ce612 [id=fce0f344d79e48c791907e51536847d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.205458 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be96f417f6614e569555f37c2838369d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.206985 29379 tablet_bootstrap.cc:654] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.151924 29383 tablet_bootstrap.cc:492] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.173348 30018 raft_consensus.cc:515] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.211738 29383 ts_tablet_manager.cc:1403] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.110s user 0.010s sys 0.014s
I20260617 20:16:59.212427 30018 leader_election.cc:290] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:59.212594 29383 raft_consensus.cc:359] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.202873 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd8b00391f046b694000c9dc8a8de5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.212795 29383 raft_consensus.cc:385] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.212873 29383 raft_consensus.cc:740] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.213013 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf67f3f62714cd3bb9cce3f207cc3b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.213092 29383 consensus_queue.cc:260] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.213640 29383 ts_tablet_manager.cc:1434] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:16:59.213938 29383 tablet_bootstrap.cc:492] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.213989 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0969f0a128834168ad1fde29b32e32d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:59.214160 29126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3ad8de250a47da9c9a31dff7f495b5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:16:59.214600 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0969f0a128834168ad1fde29b32e32d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.215199 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f3ca6d6dfbe4ec9be48ea43db907676. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.215595 29383 tablet_bootstrap.cc:654] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.215873 29095 tablet_service.cc:1511] Processing CreateTablet for tablet c141dde259d44f4c88db5236190259a7 (DEFAULT_TABLE table=default.Table_11103f92f9184eae915572b6fcf56089 [id=ba4269f0c0574906ad7b8d7e0fb533d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.218940 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 5135429388f240619dcbdc7dc1a066d1 (DEFAULT_TABLE table=default.Table_35da9942c88b483c842bd60a4e136618 [id=0484fe618c604fc6ae5cf909437940b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.219326 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5135429388f240619dcbdc7dc1a066d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.225001 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 5135429388f240619dcbdc7dc1a066d1 (DEFAULT_TABLE table=default.Table_35da9942c88b483c842bd60a4e136618 [id=0484fe618c604fc6ae5cf909437940b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.225108 29383 tablet_bootstrap.cc:492] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.225263 29383 ts_tablet_manager.cc:1403] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260617 20:16:59.225677 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 39e1b23e6ea843df8d0528f9b427f47f (DEFAULT_TABLE table=default.Table_e4eb4ddc78ad49f8b8b28c441d0ca39f [id=ea076d1ff6b74b85b228164033b35451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.226112 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39e1b23e6ea843df8d0528f9b427f47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.226050 29383 raft_consensus.cc:359] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.226215 29383 raft_consensus.cc:385] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.226274 29383 raft_consensus.cc:740] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.226485 29383 consensus_queue.cc:260] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.227020 29383 ts_tablet_manager.cc:1434] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:16:59.227262 29383 tablet_bootstrap.cc:492] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.228739 29383 tablet_bootstrap.cc:654] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.228820 29104 tablet_service.cc:1511] Processing CreateTablet for tablet be96f417f6614e569555f37c2838369d (DEFAULT_TABLE table=default.Table_d98a23fa3bd844be97030f42b77ce612 [id=fce0f344d79e48c791907e51536847d6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:59.231756 29198 leader_election.cc:343] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:59.232055 30026 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260617 20:16:59.237030 30026 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260617 20:16:59.238010 29383 tablet_bootstrap.cc:492] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.238469 29383 ts_tablet_manager.cc:1403] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260617 20:16:59.239439 29383 raft_consensus.cc:359] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.239886 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_eacb11ffc7ea46848481b65cc3c5cb81" } modify_external_catalogs: true
I20260617 20:16:59.240087 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_eacb11ffc7ea46848481b65cc3c5cb81" } modify_external_catalogs: true
I20260617 20:16:59.240355 30026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260617 20:16:59.241133 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 7b14f846015b4e82b2c3bdebc21b07b9 (DEFAULT_TABLE table=default.Table_6878f9bd771944d8be106fbf847f8baa [id=91adfc411b404fa097607e44707e211c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.241556 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b14f846015b4e82b2c3bdebc21b07b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.241906 29383 raft_consensus.cc:385] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.241995 29383 raft_consensus.cc:740] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.242223 29383 consensus_queue.cc:260] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.243486 29383 ts_tablet_manager.cc:1434] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:16:59.243803 29383 tablet_bootstrap.cc:492] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.244782 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 39e1b23e6ea843df8d0528f9b427f47f (DEFAULT_TABLE table=default.Table_e4eb4ddc78ad49f8b8b28c441d0ca39f [id=ea076d1ff6b74b85b228164033b35451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.245537 29383 tablet_bootstrap.cc:654] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.257985 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0023728d2dae4d0b9dbecc4370e3127e" } modify_external_catalogs: true
I20260617 20:16:59.258291 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0023728d2dae4d0b9dbecc4370e3127e" } modify_external_catalogs: true
I20260617 20:16:59.259284 29383 tablet_bootstrap.cc:492] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.259443 29383 ts_tablet_manager.cc:1403] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20260617 20:16:59.260253 29383 raft_consensus.cc:359] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.260442 29383 raft_consensus.cc:385] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.260516 29383 raft_consensus.cc:740] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.262530 29383 consensus_queue.cc:260] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.263886 29383 ts_tablet_manager.cc:1434] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:16:59.264217 29383 tablet_bootstrap.cc:492] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.265949 29383 tablet_bootstrap.cc:654] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.277456 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_321214072f004f76a346e51f39acde1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.278431 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_321214072f004f76a346e51f39acde1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.281666 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 7b14f846015b4e82b2c3bdebc21b07b9 (DEFAULT_TABLE table=default.Table_6878f9bd771944d8be106fbf847f8baa [id=91adfc411b404fa097607e44707e211c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.282209 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be96f417f6614e569555f37c2838369d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.282786 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c141dde259d44f4c88db5236190259a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.283237 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5135429388f240619dcbdc7dc1a066d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.283682 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159bd65d4f05426d9297ee6755a7ed67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.283787 28953 tablet_service.cc:1511] Processing CreateTablet for tablet a122f01420334404a3ffe711c6f10bf4 (DEFAULT_TABLE table=default.Table_560c145ddbd849009a37389bcd5428eb [id=4bf3d921af9d4bb89d123dad34a6cffa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.284152 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a122f01420334404a3ffe711c6f10bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.284228 30193 raft_consensus.cc:515] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.284863 30193 leader_election.cc:290] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.285080 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39e1b23e6ea843df8d0528f9b427f47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.291882 29092 tablet_service.cc:1511] Processing CreateTablet for tablet a122f01420334404a3ffe711c6f10bf4 (DEFAULT_TABLE table=default.Table_560c145ddbd849009a37389bcd5428eb [id=4bf3d921af9d4bb89d123dad34a6cffa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.292351 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b14f846015b4e82b2c3bdebc21b07b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.295231 30018 consensus_queue.cc:1048] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:16:59.295589 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59a3766053144e6c9ee680f099ff1766 consensus state has no leader
I20260617 20:16:59.299659 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_71381d2e3aa94861a116255689215461" } new_table_name: "default.Table_cf5a1e5db7c2470ab6ad65a7d57777d1" modify_external_catalogs: true
I20260617 20:16:59.304378 28955 tablet_service.cc:1511] Processing CreateTablet for tablet ff2ca88b9ba54931adf1329ea664b5e6 (DEFAULT_TABLE table=default.Table_42197450734d46538ca8460001e86a63 [id=fc499f8db0824acfaf15a78fd5bb2a5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.304771 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2ca88b9ba54931adf1329ea664b5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.307394 29197 leader_election.cc:304] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:59.316171 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_30b5cd8576724dfa808a3b3da40ff3e1" } modify_external_catalogs: true
I20260617 20:16:59.316370 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_30b5cd8576724dfa808a3b3da40ff3e1" } modify_external_catalogs: true
I20260617 20:16:59.318110 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 631) took 1896 ms. Trace:
I20260617 20:16:59.318197 29377 rpcz_store.cc:276] 0617 20:16:57.421355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.421457 (+ 102us) service_pool.cc:224] Handling call
0617 20:16:58.982555 (+1561098us) ts_tablet_manager.cc:1151] Deleting tablet b19bce310bd24294b063b3b4f76b9f99
0617 20:16:58.982564 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.072276 (+ 89712us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.180787 (+108511us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.318087 (+137300us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1560952}
I20260617 20:16:59.318614 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 624) took 1898 ms. Trace:
I20260617 20:16:59.318708 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet b19bce310bd24294b063b3b4f76b9f99 (table default.Table_5716b279b26c4d29a3259333d3661d7d [id=e0633fd70c974a2d8ec482e122a7cd55]) successfully deleted
I20260617 20:16:59.318689 29377 rpcz_store.cc:276] 0617 20:16:57.420637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.420799 (+ 162us) service_pool.cc:224] Handling call
0617 20:16:59.318488 (+1897689us) ts_tablet_manager.cc:1151] Deleting tablet 8d7a76853e334a4081aa8ccc28361aca
0617 20:16:59.318500 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.318597 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1896377}
I20260617 20:16:59.318954 29377 tablet_replica.cc:333] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:59.319124 29377 raft_consensus.cc:2243] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 20:16:59.319114 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 8d7a76853e334a4081aa8ccc28361aca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d7a76853e334a4081aa8ccc28361aca already in progress: creating tablet
I20260617 20:16:59.319259 29377 raft_consensus.cc:2272] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:59.319767 29377 ts_tablet_manager.cc:1916] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:59.324764 30203 raft_consensus.cc:515] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.325767 30203 leader_election.cc:290] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.330988 29104 tablet_service.cc:1511] Processing CreateTablet for tablet ff2ca88b9ba54931adf1329ea664b5e6 (DEFAULT_TABLE table=default.Table_42197450734d46538ca8460001e86a63 [id=fc499f8db0824acfaf15a78fd5bb2a5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.333814 29376 ts_tablet_manager.cc:1929] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:59.334513 29376 log.cc:1199] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/1a725364bb9646e6bc80fc4f67d04a16
I20260617 20:16:59.335179 29376 ts_tablet_manager.cc:1950] T 1a725364bb9646e6bc80fc4f67d04a16 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:16:59.342891 30018 raft_consensus.cc:2804] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:59.343065 30018 raft_consensus.cc:697] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:59.343333 30018 consensus_queue.cc:237] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:59.351018 29062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 433102us
I20260617 20:16:59.357466 30193 raft_consensus.cc:493] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.357640 30193 raft_consensus.cc:515] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.358348 30193 leader_election.cc:290] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.362887 30193 raft_consensus.cc:493] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.363049 30193 raft_consensus.cc:515] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.363670 30193 leader_election.cc:290] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.364140 30193 raft_consensus.cc:493] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.364298 30193 raft_consensus.cc:515] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.364929 30193 leader_election.cc:290] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.369939 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_db8214a5a3c246d294d340b09774568d" } new_table_name: "default.Table_eb1362a8011c49d8979bb821d06c9c4e" modify_external_catalogs: true
I20260617 20:16:59.376106 30193 raft_consensus.cc:493] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.376365 30193 raft_consensus.cc:515] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.377359 30193 leader_election.cc:290] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.379806 29375 ts_tablet_manager.cc:1929] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:16:59.379938 29375 log.cc:1199] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/dd7079ea860149f19227264b8507685b
I20260617 20:16:59.380290 29375 ts_tablet_manager.cc:1950] T dd7079ea860149f19227264b8507685b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:59.380569 30202 raft_consensus.cc:515] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.381162 30202 leader_election.cc:290] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.381333 30202 raft_consensus.cc:493] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.381431 30202 raft_consensus.cc:515] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.381937 30202 leader_election.cc:290] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.382354 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a122f01420334404a3ffe711c6f10bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.385382 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 97541af7c02d46b98106692d92778741 (table default.Table_702d2d2262b845b68b13e005c388d10b [id=f608d4e53a0f4d37af562e6ce53576d8]). Expected version 3 got 0
I20260617 20:16:59.386451 28664 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_702d2d2262b845b68b13e005c388d10b [id=f608d4e53a0f4d37af562e6ce53576d8] alter complete (version 3)
I20260617 20:16:59.386446 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67a3124306094c72ad78e5473aa35bdb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:59.386665 29259 raft_consensus.cc:3060] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.389853 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2ca88b9ba54931adf1329ea664b5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.389786 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e27c5834baa48ed953fccef54e6c52b" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:59.389959 29257 raft_consensus.cc:3060] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.391043 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75519f97f1ce49ceb3a739ba7c7bc239" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:59.391104 29263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97541af7c02d46b98106692d92778741" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:59.391199 29261 raft_consensus.cc:2468] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:59.391573 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet dcd999d88d954e50810cc01b297a27a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 403095586c704ecaa2a9931295bd1330) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.391841 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e6cee209a5a44d6b35eb50e9c33228f" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:59.392212 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9844fab126448895c4c9d4c3c78d76" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:59.392361 29256 raft_consensus.cc:2468] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:16:59.392623 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 159bd65d4f05426d9297ee6755a7ed67 (DEFAULT_TABLE table=default.Table_a0abac57842c430484585d01d659001e [id=2c08c48fb49b49b0bd0fc07ce29b460b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.397053 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2880530e29494f939769447dfb05fd16" } modify_external_catalogs: true
I20260617 20:16:59.397229 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2880530e29494f939769447dfb05fd16" } modify_external_catalogs: true
I20260617 20:16:59.398625 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_08229bcb0d3e45ec991f5946cfc5cfda" } modify_external_catalogs: true
I20260617 20:16:59.398793 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_08229bcb0d3e45ec991f5946cfc5cfda" } modify_external_catalogs: true
I20260617 20:16:59.398852 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 75519f97f1ce49ceb3a739ba7c7bc239 with delete_type TABLET_DATA_DELETED (replaced by tablet c73bdcc1cefd48f3b99e0c059c3a7467) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.401528 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 6f08bdd9c769403db89c20aabdc58d59 (DEFAULT_TABLE table=default.Table_c924b0d8446c4a9a98e9f94a926c3fc9 [id=8877d373152f4476bfc39347d22017a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.401873 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f08bdd9c769403db89c20aabdc58d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.399987 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0323df3b52a24def942d5dfd0ac8892b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.403616 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0323df3b52a24def942d5dfd0ac8892b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.405613 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 647) took 1783 ms. Trace:
I20260617 20:16:59.406140 29376 rpcz_store.cc:276] 0617 20:16:57.622140 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.623689 (+ 1549us) service_pool.cc:224] Handling call
0617 20:16:59.099108 (+1475419us) ts_tablet_manager.cc:1151] Deleting tablet 1a725364bb9646e6bc80fc4f67d04a16
0617 20:16:59.099117 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.203169 (+104052us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.333699 (+130530us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.405579 (+ 71880us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1475251}
I20260617 20:16:59.406579 29376 tablet_replica.cc:333] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:16:59.407030 29106 tablet_service.cc:1511] Processing CreateTablet for tablet d192d11683dc4b558cd3c3f965e657f9 (DEFAULT_TABLE table=default.Table_33c8a66e7ef746d4ad74e64b0e4a656d [id=486950be846f496c94c81caab4b47ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.407685 30296 raft_consensus.cc:2749] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:59.409682 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d192d11683dc4b558cd3c3f965e657f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.419220 30203 raft_consensus.cc:493] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.419572 30203 raft_consensus.cc:515] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.420261 28668 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_7e36e71e8aca4a5e8813c465c31db50a [id=de24e09cee8e4f28998625c2697769b3]). Expected version 1 got 0
I20260617 20:16:59.420502 30203 leader_election.cc:290] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.420607 28668 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:16:59.420924 28668 catalog_manager.cc:5696] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:16:59.421423 28668 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 32c3a4c3bee5444697f5d53d51c62894 (table default.Table_675137d48e694996a1fbfc31e4fd7c9b [id=7a5ce2f1ca114a508611d15c5a7c18c4]). Expected version 2 got 0
W20260617 20:16:59.427603 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 158683us
I20260617 20:16:59.428238 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3014c93d6804f3896f452f041cbedc9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:59.428757 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc36f62aa0bf46278cb84ec8cb7eef55" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:59.429200 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a1c96212014333935ec7f7c92a306c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:16:59.430198 29128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4de5dafb1474de1911148bb3b4527cf" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:16:59.431105 28925 leader_election.cc:343] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:59.431320 28925 leader_election.cc:343] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:59.431485 28925 leader_election.cc:343] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:16:59.431629 28925 leader_election.cc:343] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:16:59.432626 29378 tablet_bootstrap.cc:492] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:59.432765 29378 ts_tablet_manager.cc:1403] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.358s user 0.031s sys 0.049s
I20260617 20:16:59.434600 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 91fac788a74346e28f7b7e5939459325 (DEFAULT_TABLE table=default.Table_307ffbdd67584561a453682d4cda44ca [id=c8141bfc764043759158982ba8d6821f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.435057 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91fac788a74346e28f7b7e5939459325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.435395 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 2b91a692a9c245cc897842ac29c210b3 (DEFAULT_TABLE table=default.Table_6791b989125046d893a9c24ae1e65c12 [id=e495b17f9a99422e9e29cf49befb762a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.435806 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b91a692a9c245cc897842ac29c210b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.438308 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 88ab6fe7319940fcabd315193c51e199
I20260617 20:16:59.438977 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet 663dbe73689d4849a85b68a79ea4062c from {username='slave'} at 127.0.0.1:60552
I20260617 20:16:59.442677 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 88ab6fe7319940fcabd315193c51e199 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.443550 29107 tablet_service.cc:1511] Processing CreateTablet for tablet b002468734394d8181543368ac878c6f (DEFAULT_TABLE table=default.Table_48c2b283a7174f7abb91a866c98b1165 [id=73e0ea6b09e746efb789f6396b4a02a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.443979 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b002468734394d8181543368ac878c6f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:59.457398 28657 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.245.253:38361: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20260617 20:16:59.461506 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5f6435bac04e472c99e81b6e7e9a6012
I20260617 20:16:59.465675 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f6435bac04e472c99e81b6e7e9a6012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.466536 29104 tablet_service.cc:1511] Processing CreateTablet for tablet dc8f02157ae04da7975bf2ee22f549a0 (DEFAULT_TABLE table=default.Table_aead2dfbc56e41b09cb8d70dd31f9fe7 [id=5ced09db636a4865bbb6661928063245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.467119 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 61d5e895c4604795bb49a2ac99afdbf9 (DEFAULT_TABLE table=default.Table_db8214a5a3c246d294d340b09774568d [id=95ab812b28e14b0e9285f3e3bedf77fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.467415 29224 tablet_service.cc:1511] Processing CreateTablet for tablet c141dde259d44f4c88db5236190259a7 (DEFAULT_TABLE table=default.Table_11103f92f9184eae915572b6fcf56089 [id=ba4269f0c0574906ad7b8d7e0fb533d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.467630 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 4885f685cdcd4f01adea4819f09ef51e (DEFAULT_TABLE table=default.Table_489218ed90a3450591befcb0c8064bc7 [id=9f014e9b411e496398d894dc77706d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.468098 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 43462cf7003747d08e6b0e5db5999b3f (DEFAULT_TABLE table=default.Table_d4f8ff9bb47c440b96251b7d063e73f6 [id=b267380ca82144ebbc909227070c204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.468606 29238 tablet_service.cc:1511] Processing CreateTablet for tablet be96f417f6614e569555f37c2838369d (DEFAULT_TABLE table=default.Table_d98a23fa3bd844be97030f42b77ce612 [id=fce0f344d79e48c791907e51536847d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.469039 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8f02157ae04da7975bf2ee22f549a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.469430 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d5e895c4604795bb49a2ac99afdbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.469607 29243 tablet_service.cc:1511] Processing CreateTablet for tablet 5135429388f240619dcbdc7dc1a066d1 (DEFAULT_TABLE table=default.Table_35da9942c88b483c842bd60a4e136618 [id=0484fe618c604fc6ae5cf909437940b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.472363 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 39e1b23e6ea843df8d0528f9b427f47f (DEFAULT_TABLE table=default.Table_e4eb4ddc78ad49f8b8b28c441d0ca39f [id=ea076d1ff6b74b85b228164033b35451]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.473685 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 607) took 2635 ms. Trace:
I20260617 20:16:59.473784 29375 rpcz_store.cc:276] 0617 20:16:56.837777 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.840503 (+ 2726us) service_pool.cc:224] Handling call
0617 20:16:59.181581 (+2341078us) ts_tablet_manager.cc:1151] Deleting tablet dd7079ea860149f19227264b8507685b
0617 20:16:59.181588 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.281031 (+ 99443us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.379741 (+ 98710us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.473649 (+ 93908us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2340910}
I20260617 20:16:59.474215 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 612) took 2619 ms. Trace:
I20260617 20:16:59.474311 29375 rpcz_store.cc:276] 0617 20:16:56.854926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.854982 (+ 56us) service_pool.cc:224] Handling call
0617 20:16:59.474062 (+2619080us) ts_tablet_manager.cc:1151] Deleting tablet 269d2bb9f1fd45f89ab765b33a502baf
0617 20:16:59.474072 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.474172 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2618891}
I20260617 20:16:59.474659 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 613) took 2564 ms. Trace:
I20260617 20:16:59.474748 29375 rpcz_store.cc:276] 0617 20:16:56.910264 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:56.910351 (+ 87us) service_pool.cc:224] Handling call
0617 20:16:59.474537 (+2564186us) ts_tablet_manager.cc:1151] Deleting tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac
0617 20:16:59.474545 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.474624 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2564022}
I20260617 20:16:59.474982 29375 tablet_replica.cc:333] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:16:59.475163 29375 raft_consensus.cc:2243] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:59.475334 29375 raft_consensus.cc:2272] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:59.475893 29375 ts_tablet_manager.cc:1916] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:16:59.478281 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4885f685cdcd4f01adea4819f09ef51e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.479667 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39e1b23e6ea843df8d0528f9b427f47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.480280 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5135429388f240619dcbdc7dc1a066d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.480734 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 159bd65d4f05426d9297ee6755a7ed67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.481154 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be96f417f6614e569555f37c2838369d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.483506 29257 raft_consensus.cc:2468] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:59.483956 29377 ts_tablet_manager.cc:1929] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:59.484072 29377 log.cc:1199] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/0e6cee209a5a44d6b35eb50e9c33228f
I20260617 20:16:59.484378 29377 ts_tablet_manager.cc:1950] T 0e6cee209a5a44d6b35eb50e9c33228f P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:59.484784 29376 raft_consensus.cc:2243] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:59.485185 29376 raft_consensus.cc:2272] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:59.485751 29376 ts_tablet_manager.cc:1916] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:59.486002 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5bf67f3f62714cd3bb9cce3f207cc3b8 consensus state has no leader
I20260617 20:16:59.490046 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43462cf7003747d08e6b0e5db5999b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.490329 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fbd010547fdb4650b1d982bc400ade26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.490971 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbd010547fdb4650b1d982bc400ade26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.493862 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c141dde259d44f4c88db5236190259a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.497186 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 7b14f846015b4e82b2c3bdebc21b07b9 (DEFAULT_TABLE table=default.Table_6878f9bd771944d8be106fbf847f8baa [id=91adfc411b404fa097607e44707e211c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.498219 29240 tablet_service.cc:1511] Processing CreateTablet for tablet ff2ca88b9ba54931adf1329ea664b5e6 (DEFAULT_TABLE table=default.Table_42197450734d46538ca8460001e86a63 [id=fc499f8db0824acfaf15a78fd5bb2a5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.498728 28661 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet b8d539a22c5d4fecae54c322297eb1a2
I20260617 20:16:59.498786 29243 tablet_service.cc:1511] Processing CreateTablet for tablet a122f01420334404a3ffe711c6f10bf4 (DEFAULT_TABLE table=default.Table_560c145ddbd849009a37389bcd5428eb [id=4bf3d921af9d4bb89d123dad34a6cffa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.501441 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 6f08bdd9c769403db89c20aabdc58d59 (DEFAULT_TABLE table=default.Table_c924b0d8446c4a9a98e9f94a926c3fc9 [id=8877d373152f4476bfc39347d22017a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.502626 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_712380b8c25e4e81a05694199000e983" } new_table_name: "default.Table_6f988db656bc49f9b1dede83c87d1795" modify_external_catalogs: true
I20260617 20:16:59.502622 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet dd7079ea860149f19227264b8507685b (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]) successfully deleted
W20260617 20:16:59.503888 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 269d2bb9f1fd45f89ab765b33a502baf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 269d2bb9f1fd45f89ab765b33a502baf already in progress: creating tablet
I20260617 20:16:59.504061 30202 consensus_queue.cc:1048] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:16:59.504216 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac already in progress: creating tablet
I20260617 20:16:59.505004 29378 raft_consensus.cc:359] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.505264 29378 raft_consensus.cc:385] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.505406 29378 raft_consensus.cc:740] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.505802 29378 consensus_queue.cc:260] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.506485 29378 ts_tablet_manager.cc:1434] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.074s user 0.003s sys 0.000s
I20260617 20:16:59.508767 29378 tablet_bootstrap.cc:492] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:59.510378 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61d5e895c4604795bb49a2ac99afdbf9 consensus state has no leader
I20260617 20:16:59.510937 29378 tablet_bootstrap.cc:654] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.512498 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3ad8de250a47da9c9a31dff7f495b5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:16:59.512697 28990 raft_consensus.cc:3060] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.516852 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d71ffcb31abf48718dffc393996e7ebd" } new_table_name: "default.Table_3efde5426d164371bad188299aea42a3" modify_external_catalogs: true
I20260617 20:16:59.516953 29107 tablet_service.cc:1511] Processing CreateTablet for tablet d123638c3d384630b367ac3fd209caba (DEFAULT_TABLE table=default.Table_5927f45d8048449fa563d499f1df55a7 [id=af163181d9af4bfbb34871d76855800a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.522302 29095 tablet_service.cc:1511] Processing CreateTablet for tablet a9f9d4701a8b469b90dbb2ccacff121a (DEFAULT_TABLE table=default.Table_874c5733c8264dda8206652cd4019646 [id=c98f3dd0bba745a8949f2742d8917003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.526433 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 6d84e71b70d2486ab3658fc4e7d56286 (DEFAULT_TABLE table=default.Table_e260ca83764a418697982bac8c69b880 [id=e7190b334ac442dbaf3eaca387972445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.526867 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 7f239f81c40743b2aaa70a361997db77
I20260617 20:16:59.528872 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f239f81c40743b2aaa70a361997db77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.532927 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 672aba4228fc44ef9cea80dd6f07c3c9 (DEFAULT_TABLE table=default.Table_39641ab506b845759f012df286383321 [id=c3b8272c0a664a97878487a63f309f6f]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:16:59.534036 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 102242us
I20260617 20:16:59.534071 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_487f14a2a0554f68af6b03801e647fac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.534658 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_487f14a2a0554f68af6b03801e647fac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.534696 30305 tablet.cc:1724] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:16:59.535123 29126 raft_consensus.cc:3060] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.535277 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffbd145b8cc49fb99ed5eb544d17c41 (DEFAULT_TABLE table=default.Table_c355818357334e2b98c839a655ef35eb [id=d3cd825ca5b742e4be6b655a235b7185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.540119 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet fc36f62aa0bf46278cb84ec8cb7eef55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.540771 29233 tablet_service.cc:1511] Processing CreateTablet for tablet d192d11683dc4b558cd3c3f965e657f9 (DEFAULT_TABLE table=default.Table_33c8a66e7ef746d4ad74e64b0e4a656d [id=486950be846f496c94c81caab4b47ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.541500 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 91fac788a74346e28f7b7e5939459325 (DEFAULT_TABLE table=default.Table_307ffbdd67584561a453682d4cda44ca [id=c8141bfc764043759158982ba8d6821f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.542183 29230 tablet_service.cc:1511] Processing CreateTablet for tablet b002468734394d8181543368ac878c6f (DEFAULT_TABLE table=default.Table_48c2b283a7174f7abb91a866c98b1165 [id=73e0ea6b09e746efb789f6396b4a02a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.542675 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 88ab6fe7319940fcabd315193c51e199 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.543323 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 2b91a692a9c245cc897842ac29c210b3 (DEFAULT_TABLE table=default.Table_6791b989125046d893a9c24ae1e65c12 [id=e495b17f9a99422e9e29cf49befb762a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.544077 29241 tablet_service.cc:1511] Processing CreateTablet for tablet dc8f02157ae04da7975bf2ee22f549a0 (DEFAULT_TABLE table=default.Table_aead2dfbc56e41b09cb8d70dd31f9fe7 [id=5ced09db636a4865bbb6661928063245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.544992 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f6435bac04e472c99e81b6e7e9a6012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.545580 29225 tablet_service.cc:1511] Processing CreateTablet for tablet d123638c3d384630b367ac3fd209caba (DEFAULT_TABLE table=default.Table_5927f45d8048449fa563d499f1df55a7 [id=af163181d9af4bfbb34871d76855800a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.546363 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5806949c371b41b0a162a4c8cbf6b435
I20260617 20:16:59.546294 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 61d5e895c4604795bb49a2ac99afdbf9 (DEFAULT_TABLE table=default.Table_db8214a5a3c246d294d340b09774568d [id=95ab812b28e14b0e9285f3e3bedf77fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.547024 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 4885f685cdcd4f01adea4819f09ef51e (DEFAULT_TABLE table=default.Table_489218ed90a3450591befcb0c8064bc7 [id=9f014e9b411e496398d894dc77706d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.547834 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 43462cf7003747d08e6b0e5db5999b3f (DEFAULT_TABLE table=default.Table_d4f8ff9bb47c440b96251b7d063e73f6 [id=b267380ca82144ebbc909227070c204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.548520 29235 tablet_service.cc:1511] Processing CreateTablet for tablet a9f9d4701a8b469b90dbb2ccacff121a (DEFAULT_TABLE table=default.Table_874c5733c8264dda8206652cd4019646 [id=c98f3dd0bba745a8949f2742d8917003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.549016 29236 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f239f81c40743b2aaa70a361997db77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.549573 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 6d84e71b70d2486ab3658fc4e7d56286 (DEFAULT_TABLE table=default.Table_e260ca83764a418697982bac8c69b880 [id=e7190b334ac442dbaf3eaca387972445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.549885 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 5806949c371b41b0a162a4c8cbf6b435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.550254 29239 tablet_service.cc:1511] Processing CreateTablet for tablet 672aba4228fc44ef9cea80dd6f07c3c9 (DEFAULT_TABLE table=default.Table_39641ab506b845759f012df286383321 [id=c3b8272c0a664a97878487a63f309f6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.550966 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffbd145b8cc49fb99ed5eb544d17c41 (DEFAULT_TABLE table=default.Table_c355818357334e2b98c839a655ef35eb [id=d3cd825ca5b742e4be6b655a235b7185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.550875 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f168b2e932084d149c71a4b87f021c3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.551573 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f168b2e932084d149c71a4b87f021c3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.553089 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5 (DEFAULT_TABLE table=default.Table_cdca7e869e14460f90d0a273c55a4670 [id=63f22250feda4b1f82244a3ecdce61c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.555727 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 6f08bdd9c769403db89c20aabdc58d59 (DEFAULT_TABLE table=default.Table_c924b0d8446c4a9a98e9f94a926c3fc9 [id=8877d373152f4476bfc39347d22017a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.555814 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet f4de5dafb1474de1911148bb3b4527cf with delete_type TABLET_DATA_DELETED (replaced by tablet e7eb77c619e04c448a084638668dbb6a) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.556118 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f08bdd9c769403db89c20aabdc58d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.556288 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 91fac788a74346e28f7b7e5939459325 (DEFAULT_TABLE table=default.Table_307ffbdd67584561a453682d4cda44ca [id=c8141bfc764043759158982ba8d6821f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.556579 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91fac788a74346e28f7b7e5939459325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.558025 29378 tablet_bootstrap.cc:492] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:59.558169 29378 ts_tablet_manager.cc:1403] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20260617 20:16:59.559240 29378 raft_consensus.cc:359] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.559458 29378 raft_consensus.cc:385] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.559518 29378 raft_consensus.cc:740] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.559485 28957 tablet_service.cc:1511] Processing CreateTablet for tablet d192d11683dc4b558cd3c3f965e657f9 (DEFAULT_TABLE table=default.Table_33c8a66e7ef746d4ad74e64b0e4a656d [id=486950be846f496c94c81caab4b47ce9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.559805 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d192d11683dc4b558cd3c3f965e657f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.559757 29378 consensus_queue.cc:260] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.559834 28959 tablet_service.cc:1511] Processing CreateTablet for tablet b002468734394d8181543368ac878c6f (DEFAULT_TABLE table=default.Table_48c2b283a7174f7abb91a866c98b1165 [id=73e0ea6b09e746efb789f6396b4a02a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.560120 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b002468734394d8181543368ac878c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.560371 29378 ts_tablet_manager.cc:1434] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:16:59.562769 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.562903 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 88ab6fe7319940fcabd315193c51e199 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.563308 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 2b91a692a9c245cc897842ac29c210b3 (DEFAULT_TABLE table=default.Table_6791b989125046d893a9c24ae1e65c12 [id=e495b17f9a99422e9e29cf49befb762a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.563632 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b91a692a9c245cc897842ac29c210b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.568535 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f6435bac04e472c99e81b6e7e9a6012 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.568629 28963 tablet_service.cc:1511] Processing CreateTablet for tablet dc8f02157ae04da7975bf2ee22f549a0 (DEFAULT_TABLE table=default.Table_aead2dfbc56e41b09cb8d70dd31f9fe7 [id=5ced09db636a4865bbb6661928063245]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.569000 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8f02157ae04da7975bf2ee22f549a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.569046 28969 tablet_service.cc:1511] Processing CreateTablet for tablet d123638c3d384630b367ac3fd209caba (DEFAULT_TABLE table=default.Table_5927f45d8048449fa563d499f1df55a7 [id=af163181d9af4bfbb34871d76855800a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.569339 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d123638c3d384630b367ac3fd209caba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.571954 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 7ecc4b5e866945b1aec9e4a84cf360ff (DEFAULT_TABLE table=default.Table_e271ce7263b74cbfadbee5ec752a965d [id=f3ff33ab728e488a802d626b5dff181d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.572384 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 61d5e895c4604795bb49a2ac99afdbf9 (DEFAULT_TABLE table=default.Table_db8214a5a3c246d294d340b09774568d [id=95ab812b28e14b0e9285f3e3bedf77fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.572688 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d5e895c4604795bb49a2ac99afdbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.574352 30341 tablet.cc:1724] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:16:59.575999 29379 tablet_bootstrap.cc:492] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:16:59.576107 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 4885f685cdcd4f01adea4819f09ef51e (DEFAULT_TABLE table=default.Table_489218ed90a3450591befcb0c8064bc7 [id=9f014e9b411e496398d894dc77706d04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.576442 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4885f685cdcd4f01adea4819f09ef51e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.577586 29379 ts_tablet_manager.cc:1403] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.371s user 0.030s sys 0.078s
I20260617 20:16:59.579707 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 625) took 2158 ms. Trace:
I20260617 20:16:59.579780 29377 rpcz_store.cc:276] 0617 20:16:57.420757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.422226 (+ 1469us) service_pool.cc:224] Handling call
0617 20:16:59.318913 (+1896687us) ts_tablet_manager.cc:1151] Deleting tablet 0e6cee209a5a44d6b35eb50e9c33228f
0617 20:16:59.318922 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.386941 (+ 68019us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.483884 (+ 96943us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.579684 (+ 95800us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1896467}
I20260617 20:16:59.580197 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 632) took 2137 ms. Trace:
I20260617 20:16:59.580277 29377 rpcz_store.cc:276] 0617 20:16:57.442332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.442396 (+ 64us) service_pool.cc:224] Handling call
0617 20:16:59.580080 (+2137684us) ts_tablet_manager.cc:1151] Deleting tablet 6c0aa4861a51488db2d1a7041c25ae22
0617 20:16:59.580089 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.580183 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2137492}
I20260617 20:16:59.580646 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 43462cf7003747d08e6b0e5db5999b3f (DEFAULT_TABLE table=default.Table_d4f8ff9bb47c440b96251b7d063e73f6 [id=b267380ca82144ebbc909227070c204e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.582329 28960 tablet_service.cc:1511] Processing CreateTablet for tablet a9f9d4701a8b469b90dbb2ccacff121a (DEFAULT_TABLE table=default.Table_874c5733c8264dda8206652cd4019646 [id=c98f3dd0bba745a8949f2742d8917003]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.582840 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 6d84e71b70d2486ab3658fc4e7d56286 (DEFAULT_TABLE table=default.Table_e260ca83764a418697982bac8c69b880 [id=e7190b334ac442dbaf3eaca387972445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.583206 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f239f81c40743b2aaa70a361997db77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.583637 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 672aba4228fc44ef9cea80dd6f07c3c9 (DEFAULT_TABLE table=default.Table_39641ab506b845759f012df286383321 [id=c3b8272c0a664a97878487a63f309f6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.584120 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 1ffbd145b8cc49fb99ed5eb544d17c41 (DEFAULT_TABLE table=default.Table_c355818357334e2b98c839a655ef35eb [id=d3cd825ca5b742e4be6b655a235b7185]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.584618 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5 (DEFAULT_TABLE table=default.Table_cdca7e869e14460f90d0a273c55a4670 [id=63f22250feda4b1f82244a3ecdce61c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.584985 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 5806949c371b41b0a162a4c8cbf6b435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.585536 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 7ecc4b5e866945b1aec9e4a84cf360ff (DEFAULT_TABLE table=default.Table_e271ce7263b74cbfadbee5ec752a965d [id=f3ff33ab728e488a802d626b5dff181d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.591856 29063 leader_election.cc:304] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:59.593263 29259 raft_consensus.cc:2468] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:16:59.593870 29377 tablet_replica.cc:333] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:16:59.594094 29377 raft_consensus.cc:2243] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:16:59.594283 29377 raft_consensus.cc:2272] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:16:59.594458 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1404d8949a194779a7fe937bc4857a4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:59.594835 29377 ts_tablet_manager.cc:1916] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:16:59.595028 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1404d8949a194779a7fe937bc4857a4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.597229 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 9dad85a23c0a45218fcd6ac04c12831a (DEFAULT_TABLE table=default.Table_b5d227c61e734225b76fd057b7ad9b96 [id=4cb0ef24b723455aacc2dc61526886d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.598861 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ecc4b5e866945b1aec9e4a84cf360ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.601728 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43462cf7003747d08e6b0e5db5999b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.602722 29378 tablet_bootstrap.cc:492] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:59.606510 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f9d4701a8b469b90dbb2ccacff121a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.606667 28663 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 086bd3079e8f4a6d85ccc681a38a47b0 (table default.Table_87c7eb0a5f3843a4ae45931a17a7b234 [id=cb568e8af2da4807b99a6d07c57afca9]). Expected version 3 got 0
I20260617 20:16:59.606894 28663 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:16:59.609537 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d84e71b70d2486ab3658fc4e7d56286. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:59.610347 28654 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet dd8a7096a09147789ac203c150a19419 consensus state has no leader
I20260617 20:16:59.611855 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 1a725364bb9646e6bc80fc4f67d04a16 (table default.Table_8c70a2be0e4b406880787a57850701ca [id=a8259ff095ae4a3e99259235698d998f]) successfully deleted
I20260617 20:16:59.612957 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 672aba4228fc44ef9cea80dd6f07c3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.612870 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_53b5071e49a2403a9045e136cfafa85b" } new_table_name: "default.Table_75e979e8d7bd46d29cf374e5f594e095" modify_external_catalogs: true
I20260617 20:16:59.614347 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_bd0b72adbbe6450ea5af79b717033ff7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.614912 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd0b72adbbe6450ea5af79b717033ff7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.616225 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dad85a23c0a45218fcd6ac04c12831a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.616190 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b1dbf26dd897427fb16163fa330af154"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.616703 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1dbf26dd897427fb16163fa330af154 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.620862 28986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97541af7c02d46b98106692d92778741" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:59.621742 29383 tablet_bootstrap.cc:492] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.621927 29383 ts_tablet_manager.cc:1403] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.358s user 0.045s sys 0.055s
I20260617 20:16:59.622303 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 0e6cee209a5a44d6b35eb50e9c33228f (table default.Table_81cf092bd1634c3a82380616f225e4d6 [id=313f374332bf42b5bafbd20afd819a30]) successfully deleted
W20260617 20:16:59.622768 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 6c0aa4861a51488db2d1a7041c25ae22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c0aa4861a51488db2d1a7041c25ae22 already in progress: creating tablet
I20260617 20:16:59.622833 29383 raft_consensus.cc:359] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.623044 29383 raft_consensus.cc:385] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.623018 30296 raft_consensus.cc:2804] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:59.623099 29383 raft_consensus.cc:740] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.623159 30296 raft_consensus.cc:493] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:59.623274 30296 raft_consensus.cc:3060] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.623303 29383 consensus_queue.cc:260] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:59.623593 29062 leader_election.cc:343] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 67a3124306094c72ad78e5473aa35bdb
I20260617 20:16:59.623770 29383 ts_tablet_manager.cc:1434] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:16:59.623880 29379 raft_consensus.cc:359] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.624068 29383 tablet_bootstrap.cc:492] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.624061 29379 raft_consensus.cc:385] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.624145 29379 raft_consensus.cc:740] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.624374 29379 consensus_queue.cc:260] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:16:59.624445 29062 leader_election.cc:343] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 4e27c5834baa48ed953fccef54e6c52b
I20260617 20:16:59.624886 29379 ts_tablet_manager.cc:1434] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.047s user 0.001s sys 0.001s
I20260617 20:16:59.625187 29379 tablet_bootstrap.cc:492] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:16:59.625314 29383 tablet_bootstrap.cc:654] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.625353 29063 leader_election.cc:304] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:59.625941 30117 raft_consensus.cc:2804] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:59.626050 30117 raft_consensus.cc:493] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:59.626152 30117 raft_consensus.cc:3060] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.629103 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 663dbe73689d4849a85b68a79ea4062c
I20260617 20:16:59.629377 29383 tablet_bootstrap.cc:492] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.629492 29383 ts_tablet_manager.cc:1403] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260617 20:16:59.629683 28662 catalog_manager.cc:6784] ReplaceTablet: tablet 663dbe73689d4849a85b68a79ea4062c deleted and replaced by tablet 4372081172384c9f96388d38208d9853
I20260617 20:16:59.629283 28990 raft_consensus.cc:2468] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:16:59.630251 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 663dbe73689d4849a85b68a79ea4062c with delete_type TABLET_DATA_DELETED (replaced by tablet 4372081172384c9f96388d38208d9853) from {username='slave'} at 127.0.0.1:43332
I20260617 20:16:59.632316 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffbd145b8cc49fb99ed5eb544d17c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.633482 29378 tablet_bootstrap.cc:654] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.634629 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1cd67e2f494841bb87d2fb5d340241d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.635193 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cd67e2f494841bb87d2fb5d340241d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.635411 29383 raft_consensus.cc:359] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:59.635648 29383 raft_consensus.cc:385] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.635706 29383 raft_consensus.cc:740] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.635924 29383 consensus_queue.cc:260] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:59.636655 29383 ts_tablet_manager.cc:1434] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 20:16:59.636971 29383 tablet_bootstrap.cc:492] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.637707 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.638616 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet 663dbe73689d4849a85b68a79ea4062c with delete_type TABLET_DATA_DELETED (replaced by tablet 4372081172384c9f96388d38208d9853) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.638898 29383 tablet_bootstrap.cc:654] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.640883 30248 raft_consensus.cc:493] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.640988 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a1c96212014333935ec7f7c92a306c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.641041 30248 raft_consensus.cc:515] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.641788 30248 leader_election.cc:290] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:59.643307 30248 raft_consensus.cc:493] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.643455 30248 raft_consensus.cc:515] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.644109 30248 leader_election.cc:290] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:59.645419 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3014c93d6804f3896f452f041cbedc9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:59.645573 29259 raft_consensus.cc:3060] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.647210 30332 consensus_queue.cc:1048] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:59.648012 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc36f62aa0bf46278cb84ec8cb7eef55" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:59.648172 29257 raft_consensus.cc:3060] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:16:59.648234 29197 consensus_peers.cc:597] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8d373f177494f1486fcae4a67a13041. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:59.650496 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:16:59.653210 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a39fd5d8d0904a738db01e4866ba504f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:16:59.654016 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a39fd5d8d0904a738db01e4866ba504f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.657367 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb with delete_type TABLET_DATA_DELETED (replaced by tablet 77f685eeac48402888cbc8ef97fb4b94) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.657858 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet b4240e14b48f4a43b7ce9c6512fc7ff2 with delete_type TABLET_DATA_DELETED (replaced by tablet cb8f218e9f2d44bfbfd843ac8517a152) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.648510 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a1c96212014333935ec7f7c92a306c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:59.662001 29256 raft_consensus.cc:2468] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:59.648710 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4de5dafb1474de1911148bb3b4527cf" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:59.662309 29260 raft_consensus.cc:2468] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
W20260617 20:16:59.662593 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3369727329a74fa5bab98deb507f0d06 consensus state has no leader
I20260617 20:16:59.667423 28925 leader_election.cc:304] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:59.667908 30332 raft_consensus.cc:2804] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:59.667990 30332 raft_consensus.cc:493] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:59.668064 30332 raft_consensus.cc:3060] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.672797 30248 raft_consensus.cc:493] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.672979 30248 raft_consensus.cc:515] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.673732 30248 leader_election.cc:290] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:59.674405 28925 leader_election.cc:304] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:59.674916 30202 raft_consensus.cc:2804] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:59.675009 30202 raft_consensus.cc:493] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:59.675083 30202 raft_consensus.cc:3060] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.676494 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b38397bd90c94aa5ab36026db378ccd8" } modify_external_catalogs: true
I20260617 20:16:59.676733 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b38397bd90c94aa5ab36026db378ccd8" } modify_external_catalogs: true
W20260617 20:16:59.686753 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48cfb5fe21bc477cab8df011b6bee2d5 consensus state has no leader
I20260617 20:16:59.691330 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0323df3b52a24def942d5dfd0ac8892b" } modify_external_catalogs: true
I20260617 20:16:59.691560 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0323df3b52a24def942d5dfd0ac8892b" } modify_external_catalogs: true
I20260617 20:16:59.691999 30332 raft_consensus.cc:515] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.693037 30332 leader_election.cc:290] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.697113 29383 tablet_bootstrap.cc:492] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.697347 29383 ts_tablet_manager.cc:1403] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.060s user 0.010s sys 0.005s
I20260617 20:16:59.698293 29383 raft_consensus.cc:359] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.699265 29378 tablet_bootstrap.cc:492] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:59.699604 29378 ts_tablet_manager.cc:1403] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.097s user 0.000s sys 0.013s
I20260617 20:16:59.700750 29378 raft_consensus.cc:359] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.701076 29383 raft_consensus.cc:385] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.701203 29383 raft_consensus.cc:740] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.701740 29383 consensus_queue.cc:260] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.702636 29383 ts_tablet_manager.cc:1434] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:16:59.702795 29378 raft_consensus.cc:385] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.703240 29383 tablet_bootstrap.cc:492] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.703361 29378 raft_consensus.cc:740] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.703804 29378 consensus_queue.cc:260] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.705261 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9f2d0c2b8bf04f54b37f0d9a0fb8358f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:16:59.705952 29383 tablet_bootstrap.cc:654] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:16:59.706174 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f2d0c2b8bf04f54b37f0d9a0fb8358f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:16:59.708755 29378 ts_tablet_manager.cc:1434] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260617 20:16:59.713083 29383 tablet_bootstrap.cc:492] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.713222 29383 ts_tablet_manager.cc:1403] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260617 20:16:59.714084 29383 raft_consensus.cc:359] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.715929 29383 raft_consensus.cc:385] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.716197 29383 raft_consensus.cc:740] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.716614 29383 consensus_queue.cc:260] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.717867 29383 ts_tablet_manager.cc:1434] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260617 20:16:59.718700 29383 tablet_bootstrap.cc:492] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.719810 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b14f846015b4e82b2c3bdebc21b07b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.720096 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b91a692a9c245cc897842ac29c210b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.733186 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc8f02157ae04da7975bf2ee22f549a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.733558 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a122f01420334404a3ffe711c6f10bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.734102 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2ca88b9ba54931adf1329ea664b5e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.734526 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91fac788a74346e28f7b7e5939459325. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.735132 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43462cf7003747d08e6b0e5db5999b3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.735569 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61d5e895c4604795bb49a2ac99afdbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.735795 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b002468734394d8181543368ac878c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.736186 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d123638c3d384630b367ac3fd209caba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.736403 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4885f685cdcd4f01adea4819f09ef51e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.736465 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6cb2486917764383bc50fe8b80d84a07" } new_table_name: "default.Table_eddd37adcac449fdafd97ff4e5f726ea" modify_external_catalogs: true
I20260617 20:16:59.737908 28953 tablet_service.cc:1558] Processing DeleteTablet for tablet cf8d04ef8acd4fcaa69df9253cd89462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:16:59.741597 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffbd145b8cc49fb99ed5eb544d17c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.742327 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f9d4701a8b469b90dbb2ccacff121a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.742988 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d192d11683dc4b558cd3c3f965e657f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.743453 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 672aba4228fc44ef9cea80dd6f07c3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.743599 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d84e71b70d2486ab3658fc4e7d56286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.744038 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f08bdd9c769403db89c20aabdc58d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.714202 29259 raft_consensus.cc:2468] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:59.754029 28925 leader_election.cc:304] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:59.755532 30332 raft_consensus.cc:2804] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:59.755977 30332 raft_consensus.cc:697] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:59.756327 30332 consensus_queue.cc:237] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.757833 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a1c96212014333935ec7f7c92a306c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:59.758087 29259 raft_consensus.cc:3060] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.760286 30201 consensus_queue.cc:1048] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:16:59.761480 29378 tablet_bootstrap.cc:492] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:59.763114 29378 tablet_bootstrap.cc:654] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.774950 29197 leader_election.cc:304] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:59.775380 30248 raft_consensus.cc:2804] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:59.775525 30248 raft_consensus.cc:697] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:16:59.775774 30248 consensus_queue.cc:237] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.778666 29378 tablet_bootstrap.cc:492] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:59.778861 29378 ts_tablet_manager.cc:1403] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.009s
I20260617 20:16:59.778931 30202 raft_consensus.cc:515] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.779489 30202 leader_election.cc:290] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.779742 29378 raft_consensus.cc:359] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.779930 29378 raft_consensus.cc:385] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.779984 29378 raft_consensus.cc:740] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.780182 29378 consensus_queue.cc:260] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.781320 29378 ts_tablet_manager.cc:1434] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:16:59.781699 29378 tablet_bootstrap.cc:492] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:59.783514 29378 tablet_bootstrap.cc:654] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.791169 28986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a1c96212014333935ec7f7c92a306c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:59.791433 28986 raft_consensus.cc:2393] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 5ca3d93189744132bbf55ac01f3a8254 in this term.
I20260617 20:16:59.792363 29378 tablet_bootstrap.cc:492] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:59.792770 29378 ts_tablet_manager.cc:1403] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260617 20:16:59.793752 29378 raft_consensus.cc:359] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:59.794879 29378 raft_consensus.cc:385] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.795086 29378 raft_consensus.cc:740] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.795528 29378 consensus_queue.cc:260] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:16:59.796679 29378 ts_tablet_manager.cc:1434] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 20:16:59.796696 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 5806949c371b41b0a162a4c8cbf6b435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:16:59.797118 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5 (DEFAULT_TABLE table=default.Table_cdca7e869e14460f90d0a273c55a4670 [id=63f22250feda4b1f82244a3ecdce61c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.797610 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.797678 29378 tablet_bootstrap.cc:492] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:16:59.800565 30357 log.cc:927] Time spent T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
I20260617 20:16:59.802667 29378 tablet_bootstrap.cc:654] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.802954 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4de5dafb1474de1911148bb3b4527cf" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:59.803131 29256 raft_consensus.cc:3060] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.804678 29257 raft_consensus.cc:2468] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:59.805119 28925 leader_election.cc:304] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:16:59.805512 30202 raft_consensus.cc:2804] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:59.805636 30202 raft_consensus.cc:697] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:59.805899 30202 consensus_queue.cc:237] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.812852 30253 raft_consensus.cc:493] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.812999 30253 raft_consensus.cc:515] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.813637 30253 leader_election.cc:290] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:59.815327 29378 tablet_bootstrap.cc:492] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:16:59.815469 29378 ts_tablet_manager.cc:1403] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.004s
I20260617 20:16:59.818248 29378 raft_consensus.cc:359] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.818423 29378 raft_consensus.cc:385] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.818483 29378 raft_consensus.cc:740] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.818662 29378 consensus_queue.cc:260] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.820895 29378 ts_tablet_manager.cc:1434] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260617 20:16:59.822881 29378 tablet_bootstrap.cc:492] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:16:59.825702 29378 tablet_bootstrap.cc:654] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.825732 28986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4de5dafb1474de1911148bb3b4527cf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:59.825879 29383 tablet_bootstrap.cc:654] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.825948 28986 raft_consensus.cc:2393] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 5ca3d93189744132bbf55ac01f3a8254 in this term.
I20260617 20:16:59.837965 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d123638c3d384630b367ac3fd209caba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.848363 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 9dad85a23c0a45218fcd6ac04c12831a (DEFAULT_TABLE table=default.Table_b5d227c61e734225b76fd057b7ad9b96 [id=4cb0ef24b723455aacc2dc61526886d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.848737 29063 leader_election.cc:304] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:16:59.849151 30193 raft_consensus.cc:2804] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
W20260617 20:16:59.849318 29062 consensus_peers.cc:597] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:59.849414 30296 raft_consensus.cc:515] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.850275 30253 raft_consensus.cc:493] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.850430 30253 raft_consensus.cc:515] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.851095 30253 leader_election.cc:290] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:16:59.852672 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 672aba4228fc44ef9cea80dd6f07c3c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:59.853541 29062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 215371us
I20260617 20:16:59.855219 30193 raft_consensus.cc:697] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
W20260617 20:16:59.855564 29063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 221088us
I20260617 20:16:59.856300 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75519f97f1ce49ceb3a739ba7c7bc239" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:16:59.856498 29258 raft_consensus.cc:3060] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.861318 30296 leader_election.cc:290] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.864861 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ffbd145b8cc49fb99ed5eb544d17c41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.865231 30253 raft_consensus.cc:493] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.865398 30253 raft_consensus.cc:515] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.867951 30253 leader_election.cc:290] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:16:59.872177 30332 raft_consensus.cc:493] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.872337 30332 raft_consensus.cc:515] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.873492 30332 leader_election.cc:290] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.874187 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ea9cfa1c5a42359e5fa8a2c4c433a4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:16:59.874383 29257 raft_consensus.cc:2468] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:16:59.874786 28925 leader_election.cc:304] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:59.875890 30332 raft_consensus.cc:2804] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:16:59.876036 30332 raft_consensus.cc:493] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:16:59.876168 30332 raft_consensus.cc:3060] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.877419 30294 raft_consensus.cc:493] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.877580 30193 consensus_queue.cc:237] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.877976 29383 tablet_bootstrap.cc:492] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:16:59.878201 29383 ts_tablet_manager.cc:1403] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.160s user 0.007s sys 0.004s
W20260617 20:16:59.878533 29062 leader_election.cc:343] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 0e6cee209a5a44d6b35eb50e9c33228f
I20260617 20:16:59.879629 29377 ts_tablet_manager.cc:1929] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:16:59.879726 29377 log.cc:1199] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/5e53946c85ab4a8286a6e174cc411c5e
I20260617 20:16:59.881349 29383 raft_consensus.cc:359] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.881875 29383 raft_consensus.cc:385] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:16:59.882030 29383 raft_consensus.cc:740] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:16:59.892315 29259 raft_consensus.cc:2468] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:59.893436 28925 leader_election.cc:304] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:59.899793 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d84e71b70d2486ab3658fc4e7d56286. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.903759 30117 raft_consensus.cc:515] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.903780 30294 raft_consensus.cc:515] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.904608 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dad85a23c0a45218fcd6ac04c12831a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.903765 29375 ts_tablet_manager.cc:1929] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:16:59.903802 29062 leader_election.cc:304] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:59.910974 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4de5dafb1474de1911148bb3b4527cf" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:59.912204 29124 raft_consensus.cc:3060] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:16:59.912526 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a1c96212014333935ec7f7c92a306c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:16:59.913409 29099 tablet_service.cc:1511] Processing CreateTablet for tablet a522f064b9f944d1802f8b730f208ed0 (DEFAULT_TABLE table=default.Table_ac91b73059814eb6b58292b2e1558ace [id=e2933414bca44da084411334f63ccfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.912973 29383 consensus_queue.cc:260] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.914167 30294 leader_election.cc:290] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.914669 30117 leader_election.cc:290] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:16:59.915145 29062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 50945.1us
W20260617 20:16:59.915402 29062 leader_election.cc:343] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 9f9844fab126448895c4c9d4c3c78d76
W20260617 20:16:59.915762 29062 leader_election.cc:343] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 75519f97f1ce49ceb3a739ba7c7bc239
I20260617 20:16:59.915719 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 7e9876434d9640ce9a4b30336c499241 (DEFAULT_TABLE table=default.Table_fbeeaf93389f4790acf4f3353d0952d8 [id=7c887cea4a7c4feea06af161c4c9b87d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.915889 29383 ts_tablet_manager.cc:1434] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.037s user 0.002s sys 0.001s
I20260617 20:16:59.917287 29383 tablet_bootstrap.cc:492] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:16:59.915418 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4c040cfe4445bca51e302a98b40971 (DEFAULT_TABLE table=default.Table_fbc7dc910d9b4eda962ff4b9328e00a3 [id=1efcb5e6de134a54bc4250ae502080e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.920709 30296 raft_consensus.cc:2749] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:16:59.923038 29375 log.cc:1199] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/d1654ae96ce041fa9b9b881af7dd342e
I20260617 20:16:59.923918 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9b99132b80406cb860b679bfdd782c (DEFAULT_TABLE table=default.Table_41576d8b3a1d4789ab70d3afb1cd0fbe [id=efa2e89ef6244e92803dd43d0ef74d50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.924386 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ecc4b5e866945b1aec9e4a84cf360ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.925498 29062 leader_election.cc:304] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:16:59.927366 30296 consensus_queue.cc:1048] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260617 20:16:59.928020 29062 consensus_peers.cc:597] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0859e56b5b7a483ea5e751f0468cbab8. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:16:59.928236 29062 leader_election.cc:343] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 75519f97f1ce49ceb3a739ba7c7bc239
I20260617 20:16:59.928905 29375 ts_tablet_manager.cc:1950] T d1654ae96ce041fa9b9b881af7dd342e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:16:59.929230 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9b99132b80406cb860b679bfdd782c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.929668 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4c040cfe4445bca51e302a98b40971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.930027 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a522f064b9f944d1802f8b730f208ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.930305 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9f9d4701a8b469b90dbb2ccacff121a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.933506 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.933809 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9876434d9640ce9a4b30336c499241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.941550 30350 tablet.cc:1724] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:16:59.947692 29383 tablet_bootstrap.cc:654] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.893754 30314 raft_consensus.cc:2804] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
W20260617 20:16:59.905984 30365 log.cc:927] Time spent T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: Append to log took a long time: real 0.130s user 0.000s sys 0.000s
I20260617 20:16:59.950923 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9b99132b80406cb860b679bfdd782c (DEFAULT_TABLE table=default.Table_41576d8b3a1d4789ab70d3afb1cd0fbe [id=efa2e89ef6244e92803dd43d0ef74d50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.951341 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9b99132b80406cb860b679bfdd782c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.883098 30324 raft_consensus.cc:493] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:16:59.951838 30314 raft_consensus.cc:697] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:59.952123 29377 ts_tablet_manager.cc:1950] T 5e53946c85ab4a8286a6e174cc411c5e P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:16:59.956033 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 633) took 2506 ms. Trace:
I20260617 20:16:59.956543 29377 rpcz_store.cc:276] 0617 20:16:57.449368 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.449432 (+ 64us) service_pool.cc:224] Handling call
0617 20:16:59.580507 (+2131075us) ts_tablet_manager.cc:1151] Deleting tablet 5e53946c85ab4a8286a6e174cc411c5e
0617 20:16:59.580515 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.789612 (+209097us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.879561 (+ 89949us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.956016 (+ 76455us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2130867}
I20260617 20:16:59.957244 29379 tablet_bootstrap.cc:654] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:16:59.954087 30324 raft_consensus.cc:515] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.964895 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 634) took 2502 ms. Trace:
I20260617 20:16:59.964979 29377 rpcz_store.cc:276] 0617 20:16:57.462615 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.462826 (+ 211us) service_pool.cc:224] Handling call
0617 20:16:59.964784 (+2501958us) ts_tablet_manager.cc:1151] Deleting tablet 6c0aa4861a51488db2d1a7041c25ae22
0617 20:16:59.964794 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.964881 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2501705}
I20260617 20:16:59.965764 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4c040cfe4445bca51e302a98b40971 (DEFAULT_TABLE table=default.Table_fbc7dc910d9b4eda962ff4b9328e00a3 [id=1efcb5e6de134a54bc4250ae502080e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.966099 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4c040cfe4445bca51e302a98b40971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.962966 28960 tablet_service.cc:1511] Processing CreateTablet for tablet a522f064b9f944d1802f8b730f208ed0 (DEFAULT_TABLE table=default.Table_ac91b73059814eb6b58292b2e1558ace [id=e2933414bca44da084411334f63ccfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.967217 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 636) took 2486 ms. Trace:
I20260617 20:16:59.967330 29377 rpcz_store.cc:276] 0617 20:16:57.481164 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.485365 (+ 4201us) service_pool.cc:224] Handling call
0617 20:16:59.965222 (+2479857us) ts_tablet_manager.cc:1151] Deleting tablet 5477576e46c84bb6b8a8c7053c61641c
0617 20:16:59.965230 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.967200 (+ 1970us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2392686}
I20260617 20:16:59.968191 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a522f064b9f944d1802f8b730f208ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:16:59.963641 28986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe079091784d7e8035659edd442ba6" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:16:59.971666 30324 leader_election.cc:290] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:16:59.967705 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 639) took 2447 ms. Trace:
I20260617 20:16:59.984261 29256 raft_consensus.cc:2468] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:16:59.987011 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 7ecc4b5e866945b1aec9e4a84cf360ff (DEFAULT_TABLE table=default.Table_e271ce7263b74cbfadbee5ec752a965d [id=f3ff33ab728e488a802d626b5dff181d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.987161 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 9dad85a23c0a45218fcd6ac04c12831a (DEFAULT_TABLE table=default.Table_b5d227c61e734225b76fd057b7ad9b96 [id=4cb0ef24b723455aacc2dc61526886d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:16:59.964282 30314 consensus_queue.cc:237] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.993800 29377 rpcz_store.cc:276] 0617 20:16:57.520660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.520716 (+ 56us) service_pool.cc:224] Handling call
0617 20:16:59.967615 (+2446899us) ts_tablet_manager.cc:1151] Deleting tablet d19d34e3bbe3453ca6de6ed7e62f7af4
0617 20:16:59.967623 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.967691 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2392065}
I20260617 20:16:59.996218 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 638) took 2489 ms. Trace:
I20260617 20:16:59.996862 28925 leader_election.cc:304] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:16:59.999209 30314 raft_consensus.cc:2804] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:16:59.999320 30314 raft_consensus.cc:697] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:16:59.999532 30314 consensus_queue.cc:237] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.000761 29377 rpcz_store.cc:276] 0617 20:16:57.506417 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.506465 (+ 48us) service_pool.cc:224] Handling call
0617 20:16:59.996044 (+2489579us) ts_tablet_manager.cc:1151] Deleting tablet a52873eade4048af81a8e51233b9d079
0617 20:16:59.996053 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.996200 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2414638}
I20260617 20:17:00.001915 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450b08b439814915ab4371770f49f45b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:00.002146 29256 raft_consensus.cc:2468] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:00.004237 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 648) took 2307 ms. Trace:
I20260617 20:17:00.004792 28925 leader_election.cc:304] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:00.005509 29377 rpcz_store.cc:276] 0617 20:16:57.696777 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.722256 (+ 25479us) service_pool.cc:224] Handling call
0617 20:17:00.004086 (+2281830us) ts_tablet_manager.cc:1151] Deleting tablet 9574c6f0765b4329af28d72c8e94240a
0617 20:17:00.004097 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.004219 (+ 122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2281616}
I20260617 20:17:00.005842 30314 raft_consensus.cc:2804] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:00.006475 30314 raft_consensus.cc:493] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:00.006557 30314 raft_consensus.cc:3060] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.007187 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 645) took 2310 ms. Trace:
I20260617 20:17:00.008008 29377 rpcz_store.cc:276] 0617 20:16:57.696425 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.744249 (+ 47824us) service_pool.cc:224] Handling call
0617 20:17:00.007034 (+2262785us) ts_tablet_manager.cc:1151] Deleting tablet 3180f1336fd841d8b4cf7fdf94015955
0617 20:17:00.007047 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.007170 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2252063}
I20260617 20:17:00.009193 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 644) took 2334 ms. Trace:
I20260617 20:17:00.010021 29377 rpcz_store.cc:276] 0617 20:16:57.674682 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.765574 (+ 90892us) service_pool.cc:224] Handling call
0617 20:17:00.009066 (+2243492us) ts_tablet_manager.cc:1151] Deleting tablet b278ba32316c42d1b101e9803657af99
0617 20:17:00.009075 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.009178 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2243234}
I20260617 20:17:00.011559 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 652) took 2215 ms. Trace:
I20260617 20:17:00.012732 29377 rpcz_store.cc:276] 0617 20:16:57.795903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.839808 (+ 43905us) service_pool.cc:224] Handling call
0617 20:17:00.011433 (+2171625us) ts_tablet_manager.cc:1151] Deleting tablet 6afb3ed704bb4a269d92f1741455161b
0617 20:17:00.011442 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.011545 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2171281}
I20260617 20:17:00.014454 29377 tablet_replica.cc:333] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:00.015245 29377 raft_consensus.cc:2243] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:00.015919 29377 raft_consensus.cc:2272] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:00.018079 29377 ts_tablet_manager.cc:1916] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:00.012257 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 7e9876434d9640ce9a4b30336c499241 (DEFAULT_TABLE table=default.Table_fbeeaf93389f4790acf4f3353d0952d8 [id=7c887cea4a7c4feea06af161c4c9b87d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:00.020304 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9876434d9640ce9a4b30336c499241. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:16:59.962050 29062 consensus_peers.cc:597] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46ea43994a0a42fe9e16d7bc6a2118e6. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:16:59.989210 30391 tablet.cc:1724] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 20:17:00.021991 29062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 59961.3us
I20260617 20:16:59.989526 30117 raft_consensus.cc:2749] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:00.022244 29062 leader_election.cc:343] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 9f9844fab126448895c4c9d4c3c78d76
I20260617 20:17:00.027817 30253 raft_consensus.cc:493] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.027961 30253 raft_consensus.cc:515] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:16:59.994031 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 614) took 2816 ms. Trace:
I20260617 20:17:00.000818 29127 raft_consensus.cc:3060] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.028187 29375 rpcz_store.cc:276] 0617 20:16:57.177623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.177676 (+ 53us) service_pool.cc:224] Handling call
0617 20:16:59.474923 (+2297247us) ts_tablet_manager.cc:1151] Deleting tablet d1654ae96ce041fa9b9b881af7dd342e
0617 20:16:59.474931 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.589501 (+114570us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.891029 (+301528us) tablet_metadata.cc:665] Metadata flushed
0617 20:16:59.993997 (+102968us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2297058}
I20260617 20:17:00.028568 29375 tablet_replica.cc:333] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:00.028613 30253 leader_election.cc:290] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:00.028764 29375 raft_consensus.cc:2243] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:00.028934 29375 raft_consensus.cc:2272] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:00.029458 29375 ts_tablet_manager.cc:1916] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:00.001382 29124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ea9cfa1c5a42359e5fa8a2c4c433a4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.001451 29123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450b08b439814915ab4371770f49f45b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.001652 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a1c96212014333935ec7f7c92a306c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.002720 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4de5dafb1474de1911148bb3b4527cf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.003167 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e0c5d20a4548cc8124302aa38bcb21" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.003754 29121 raft_consensus.cc:3060] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.003887 29119 raft_consensus.cc:3060] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.005236 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8d04ef8acd4fcaa69df9253cd89462" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.005667 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7b878728a495f83b6584f8a6aca67" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.005792 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ea6cac8d44b4b8d41e3e33e0fd6cb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.042999 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e0c5d20a4548cc8124302aa38bcb21" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:00.043246 28989 raft_consensus.cc:2468] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:00.043349 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ea6cac8d44b4b8d41e3e33e0fd6cb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:00.043520 28985 raft_consensus.cc:2468] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:00.043570 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8d04ef8acd4fcaa69df9253cd89462" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:00.043746 28987 raft_consensus.cc:2468] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:00.043871 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4240e14b48f4a43b7ce9c6512fc7ff2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:00.043994 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7b878728a495f83b6584f8a6aca67" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:00.044039 28985 raft_consensus.cc:2468] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:00.044153 28988 raft_consensus.cc:2468] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:00.046183 30402 tablet.cc:1724] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:00.006089 29063 leader_election.cc:304] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:00.052142 30193 raft_consensus.cc:2804] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:00.052348 30193 raft_consensus.cc:697] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:00.052631 30193 consensus_queue.cc:237] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.053411 30341 tablet.cc:1724] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:00.012709 30339 tablet.cc:1724] T 97541af7c02d46b98106692d92778741 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260617 20:17:00.060650 29063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 54574.8us
I20260617 20:17:00.061236 30193 consensus_queue.cc:1048] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:00.063256 30253 consensus_queue.cc:1048] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:00.063666 29063 consensus_peers.cc:597] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46ea43994a0a42fe9e16d7bc6a2118e6. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:00.064214 30253 consensus_queue.cc:1048] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:00.064762 29197 leader_election.cc:304] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:00.064996 30253 raft_consensus.cc:2804] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:00.065080 30253 raft_consensus.cc:493] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:00.065157 30253 raft_consensus.cc:3060] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:00.065534 29197 consensus_peers.cc:597] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e6cee209a5a44d6b35eb50e9c33228f. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:00.065688 29197 leader_election.cc:304] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:17:00.065841 28925 leader_election.cc:343] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.065949 29197 leader_election.cc:304] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:00.065953 30371 raft_consensus.cc:2804] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:00.066100 30371 raft_consensus.cc:493] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:00.066184 30371 raft_consensus.cc:3060] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.066232 30248 raft_consensus.cc:2804] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:00.066273 30248 raft_consensus.cc:493] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:00.066315 30248 raft_consensus.cc:3060] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:00.068622 28925 leader_election.cc:343] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.070894 29198 consensus_peers.cc:597] T f6c9d59b6b5a4dee8ca970247f613e53 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:00.075850 29376 ts_tablet_manager.cc:1929] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:00.075974 29376 log.cc:1199] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/4e27c5834baa48ed953fccef54e6c52b
I20260617 20:17:00.076283 29376 ts_tablet_manager.cc:1950] T 4e27c5834baa48ed953fccef54e6c52b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:00.076573 30402 tablet.cc:1724] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:00.073181 30332 raft_consensus.cc:515] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.080036 29258 raft_consensus.cc:2468] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:00.080907 30332 leader_election.cc:290] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:00.083979 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb with delete_type TABLET_DATA_DELETED (replaced by tablet 77f685eeac48402888cbc8ef97fb4b94) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:00.084151 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:00.084272 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a1c96212014333935ec7f7c92a306c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:00.084373 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet f4de5dafb1474de1911148bb3b4527cf with delete_type TABLET_DATA_DELETED (replaced by tablet e7eb77c619e04c448a084638668dbb6a) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:00.084455 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f7b878728a495f83b6584f8a6aca67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:00.084553 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet cf8d04ef8acd4fcaa69df9253cd89462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:00.084633 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 663dbe73689d4849a85b68a79ea4062c with delete_type TABLET_DATA_DELETED (replaced by tablet 4372081172384c9f96388d38208d9853) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:00.087221 29240 tablet_service.cc:1511] Processing CreateTablet for tablet a522f064b9f944d1802f8b730f208ed0 (DEFAULT_TABLE table=default.Table_ac91b73059814eb6b58292b2e1558ace [id=e2933414bca44da084411334f63ccfb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:00.087635 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a522f064b9f944d1802f8b730f208ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:00.092636 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9b99132b80406cb860b679bfdd782c (DEFAULT_TABLE table=default.Table_41576d8b3a1d4789ab70d3afb1cd0fbe [id=efa2e89ef6244e92803dd43d0ef74d50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:00.093039 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9b99132b80406cb860b679bfdd782c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:00.095475 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4c040cfe4445bca51e302a98b40971 (DEFAULT_TABLE table=default.Table_fbc7dc910d9b4eda962ff4b9328e00a3 [id=1efcb5e6de134a54bc4250ae502080e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:00.095999 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4c040cfe4445bca51e302a98b40971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:00.109346 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ecc4b5e866945b1aec9e4a84cf360ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:00.113026 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dad85a23c0a45218fcd6ac04c12831a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:00.066174 29197 leader_election.cc:304] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:00.114102 30018 raft_consensus.cc:2804] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:00.114185 30018 raft_consensus.cc:493] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:00.114279 30018 raft_consensus.cc:3060] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:00.114557 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 48397.1us
I20260617 20:17:00.114923 29197 leader_election.cc:304] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:00.115792 30420 raft_consensus.cc:2804] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:00.115932 30420 raft_consensus.cc:493] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:00.116053 30420 raft_consensus.cc:3060] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.128448 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f9844fab126448895c4c9d4c3c78d76" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:00.128571 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7efe079091784d7e8035659edd442ba6" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:00.128670 29258 raft_consensus.cc:3060] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.129460 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ea9cfa1c5a42359e5fa8a2c4c433a4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:00.129693 29260 raft_consensus.cc:3060] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.134265 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 7e9876434d9640ce9a4b30336c499241 (DEFAULT_TABLE table=default.Table_fbeeaf93389f4790acf4f3353d0952d8 [id=7c887cea4a7c4feea06af161c4c9b87d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:00.137621 28925 leader_election.cc:343] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.138439 30422 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.245.253:38361 every 8 connection(s)
I20260617 20:17:00.138854 30026 rpc_server.cc:307] RPC server started. Bound to: 127.27.245.253:38361
I20260617 20:17:00.141710 30026 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-1/data/info.pb
W20260617 20:17:00.142024 28925 leader_election.cc:343] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.142937 28631 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRePpQS/build/asan/bin/kudu as pid 30026
I20260617 20:17:00.148820 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4240e14b48f4a43b7ce9c6512fc7ff2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.150422 30202 consensus_queue.cc:1048] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:00.152344 29063 leader_election.cc:304] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:00.166232 30402 tablet.cc:1724] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:00.168023 30371 raft_consensus.cc:515] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.168689 30371 leader_election.cc:290] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:00.171058 30248 raft_consensus.cc:515] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.171638 30248 leader_election.cc:290] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:00.172684 30253 raft_consensus.cc:515] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.173220 30253 leader_election.cc:290] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:00.179859 30314 raft_consensus.cc:515] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:00.183422 29198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 112276us
W20260617 20:17:00.185105 29198 leader_election.cc:343] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.185266 29198 leader_election.cc:304] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.185539 30247 raft_consensus.cc:2749] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:00.185962 30314 leader_election.cc:290] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:00.186009 29198 leader_election.cc:343] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.186106 29198 leader_election.cc:304] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.186344 30247 raft_consensus.cc:2749] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:00.186712 29198 leader_election.cc:343] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.187034 29198 leader_election.cc:343] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.187340 29198 leader_election.cc:343] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.187618 29198 leader_election.cc:343] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.187916 29198 leader_election.cc:343] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.191802 28988 raft_consensus.cc:1275] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Refusing update from remote peer a8c0aea0206f44d683ed3b6b18c719f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:17:00.191987 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 650) took 2493 ms. Trace:
I20260617 20:17:00.192067 29376 rpcz_store.cc:276] 0617 20:16:57.698764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.699166 (+ 402us) service_pool.cc:224] Handling call
0617 20:16:59.406534 (+1707368us) ts_tablet_manager.cc:1151] Deleting tablet 4e27c5834baa48ed953fccef54e6c52b
0617 20:16:59.406544 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:16:59.485092 (+ 78548us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x6160000c5854. stack: 00007f5f5963e496 00007f5f5963e250 00007f5f586693ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f5f656e47e0 00007f5f66a30933 00007f5f695f3ae7 00007f5f69626bb4 00007f5f696075d0 00007f5f6960735d 0000000000aa681c 00007f5f596849ff 00007f5f59687d1b 00007f5f59687b98
0617 20:16:59.586049 (+100957us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.075785 (+489736us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.191967 (+116182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177850752,"tablet-delete.queue_time_us":1707214}
I20260617 20:17:00.192493 29376 tablet_replica.cc:333] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:00.192687 29376 raft_consensus.cc:2243] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:00.192864 29376 raft_consensus.cc:2272] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:00.193972 29376 ts_tablet_manager.cc:1916] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:00.197343 30247 consensus_queue.cc:1048] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:00.198804 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8d04ef8acd4fcaa69df9253cd89462" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:00.198990 28988 raft_consensus.cc:3060] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.197331 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9876434d9640ce9a4b30336c499241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:00.202270 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ea6cac8d44b4b8d41e3e33e0fd6cb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:00.202579 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e0c5d20a4548cc8124302aa38bcb21" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:00.202808 28985 raft_consensus.cc:3060] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.202567 28990 raft_consensus.cc:3060] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.204389 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 5e53946c85ab4a8286a6e174cc411c5e (table default.Table_2ca839bde234444b97808d82d7974e3c [id=e682c8658ea84718a5e3909a6f6b7246]) successfully deleted
W20260617 20:17:00.204670 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 6c0aa4861a51488db2d1a7041c25ae22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c0aa4861a51488db2d1a7041c25ae22 already in progress: creating tablet
W20260617 20:17:00.206018 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5477576e46c84bb6b8a8c7053c61641c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5477576e46c84bb6b8a8c7053c61641c already in progress: creating tablet
I20260617 20:17:00.206151 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 4e27c5834baa48ed953fccef54e6c52b (table default.Table_56f5d206c3934a59a6ef16d7c15e3de6 [id=6c3209da79fb4c518d0583b668a9209e]) successfully deleted
W20260617 20:17:00.206363 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d19d34e3bbe3453ca6de6ed7e62f7af4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d19d34e3bbe3453ca6de6ed7e62f7af4 already in progress: creating tablet
I20260617 20:17:00.207670 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450b08b439814915ab4371770f49f45b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:00.207890 29259 raft_consensus.cc:3060] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.211081 29037 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:00.215094 30424 sys_catalog.cc:263] Verifying existing consensus state
I20260617 20:17:00.217981 30404 tablet.cc:1719] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254: Skipping requested alter to schema version 3, tablet already version 3
W20260617 20:17:00.218540 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet a52873eade4048af81a8e51233b9d079 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a52873eade4048af81a8e51233b9d079 already in progress: creating tablet
I20260617 20:17:00.218569 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet d1654ae96ce041fa9b9b881af7dd342e (table default.Table_1d839677a1834e13914e3c77a8f38f01 [id=82e506e43d294d23988395ecdb33cffd]) successfully deleted
W20260617 20:17:00.218844 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 9574c6f0765b4329af28d72c8e94240a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9574c6f0765b4329af28d72c8e94240a already in progress: creating tablet
W20260617 20:17:00.219199 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3180f1336fd841d8b4cf7fdf94015955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3180f1336fd841d8b4cf7fdf94015955 already in progress: creating tablet
W20260617 20:17:00.219431 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet b278ba32316c42d1b101e9803657af99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b278ba32316c42d1b101e9803657af99 already in progress: creating tablet
W20260617 20:17:00.219656 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 6afb3ed704bb4a269d92f1741455161b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6afb3ed704bb4a269d92f1741455161b already in progress: creating tablet
I20260617 20:17:00.222968 29378 tablet_bootstrap.cc:492] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.223186 29378 ts_tablet_manager.cc:1403] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.400s user 0.059s sys 0.154s
I20260617 20:17:00.224174 29378 raft_consensus.cc:359] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.224468 29378 raft_consensus.cc:385] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.224673 29378 raft_consensus.cc:740] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.224973 29378 consensus_queue.cc:260] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.225659 29378 ts_tablet_manager.cc:1434] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:17:00.226009 29378 tablet_bootstrap.cc:492] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.227982 29378 tablet_bootstrap.cc:654] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.229614 30341 tablet.cc:1719] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:00.238163 29378 tablet_bootstrap.cc:492] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.238536 29378 ts_tablet_manager.cc:1403] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.009s
I20260617 20:17:00.239457 29378 raft_consensus.cc:359] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.239696 29378 raft_consensus.cc:385] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.239799 29378 raft_consensus.cc:740] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.240077 29378 consensus_queue.cc:260] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.240648 29378 ts_tablet_manager.cc:1434] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:00.241003 29378 tablet_bootstrap.cc:492] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.241675 30424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Bootstrap starting.
I20260617 20:17:00.241869 30404 tablet.cc:1719] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:00.243062 29378 tablet_bootstrap.cc:654] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.251657 28960 tablet_service.cc:1511] Processing CreateTablet for tablet d16bbe642edc43449d3b910ca5cf4d37 (DEFAULT_TABLE table=default.Table_17f5f997158040c293ab63c2bd96216e [id=9fc78b76e16c4e19bfa7698cc5a39930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:00.253366 30294 raft_consensus.cc:2804] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:00.253579 30294 raft_consensus.cc:697] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:00.253893 30294 consensus_queue.cc:237] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.261898 30018 raft_consensus.cc:515] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.262482 30018 leader_election.cc:290] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:00.262774 28988 raft_consensus.cc:2468] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:17:00.267443 29063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 97165.2us
I20260617 20:17:00.265246 28985 raft_consensus.cc:2468] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:00.270773 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16bbe642edc43449d3b910ca5cf4d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:00.276160 30018 consensus_queue.cc:1048] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:00.276713 29063 leader_election.cc:304] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:00.277076 30296 raft_consensus.cc:2749] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:00.277420 30018 consensus_queue.cc:1048] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:00.277443 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8d04ef8acd4fcaa69df9253cd89462" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:00.277611 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4240e14b48f4a43b7ce9c6512fc7ff2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:00.277675 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ea6cac8d44b4b8d41e3e33e0fd6cb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:00.277271 29063 consensus_peers.cc:597] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0859e56b5b7a483ea5e751f0468cbab8. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:00.277534 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e0c5d20a4548cc8124302aa38bcb21" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:00.284732 29104 tablet_service.cc:1511] Processing CreateTablet for tablet d16bbe642edc43449d3b910ca5cf4d37 (DEFAULT_TABLE table=default.Table_17f5f997158040c293ab63c2bd96216e [id=9fc78b76e16c4e19bfa7698cc5a39930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:00.285167 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ea9cfa1c5a42359e5fa8a2c4c433a4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:00.285475 30193 raft_consensus.cc:493] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.286317 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450b08b439814915ab4371770f49f45b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:00.288951 29063 consensus_peers.cc:597] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a725364bb9646e6bc80fc4f67d04a16. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:00.290200 30018 raft_consensus.cc:493] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.290356 30018 raft_consensus.cc:515] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.290982 30018 leader_election.cc:290] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:17:00.291174 28925 leader_election.cc:343] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.291397 28925 leader_election.cc:343] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.292362 29198 consensus_peers.cc:597] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:00.292570 29198 leader_election.cc:343] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.292814 29198 leader_election.cc:343] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.293008 29198 leader_election.cc:343] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.293190 29198 leader_election.cc:343] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.296031 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4240e14b48f4a43b7ce9c6512fc7ff2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:00.296243 28985 raft_consensus.cc:3060] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.296301 30193 raft_consensus.cc:515] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.297236 29197 leader_election.cc:304] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.297576 30018 raft_consensus.cc:2804] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:00.297693 30018 raft_consensus.cc:697] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:00.297921 30018 consensus_queue.cc:237] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.299548 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16bbe642edc43449d3b910ca5cf4d37. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:00.303649 29062 consensus_peers.cc:597] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a725364bb9646e6bc80fc4f67d04a16. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:00.306362 29197 leader_election.cc:304] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.306679 30410 raft_consensus.cc:2804] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:00.306799 30410 raft_consensus.cc:697] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:00.307058 30410 consensus_queue.cc:237] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.308789 30339 tablet.cc:1724] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:00.312603 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086bd3079e8f4a6d85ccc681a38a47b0" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:00.314379 29378 tablet_bootstrap.cc:492] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.314517 29378 ts_tablet_manager.cc:1403] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.074s user 0.024s sys 0.004s
I20260617 20:17:00.315548 30371 raft_consensus.cc:493] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.315709 30371 raft_consensus.cc:515] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:00.316216 29378 raft_consensus.cc:359] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.316376 29378 raft_consensus.cc:385] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.316386 30371 leader_election.cc:290] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:00.316425 29378 raft_consensus.cc:740] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.318246 29378 consensus_queue.cc:260] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.319381 29378 ts_tablet_manager.cc:1434] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 20:17:00.319675 29378 tablet_bootstrap.cc:492] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.320629 29175 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:00.321686 30193 leader_election.cc:290] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:00.323875 29378 tablet_bootstrap.cc:654] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.324996 30341 tablet.cc:1724] T 32c3a4c3bee5444697f5d53d51c62894 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:00.332257 29378 tablet_bootstrap.cc:492] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.332417 29378 ts_tablet_manager.cc:1403] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s
I20260617 20:17:00.333129 29378 raft_consensus.cc:359] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.333326 29378 raft_consensus.cc:385] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.333391 29378 raft_consensus.cc:740] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.335409 29378 consensus_queue.cc:260] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.335918 29378 ts_tablet_manager.cc:1434] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:00.336184 29378 tablet_bootstrap.cc:492] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.337477 29378 tablet_bootstrap.cc:654] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.344456 29378 tablet_bootstrap.cc:492] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.345331 29378 ts_tablet_manager.cc:1403] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260617 20:17:00.346091 29378 raft_consensus.cc:359] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.346273 29378 raft_consensus.cc:385] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.347626 29378 raft_consensus.cc:740] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.348110 29378 consensus_queue.cc:260] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.349363 29378 ts_tablet_manager.cc:1434] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:17:00.349642 29378 tablet_bootstrap.cc:492] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.350689 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090b8720e5df447aa0da147bd8dfaa8c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.351907 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b06f05d9b4273a61bcb2d6e0ad796" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.352105 29378 tablet_bootstrap.cc:654] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:00.353446 29198 leader_election.cc:343] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.353717 29198 leader_election.cc:343] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.358636 29378 tablet_bootstrap.cc:492] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.358765 29378 ts_tablet_manager.cc:1403] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260617 20:17:00.359373 29378 raft_consensus.cc:359] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.359526 29378 raft_consensus.cc:385] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.359572 29378 raft_consensus.cc:740] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.360000 28990 raft_consensus.cc:2468] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:00.360524 29377 ts_tablet_manager.cc:1929] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:17:00.360626 29377 log.cc:1199] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/d2c0988a73d547d08d0924784bff9222
I20260617 20:17:00.361004 29377 ts_tablet_manager.cc:1950] T d2c0988a73d547d08d0924784bff9222 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:00.361289 29378 consensus_queue.cc:260] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.362303 29378 ts_tablet_manager.cc:1434] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:00.362567 29378 tablet_bootstrap.cc:492] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.364085 28985 raft_consensus.cc:2468] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:00.365417 29378 tablet_bootstrap.cc:654] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.366897 29258 raft_consensus.cc:2468] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:00.372978 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 653) took 2463 ms. Trace:
I20260617 20:17:00.374423 29378 tablet_bootstrap.cc:492] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.374564 29378 ts_tablet_manager.cc:1403] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.001s
I20260617 20:17:00.373116 29377 rpcz_store.cc:276] 0617 20:16:57.909503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.910108 (+ 605us) service_pool.cc:224] Handling call
0617 20:17:00.014411 (+2104303us) ts_tablet_manager.cc:1151] Deleting tablet d2c0988a73d547d08d0924784bff9222
0617 20:17:00.014420 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.270374 (+255954us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.360458 (+ 90084us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.372943 (+ 12485us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2101401}
I20260617 20:17:00.375003 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 668) took 2437 ms. Trace:
I20260617 20:17:00.375110 29377 rpcz_store.cc:276] 0617 20:16:57.937026 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.937088 (+ 62us) service_pool.cc:224] Handling call
0617 20:17:00.374791 (+2437703us) ts_tablet_manager.cc:1151] Deleting tablet 9370421288e2449fae454aec32883810
0617 20:17:00.374805 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.374979 (+ 174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2437528}
I20260617 20:17:00.375514 29377 tablet_replica.cc:333] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:00.375792 29377 raft_consensus.cc:2243] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:00.375998 29377 raft_consensus.cc:2272] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:00.377657 29378 raft_consensus.cc:359] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.377862 29378 raft_consensus.cc:385] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.377931 29378 raft_consensus.cc:740] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.378140 29378 consensus_queue.cc:260] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.378612 29378 ts_tablet_manager.cc:1434] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 20:17:00.378901 29378 tablet_bootstrap.cc:492] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.379437 29377 ts_tablet_manager.cc:1916] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:00.383497 29378 tablet_bootstrap.cc:654] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.390012 29378 tablet_bootstrap.cc:492] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.390133 29378 ts_tablet_manager.cc:1403] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.001s
I20260617 20:17:00.390857 29378 raft_consensus.cc:359] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.391016 29378 raft_consensus.cc:385] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.391062 29378 raft_consensus.cc:740] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.393082 29378 consensus_queue.cc:260] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.393558 29378 ts_tablet_manager.cc:1434] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:00.393821 29378 tablet_bootstrap.cc:492] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.395345 29378 tablet_bootstrap.cc:654] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.405272 29378 tablet_bootstrap.cc:492] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.405457 29378 ts_tablet_manager.cc:1403] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
I20260617 20:17:00.406216 29378 raft_consensus.cc:359] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.406394 29378 raft_consensus.cc:385] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.406466 29378 raft_consensus.cc:740] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.408905 29378 consensus_queue.cc:260] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.409443 29378 ts_tablet_manager.cc:1434] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:00.409745 29378 tablet_bootstrap.cc:492] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.411228 30453 tablet.cc:1719] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:00.414306 29378 tablet_bootstrap.cc:654] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.421489 29378 tablet_bootstrap.cc:492] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.421660 29378 ts_tablet_manager.cc:1403] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
I20260617 20:17:00.422359 29378 raft_consensus.cc:359] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.422521 29378 raft_consensus.cc:385] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.422567 29378 raft_consensus.cc:740] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.422750 29378 consensus_queue.cc:260] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.423177 29378 ts_tablet_manager.cc:1434] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:17:00.423420 29378 tablet_bootstrap.cc:492] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.425024 29378 tablet_bootstrap.cc:654] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.432309 30404 tablet.cc:1724] T 32c3a4c3bee5444697f5d53d51c62894 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:00.437111 29378 tablet_bootstrap.cc:492] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.437243 29378 ts_tablet_manager.cc:1403] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.002s
I20260617 20:17:00.439189 29378 raft_consensus.cc:359] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.439355 29378 raft_consensus.cc:385] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.439402 29378 raft_consensus.cc:740] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.440201 29378 consensus_queue.cc:260] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.441160 29378 ts_tablet_manager.cc:1434] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
W20260617 20:17:00.442004 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 117775us
I20260617 20:17:00.442220 29378 tablet_bootstrap.cc:492] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.443811 29378 tablet_bootstrap.cc:654] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.444093 30453 tablet.cc:1724] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:00.449775 29378 tablet_bootstrap.cc:492] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.449913 29378 ts_tablet_manager.cc:1403] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260617 20:17:00.451327 29378 raft_consensus.cc:359] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.451491 29378 raft_consensus.cc:385] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.451543 29378 raft_consensus.cc:740] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.451720 29378 consensus_queue.cc:260] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.453498 29378 ts_tablet_manager.cc:1434] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:00.453727 29378 tablet_bootstrap.cc:492] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.457122 29378 tablet_bootstrap.cc:654] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.461347 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_ae4ab5348d244f92a3ecd4fac3ca86b2 [id=06b76ab80c3b453986d047f7f1f832ac]) successfully deleted
I20260617 20:17:00.467557 29260 raft_consensus.cc:2468] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
W20260617 20:17:00.468021 28656 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 175762us
I20260617 20:17:00.470749 29233 tablet_service.cc:1511] Processing CreateTablet for tablet d16bbe642edc43449d3b910ca5cf4d37 (DEFAULT_TABLE table=default.Table_17f5f997158040c293ab63c2bd96216e [id=9fc78b76e16c4e19bfa7698cc5a39930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:00.470877 28665 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 943) took 1014 ms. Trace:
W20260617 20:17:00.473562 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e5396b42681e4a1fbf0df74c86ee810c consensus state has no leader
W20260617 20:17:00.474432 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 9370421288e2449fae454aec32883810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9370421288e2449fae454aec32883810 already in progress: creating tablet
I20260617 20:17:00.470984 28665 rpcz_store.cc:276] 0617 20:16:59.455800 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.590205 (+134405us) service_pool.cc:224] Handling call
0617 20:16:59.594376 (+ 4171us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:16:59.595110 (+ 734us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:16:59.595577 (+ 467us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:00.469452 (+873875us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:00.469564 (+ 112us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:00.469843 (+ 279us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:16:59.838537 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:16:59.847076 (+ 8539us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:16:59.847088 (+ 12us) write_op.cc:435] Acquired schema lock
0617 20:16:59.847464 (+ 376us) tablet.cc:662] Decoding operations
0617 20:16:59.949516 (+102052us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:16:59.949532 (+ 16us) write_op.cc:641] Partition lock acquired for write op
0617 20:16:59.949538 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:00.205798 (+256260us) tablet.cc:701] Row locks acquired
0617 20:17:00.205804 (+ 6us) write_op.cc:260] PREPARE: finished
0617 20:17:00.205858 (+ 54us) write_op.cc:270] Start()
0617 20:17:00.208221 (+ 2363us) write_op.cc:276] Timestamp: P: 1781727420205836 usec, L: 0
0617 20:17:00.208228 (+ 7us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.208678 (+ 450us) log.cc:844] Serialized 433 byte log entry
0617 20:17:00.221384 (+ 12706us) op_driver.cc:464] REPLICATION: finished
0617 20:17:00.221991 (+ 607us) write_op.cc:301] APPLY: starting
0617 20:17:00.222013 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:00.222082 (+ 69us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:00.250275 (+ 28193us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:00.250433 (+ 158us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:00.250478 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:00.250486 (+ 8us) write_op.cc:312] APPLY: finished
0617 20:17:00.250578 (+ 92us) log.cc:844] Serialized 29 byte log entry
0617 20:17:00.469078 (+218500us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x619000100158. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fa11e1c651d 00007fa11e1cb419 00007fa11e0b80bd 00007fa11e0be626 00007fa11e0bc98c 00007fa11e092472 00007fa11e0907f8 00007fa11e093870 00007fa11e09367d 0000000000aa681c
0617 20:17:00.469092 (+ 14us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.469116 (+ 24us) write_op.cc:454] Released schema lock
0617 20:17:00.469126 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:00.469223 (+ 97us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.469226 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":8977792,"child_traces":[["op",{"apply.queue_time_us":550,"apply.run_cpu_time_us":1320,"apply.run_wall_time_us":247217,"num_ops":2,"prepare.queue_time_us":136382,"prepare.run_cpu_time_us":1683,"prepare.run_wall_time_us":378846,"raft.queue_time_us":87,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":265,"replication_time_us":13123,"spinlock_wait_cycles":9041792}]]}
I20260617 20:17:00.483879 30424 log.cc:826] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Log is configured to *not* fsync() on all Append() calls
I20260617 20:17:00.486845 29226 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 721) took 1094 ms. Trace:
I20260617 20:17:00.486936 29226 rpcz_store.cc:276] 0617 20:16:59.392178 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.392324 (+ 146us) service_pool.cc:224] Handling call
0617 20:16:59.392825 (+ 501us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:59.392868 (+ 43us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:17:00.108919 (+716051us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.486706 (+377787us) tablet_replica.cc:206] Creating consensus instance
0617 20:17:00.486827 (+ 121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:17:00.499679 30423 raft_consensus.cc:493] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.499872 30423 raft_consensus.cc:515] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.500488 30423 leader_election.cc:290] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:00.509944 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8a7096a09147789ac203c150a19419" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:00.511817 29198 leader_election.cc:343] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.512403 29375 ts_tablet_manager.cc:1929] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:17:00.515362 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 72798.5us
I20260617 20:17:00.515735 29197 leader_election.cc:304] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.513266 29375 log.cc:1199] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/b1b3565799894d82a3cc29ab2a19307c
I20260617 20:17:00.516537 29375 ts_tablet_manager.cc:1950] T b1b3565799894d82a3cc29ab2a19307c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:00.520110 30201 raft_consensus.cc:493] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.520321 30201 raft_consensus.cc:515] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.521435 30201 leader_election.cc:290] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:00.524077 30410 raft_consensus.cc:2804] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:00.524216 30410 raft_consensus.cc:697] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:00.524502 30410 consensus_queue.cc:237] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.526401 29197 leader_election.cc:304] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.526686 30410 raft_consensus.cc:2804] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:00.526777 30410 raft_consensus.cc:697] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:00.526950 30410 consensus_queue.cc:237] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.517843 29376 ts_tablet_manager.cc:1929] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:00.529422 29376 log.cc:1199] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/67a3124306094c72ad78e5473aa35bdb
I20260617 20:17:00.529798 29376 ts_tablet_manager.cc:1950] T 67a3124306094c72ad78e5473aa35bdb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:00.532512 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16bbe642edc43449d3b910ca5cf4d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:00.521514 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5d9677bc184c30be1a11bfa85a97c8" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:00.536861 28925 leader_election.cc:343] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.519550 29383 tablet_bootstrap.cc:492] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:00.552440 29383 ts_tablet_manager.cc:1403] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.635s user 0.002s sys 0.002s
I20260617 20:17:00.553782 29383 raft_consensus.cc:359] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.554075 29383 raft_consensus.cc:385] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.554143 29383 raft_consensus.cc:740] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.554388 29383 consensus_queue.cc:260] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.555110 29383 ts_tablet_manager.cc:1434] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:00.555745 29383 tablet_bootstrap.cc:492] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:00.557080 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090b8720e5df447aa0da147bd8dfaa8c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:00.557313 28985 raft_consensus.cc:2468] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:00.558036 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b06f05d9b4273a61bcb2d6e0ad796" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:00.558194 28985 raft_consensus.cc:2468] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:00.559279 30403 tablet.cc:1724] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:00.559533 28925 leader_election.cc:304] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.559904 30201 raft_consensus.cc:2804] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:00.560024 30201 raft_consensus.cc:697] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:00.560278 30201 consensus_queue.cc:237] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.565116 30420 raft_consensus.cc:515] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.565860 30420 leader_election.cc:290] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:00.572333 29242 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 740) took 1026 ms. Trace:
I20260617 20:17:00.572427 29242 rpcz_store.cc:276] 0617 20:16:59.545999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.546106 (+ 107us) service_pool.cc:224] Handling call
0617 20:16:59.546504 (+ 398us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:59.546528 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:17:00.108107 (+561579us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.572158 (+464051us) tablet_replica.cc:206] Creating consensus instance
0617 20:17:00.572313 (+ 155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:17:00.585484 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7b878728a495f83b6584f8a6aca67" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:00.586023 29063 leader_election.cc:304] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:00.586357 30294 raft_consensus.cc:2804] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:00.586673 30294 raft_consensus.cc:697] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:00.587096 30294 consensus_queue.cc:237] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.589579 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 615) took 3410 ms. Trace:
I20260617 20:17:00.589754 29375 rpcz_store.cc:276] 0617 20:16:57.179366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.179682 (+ 316us) service_pool.cc:224] Handling call
0617 20:17:00.028502 (+2848820us) ts_tablet_manager.cc:1151] Deleting tablet b1b3565799894d82a3cc29ab2a19307c
0617 20:17:00.028510 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.367899 (+339389us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.512324 (+144425us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.589536 (+ 77212us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2848645}
I20260617 20:17:00.591539 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet b1b3565799894d82a3cc29ab2a19307c (table default.Table_2f2534b9a19341bdb7f92a6da5470fea [id=2133bdb470c34a7dbc0508a2d780094b]) successfully deleted
W20260617 20:17:00.592038 29198 leader_election.cc:343] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.592239 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 616) took 3392 ms. Trace:
I20260617 20:17:00.592368 29375 rpcz_store.cc:276] 0617 20:16:57.199503 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.199556 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:00.592076 (+3392520us) ts_tablet_manager.cc:1151] Deleting tablet 58213ec0a9364a91a15fc0329f28605b
0617 20:17:00.592088 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.592199 (+ 111us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3392318}
W20260617 20:17:00.594362 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 58213ec0a9364a91a15fc0329f28605b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58213ec0a9364a91a15fc0329f28605b already in progress: creating tablet
I20260617 20:17:00.594990 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 617) took 3394 ms. Trace:
I20260617 20:17:00.595911 29375 rpcz_store.cc:276] 0617 20:16:57.200617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.200660 (+ 43us) service_pool.cc:224] Handling call
0617 20:17:00.594837 (+3394177us) ts_tablet_manager.cc:1151] Deleting tablet 3defb7ba4604412597316f8e5c8d5ccd
0617 20:17:00.594850 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.594950 (+ 100us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3394025}
W20260617 20:17:00.597072 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3defb7ba4604412597316f8e5c8d5ccd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3defb7ba4604412597316f8e5c8d5ccd already in progress: creating tablet
I20260617 20:17:00.523366 29379 tablet_bootstrap.cc:492] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:00.598160 29379 ts_tablet_manager.cc:1403] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.973s user 0.008s sys 0.016s
I20260617 20:17:00.599234 29379 raft_consensus.cc:359] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.599707 29379 raft_consensus.cc:385] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.600030 29379 raft_consensus.cc:740] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.592916 30339 tablet.cc:1719] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:00.604512 30201 raft_consensus.cc:493] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.604657 30201 raft_consensus.cc:515] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.605727 30201 leader_election.cc:290] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:00.610555 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5faea831376646c1bdfcaf8fbbc7ca6d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.618610 29310 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
W20260617 20:17:00.622556 28669 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.193:34505 (request call id 110) took 863 ms (client timeout 1000 ms). Trace:
W20260617 20:17:00.622718 28669 rpcz_store.cc:269] 0617 20:16:59.759090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.473778 (+714688us) service_pool.cc:224] Handling call
0617 20:17:00.620770 (+146992us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bcaf08 00007fa11b629ca6 00007fa11b6299d5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:00.622462 (+ 1692us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":336395520}
I20260617 20:17:00.627084 28669 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet e58fbec4a9f14ddda42b5a4c0263972c (table default.Table_efb89ae603ed4713a25716af39bf03c3 [id=cd4abe077ee04673bad87834b3af273b]). Expected version 3 got 0
I20260617 20:17:00.627610 28669 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:17:00.628262 28669 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 7efe079091784d7e8035659edd442ba6 (table default.Table_6bb71611d01f469a95325bc9bbcd5251 [id=f0df4d60a326473a8fc3d040ed7324d7]). Expected version 1 got 0
I20260617 20:17:00.638036 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_12cb16608a854819a7e0834654f128bb" } modify_external_catalogs: true
I20260617 20:17:00.639892 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_12cb16608a854819a7e0834654f128bb" } modify_external_catalogs: true
I20260617 20:17:00.643581 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
I20260617 20:17:00.643939 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:17:00.644410 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 7efe079091784d7e8035659edd442ba6 (table default.Table_6bb71611d01f469a95325bc9bbcd5251 [id=f0df4d60a326473a8fc3d040ed7324d7]). Expected version 1 got 0
I20260617 20:17:00.644824 28665 catalog_manager.cc:5696] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
W20260617 20:17:00.664196 28656 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 326eb1cffb9a47078320e6fcba0743ce (table default.Table_8000cf41d95f4152983d7fe1d74cbdb8 [id=42f2f56c7b0f4ac4bddd9a9eea89a7b2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 326eb1cffb9a47078320e6fcba0743ce consensus state has no leader
I20260617 20:17:00.667577 30350 tablet.cc:1719] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:00.681382 30201 raft_consensus.cc:493] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.681546 30201 raft_consensus.cc:515] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.682191 30201 leader_election.cc:290] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:00.686622 29259 raft_consensus.cc:2468] T 450b08b439814915ab4371770f49f45b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
W20260617 20:17:00.687069 29238 consensus_meta.cc:287] T 9dad85a23c0a45218fcd6ac04c12831a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent flushing consensus metadata: real 0.571s user 0.003s sys 0.000s
I20260617 20:17:00.687472 29238 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 751) took 1026 ms. Trace:
I20260617 20:17:00.687559 29238 rpcz_store.cc:276] 0617 20:16:59.660523 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.987013 (+326490us) service_pool.cc:224] Handling call
0617 20:16:59.988392 (+ 1379us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:59.988412 (+ 20us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:17:00.116265 (+127853us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.687258 (+570993us) tablet_replica.cc:206] Creating consensus instance
0617 20:17:00.687454 (+ 196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260617 20:17:00.688004 29227 consensus_meta.cc:287] T 5c9b99132b80406cb860b679bfdd782c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent flushing consensus metadata: real 0.581s user 0.003s sys 0.000s
W20260617 20:17:00.688036 29239 consensus_meta.cc:287] T 672aba4228fc44ef9cea80dd6f07c3c9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent flushing consensus metadata: real 0.579s user 0.017s sys 0.000s
I20260617 20:17:00.688263 29239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:41028 (request call id 746) took 1138 ms. Trace:
I20260617 20:17:00.688326 29239 rpcz_store.cc:276] 0617 20:16:59.549989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.550043 (+ 54us) service_pool.cc:224] Handling call
0617 20:16:59.550438 (+ 395us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0617 20:16:59.550463 (+ 25us) ts_tablet_manager.cc:682] Creating new metadata...
0617 20:17:00.108992 (+558529us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.688131 (+579139us) tablet_replica.cc:206] Creating consensus instance
0617 20:17:00.688251 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:17:00.688812 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 649) took 2990 ms. Trace:
I20260617 20:17:00.688898 29376 rpcz_store.cc:276] 0617 20:16:57.698689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.703317 (+ 4628us) service_pool.cc:224] Handling call
0617 20:17:00.192448 (+2489131us) ts_tablet_manager.cc:1151] Deleting tablet 67a3124306094c72ad78e5473aa35bdb
0617 20:17:00.192458 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.335768 (+143310us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.517624 (+181856us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.688784 (+171160us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2488965}
I20260617 20:17:00.689153 29376 tablet_replica.cc:333] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:00.689347 29376 raft_consensus.cc:2243] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:00.689605 29376 raft_consensus.cc:2272] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:00.690114 29376 ts_tablet_manager.cc:1916] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:00.724907 30466 raft_consensus.cc:493] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590225c8ea36448093b77385d238a34a)
I20260617 20:17:00.725199 30466 raft_consensus.cc:515] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:00.733641 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 966 } } ignore_live_leader: false dest_uuid: "590225c8ea36448093b77385d238a34a" is_pre_election: true
I20260617 20:17:00.737881 30201 raft_consensus.cc:493] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.738035 30201 raft_consensus.cc:515] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.738620 30201 leader_election.cc:290] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:00.740693 28925 leader_election.cc:343] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.742017 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3726e55ed36f420ab63bcfb5a81c5aab" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.748070 30466 leader_election.cc:290] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), 87437cd320a4470fa0dedd43aa7ea3eb (127.27.245.253:38361)
I20260617 20:17:00.763115 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8a7096a09147789ac203c150a19419" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:00.763348 28985 raft_consensus.cc:2468] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:00.763751 30410 raft_consensus.cc:493] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.763882 30410 raft_consensus.cc:515] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.764531 30410 leader_election.cc:290] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:00.766482 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5d9677bc184c30be1a11bfa85a97c8" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:00.766716 29259 raft_consensus.cc:2468] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
W20260617 20:17:00.771432 29198 consensus_peers.cc:597] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:00.771888 28925 consensus_peers.cc:597] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:00.772050 28925 leader_election.cc:343] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.779779 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 618) took 3578 ms. Trace:
I20260617 20:17:00.780082 29375 rpcz_store.cc:276] 0617 20:16:57.201555 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.201596 (+ 41us) service_pool.cc:224] Handling call
0617 20:17:00.779389 (+3577793us) ts_tablet_manager.cc:1151] Deleting tablet 4a6bf28f4e434da794db9391ca7ad738
0617 20:17:00.779445 (+ 56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.779715 (+ 270us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3577605}
W20260617 20:17:00.781204 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4a6bf28f4e434da794db9391ca7ad738 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a6bf28f4e434da794db9391ca7ad738 already in progress: creating tablet
I20260617 20:17:00.783123 29377 ts_tablet_manager.cc:1929] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:00.783252 29377 log.cc:1199] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/f24954093a45411a9cbe39415fb1adb7
I20260617 20:17:00.783536 29375 tablet_replica.cc:333] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:00.783595 29377 ts_tablet_manager.cc:1950] T f24954093a45411a9cbe39415fb1adb7 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:00.783892 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d673bc9892c94725b270ef3b9dc768f4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.784281 29375 raft_consensus.cc:2243] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:00.784734 29375 raft_consensus.cc:2272] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:00.790205 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet ba3ad8de250a47da9c9a31dff7f495b5 (table default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]). Expected version 2 got 0
I20260617 20:17:00.790618 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet e58fbec4a9f14ddda42b5a4c0263972c (table default.Table_efb89ae603ed4713a25716af39bf03c3 [id=cd4abe077ee04673bad87834b3af273b]). Expected version 3 got 0
I20260617 20:17:00.797961 29375 ts_tablet_manager.cc:1916] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:00.806169 28925 leader_election.cc:343] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:00.806507 29198 leader_election.cc:343] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 3ae50375e5934acbb213379fb7c87989
I20260617 20:17:00.806947 30339 tablet.cc:1724] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:00.809094 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5faea831376646c1bdfcaf8fbbc7ca6d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:00.812515 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3726e55ed36f420ab63bcfb5a81c5aab" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:00.813098 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d673bc9892c94725b270ef3b9dc768f4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:00.813725 30403 tablet.cc:1724] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:00.818285 30350 tablet.cc:1724] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:00.822778 29088 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43328 (request call id 144) took 1415 ms. Trace:
I20260617 20:17:00.822918 29088 rpcz_store.cc:276] 0617 20:16:59.407091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.407149 (+ 58us) service_pool.cc:224] Handling call
0617 20:16:59.451686 (+ 44537us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x616000212e54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:59.554098 (+102412us) spinlock_profiling.cc:243] Waited 93.9 ms on lock 0x616000087a54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.035387 (+481289us) spinlock_profiling.cc:243] Waited 98.3 ms on lock 0x6160000a4e54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.280485 (+245098us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x6160000c6754. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.653549 (+373064us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x616000125854. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.822745 (+169196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798443136}
I20260617 20:17:00.823310 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086bd3079e8f4a6d85ccc681a38a47b0" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:00.825505 29084 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43328 (request call id 146) took 1399 ms. Trace:
I20260617 20:17:00.825596 29084 rpcz_store.cc:276] 0617 20:16:59.425795 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.426097 (+ 302us) service_pool.cc:224] Handling call
0617 20:16:59.450947 (+ 24850us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x616000212e54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:59.574672 (+123725us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x616000087a54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.035387 (+460715us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x6160000a4e54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.306465 (+271078us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x6160000c6754. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.649579 (+343114us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x616000125854. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.825458 (+175879us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814152960}
I20260617 20:17:00.833592 29383 tablet_bootstrap.cc:654] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.838120 29087 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43328 (request call id 145) took 1412 ms. Trace:
I20260617 20:17:00.838227 29087 rpcz_store.cc:276] 0617 20:16:59.425642 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.425723 (+ 81us) service_pool.cc:224] Handling call
0617 20:16:59.449040 (+ 23317us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x616000212e54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:59.574643 (+125603us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x616000087a54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.035678 (+461035us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x6160000a4e54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.306024 (+270346us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x6160000c6754. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.657474 (+351450us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x616000125854. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.838076 (+180602us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1802697216}
I20260617 20:17:00.845553 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7b878728a495f83b6584f8a6aca67" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:00.846002 28983 raft_consensus.cc:3060] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.855036 29310 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:00.857064 28668 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 944) took 1367 ms. Trace:
I20260617 20:17:00.857232 28668 rpcz_store.cc:276] 0617 20:16:59.489230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.604532 (+115302us) service_pool.cc:224] Handling call
0617 20:16:59.614295 (+ 9763us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:16:59.615005 (+ 710us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:16:59.615519 (+ 514us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:00.856810 (+1241291us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:00.856922 (+ 112us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:00.857013 (+ 91us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.218350 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.221220 (+ 2870us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.221228 (+ 8us) write_op.cc:435] Acquired schema lock
0617 20:17:00.221232 (+ 4us) tablet.cc:662] Decoding operations
0617 20:17:00.243963 (+ 22731us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.243978 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.243985 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:00.244092 (+ 107us) tablet.cc:701] Row locks acquired
0617 20:17:00.244094 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:00.244154 (+ 60us) write_op.cc:270] Start()
0617 20:17:00.254672 (+ 10518us) write_op.cc:276] Timestamp: P: 1781727420244113 usec, L: 0
0617 20:17:00.254678 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.620380 (+365702us) log.cc:844] Serialized 433 byte log entry
0617 20:17:00.620738 (+ 358us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fa11ccaaf22 00007fa11e08c305 00007fa11e08ae29 00007fa11e093250 00007fa11e09305d 0000000000aa681c 00007fa110c759ff 00007fa110c78d1b 00007fa110c78b98 0000000000aa681c
0617 20:17:00.856082 (+235344us) op_driver.cc:464] REPLICATION: finished
0617 20:17:00.856230 (+ 148us) write_op.cc:301] APPLY: starting
0617 20:17:00.856249 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:00.856316 (+ 67us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:00.856319 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:00.856431 (+ 112us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:00.856467 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:00.856474 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:00.856550 (+ 76us) log.cc:844] Serialized 29 byte log entry
0617 20:17:00.856630 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.856648 (+ 18us) write_op.cc:454] Released schema lock
0617 20:17:00.856655 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:00.856733 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.856738 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":21684608,"child_traces":[["op",{"apply.queue_time_us":93,"apply.run_cpu_time_us":493,"apply.run_wall_time_us":492,"num_ops":2,"prepare.queue_time_us":602398,"prepare.run_cpu_time_us":3533,"prepare.run_wall_time_us":402427,"replication_time_us":601369,"spinlock_wait_cycles":840540032}]]}
I20260617 20:17:00.860400 28663 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 946) took 1345 ms. Trace:
I20260617 20:17:00.860504 28663 rpcz_store.cc:276] 0617 20:16:59.516025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.607765 (+ 91740us) service_pool.cc:224] Handling call
0617 20:16:59.616120 (+ 8355us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:16:59.616803 (+ 683us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:16:59.617204 (+ 401us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:00.860103 (+1242899us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:00.860231 (+ 128us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:00.860333 (+ 102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.620878 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.620996 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.621005 (+ 9us) write_op.cc:435] Acquired schema lock
0617 20:17:00.621009 (+ 4us) tablet.cc:662] Decoding operations
0617 20:17:00.621096 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.621106 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.621115 (+ 9us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:00.621192 (+ 77us) tablet.cc:701] Row locks acquired
0617 20:17:00.621198 (+ 6us) write_op.cc:260] PREPARE: finished
0617 20:17:00.621233 (+ 35us) write_op.cc:270] Start()
0617 20:17:00.621263 (+ 30us) write_op.cc:276] Timestamp: P: 1781727420621184 usec, L: 0
0617 20:17:00.621266 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.621469 (+ 203us) log.cc:844] Serialized 433 byte log entry
0617 20:17:00.856156 (+234687us) op_driver.cc:464] REPLICATION: finished
0617 20:17:00.856806 (+ 650us) write_op.cc:301] APPLY: starting
0617 20:17:00.856817 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:00.856849 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:00.856871 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:00.856968 (+ 97us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:00.856993 (+ 25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:00.856999 (+ 6us) write_op.cc:312] APPLY: finished
0617 20:17:00.857065 (+ 66us) log.cc:844] Serialized 29 byte log entry
0617 20:17:00.857125 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.857139 (+ 14us) write_op.cc:454] Released schema lock
0617 20:17:00.857144 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:00.857214 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.857223 (+ 9us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":18599296,"child_traces":[["op",{"apply.queue_time_us":616,"apply.run_cpu_time_us":397,"apply.run_wall_time_us":397,"num_ops":2,"prepare.queue_time_us":1003252,"prepare.run_cpu_time_us":651,"prepare.run_wall_time_us":651,"replication_time_us":234873}]]}
I20260617 20:17:00.862353 28662 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 947) took 1294 ms. Trace:
I20260617 20:17:00.862433 28662 rpcz_store.cc:276] 0617 20:16:59.568210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.629854 (+ 61644us) service_pool.cc:224] Handling call
0617 20:16:59.634555 (+ 4701us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:16:59.635296 (+ 741us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:16:59.635804 (+ 508us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:00.862141 (+1226337us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:00.862227 (+ 86us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:00.862300 (+ 73us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.621583 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.621676 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.621683 (+ 7us) write_op.cc:435] Acquired schema lock
0617 20:17:00.621686 (+ 3us) tablet.cc:662] Decoding operations
0617 20:17:00.621761 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.621769 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.621792 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:00.621859 (+ 67us) tablet.cc:701] Row locks acquired
0617 20:17:00.621862 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:00.621890 (+ 28us) write_op.cc:270] Start()
0617 20:17:00.621915 (+ 25us) write_op.cc:276] Timestamp: P: 1781727420621842 usec, L: 0
0617 20:17:00.621919 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.622047 (+ 128us) log.cc:844] Serialized 433 byte log entry
0617 20:17:00.856217 (+234170us) op_driver.cc:464] REPLICATION: finished
0617 20:17:00.857284 (+ 1067us) write_op.cc:301] APPLY: starting
0617 20:17:00.857323 (+ 39us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:00.857356 (+ 33us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:00.857381 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:00.857462 (+ 81us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:00.857489 (+ 27us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:00.857496 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:00.857554 (+ 58us) log.cc:844] Serialized 29 byte log entry
0617 20:17:00.857595 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.857608 (+ 13us) write_op.cc:454] Released schema lock
0617 20:17:00.857613 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":10207104,"child_traces":[["op",{"apply.queue_time_us":1033,"apply.run_cpu_time_us":385,"apply.run_wall_time_us":385,"num_ops":2,"prepare.queue_time_us":985284,"prepare.run_cpu_time_us":515,"prepare.run_wall_time_us":514,"replication_time_us":234283,"threads_started":1}]]}
I20260617 20:17:00.869791 29378 tablet_bootstrap.cc:492] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.870023 29378 ts_tablet_manager.cc:1403] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.416s user 0.073s sys 0.112s
I20260617 20:17:00.871006 29378 raft_consensus.cc:359] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.871321 29378 raft_consensus.cc:385] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.871443 29378 raft_consensus.cc:740] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.872277 29378 consensus_queue.cc:260] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.873196 29378 ts_tablet_manager.cc:1434] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:00.873865 30202 raft_consensus.cc:493] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.873980 30202 raft_consensus.cc:515] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.874490 30202 leader_election.cc:290] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:00.873755 29378 tablet_bootstrap.cc:492] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.875228 29379 consensus_queue.cc:260] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.875676 29376 ts_tablet_manager.cc:1929] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:00.875828 29376 log.cc:1199] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/c8d373f177494f1486fcae4a67a13041
I20260617 20:17:00.876166 29376 ts_tablet_manager.cc:1950] T c8d373f177494f1486fcae4a67a13041 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:00.876473 29378 tablet_bootstrap.cc:654] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.881181 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 666) took 2944 ms. Trace:
I20260617 20:17:00.881508 29379 ts_tablet_manager.cc:1434] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.283s user 0.019s sys 0.000s
I20260617 20:17:00.881373 29377 rpcz_store.cc:276] 0617 20:16:57.936828 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.939043 (+ 2215us) service_pool.cc:224] Handling call
0617 20:17:00.375435 (+2436392us) ts_tablet_manager.cc:1151] Deleting tablet f24954093a45411a9cbe39415fb1adb7
0617 20:17:00.375449 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.506694 (+131245us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.783054 (+276360us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.881161 (+ 98107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2436259}
I20260617 20:17:00.881865 29379 tablet_bootstrap.cc:492] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:00.881908 29377 tablet_replica.cc:333] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:00.882109 29377 raft_consensus.cc:2243] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:00.882347 29377 raft_consensus.cc:2272] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:00.882943 29377 ts_tablet_manager.cc:1916] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:00.883107 30294 raft_consensus.cc:493] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.883157 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet f24954093a45411a9cbe39415fb1adb7 (table default.Table_7ccf01ded0f84e49b3d9791d7ba4096a [id=28985cea8424471d86e5a1c33ee903d5]) successfully deleted
I20260617 20:17:00.883356 29379 tablet_bootstrap.cc:654] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.883278 30294 raft_consensus.cc:515] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:00.887576 29062 leader_election.cc:343] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d2db0467c5e64e38961d3b0e66375544
I20260617 20:17:00.887956 30294 leader_election.cc:290] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:00.889405 28983 raft_consensus.cc:2468] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:00.889575 29175 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:00.891846 30202 raft_consensus.cc:493] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.891971 30202 raft_consensus.cc:515] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.892505 30202 leader_election.cc:290] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:00.894618 30341 tablet.cc:1724] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:00.895298 30403 tablet.cc:1724] T d076991ad9fb4498a11fd22fa8339889 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:00.897267 28925 leader_election.cc:304] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.897651 30202 raft_consensus.cc:2804] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:00.897751 30202 raft_consensus.cc:697] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:00.897940 30202 consensus_queue.cc:237] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.902113 29383 tablet_bootstrap.cc:492] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:00.902942 29383 ts_tablet_manager.cc:1403] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.347s user 0.003s sys 0.001s
I20260617 20:17:00.903771 29383 raft_consensus.cc:359] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.904009 29383 raft_consensus.cc:385] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.904114 29383 raft_consensus.cc:740] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.904438 29383 consensus_queue.cc:260] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.909847 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 67a3124306094c72ad78e5473aa35bdb (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]) successfully deleted
I20260617 20:17:00.911439 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 648) took 3212 ms. Trace:
I20260617 20:17:00.911597 29376 rpcz_store.cc:276] 0617 20:16:57.698603 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.703632 (+ 5029us) service_pool.cc:224] Handling call
0617 20:17:00.689113 (+2985481us) ts_tablet_manager.cc:1151] Deleting tablet c8d373f177494f1486fcae4a67a13041
0617 20:17:00.689121 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.871722 (+182601us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.875614 (+ 3892us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:00.911423 (+ 35809us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2985350}
I20260617 20:17:00.912073 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 657) took 3187 ms. Trace:
I20260617 20:17:00.912199 29376 rpcz_store.cc:276] 0617 20:16:57.724773 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.724879 (+ 106us) service_pool.cc:224] Handling call
0617 20:17:00.911948 (+3187069us) ts_tablet_manager.cc:1151] Deleting tablet 9574c6f0765b4329af28d72c8e94240a
0617 20:17:00.911957 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.912058 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3186927}
I20260617 20:17:00.912506 29376 tablet_replica.cc:333] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:00.912719 29376 raft_consensus.cc:2243] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:00.915915 29376 raft_consensus.cc:2272] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:00.916492 29376 ts_tablet_manager.cc:1916] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:00.919026 29085 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:43328 (request call id 143) took 1549 ms. Trace:
I20260617 20:17:00.919740 29085 rpcz_store.cc:276] 0617 20:16:59.369473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.369533 (+ 60us) service_pool.cc:224] Handling call
0617 20:16:59.445240 (+ 75707us) spinlock_profiling.cc:243] Waited 69.2 ms on lock 0x616000212e54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:16:59.574738 (+129498us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x616000087a54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.030139 (+455401us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x6160000a4e54. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.280189 (+250050us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x6160000c6754. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.645997 (+365808us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x616000125854. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedca7458c0 00007fedce5f6f1f 00007fedc8a18c36 00007fedc8a18965 00007fedc57da88e 00007fedc57d976e 00007fedc57df9a8 00007fedc57e030f 00007fedc57e0138 0000000000aa681c
0617 20:17:00.919000 (+273003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2728015744}
I20260617 20:17:00.922385 29378 tablet_bootstrap.cc:492] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.922574 29378 ts_tablet_manager.cc:1403] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.049s user 0.004s sys 0.003s
I20260617 20:17:00.922597 28925 leader_election.cc:304] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.923069 30314 raft_consensus.cc:2804] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:00.923149 30314 raft_consensus.cc:493] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:00.923219 30314 raft_consensus.cc:3060] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.923303 29378 raft_consensus.cc:359] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.923461 29378 raft_consensus.cc:385] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.923514 29378 raft_consensus.cc:740] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.923695 29378 consensus_queue.cc:260] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.924224 29378 ts_tablet_manager.cc:1434] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:00.924458 29378 tablet_bootstrap.cc:492] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:00.926231 29378 tablet_bootstrap.cc:654] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.929849 29383 ts_tablet_manager.cc:1434] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
W20260617 20:17:00.927564 28925 leader_election.cc:343] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.930616 28925 leader_election.cc:304] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:00.931157 30201 raft_consensus.cc:2749] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:00.931295 30201 consensus_queue.cc:1048] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:00.932623 29383 tablet_bootstrap.cc:492] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:00.937799 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed593a3fa7742a18ccc2124c3ee0fb9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.938256 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18440a4a5c254a25b87f8632de9c92b9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:00.938366 30350 tablet.cc:1724] T d076991ad9fb4498a11fd22fa8339889 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:00.938774 29197 leader_election.cc:304] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.939008 30420 raft_consensus.cc:2804] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:00.939070 30420 raft_consensus.cc:493] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:00.939121 30420 raft_consensus.cc:3060] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.941879 29197 leader_election.cc:304] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:00.942286 30423 raft_consensus.cc:2804] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:00.942378 30423 raft_consensus.cc:493] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:00.942444 30423 raft_consensus.cc:3060] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:00.944710 29379 tablet_bootstrap.cc:492] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:00.945817 29379 ts_tablet_manager.cc:1403] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.064s user 0.008s sys 0.003s
I20260617 20:17:00.946447 29379 raft_consensus.cc:359] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.946616 29379 raft_consensus.cc:385] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.946666 29379 raft_consensus.cc:740] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.946846 29379 consensus_queue.cc:260] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.950660 29383 tablet_bootstrap.cc:654] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.951938 28670 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 948) took 1333 ms. Trace:
I20260617 20:17:00.952059 28670 rpcz_store.cc:276] 0617 20:16:59.618723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.652985 (+ 34262us) service_pool.cc:224] Handling call
0617 20:16:59.654177 (+ 1192us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:16:59.654724 (+ 547us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:00.951661 (+1296937us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:00.951770 (+ 109us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:00.951879 (+ 109us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.622133 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.622224 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.622228 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:00.622230 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:00.622294 (+ 64us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.622301 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.622306 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:00.622370 (+ 64us) tablet.cc:701] Row locks acquired
0617 20:17:00.622372 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:00.622398 (+ 26us) write_op.cc:270] Start()
0617 20:17:00.622420 (+ 22us) write_op.cc:276] Timestamp: P: 1781727420622351 usec, L: 0
0617 20:17:00.622423 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.622575 (+ 152us) log.cc:844] Serialized 433 byte log entry
0617 20:17:00.950914 (+328339us) op_driver.cc:464] REPLICATION: finished
0617 20:17:00.951105 (+ 191us) write_op.cc:301] APPLY: starting
0617 20:17:00.951121 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:00.951166 (+ 45us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:00.951207 (+ 41us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:00.951351 (+ 144us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:00.951384 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:00.951392 (+ 8us) write_op.cc:312] APPLY: finished
0617 20:17:00.951490 (+ 98us) log.cc:844] Serialized 29 byte log entry
0617 20:17:00.951558 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.951574 (+ 16us) write_op.cc:454] Released schema lock
0617 20:17:00.951580 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":124,"num_ops":2,"prepare.queue_time_us":966841,"prepare.run_cpu_time_us":492,"prepare.run_wall_time_us":491,"replication_time_us":328456}]]}
I20260617 20:17:00.955847 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 1ed860fa375848708beb31ff89056214
I20260617 20:17:00.956456 28661 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:60552 (request call id 949) took 1300 ms. Trace:
I20260617 20:17:00.956561 28661 rpcz_store.cc:276] 0617 20:16:59.655710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.662774 (+ 7064us) service_pool.cc:224] Handling call
0617 20:16:59.676405 (+ 13631us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd16b6 00007fa11b62e486 00007fa11b62e1b5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:16:59.676860 (+ 455us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:16:59.677032 (+ 172us) catalog_manager.cc:2840] Modifying in-memory table state
0617 20:16:59.677119 (+ 87us) catalog_manager.cc:2849] Locking tablets
0617 20:16:59.677283 (+ 164us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 20:17:00.955538 (+1278255us) catalog_manager.cc:2881] Removing table from by-name map
0617 20:17:00.955648 (+ 110us) catalog_manager.cc:2897] Committing in-memory state
0617 20:17:00.955697 (+ 49us) catalog_manager.cc:2901] Aborting table tasks
0617 20:17:00.956418 (+ 721us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.622661 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.622747 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.622751 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:00.622753 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:00.622875 (+ 122us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.622883 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.622888 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:00.622967 (+ 79us) tablet.cc:701] Row locks acquired
0617 20:17:00.622969 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:00.622995 (+ 26us) write_op.cc:270] Start()
0617 20:17:00.623017 (+ 22us) write_op.cc:276] Timestamp: P: 1781727420622948 usec, L: 0
0617 20:17:00.623020 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.623154 (+ 134us) log.cc:844] Serialized 765 byte log entry
0617 20:17:00.951010 (+327856us) op_driver.cc:464] REPLICATION: finished
0617 20:17:00.955012 (+ 4002us) write_op.cc:301] APPLY: starting
0617 20:17:00.955030 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:00.955084 (+ 54us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:00.955115 (+ 31us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:00.955197 (+ 82us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:00.955238 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 20:17:00.955249 (+ 11us) write_op.cc:312] APPLY: finished
0617 20:17:00.955332 (+ 83us) log.cc:844] Serialized 29 byte log entry
0617 20:17:00.955408 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.955425 (+ 17us) write_op.cc:454] Released schema lock
0617 20:17:00.955434 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":31,"spinlock_wait_cycles":30741760,"child_traces":[["op",{"apply.queue_time_us":3955,"num_ops":2,"prepare.queue_time_us":944513,"prepare.run_cpu_time_us":540,"prepare.run_wall_time_us":539,"replication_time_us":327969}]]}
I20260617 20:17:00.957729 29379 ts_tablet_manager.cc:1434] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260617 20:17:00.957756 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed860fa375848708beb31ff89056214 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:17:00.959251 28925 leader_election.cc:343] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.959383 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed860fa375848708beb31ff89056214 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:00.959461 28925 leader_election.cc:304] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:00.959663 30201 raft_consensus.cc:2749] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:00.959870 30201 raft_consensus.cc:493] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.959965 30201 raft_consensus.cc:515] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:00.960090 28657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.252:46059, user_credentials={real_user=slave}} blocked reactor thread for 90953.9us
I20260617 20:17:00.960531 30201 leader_election.cc:290] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:00.960887 28925 leader_election.cc:343] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:00.961030 28925 leader_election.cc:304] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:00.961244 30201 raft_consensus.cc:2749] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:00.961699 30201 consensus_queue.cc:1048] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:00.966010 29378 tablet_bootstrap.cc:492] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:00.971779 28667 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 2abd2e89cd5c4cf79e72426e700b838f
I20260617 20:17:00.971940 28667 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:60552 (request call id 950) took 1296 ms. Trace:
I20260617 20:17:00.972033 28667 rpcz_store.cc:276] 0617 20:16:59.675643 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.687017 (+ 11374us) service_pool.cc:224] Handling call
0617 20:16:59.691268 (+ 4251us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd16b6 00007fa11b62e486 00007fa11b62e1b5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:16:59.691646 (+ 378us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:16:59.691762 (+ 116us) catalog_manager.cc:2840] Modifying in-memory table state
0617 20:16:59.691840 (+ 78us) catalog_manager.cc:2849] Locking tablets
0617 20:16:59.691960 (+ 120us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 20:17:00.971538 (+1279578us) catalog_manager.cc:2881] Removing table from by-name map
0617 20:17:00.971614 (+ 76us) catalog_manager.cc:2897] Committing in-memory state
0617 20:17:00.971650 (+ 36us) catalog_manager.cc:2901] Aborting table tasks
0617 20:17:00.971880 (+ 230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.623237 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.623316 (+ 79us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.623320 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:00.623322 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:00.623407 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.623414 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.623418 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:00.623476 (+ 58us) tablet.cc:701] Row locks acquired
0617 20:17:00.623478 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:00.623503 (+ 25us) write_op.cc:270] Start()
0617 20:17:00.623526 (+ 23us) write_op.cc:276] Timestamp: P: 1781727420623456 usec, L: 0
0617 20:17:00.623531 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.623649 (+ 118us) log.cc:844] Serialized 533 byte log entry
0617 20:17:00.970836 (+347187us) op_driver.cc:464] REPLICATION: finished
0617 20:17:00.970973 (+ 137us) write_op.cc:301] APPLY: starting
0617 20:17:00.970988 (+ 15us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:00.971034 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:00.971061 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:00.971121 (+ 60us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:00.971277 (+ 156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 20:17:00.971285 (+ 8us) write_op.cc:312] APPLY: finished
0617 20:17:00.971367 (+ 82us) log.cc:844] Serialized 29 byte log entry
0617 20:17:00.971433 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.971449 (+ 16us) write_op.cc:454] Released schema lock
0617 20:17:00.971456 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":53,"spinlock_wait_cycles":9224448,"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":450,"apply.run_wall_time_us":745,"num_ops":2,"prepare.queue_time_us":930709,"prepare.run_cpu_time_us":457,"prepare.run_wall_time_us":456,"replication_time_us":347271}]]}
I20260617 20:17:00.969426 30201 raft_consensus.cc:493] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:00.973420 30201 raft_consensus.cc:515] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.974014 30201 leader_election.cc:290] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:00.973433 29378 ts_tablet_manager.cc:1403] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.002s
I20260617 20:17:00.974988 28664 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 951) took 1295 ms. Trace:
I20260617 20:17:00.975112 28664 rpcz_store.cc:276] 0617 20:16:59.679499 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.705061 (+ 25562us) service_pool.cc:224] Handling call
0617 20:16:59.706268 (+ 1207us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:16:59.706697 (+ 429us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:00.974731 (+1268034us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:00.974833 (+ 102us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:00.974936 (+ 103us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.623729 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.623836 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.623841 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:00.623843 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:00.623904 (+ 61us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.623912 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.623916 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:00.624009 (+ 93us) tablet.cc:701] Row locks acquired
0617 20:17:00.624011 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:00.624038 (+ 27us) write_op.cc:270] Start()
0617 20:17:00.624061 (+ 23us) write_op.cc:276] Timestamp: P: 1781727420623990 usec, L: 0
0617 20:17:00.624064 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.624189 (+ 125us) log.cc:844] Serialized 433 byte log entry
0617 20:17:00.970904 (+346715us) op_driver.cc:464] REPLICATION: finished
0617 20:17:00.974129 (+ 3225us) write_op.cc:301] APPLY: starting
0617 20:17:00.974216 (+ 87us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:00.974252 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:00.974285 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:00.974387 (+ 102us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:00.974417 (+ 30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:00.974424 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:00.974519 (+ 95us) log.cc:844] Serialized 29 byte log entry
0617 20:17:00.974630 (+ 111us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.974647 (+ 17us) write_op.cc:454] Released schema lock
0617 20:17:00.974653 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3186,"num_ops":2,"prepare.queue_time_us":916503,"prepare.run_cpu_time_us":507,"prepare.run_wall_time_us":506,"replication_time_us":346826}]]}
I20260617 20:17:00.975414 29378 raft_consensus.cc:359] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.975688 29378 raft_consensus.cc:385] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:00.975757 29378 raft_consensus.cc:740] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:00.975953 29378 consensus_queue.cc:260] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.977258 29378 ts_tablet_manager.cc:1434] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:00.977752 30420 raft_consensus.cc:515] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.978312 30420 leader_election.cc:290] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:00.979305 29379 tablet_bootstrap.cc:492] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:00.980898 29379 tablet_bootstrap.cc:654] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.981164 30314 raft_consensus.cc:515] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:00.981721 30314 leader_election.cc:290] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:00.981160 29378 tablet_bootstrap.cc:492] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:17:00.985414 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb2a0578122c421ab45bf56edb7cffdb consensus state has no leader
I20260617 20:17:00.985626 28666 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60552 (request call id 952) took 1294 ms. Trace:
I20260617 20:17:00.985723 28666 rpcz_store.cc:276] 0617 20:16:59.690707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.736266 (+ 45559us) service_pool.cc:224] Handling call
0617 20:16:59.736647 (+ 381us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:16:59.736868 (+ 221us) catalog_manager.cc:3750] Apply alter schema
0617 20:16:59.737048 (+ 180us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 20:16:59.737103 (+ 55us) catalog_manager.cc:3940] Updating metadata on disk
0617 20:17:00.985136 (+1248033us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 20:17:00.985579 (+ 443us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.624273 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.624356 (+ 83us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.624360 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:00.624362 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:00.624434 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.624441 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.624447 (+ 6us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:00.624489 (+ 42us) tablet.cc:701] Row locks acquired
0617 20:17:00.624491 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:00.624516 (+ 25us) write_op.cc:270] Start()
0617 20:17:00.624537 (+ 21us) write_op.cc:276] Timestamp: P: 1781727420624469 usec, L: 0
0617 20:17:00.624540 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.624662 (+ 122us) log.cc:844] Serialized 405 byte log entry
0617 20:17:00.984360 (+359698us) op_driver.cc:464] REPLICATION: finished
0617 20:17:00.984502 (+ 142us) write_op.cc:301] APPLY: starting
0617 20:17:00.984515 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:00.984545 (+ 30us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:00.984567 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:00.984612 (+ 45us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:00.984640 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:00.984773 (+ 133us) write_op.cc:312] APPLY: finished
0617 20:17:00.984854 (+ 81us) log.cc:844] Serialized 23 byte log entry
0617 20:17:00.985038 (+ 184us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.985054 (+ 16us) write_op.cc:454] Released schema lock
0617 20:17:00.985061 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":96,"num_ops":1,"prepare.queue_time_us":883797,"prepare.run_cpu_time_us":437,"prepare.run_wall_time_us":436,"replication_time_us":359793}]]}
W20260617 20:17:00.988229 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 44654.9us
I20260617 20:17:00.990252 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 64bb6d176a4845eca312848ae5104647
I20260617 20:17:00.990736 29378 tablet_bootstrap.cc:654] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:00.990883 28669 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:60552 (request call id 953) took 1287 ms. Trace:
I20260617 20:17:00.991245 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet 64bb6d176a4845eca312848ae5104647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:00 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:00.990985 28669 rpcz_store.cc:276] 0617 20:16:59.703184 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.633826 (+930642us) service_pool.cc:224] Handling call
0617 20:17:00.640207 (+ 6381us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:17:00.640720 (+ 513us) catalog_manager.cc:2840] Modifying in-memory table state
0617 20:17:00.641010 (+ 290us) catalog_manager.cc:2849] Locking tablets
0617 20:17:00.641712 (+ 702us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 20:17:00.989827 (+348115us) catalog_manager.cc:2881] Removing table from by-name map
0617 20:17:00.990139 (+ 312us) catalog_manager.cc:2897] Committing in-memory state
0617 20:17:00.990189 (+ 50us) catalog_manager.cc:2901] Aborting table tasks
0617 20:17:00.990825 (+ 636us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.642747 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.642869 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.642875 (+ 6us) write_op.cc:435] Acquired schema lock
0617 20:17:00.642878 (+ 3us) tablet.cc:662] Decoding operations
0617 20:17:00.642985 (+ 107us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.642994 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.643000 (+ 6us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:00.643128 (+ 128us) tablet.cc:701] Row locks acquired
0617 20:17:00.643130 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:00.643163 (+ 33us) write_op.cc:270] Start()
0617 20:17:00.643200 (+ 37us) write_op.cc:276] Timestamp: P: 1781727420643113 usec, L: 0
0617 20:17:00.643203 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.643378 (+ 175us) log.cc:844] Serialized 774 byte log entry
0617 20:17:00.984436 (+341058us) op_driver.cc:464] REPLICATION: finished
0617 20:17:00.987189 (+ 2753us) write_op.cc:301] APPLY: starting
0617 20:17:00.987203 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:00.987239 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:00.987278 (+ 39us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:00.987336 (+ 58us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:00.987364 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 20:17:00.987371 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:00.987428 (+ 57us) log.cc:844] Serialized 29 byte log entry
0617 20:17:00.987490 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:00.987505 (+ 15us) write_op.cc:454] Released schema lock
0617 20:17:00.987511 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2714,"apply.run_cpu_time_us":379,"apply.run_wall_time_us":378,"num_ops":2,"prepare.queue_time_us":81,"prepare.run_cpu_time_us":715,"prepare.run_wall_time_us":716,"replication_time_us":341213}]]}
I20260617 20:17:00.991762 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_43860bd130d547878e058c369421cbba" } new_table_name: "default.Table_762c733e4f8445ad97f36fc9ee70147a" modify_external_catalogs: true
I20260617 20:17:00.991919 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f83bfe624dc64693998c453f0f0c42fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:00.992489 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f83bfe624dc64693998c453f0f0c42fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:00.994617 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6bb71611d01f469a95325bc9bbcd5251" } modify_external_catalogs: true
I20260617 20:17:00.994797 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6bb71611d01f469a95325bc9bbcd5251" } modify_external_catalogs: true
I20260617 20:17:00.995486 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_20836b89113d47f1a735b4f6100d9002" } new_table_name: "default.Table_5bb2dea5397f4dee834759955006f657" modify_external_catalogs: true
I20260617 20:17:00.997527 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 64bb6d176a4845eca312848ae5104647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:00 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:01.004549 29197 leader_election.cc:304] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.005236 30420 raft_consensus.cc:2804] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:01.005367 30420 raft_consensus.cc:493] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:01.005434 30420 raft_consensus.cc:3060] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.005914 30253 consensus_queue.cc:1048] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:01.007135 29197 consensus_peers.cc:597] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2c0988a73d547d08d0924784bff9222. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.007436 29197 leader_election.cc:304] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.007830 30253 raft_consensus.cc:2804] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:01.007932 30253 raft_consensus.cc:697] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:01.008164 30253 consensus_queue.cc:237] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.011168 29378 tablet_bootstrap.cc:492] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.011358 29378 ts_tablet_manager.cc:1403] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.000s
I20260617 20:17:01.012115 29378 raft_consensus.cc:359] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.012434 29378 raft_consensus.cc:385] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.012529 29378 raft_consensus.cc:740] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.012785 29378 consensus_queue.cc:260] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.013173 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a6787e5dc20a42b6812d3cd0acc6112c" } modify_external_catalogs: true
I20260617 20:17:01.019225 29383 tablet_bootstrap.cc:492] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.019362 29383 ts_tablet_manager.cc:1403] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.087s user 0.003s sys 0.001s
I20260617 20:17:01.020470 29383 raft_consensus.cc:359] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.020689 29383 raft_consensus.cc:385] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.020766 29383 raft_consensus.cc:740] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.021205 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a6787e5dc20a42b6812d3cd0acc6112c" } modify_external_catalogs: true
I20260617 20:17:01.024080 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_edd43d9adb4a4c32b4de61db1c2c6885"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:01.024745 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_edd43d9adb4a4c32b4de61db1c2c6885 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:01.024849 30202 raft_consensus.cc:493] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.024976 30202 raft_consensus.cc:515] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.025862 30202 leader_election.cc:290] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.026473 29378 ts_tablet_manager.cc:1434] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20260617 20:17:01.026743 29378 tablet_bootstrap.cc:492] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:01.028728 29379 tablet_bootstrap.cc:492] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.028847 29379 ts_tablet_manager.cc:1403] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.000s
I20260617 20:17:01.029544 29379 raft_consensus.cc:359] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.029687 29379 raft_consensus.cc:385] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.029731 29379 raft_consensus.cc:740] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.029899 29379 consensus_queue.cc:260] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.021008 29383 consensus_queue.cc:260] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.031697 29383 ts_tablet_manager.cc:1434] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20260617 20:17:01.032078 29383 tablet_bootstrap.cc:492] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:01.032903 29379 ts_tablet_manager.cc:1434] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:17:01.033864 29379 tablet_bootstrap.cc:492] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.035372 29379 tablet_bootstrap.cc:654] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.037245 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 7efe079091784d7e8035659edd442ba6 (table default.Table_6bb71611d01f469a95325bc9bbcd5251 [id=f0df4d60a326473a8fc3d040ed7324d7]). Expected version 1 got 0
I20260617 20:17:01.037571 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 086bd3079e8f4a6d85ccc681a38a47b0 (table default.Table_87c7eb0a5f3843a4ae45931a17a7b234 [id=cb568e8af2da4807b99a6d07c57afca9]). Expected version 3 got 0
I20260617 20:17:01.037825 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 3 got 0
I20260617 20:17:01.038419 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:17:01.041682 29378 tablet_bootstrap.cc:654] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.045032 29383 tablet_bootstrap.cc:654] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:01.051625 28925 consensus_peers.cc:597] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:01.052187 28925 consensus_peers.cc:597] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.053014 29063 leader_election.cc:304] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.053463 30294 raft_consensus.cc:2749] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:01.055296 30339 tablet.cc:1724] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 20:17:01.055534 28925 leader_election.cc:343] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.055859 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090b8720e5df447aa0da147bd8dfaa8c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:01.056211 28925 leader_election.cc:343] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:01.063206 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 55819.6us
W20260617 20:17:01.063880 29197 leader_election.cc:343] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3ae50375e5934acbb213379fb7c87989
I20260617 20:17:01.064078 29197 leader_election.cc:304] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.064530 30253 raft_consensus.cc:2749] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.067842 30294 raft_consensus.cc:493] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.067979 30294 raft_consensus.cc:515] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.068540 30294 leader_election.cc:290] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:01.069525 29062 leader_election.cc:343] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b19bce310bd24294b063b3b4f76b9f99
I20260617 20:17:01.071347 29378 tablet_bootstrap.cc:492] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.072023 29379 tablet_bootstrap.cc:492] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.072198 29379 ts_tablet_manager.cc:1403] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.002s
I20260617 20:17:01.072924 29379 raft_consensus.cc:359] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.071498 30202 raft_consensus.cc:493] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.073194 30202 raft_consensus.cc:515] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.073870 30202 leader_election.cc:290] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.074317 29378 ts_tablet_manager.cc:1403] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.048s user 0.006s sys 0.002s
I20260617 20:17:01.074796 29376 ts_tablet_manager.cc:1929] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:01.074951 29376 log.cc:1199] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/af9c687fe56f42af82dd4728ca53cd32
I20260617 20:17:01.074962 29379 raft_consensus.cc:385] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.075052 29379 raft_consensus.cc:740] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.075321 29376 ts_tablet_manager.cc:1950] T af9c687fe56f42af82dd4728ca53cd32 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:01.075320 29379 consensus_queue.cc:260] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.076000 29378 raft_consensus.cc:359] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.076447 30423 raft_consensus.cc:515] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:01.077047 30423 leader_election.cc:290] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:01.078344 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet c8d373f177494f1486fcae4a67a13041 (table default.Table_fb580c3d4089464aa53ff2360464aaae [id=9abd27ea648b4d3f9fb79584fe4e9fb8]) successfully deleted
W20260617 20:17:01.078644 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 9574c6f0765b4329af28d72c8e94240a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9574c6f0765b4329af28d72c8e94240a already in progress: creating tablet
I20260617 20:17:01.083405 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2db0467c5e64e38961d3b0e66375544" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.083586 29260 raft_consensus.cc:2468] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:01.083838 29379 ts_tablet_manager.cc:1434] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260617 20:17:01.084107 29378 raft_consensus.cc:385] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.084487 29379 tablet_bootstrap.cc:492] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.084589 29378 raft_consensus.cc:740] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.084893 29378 consensus_queue.cc:260] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.085259 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ed860fa375848708beb31ff89056214 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:01.085806 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet 64bb6d176a4845eca312848ae5104647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:00 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:01.086458 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18440a4a5c254a25b87f8632de9c92b9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.086799 29379 tablet_bootstrap.cc:654] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.087450 29378 ts_tablet_manager.cc:1434] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260617 20:17:01.087925 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed593a3fa7742a18ccc2124c3ee0fb9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.088056 29378 tablet_bootstrap.cc:492] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:01.083905 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090b8720e5df447aa0da147bd8dfaa8c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:01.088340 28990 raft_consensus.cc:3060] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:01.090945 29062 consensus_peers.cc:597] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e27c5834baa48ed953fccef54e6c52b. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.081605 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b06f05d9b4273a61bcb2d6e0ad796" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:01.092177 28985 raft_consensus.cc:3060] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.092494 29378 tablet_bootstrap.cc:654] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.096122 29378 tablet_bootstrap.cc:492] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.096249 29378 ts_tablet_manager.cc:1403] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260617 20:17:01.096979 29378 raft_consensus.cc:359] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:01.097141 29378 raft_consensus.cc:385] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.097203 29378 raft_consensus.cc:740] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.098482 29383 tablet_bootstrap.cc:492] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.098615 29383 ts_tablet_manager.cc:1403] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.067s user 0.000s sys 0.002s
I20260617 20:17:01.099143 29379 tablet_bootstrap.cc:492] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.099251 29379 ts_tablet_manager.cc:1403] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260617 20:17:01.099318 29383 raft_consensus.cc:359] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.099453 29383 raft_consensus.cc:385] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.099495 29383 raft_consensus.cc:740] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.099666 29383 consensus_queue.cc:260] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.103153 29379 raft_consensus.cc:359] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.103368 29379 raft_consensus.cc:385] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.103459 29379 raft_consensus.cc:740] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.103641 29378 consensus_queue.cc:260] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:01.103957 29379 consensus_queue.cc:260] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.104640 29378 ts_tablet_manager.cc:1434] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260617 20:17:01.105098 29379 ts_tablet_manager.cc:1434] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:17:01.105415 29379 tablet_bootstrap.cc:492] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:17:01.104856 30424 log.cc:927] Time spent T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260617 20:17:01.105705 29378 tablet_bootstrap.cc:492] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:01.107288 29378 tablet_bootstrap.cc:654] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.109525 29379 tablet_bootstrap.cc:654] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.111111 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59430dd630b4ca6b573ea4230212abf" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.112349 28664 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 957) took 1313 ms. Trace:
I20260617 20:17:01.112488 28664 rpcz_store.cc:276] 0617 20:16:59.799593 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.975630 (+1176037us) service_pool.cc:224] Handling call
0617 20:17:00.991867 (+ 16237us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:00.992581 (+ 714us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:00.993039 (+ 458us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:01.112075 (+119036us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:01.112201 (+ 126us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:01.112311 (+ 110us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.993764 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.993882 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.993892 (+ 10us) write_op.cc:435] Acquired schema lock
0617 20:17:00.993896 (+ 4us) tablet.cc:662] Decoding operations
0617 20:17:00.993998 (+ 102us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.994007 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.994014 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:00.994077 (+ 63us) tablet.cc:701] Row locks acquired
0617 20:17:00.994080 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:00.994108 (+ 28us) write_op.cc:270] Start()
0617 20:17:00.994136 (+ 28us) write_op.cc:276] Timestamp: P: 1781727420994072 usec, L: 0
0617 20:17:00.994139 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.994287 (+ 148us) log.cc:844] Serialized 433 byte log entry
0617 20:17:01.111536 (+117249us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.111601 (+ 65us) write_op.cc:301] APPLY: starting
0617 20:17:01.111609 (+ 8us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.111647 (+ 38us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.111680 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.111810 (+ 130us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.111830 (+ 20us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:01.111835 (+ 5us) write_op.cc:312] APPLY: finished
0617 20:17:01.111878 (+ 43us) log.cc:844] Serialized 29 byte log entry
0617 20:17:01.111956 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.111987 (+ 31us) write_op.cc:454] Released schema lock
0617 20:17:01.111993 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":36763008,"child_traces":[["op",{"apply.queue_time_us":23,"num_ops":2,"prepare.queue_time_us":306,"prepare.run_cpu_time_us":613,"prepare.run_wall_time_us":613,"raft.queue_time_us":8662,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":13,"replication_time_us":117375,"spinlock_wait_cycles":384}]]}
W20260617 20:17:01.113759 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d44524b02e6f4c1291bca50e9261459b consensus state has no leader
I20260617 20:17:01.113930 28662 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60552 (request call id 954) took 1389 ms. Trace:
I20260617 20:17:01.114024 28662 rpcz_store.cc:276] 0617 20:16:59.724349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.862935 (+1138586us) service_pool.cc:224] Handling call
0617 20:17:00.995397 (+132462us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd2956 00007fa11b630146 00007fa11b62fe75 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:00.995686 (+ 289us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:17:00.995921 (+ 235us) catalog_manager.cc:3750] Apply alter schema
0617 20:17:00.996108 (+ 187us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 20:17:00.996192 (+ 84us) catalog_manager.cc:3940] Updating metadata on disk
0617 20:17:01.113561 (+117369us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 20:17:01.113877 (+ 316us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.996723 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.996815 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.996822 (+ 7us) write_op.cc:435] Acquired schema lock
0617 20:17:00.996826 (+ 4us) tablet.cc:662] Decoding operations
0617 20:17:00.996915 (+ 89us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.996925 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.996929 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:00.996981 (+ 52us) tablet.cc:701] Row locks acquired
0617 20:17:00.996985 (+ 4us) write_op.cc:260] PREPARE: finished
0617 20:17:00.997017 (+ 32us) write_op.cc:270] Start()
0617 20:17:00.997056 (+ 39us) write_op.cc:276] Timestamp: P: 1781727420996981 usec, L: 0
0617 20:17:00.997059 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.997216 (+ 157us) log.cc:844] Serialized 405 byte log entry
0617 20:17:01.111603 (+114387us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.111664 (+ 61us) write_op.cc:301] APPLY: starting
0617 20:17:01.111672 (+ 8us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.111703 (+ 31us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.111719 (+ 16us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.111757 (+ 38us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.111788 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:01.111795 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:01.111879 (+ 84us) log.cc:844] Serialized 23 byte log entry
0617 20:17:01.113390 (+ 1511us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.113405 (+ 15us) write_op.cc:454] Released schema lock
0617 20:17:01.113410 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:01.113479 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.113482 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":304006912,"child_traces":[["op",{"apply.queue_time_us":29,"apply.run_cpu_time_us":375,"apply.run_wall_time_us":1805,"mutex_wait_us":1438,"num_ops":1,"prepare.queue_time_us":52,"prepare.run_cpu_time_us":11294,"prepare.run_wall_time_us":72058,"raft.queue_time_us":5825,"raft.run_cpu_time_us":9,"raft.run_wall_time_us":8,"replication_time_us":114527,"thread_start_us":71447,"threads_started":1}]]}
I20260617 20:17:01.114847 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_28f33cd39a814646bedf696c7f0db67c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:01.115437 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28f33cd39a814646bedf696c7f0db67c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:01.113250 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d5804c5dc2dd4b429190b2aefcbfd3f9" } new_table_name: "default.Table_b483cf7dec364fe98091142bf8d1a6a2" modify_external_catalogs: true
W20260617 20:17:01.118880 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c17aa7f99fc74838b9975c3e9289ccfd consensus state has no leader
I20260617 20:17:01.119065 28669 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60552 (request call id 959) took 1242 ms. Trace:
I20260617 20:17:01.119159 28669 rpcz_store.cc:276] 0617 20:16:59.876989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.991593 (+1114604us) service_pool.cc:224] Handling call
0617 20:17:00.991960 (+ 367us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:17:00.992152 (+ 192us) catalog_manager.cc:3750] Apply alter schema
0617 20:17:00.992295 (+ 143us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 20:17:00.992363 (+ 68us) catalog_manager.cc:3940] Updating metadata on disk
0617 20:17:01.118682 (+126319us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 20:17:01.119001 (+ 319us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.993076 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.993175 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.993180 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:00.993182 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:00.993263 (+ 81us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.993273 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.993278 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:00.993371 (+ 93us) tablet.cc:701] Row locks acquired
0617 20:17:00.993373 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:00.993407 (+ 34us) write_op.cc:270] Start()
0617 20:17:00.993436 (+ 29us) write_op.cc:276] Timestamp: P: 1781727420993372 usec, L: 0
0617 20:17:00.993440 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.993630 (+ 190us) log.cc:844] Serialized 405 byte log entry
0617 20:17:01.110968 (+117338us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.111529 (+ 561us) write_op.cc:301] APPLY: starting
0617 20:17:01.111548 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.118256 (+ 6708us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.118286 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.118332 (+ 46us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.118363 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:01.118370 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:01.118446 (+ 76us) log.cc:844] Serialized 23 byte log entry
0617 20:17:01.118514 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.118528 (+ 14us) write_op.cc:454] Released schema lock
0617 20:17:01.118535 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:01.118602 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.118605 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":55,"apply.run_cpu_time_us":413,"apply.run_wall_time_us":7070,"num_ops":1,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":646,"prepare.run_wall_time_us":645,"raft.queue_time_us":4518,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":15003,"replication_time_us":117487}]]}
I20260617 20:17:01.119959 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_83cd5e3f2921420f822eee497a0087d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:01.120517 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83cd5e3f2921420f822eee497a0087d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:01.121810 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5241ab75a034ee3b57c07185835a858" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.122820 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5d9677bc184c30be1a11bfa85a97c8" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:01.130575 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5a20867de1214c0fb4cb8504e8361c5b
I20260617 20:17:01.131065 28661 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:60552 (request call id 955) took 1401 ms. Trace:
I20260617 20:17:01.131145 28661 rpcz_store.cc:276] 0617 20:16:59.730088 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.957127 (+1227039us) service_pool.cc:224] Handling call
0617 20:17:01.013106 (+ 55979us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd16b6 00007fa11b62e486 00007fa11b62e1b5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:01.021422 (+ 8316us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:17:01.021615 (+ 193us) catalog_manager.cc:2840] Modifying in-memory table state
0617 20:17:01.021711 (+ 96us) catalog_manager.cc:2849] Locking tablets
0617 20:17:01.021917 (+ 206us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 20:17:01.130399 (+108482us) catalog_manager.cc:2881] Removing table from by-name map
0617 20:17:01.130484 (+ 85us) catalog_manager.cc:2897] Committing in-memory state
0617 20:17:01.130525 (+ 41us) catalog_manager.cc:2901] Aborting table tasks
0617 20:17:01.131014 (+ 489us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:01.068822 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:01.068945 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:01.068952 (+ 7us) write_op.cc:435] Acquired schema lock
0617 20:17:01.068956 (+ 4us) tablet.cc:662] Decoding operations
0617 20:17:01.069116 (+ 160us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:01.069129 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:01.069133 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:01.069233 (+ 100us) tablet.cc:701] Row locks acquired
0617 20:17:01.069235 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:01.069267 (+ 32us) write_op.cc:270] Start()
0617 20:17:01.069318 (+ 51us) write_op.cc:276] Timestamp: P: 1781727421069226 usec, L: 0
0617 20:17:01.123572 (+ 54254us) op_driver.cc:348] REPLICATION: starting
0617 20:17:01.123766 (+ 194us) log.cc:844] Serialized 765 byte log entry
0617 20:17:01.126802 (+ 3036us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.129970 (+ 3168us) write_op.cc:301] APPLY: starting
0617 20:17:01.129986 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.130027 (+ 41us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.130051 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.130128 (+ 77us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.130161 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 20:17:01.130168 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:01.130234 (+ 66us) log.cc:844] Serialized 29 byte log entry
0617 20:17:01.130301 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.130317 (+ 16us) write_op.cc:454] Released schema lock
0617 20:17:01.130323 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":93352320,"child_traces":[["op",{"apply.queue_time_us":3088,"num_ops":2,"prepare.queue_time_us":46217,"prepare.run_cpu_time_us":848,"prepare.run_wall_time_us":55061,"raft.queue_time_us":95,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":286,"replication_time_us":3199}]]}
I20260617 20:17:01.137460 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a20867de1214c0fb4cb8504e8361c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:01.138150 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a20867de1214c0fb4cb8504e8361c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:01.145793 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9b9ef0f3fc184c1d86b33196c9b9ae9d" } new_table_name: "default.Table_332fe4fe72a24b07981c7f0150c254bd" modify_external_catalogs: true
I20260617 20:17:01.146636 29378 tablet_bootstrap.cc:492] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.147013 29378 ts_tablet_manager.cc:1403] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.041s user 0.012s sys 0.005s
I20260617 20:17:01.148130 29378 raft_consensus.cc:359] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.148361 29378 raft_consensus.cc:385] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.148377 28666 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 958) took 1289 ms. Trace:
I20260617 20:17:01.148461 29378 raft_consensus.cc:740] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.148770 29378 consensus_queue.cc:260] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.148499 28666 rpcz_store.cc:276] 0617 20:16:59.858869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.986279 (+1127410us) service_pool.cc:224] Handling call
0617 20:17:01.022805 (+ 36526us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:01.024870 (+ 2065us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:01.025425 (+ 555us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:01.148087 (+122662us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:01.148208 (+ 121us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:01.148311 (+ 103us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:01.123919 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:01.124016 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:01.124021 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:01.124023 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:01.124106 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:01.124116 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:01.124120 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:01.124196 (+ 76us) tablet.cc:701] Row locks acquired
0617 20:17:01.124198 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:01.124233 (+ 35us) write_op.cc:270] Start()
0617 20:17:01.124274 (+ 41us) write_op.cc:276] Timestamp: P: 1781727421124188 usec, L: 0
0617 20:17:01.124278 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:01.124427 (+ 149us) log.cc:844] Serialized 433 byte log entry
0617 20:17:01.147484 (+ 23057us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.147616 (+ 132us) write_op.cc:301] APPLY: starting
0617 20:17:01.147626 (+ 10us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.147665 (+ 39us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.147692 (+ 27us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.147784 (+ 92us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.147813 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:01.147819 (+ 6us) write_op.cc:312] APPLY: finished
0617 20:17:01.147894 (+ 75us) log.cc:844] Serialized 29 byte log entry
0617 20:17:01.147973 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.147992 (+ 19us) write_op.cc:454] Released schema lock
0617 20:17:01.148000 (+ 8us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":62429056,"child_traces":[["op",{"apply.queue_time_us":81,"num_ops":2,"prepare.queue_time_us":97990,"prepare.run_cpu_time_us":588,"prepare.run_wall_time_us":588,"replication_time_us":23182}]]}
I20260617 20:17:01.149892 29378 ts_tablet_manager.cc:1434] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:01.150220 29378 tablet_bootstrap.cc:492] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:01.151845 29378 tablet_bootstrap.cc:654] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.154542 29378 tablet_bootstrap.cc:492] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.154706 29378 ts_tablet_manager.cc:1403] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260617 20:17:01.155419 29378 raft_consensus.cc:359] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.155644 29378 raft_consensus.cc:385] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.155745 29378 raft_consensus.cc:740] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.155998 29378 consensus_queue.cc:260] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.156601 29378 ts_tablet_manager.cc:1434] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:01.156890 29378 tablet_bootstrap.cc:492] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:01.158031 29379 tablet_bootstrap.cc:492] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.158159 29379 ts_tablet_manager.cc:1403] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.053s user 0.007s sys 0.012s
I20260617 20:17:01.158856 29379 raft_consensus.cc:359] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.158995 29379 raft_consensus.cc:385] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.159036 29379 raft_consensus.cc:740] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.159343 29379 consensus_queue.cc:260] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.161816 29379 ts_tablet_manager.cc:1434] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:01.162281 29379 tablet_bootstrap.cc:492] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.162523 28662 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 961) took 1237 ms. Trace:
I20260617 20:17:01.162627 28662 rpcz_store.cc:276] 0617 20:16:59.925099 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.114656 (+1189557us) service_pool.cc:224] Handling call
0617 20:17:01.115548 (+ 892us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:01.116008 (+ 460us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:01.162251 (+ 46243us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:01.162355 (+ 104us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:01.162461 (+ 106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:01.146103 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:01.146232 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:01.146237 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:01.146239 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:01.146333 (+ 94us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:01.146343 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:01.146347 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:01.146428 (+ 81us) tablet.cc:701] Row locks acquired
0617 20:17:01.146431 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:01.146477 (+ 46us) write_op.cc:270] Start()
0617 20:17:01.146504 (+ 27us) write_op.cc:276] Timestamp: P: 1781727421146420 usec, L: 0
0617 20:17:01.146508 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:01.146650 (+ 142us) log.cc:844] Serialized 433 byte log entry
0617 20:17:01.161759 (+ 15109us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.161834 (+ 75us) write_op.cc:301] APPLY: starting
0617 20:17:01.161847 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.161876 (+ 29us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.161895 (+ 19us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.162007 (+ 112us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.162037 (+ 30us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:01.162044 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:01.162106 (+ 62us) log.cc:844] Serialized 29 byte log entry
0617 20:17:01.162161 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.162173 (+ 12us) write_op.cc:454] Released schema lock
0617 20:17:01.162179 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":32,"num_ops":2,"prepare.queue_time_us":29647,"prepare.run_cpu_time_us":618,"prepare.run_wall_time_us":618,"replication_time_us":15226}]]}
I20260617 20:17:01.163239 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet c3496887f6a045e293698d09d9cc1c16 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:01.163862 29379 tablet_bootstrap.cc:654] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:01.165172 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 425c1727564745b2ab84b39a2d190db5 consensus state has no leader
I20260617 20:17:01.165328 28664 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60552 (request call id 960) took 1274 ms. Trace:
I20260617 20:17:01.165413 28664 rpcz_store.cc:276] 0617 20:16:59.891172 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.113091 (+1221919us) service_pool.cc:224] Handling call
0617 20:17:01.117256 (+ 4165us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:17:01.117483 (+ 227us) catalog_manager.cc:3750] Apply alter schema
0617 20:17:01.117642 (+ 159us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 20:17:01.117714 (+ 72us) catalog_manager.cc:3940] Updating metadata on disk
0617 20:17:01.164950 (+ 47236us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 20:17:01.165281 (+ 331us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:01.146746 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:01.146830 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:01.146834 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:01.146836 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:01.146918 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:01.146925 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:01.146929 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:01.146978 (+ 49us) tablet.cc:701] Row locks acquired
0617 20:17:01.146982 (+ 4us) write_op.cc:260] PREPARE: finished
0617 20:17:01.147011 (+ 29us) write_op.cc:270] Start()
0617 20:17:01.147038 (+ 27us) write_op.cc:276] Timestamp: P: 1781727421146965 usec, L: 0
0617 20:17:01.147040 (+ 2us) op_driver.cc:348] REPLICATION: starting
0617 20:17:01.147193 (+ 153us) log.cc:844] Serialized 405 byte log entry
0617 20:17:01.164535 (+ 17342us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.164629 (+ 94us) write_op.cc:301] APPLY: starting
0617 20:17:01.164640 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.164664 (+ 24us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.164696 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.164730 (+ 34us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.164756 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:01.164763 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:01.164813 (+ 50us) log.cc:844] Serialized 23 byte log entry
0617 20:17:01.164865 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.164877 (+ 12us) write_op.cc:454] Released schema lock
0617 20:17:01.164882 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":52,"num_ops":1,"prepare.queue_time_us":28616,"prepare.run_cpu_time_us":507,"prepare.run_wall_time_us":506,"replication_time_us":17472}]]}
I20260617 20:17:01.165835 29378 tablet_bootstrap.cc:654] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.165908 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet bc486f0c614c4bab94d923f2e7623a03 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:01.167622 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_86ee1dcdebe4461692b1cc1234cc4965"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:01.168206 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86ee1dcdebe4461692b1cc1234cc4965 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:01.169657 29175 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:01.169929 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet dd89c8452c444af99d8bce0c7cbf8ce1 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:01.170307 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet c17aa7f99fc74838b9975c3e9289ccfd from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:01.175649 29375 ts_tablet_manager.cc:1929] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:01.175776 29375 log.cc:1199] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/70698bb6ff6f4fe0b465f2974fcc24ea
I20260617 20:17:01.176080 29375 ts_tablet_manager.cc:1950] T 70698bb6ff6f4fe0b465f2974fcc24ea P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:01.180784 30294 raft_consensus.cc:493] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.180909 30294 raft_consensus.cc:515] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.181480 30294 leader_election.cc:290] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.181515 30420 raft_consensus.cc:515] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.182068 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c9d59b6b5a4dee8ca970247f613e53" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:01.182145 30420 leader_election.cc:290] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:01.182476 29377 ts_tablet_manager.cc:1929] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:01.182583 29377 log.cc:1199] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/0bbef4cc28ef46288cfc7d1933c71710
I20260617 20:17:01.182989 29377 ts_tablet_manager.cc:1950] T 0bbef4cc28ef46288cfc7d1933c71710 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:01.183202 28990 raft_consensus.cc:2468] T 090b8720e5df447aa0da147bd8dfaa8c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:01.184368 29383 ts_tablet_manager.cc:1434] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.086s user 0.000s sys 0.002s
I20260617 20:17:01.184655 29383 tablet_bootstrap.cc:492] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:01.186267 29383 tablet_bootstrap.cc:654] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.186959 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 660) took 3461 ms. Trace:
I20260617 20:17:01.187027 29376 rpcz_store.cc:276] 0617 20:16:57.724989 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.725035 (+ 46us) service_pool.cc:224] Handling call
0617 20:17:00.912466 (+3187431us) ts_tablet_manager.cc:1151] Deleting tablet af9c687fe56f42af82dd4728ca53cd32
0617 20:17:00.912475 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.069682 (+157207us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.074740 (+ 5058us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.186936 (+112196us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3187223}
I20260617 20:17:01.187403 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 653) took 3462 ms. Trace:
I20260617 20:17:01.187472 29376 rpcz_store.cc:276] 0617 20:16:57.724479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.726264 (+ 1785us) service_pool.cc:224] Handling call
0617 20:17:01.187281 (+3461017us) ts_tablet_manager.cc:1151] Deleting tablet b278ba32316c42d1b101e9803657af99
0617 20:17:01.187290 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.187386 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3460751}
I20260617 20:17:01.187732 29376 tablet_replica.cc:333] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:01.187927 29376 raft_consensus.cc:2243] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:01.188081 29376 raft_consensus.cc:2272] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.188532 29376 ts_tablet_manager.cc:1916] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:01.198274 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24e4b91def8642b7a8a063c06f43e060" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:01.198827 28925 leader_election.cc:343] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:01.199028 28925 leader_election.cc:343] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:01.199213 28925 leader_election.cc:343] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.199295 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b06f05d9b4273a61bcb2d6e0ad796" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:01.199666 29127 raft_consensus.cc:3060] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.199744 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58213ec0a9364a91a15fc0329f28605b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:01.199832 28925 leader_election.cc:343] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:01.200307 28925 leader_election.cc:343] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:01.200493 28925 consensus_peers.cc:597] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.201152 30341 tablet.cc:1724] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:01.201453 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8a7096a09147789ac203c150a19419" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:01.201894 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59430dd630b4ca6b573ea4230212abf" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.202325 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5241ab75a034ee3b57c07185835a858" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.202519 29256 raft_consensus.cc:2468] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:01.202924 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a5d9677bc184c30be1a11bfa85a97c8" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:01.203086 29258 raft_consensus.cc:3060] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.203874 29378 tablet_bootstrap.cc:492] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.204026 29378 ts_tablet_manager.cc:1403] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.047s user 0.010s sys 0.005s
I20260617 20:17:01.204743 29378 raft_consensus.cc:359] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.204918 29378 raft_consensus.cc:385] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.204983 29378 raft_consensus.cc:740] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.205220 29378 consensus_queue.cc:260] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.205801 29378 ts_tablet_manager.cc:1434] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260617 20:17:01.205894 29198 leader_election.cc:343] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.206077 29378 tablet_bootstrap.cc:492] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:17:01.206107 29198 leader_election.cc:343] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.206146 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24e4b91def8642b7a8a063c06f43e060" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.206269 29262 raft_consensus.cc:2468] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:01.206950 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58213ec0a9364a91a15fc0329f28605b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.207562 29378 tablet_bootstrap.cc:654] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:01.218201 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a6522ae212784b7ebd47cc3403aa3477 consensus state has no leader
W20260617 20:17:01.228255 28925 leader_election.cc:343] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.228408 28925 leader_election.cc:304] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.228626 30202 raft_consensus.cc:2749] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:01.229643 28925 leader_election.cc:343] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.229761 28925 leader_election.cc:304] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.229956 30202 raft_consensus.cc:2749] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.231211 29378 tablet_bootstrap.cc:492] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.231388 29378 ts_tablet_manager.cc:1403] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.005s
I20260617 20:17:01.232579 29378 raft_consensus.cc:359] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.232856 29378 raft_consensus.cc:385] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.232940 29378 raft_consensus.cc:740] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.233186 29378 consensus_queue.cc:260] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:01.233680 29198 leader_election.cc:343] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.235212 29378 ts_tablet_manager.cc:1434] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:17:01.235651 29378 tablet_bootstrap.cc:492] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:01.235997 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8a7096a09147789ac203c150a19419" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:01.236176 28990 raft_consensus.cc:3060] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.236492 29063 leader_election.cc:304] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:01.240761 29378 tablet_bootstrap.cc:654] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:01.241243 28925 leader_election.cc:343] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.241537 28925 leader_election.cc:304] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.241937 30480 raft_consensus.cc:2749] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.242457 30294 raft_consensus.cc:2804] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:01.242542 30294 raft_consensus.cc:493] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:01.242609 30294 raft_consensus.cc:3060] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:01.242679 29063 consensus_peers.cc:597] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67a3124306094c72ad78e5473aa35bdb. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:01.242866 29063 consensus_peers.cc:597] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e27c5834baa48ed953fccef54e6c52b. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.250664 28925 leader_election.cc:304] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.251034 30480 raft_consensus.cc:2804] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:01.251125 30480 raft_consensus.cc:493] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:01.251329 30480 raft_consensus.cc:3060] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:01.253986 29062 consensus_peers.cc:597] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67a3124306094c72ad78e5473aa35bdb. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.254807 29383 tablet_bootstrap.cc:492] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.254959 29383 ts_tablet_manager.cc:1403] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.000s
I20260617 20:17:01.255810 29383 raft_consensus.cc:359] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.255981 29383 raft_consensus.cc:385] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.256047 29383 raft_consensus.cc:740] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.256218 29383 consensus_queue.cc:260] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.257256 29383 ts_tablet_manager.cc:1434] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260617 20:17:01.259182 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9a706992e1f74b07b585f66b6491d7e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:01.259806 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a706992e1f74b07b585f66b6491d7e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:01.260982 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet af9c687fe56f42af82dd4728ca53cd32 (table default.Table_b69715660a0e44959e855ca44fb09056 [id=6fe28533c9a445a88d8bcb86636c4905]) successfully deleted
W20260617 20:17:01.261391 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet b278ba32316c42d1b101e9803657af99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b278ba32316c42d1b101e9803657af99 already in progress: creating tablet
I20260617 20:17:01.261807 28669 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 962) took 1055 ms. Trace:
I20260617 20:17:01.261910 28669 rpcz_store.cc:276] 0617 20:17:00.203298 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.119773 (+916475us) service_pool.cc:224] Handling call
0617 20:17:01.120611 (+ 838us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:01.121057 (+ 446us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:01.258691 (+137634us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:01.258808 (+ 117us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:01.258910 (+ 102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:01.147289 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:01.147380 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:01.147384 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:01.147386 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:01.147449 (+ 63us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:01.147456 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:01.147473 (+ 17us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:01.147535 (+ 62us) tablet.cc:701] Row locks acquired
0617 20:17:01.147538 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:01.147567 (+ 29us) write_op.cc:270] Start()
0617 20:17:01.147610 (+ 43us) write_op.cc:276] Timestamp: P: 1781727421147522 usec, L: 0
0617 20:17:01.147613 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:01.170738 (+ 23125us) log.cc:844] Serialized 433 byte log entry
0617 20:17:01.170951 (+ 213us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fa11ccaaf22 00007fa11e08c305 00007fa11e08ae29 00007fa11e093250 00007fa11e09305d 0000000000aa681c 00007fa110c759ff 00007fa110c78d1b 00007fa110c78b98 0000000000aa681c
0617 20:17:01.214724 (+ 43773us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.215045 (+ 321us) write_op.cc:301] APPLY: starting
0617 20:17:01.221368 (+ 6323us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.221417 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.221422 (+ 5us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.258299 (+ 36877us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.258356 (+ 57us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:01.258366 (+ 10us) write_op.cc:312] APPLY: finished
0617 20:17:01.258470 (+ 104us) log.cc:844] Serialized 29 byte log entry
0617 20:17:01.258566 (+ 96us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.258589 (+ 23us) write_op.cc:454] Released schema lock
0617 20:17:01.258597 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:01.258996 (+ 399us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.259003 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":275,"apply.run_cpu_time_us":622,"apply.run_wall_time_us":43937,"num_ops":2,"prepare.queue_time_us":24667,"prepare.run_cpu_time_us":903,"prepare.run_wall_time_us":23723,"raft.queue_time_us":93,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":17003,"replication_time_us":67086,"spinlock_wait_cycles":52740992}]]}
I20260617 20:17:01.262776 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_83dad09bc9d6404d8bb9f0cbcf719f08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:01.263288 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83dad09bc9d6404d8bb9f0cbcf719f08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:01.270023 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e4bae15c95f24a148e48b458b3ffd46d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:01.270609 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4bae15c95f24a148e48b458b3ffd46d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:01.271939 30202 raft_consensus.cc:493] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.272123 30202 raft_consensus.cc:515] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.272881 30202 leader_election.cc:290] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.278371 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet d44524b02e6f4c1291bca50e9261459b from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:01.278877 28985 raft_consensus.cc:2468] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:01.279675 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8e6d066264d0412f9b74d0ffff011db9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:01.280903 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e6d066264d0412f9b74d0ffff011db9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:01.281085 29258 raft_consensus.cc:2468] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:01.285980 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 669) took 3271 ms. Trace:
I20260617 20:17:01.286082 29377 rpcz_store.cc:276] 0617 20:16:58.014256 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.014302 (+ 46us) service_pool.cc:224] Handling call
0617 20:17:00.881864 (+2867562us) ts_tablet_manager.cc:1151] Deleting tablet 0bbef4cc28ef46288cfc7d1933c71710
0617 20:17:00.881872 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:00.989950 (+108078us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.182412 (+192462us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.285956 (+103544us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2837542}
I20260617 20:17:01.286490 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 674) took 2847 ms. Trace:
I20260617 20:17:01.286562 29377 rpcz_store.cc:276] 0617 20:16:58.439405 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.439456 (+ 51us) service_pool.cc:224] Handling call
0617 20:17:01.286358 (+2846902us) ts_tablet_manager.cc:1151] Deleting tablet 29a176d1f3b0446984af141e02bac329
0617 20:17:01.286369 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.286472 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2846674}
I20260617 20:17:01.286926 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 672) took 2882 ms. Trace:
I20260617 20:17:01.286993 29377 rpcz_store.cc:276] 0617 20:16:58.404316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.404394 (+ 78us) service_pool.cc:224] Handling call
0617 20:17:01.286776 (+2882382us) ts_tablet_manager.cc:1151] Deleting tablet 0916139a64df436fafa18c7e86fbf91c
0617 20:17:01.286784 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.286911 (+ 127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2846013}
I20260617 20:17:01.287287 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 673) took 2868 ms. Trace:
I20260617 20:17:01.287345 29377 rpcz_store.cc:276] 0617 20:16:58.418719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.418880 (+ 161us) service_pool.cc:224] Handling call
0617 20:17:01.287184 (+2868304us) ts_tablet_manager.cc:1151] Deleting tablet 0eaa60028a1647e580a987c3a0836a24
0617 20:17:01.287203 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.287275 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2846408}
I20260617 20:17:01.287652 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 676) took 2803 ms. Trace:
I20260617 20:17:01.287711 29377 rpcz_store.cc:276] 0617 20:16:58.484473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.487029 (+ 2556us) service_pool.cc:224] Handling call
0617 20:17:01.287535 (+2800506us) ts_tablet_manager.cc:1151] Deleting tablet 65747872eaac450cb3b8efb3a2d2694f
0617 20:17:01.287546 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.287639 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2800293}
I20260617 20:17:01.287993 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 679) took 2763 ms. Trace:
I20260617 20:17:01.288050 29377 rpcz_store.cc:276] 0617 20:16:58.524541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.524618 (+ 77us) service_pool.cc:224] Handling call
0617 20:17:01.287904 (+2763286us) ts_tablet_manager.cc:1151] Deleting tablet f5387e3c30b24cb285ea5cc657981321
0617 20:17:01.287913 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.287981 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2762897}
I20260617 20:17:01.288259 29377 tablet_replica.cc:333] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:01.288467 29377 raft_consensus.cc:2243] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:01.288604 29377 raft_consensus.cc:2272] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.289113 29377 ts_tablet_manager.cc:1916] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:01.289803 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 619) took 4086 ms. Trace:
I20260617 20:17:01.289901 29375 rpcz_store.cc:276] 0617 20:16:57.203208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.203257 (+ 49us) service_pool.cc:224] Handling call
0617 20:17:00.783168 (+3579911us) ts_tablet_manager.cc:1151] Deleting tablet 70698bb6ff6f4fe0b465f2974fcc24ea
0617 20:17:00.783293 (+ 125us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.077329 (+294036us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.175585 (+ 98256us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.289781 (+114196us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3579781}
I20260617 20:17:01.290350 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 620) took 4079 ms. Trace:
I20260617 20:17:01.290421 29375 rpcz_store.cc:276] 0617 20:16:57.210433 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.210476 (+ 43us) service_pool.cc:224] Handling call
0617 20:17:01.290229 (+4079753us) ts_tablet_manager.cc:1151] Deleting tablet 622ccfd80da446e98a0fedc1085b70d7
0617 20:17:01.290239 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.290332 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4079591}
I20260617 20:17:01.290719 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 621) took 4077 ms. Trace:
I20260617 20:17:01.290781 29375 rpcz_store.cc:276] 0617 20:16:57.212769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.212812 (+ 43us) service_pool.cc:224] Handling call
0617 20:17:01.290630 (+4077818us) ts_tablet_manager.cc:1151] Deleting tablet 8d7a76853e334a4081aa8ccc28361aca
0617 20:17:01.290638 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.290706 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4077679}
I20260617 20:17:01.291065 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 622) took 4053 ms. Trace:
I20260617 20:17:01.291129 29375 rpcz_store.cc:276] 0617 20:16:57.237456 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.237713 (+ 257us) service_pool.cc:224] Handling call
0617 20:17:01.290979 (+4053266us) ts_tablet_manager.cc:1151] Deleting tablet f62c5a2071dd46dfbde504459508b069
0617 20:17:01.290986 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.291052 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4053067}
I20260617 20:17:01.291348 29375 tablet_replica.cc:333] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:01.291538 29375 raft_consensus.cc:2243] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:01.291667 29375 raft_consensus.cc:2272] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.294687 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1cd67e2f494841bb87d2fb5d340241d8" } modify_external_catalogs: true
I20260617 20:17:01.294862 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1cd67e2f494841bb87d2fb5d340241d8" } modify_external_catalogs: true
I20260617 20:17:01.296881 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 0bbef4cc28ef46288cfc7d1933c71710 (table default.Table_e01af13e5b514cca8b4cfc05a15a949d [id=9850785700a84b33a30caf29ab508aea]) successfully deleted
I20260617 20:17:01.297012 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_48c2b283a7174f7abb91a866c98b1165" } modify_external_catalogs: true
W20260617 20:17:01.297137 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 29a176d1f3b0446984af141e02bac329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29a176d1f3b0446984af141e02bac329 already in progress: creating tablet
W20260617 20:17:01.297438 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 0916139a64df436fafa18c7e86fbf91c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0916139a64df436fafa18c7e86fbf91c already in progress: creating tablet
W20260617 20:17:01.297639 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 0eaa60028a1647e580a987c3a0836a24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0eaa60028a1647e580a987c3a0836a24 already in progress: creating tablet
W20260617 20:17:01.297856 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 65747872eaac450cb3b8efb3a2d2694f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65747872eaac450cb3b8efb3a2d2694f already in progress: creating tablet
W20260617 20:17:01.298049 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f5387e3c30b24cb285ea5cc657981321 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5387e3c30b24cb285ea5cc657981321 already in progress: creating tablet
I20260617 20:17:01.301721 30202 consensus_queue.cc:1048] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:01.302474 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 70698bb6ff6f4fe0b465f2974fcc24ea (table default.Table_324930e6680749aeb68583d56acef5eb [id=b997135a77454a3b83cbd538427aa2f1]) successfully deleted
W20260617 20:17:01.302690 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 622ccfd80da446e98a0fedc1085b70d7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 622ccfd80da446e98a0fedc1085b70d7 already in progress: creating tablet
W20260617 20:17:01.302917 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 8d7a76853e334a4081aa8ccc28361aca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d7a76853e334a4081aa8ccc28361aca already in progress: creating tablet
I20260617 20:17:01.302945 28925 leader_election.cc:304] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:17:01.303107 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet f62c5a2071dd46dfbde504459508b069 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f62c5a2071dd46dfbde504459508b069 already in progress: creating tablet
I20260617 20:17:01.303328 30202 raft_consensus.cc:2804] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:01.303401 30202 raft_consensus.cc:493] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:01.303463 30202 raft_consensus.cc:3060] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:01.303854 28925 leader_election.cc:343] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.303967 28925 leader_election.cc:304] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.304347 30201 raft_consensus.cc:2749] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.305073 29375 ts_tablet_manager.cc:1916] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:01.252348 30501 tablet.cc:1724] T d076991ad9fb4498a11fd22fa8339889 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:01.297154 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_48c2b283a7174f7abb91a866c98b1165" } modify_external_catalogs: true
W20260617 20:17:01.314564 29197 consensus_peers.cc:597] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.318204 29197 leader_election.cc:304] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.318992 30253 raft_consensus.cc:2804] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:01.319136 30253 raft_consensus.cc:697] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:01.319433 30253 consensus_queue.cc:237] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.322487 30201 raft_consensus.cc:493] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.322670 30201 raft_consensus.cc:515] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.323410 30201 leader_election.cc:290] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:01.329582 29062 consensus_peers.cc:597] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75519f97f1ce49ceb3a739ba7c7bc239. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:01.330639 29198 consensus_peers.cc:597] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.333034 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02529cd1e764a3886de27d86e9690e3" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.333242 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead0291870a443d9b76ea919a45a4303" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:01.333953 28925 leader_election.cc:343] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:01.334434 28925 leader_election.cc:343] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:01.335027 30424 log.cc:927] Time spent T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Append to log took a long time: real 0.089s user 0.001s sys 0.000s
I20260617 20:17:01.343075 28666 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 1a0d27ae73674afdb7eb7a212a55da21
I20260617 20:17:01.343540 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_654bcfb3ac7749e48f76f25e93335840"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:01.344245 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_654bcfb3ac7749e48f76f25e93335840 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:01.353790 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_05dfcb6814c143ee9890aba309a96146" } new_table_name: "default.Table_be59d14cee3545fbb5d986ae101f78cc" modify_external_catalogs: true
W20260617 20:17:01.362735 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1f1600da5c434063a8458ebed1f6d4de consensus state has no leader
I20260617 20:17:01.363266 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1d22b434bff34f6da7ebe3e45e5bbee2" } modify_external_catalogs: true
I20260617 20:17:01.363621 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1d22b434bff34f6da7ebe3e45e5bbee2" } modify_external_catalogs: true
I20260617 20:17:01.366505 29383 tablet_bootstrap.cc:492] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:01.366675 29379 tablet_bootstrap.cc:492] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.366896 29379 ts_tablet_manager.cc:1403] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.205s user 0.015s sys 0.055s
I20260617 20:17:01.367715 29379 raft_consensus.cc:359] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.367986 29379 raft_consensus.cc:385] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.368080 29379 raft_consensus.cc:740] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.368463 29379 consensus_queue.cc:260] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:01.368485 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 50395.1us
I20260617 20:17:01.375419 30420 consensus_queue.cc:1048] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:01.377526 30480 raft_consensus.cc:515] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.378109 30480 leader_election.cc:290] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.378413 30294 raft_consensus.cc:515] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.378955 30294 leader_election.cc:290] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.381669 29379 ts_tablet_manager.cc:1434] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20260617 20:17:01.381980 29379 tablet_bootstrap.cc:492] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.383459 29379 tablet_bootstrap.cc:654] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.380285 29197 leader_election.cc:304] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.387795 30253 raft_consensus.cc:2804] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:01.388013 30253 raft_consensus.cc:697] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:01.388258 30253 consensus_queue.cc:237] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
W20260617 20:17:01.389099 29062 leader_election.cc:343] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: d2db0467c5e64e38961d3b0e66375544
W20260617 20:17:01.390431 29062 consensus_peers.cc:597] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f9844fab126448895c4c9d4c3c78d76. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.401916 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5241ab75a034ee3b57c07185835a858" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:01.407624 30480 raft_consensus.cc:493] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.407770 30480 raft_consensus.cc:515] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.408433 30480 leader_election.cc:290] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.409718 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19bce310bd24294b063b3b4f76b9f99" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.409961 29259 raft_consensus.cc:2393] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate 5ca3d93189744132bbf55ac01f3a8254 in this term.
I20260617 20:17:01.410131 29378 tablet_bootstrap.cc:492] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.410266 29378 ts_tablet_manager.cc:1403] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.175s user 0.011s sys 0.041s
I20260617 20:17:01.411070 29378 raft_consensus.cc:359] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.411257 29378 raft_consensus.cc:385] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.411348 29378 raft_consensus.cc:740] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.411595 29378 consensus_queue.cc:260] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:01.411830 28925 leader_election.cc:343] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.412088 29378 ts_tablet_manager.cc:1434] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:01.412369 29378 tablet_bootstrap.cc:492] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:01.413383 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c9d59b6b5a4dee8ca970247f613e53" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.414072 29378 tablet_bootstrap.cc:654] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.415593 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f239f81c40743b2aaa70a361997db77" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.415656 30480 raft_consensus.cc:493] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.415759 30480 raft_consensus.cc:515] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.416225 30480 leader_election.cc:290] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.428622 29379 tablet_bootstrap.cc:492] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.428844 29379 ts_tablet_manager.cc:1403] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.020s
I20260617 20:17:01.429611 29379 raft_consensus.cc:359] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.429862 29379 raft_consensus.cc:385] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.429945 29379 raft_consensus.cc:740] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.430191 29379 consensus_queue.cc:260] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:01.430881 28925 leader_election.cc:343] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.431259 29379 ts_tablet_manager.cc:1434] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:01.431555 29379 tablet_bootstrap.cc:492] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.431962 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2db0467c5e64e38961d3b0e66375544" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:01.432169 29262 raft_consensus.cc:3060] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.433372 29379 tablet_bootstrap.cc:654] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.436071 29383 tablet_bootstrap.cc:654] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.446353 29378 tablet_bootstrap.cc:492] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.446561 29378 ts_tablet_manager.cc:1403] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.034s user 0.011s sys 0.003s
I20260617 20:17:01.447388 29378 raft_consensus.cc:359] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.447707 29378 raft_consensus.cc:385] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.447827 29378 raft_consensus.cc:740] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.448118 29378 consensus_queue.cc:260] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.451289 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a20867de1214c0fb4cb8504e8361c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:01.452962 28925 leader_election.cc:304] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.453445 30201 raft_consensus.cc:2804] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:01.453563 30201 raft_consensus.cc:697] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:01.453979 30201 consensus_queue.cc:237] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.457592 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cafcade995b407f84f56b8cd3ab6892" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:01.459316 28925 leader_election.cc:343] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.460032 29378 ts_tablet_manager.cc:1434] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20260617 20:17:01.460330 29378 tablet_bootstrap.cc:492] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:01.464958 29378 tablet_bootstrap.cc:654] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:01.467010 29527 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.245.253:38361 timed out after 0.739s (SENT)
I20260617 20:17:01.467999 29262 raft_consensus.cc:2468] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:01.469496 28990 raft_consensus.cc:2468] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:01.471753 30202 raft_consensus.cc:515] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.472299 30202 leader_election.cc:290] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.473412 29377 ts_tablet_manager.cc:1929] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:01.473532 29377 log.cc:1199] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/89f7b878728a495f83b6584f8a6aca67
I20260617 20:17:01.473562 29379 tablet_bootstrap.cc:492] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.473701 29379 ts_tablet_manager.cc:1403] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.007s
I20260617 20:17:01.473834 29377 ts_tablet_manager.cc:1950] T 89f7b878728a495f83b6584f8a6aca67 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:01.478541 29063 leader_election.cc:304] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.479031 30294 raft_consensus.cc:3060] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.490274 29063 leader_election.cc:304] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.491730 30193 raft_consensus.cc:2749] T f6c9d59b6b5a4dee8ca970247f613e53 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.497884 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02529cd1e764a3886de27d86e9690e3" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.474551 29379 raft_consensus.cc:359] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.500789 29379 raft_consensus.cc:385] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.500857 29379 raft_consensus.cc:740] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.501051 29379 consensus_queue.cc:260] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:01.498901 29063 consensus_peers.cc:597] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.505311 29379 ts_tablet_manager.cc:1434] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.032s user 0.001s sys 0.001s
I20260617 20:17:01.505698 29379 tablet_bootstrap.cc:492] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.506557 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead0291870a443d9b76ea919a45a4303" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.507773 29379 tablet_bootstrap.cc:654] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.510180 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24e4b91def8642b7a8a063c06f43e060" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:01.512624 29378 tablet_bootstrap.cc:492] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.512784 29378 ts_tablet_manager.cc:1403] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.001s
I20260617 20:17:01.513854 29378 raft_consensus.cc:359] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.514040 29378 raft_consensus.cc:385] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.514101 29378 raft_consensus.cc:740] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.514302 29378 consensus_queue.cc:260] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.514854 29378 ts_tablet_manager.cc:1434] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:01.515136 29378 tablet_bootstrap.cc:492] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:01.515466 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5241ab75a034ee3b57c07185835a858" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:01.515667 29262 raft_consensus.cc:3060] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.517253 29378 tablet_bootstrap.cc:654] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.522959 29383 tablet_bootstrap.cc:492] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.523275 30202 raft_consensus.cc:493] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.523433 30202 raft_consensus.cc:515] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.524109 30202 leader_election.cc:290] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.524614 29383 ts_tablet_manager.cc:1403] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.158s user 0.002s sys 0.002s
I20260617 20:17:01.525509 29383 raft_consensus.cc:359] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.525763 29383 raft_consensus.cc:385] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.525874 29383 raft_consensus.cc:740] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.526134 29383 consensus_queue.cc:260] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.528216 29383 ts_tablet_manager.cc:1434] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:17:01.528726 29383 tablet_bootstrap.cc:492] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:17:01.537508 28925 leader_election.cc:343] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.537688 29121 raft_consensus.cc:3060] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.538331 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaa60028a1647e580a987c3a0836a24" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.543560 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaa60028a1647e580a987c3a0836a24" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.544472 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24e4b91def8642b7a8a063c06f43e060" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:01.544644 29256 raft_consensus.cc:3060] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:01.538771 29198 consensus_peers.cc:597] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.542467 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f239f81c40743b2aaa70a361997db77" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.546828 29383 tablet_bootstrap.cc:654] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.547880 30410 raft_consensus.cc:493] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.548019 30410 raft_consensus.cc:515] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.548678 30410 leader_election.cc:290] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:01.548709 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cafcade995b407f84f56b8cd3ab6892" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.554942 29379 tablet_bootstrap.cc:492] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.555136 29379 ts_tablet_manager.cc:1403] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.015s
I20260617 20:17:01.555961 29379 raft_consensus.cc:359] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.556164 29379 raft_consensus.cc:385] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.556246 29379 raft_consensus.cc:740] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.556463 29379 consensus_queue.cc:260] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.559294 29379 ts_tablet_manager.cc:1434] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:01.559662 29379 tablet_bootstrap.cc:492] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.561921 30201 consensus_queue.cc:1048] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:01.562479 29379 tablet_bootstrap.cc:654] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:01.562722 28925 leader_election.cc:343] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:01.563144 29198 consensus_peers.cc:597] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.564517 29063 leader_election.cc:304] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:01.565152 30193 raft_consensus.cc:2804] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:01.565925 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d673bc9892c94725b270ef3b9dc768f4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:01.566468 29198 leader_election.cc:343] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.569465 29376 ts_tablet_manager.cc:1929] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:01.569468 29262 raft_consensus.cc:2468] T b5241ab75a034ee3b57c07185835a858 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:01.569612 29376 log.cc:1199] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/75519f97f1ce49ceb3a739ba7c7bc239
I20260617 20:17:01.569927 29376 ts_tablet_manager.cc:1950] T 75519f97f1ce49ceb3a739ba7c7bc239 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:01.572206 30294 raft_consensus.cc:2749] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.567116 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 681) took 3006 ms. Trace:
I20260617 20:17:01.572548 29377 rpcz_store.cc:276] 0617 20:16:58.560136 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.567328 (+ 7192us) service_pool.cc:224] Handling call
0617 20:17:01.288224 (+2720896us) ts_tablet_manager.cc:1151] Deleting tablet 89f7b878728a495f83b6584f8a6aca67
0617 20:17:01.288231 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.381628 (+ 93397us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.473355 (+ 91727us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.567066 (+ 93711us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2720625}
I20260617 20:17:01.572955 29377 tablet_replica.cc:333] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:01.573185 29377 raft_consensus.cc:2243] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:01.573530 29377 raft_consensus.cc:2272] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.574014 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 89f7b878728a495f83b6584f8a6aca67 (table default.Table_bb7f63dd419f420bb7bed4cf3bd9042e [id=6fb9858b817a4575abd3b84a32027d90]) successfully deleted
I20260617 20:17:01.574805 29375 ts_tablet_manager.cc:1929] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:01.574941 29375 log.cc:1199] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/13ba94ec9e27403b974e5e6fea46e59e
I20260617 20:17:01.575239 29375 ts_tablet_manager.cc:1950] T 13ba94ec9e27403b974e5e6fea46e59e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:01.572312 30201 raft_consensus.cc:493] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.575845 29377 ts_tablet_manager.cc:1916] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:01.575670 30201 raft_consensus.cc:515] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:01.577806 30201 leader_election.cc:290] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:01.583256 28925 leader_election.cc:343] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.583432 28925 leader_election.cc:304] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.583918 30201 raft_consensus.cc:2749] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:01.584512 28925 leader_election.cc:343] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.584643 28925 leader_election.cc:304] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.585105 30201 raft_consensus.cc:2749] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.586483 29197 leader_election.cc:304] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.587146 30410 raft_consensus.cc:2804] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:01.587286 30410 raft_consensus.cc:697] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:01.587550 30410 consensus_queue.cc:237] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.590021 30193 raft_consensus.cc:697] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:01.590395 30193 consensus_queue.cc:237] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.599860 29378 tablet_bootstrap.cc:492] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.600050 29378 ts_tablet_manager.cc:1403] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.085s user 0.002s sys 0.023s
I20260617 20:17:01.600935 29378 raft_consensus.cc:359] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.601147 29378 raft_consensus.cc:385] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.601257 29378 raft_consensus.cc:740] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.601800 29378 consensus_queue.cc:260] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.606913 30410 consensus_queue.cc:1048] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:01.613348 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 661) took 3888 ms. Trace:
I20260617 20:17:01.614491 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 623) took 4337 ms. Trace:
I20260617 20:17:01.614574 29375 rpcz_store.cc:276] 0617 20:16:57.276876 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.277127 (+ 251us) service_pool.cc:224] Handling call
0617 20:17:01.291311 (+4014184us) ts_tablet_manager.cc:1151] Deleting tablet 13ba94ec9e27403b974e5e6fea46e59e
0617 20:17:01.291319 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.474178 (+182859us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.574730 (+100552us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.614472 (+ 39742us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4013902}
I20260617 20:17:01.614953 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 624) took 4320 ms. Trace:
I20260617 20:17:01.615017 29375 rpcz_store.cc:276] 0617 20:16:57.294993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.295053 (+ 60us) service_pool.cc:224] Handling call
0617 20:17:01.614826 (+4319773us) ts_tablet_manager.cc:1151] Deleting tablet a350456a8eb143838de58a05c76c9056
0617 20:17:01.614834 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.614939 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4319606}
I20260617 20:17:01.615274 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 625) took 4309 ms. Trace:
I20260617 20:17:01.615327 29375 rpcz_store.cc:276] 0617 20:16:57.305622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.305683 (+ 61us) service_pool.cc:224] Handling call
0617 20:17:01.615197 (+4309514us) ts_tablet_manager.cc:1151] Deleting tablet bc486f0c614c4bab94d923f2e7623a03
0617 20:17:01.615204 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.615263 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4309337}
I20260617 20:17:01.615607 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 626) took 4286 ms. Trace:
I20260617 20:17:01.615665 29375 rpcz_store.cc:276] 0617 20:16:57.329059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.329140 (+ 81us) service_pool.cc:224] Handling call
0617 20:17:01.615514 (+4286374us) ts_tablet_manager.cc:1151] Deleting tablet 5b2797384f7845969ee9744b444f1acc
0617 20:17:01.615521 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.615593 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4286071}
I20260617 20:17:01.615935 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 627) took 4212 ms. Trace:
I20260617 20:17:01.615990 29375 rpcz_store.cc:276] 0617 20:16:57.403370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.403426 (+ 56us) service_pool.cc:224] Handling call
0617 20:17:01.615845 (+4212419us) ts_tablet_manager.cc:1151] Deleting tablet 8d7a76853e334a4081aa8ccc28361aca
0617 20:17:01.615853 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.615924 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4212233}
I20260617 20:17:01.616178 29375 tablet_replica.cc:333] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:01.613461 29376 rpcz_store.cc:276] 0617 20:16:57.725134 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.729619 (+ 4485us) service_pool.cc:224] Handling call
0617 20:17:01.187689 (+3458070us) ts_tablet_manager.cc:1151] Deleting tablet 75519f97f1ce49ceb3a739ba7c7bc239
0617 20:17:01.187700 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.377488 (+189788us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.569390 (+191902us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.613325 (+ 43935us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3457949}
I20260617 20:17:01.616341 29375 raft_consensus.cc:2243] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:01.616469 29375 raft_consensus.cc:2272] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.617278 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 652) took 3892 ms. Trace:
I20260617 20:17:01.617324 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 13ba94ec9e27403b974e5e6fea46e59e (table default.Table_6791b989125046d893a9c24ae1e65c12 [id=e495b17f9a99422e9e29cf49befb762a]) successfully deleted
I20260617 20:17:01.617424 29376 rpcz_store.cc:276] 0617 20:16:57.724392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.734055 (+ 9663us) service_pool.cc:224] Handling call
0617 20:17:01.617139 (+3883084us) ts_tablet_manager.cc:1151] Deleting tablet 3180f1336fd841d8b4cf7fdf94015955
0617 20:17:01.617151 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.617257 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3854903}
W20260617 20:17:01.617676 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet a350456a8eb143838de58a05c76c9056 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a350456a8eb143838de58a05c76c9056 already in progress: creating tablet
I20260617 20:17:01.617775 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 662) took 3846 ms. Trace:
I20260617 20:17:01.617843 29376 rpcz_store.cc:276] 0617 20:16:57.771422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.772648 (+ 1226us) service_pool.cc:224] Handling call
0617 20:17:01.617664 (+3845016us) ts_tablet_manager.cc:1151] Deleting tablet 6afb3ed704bb4a269d92f1741455161b
0617 20:17:01.617673 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.617760 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3844820}
W20260617 20:17:01.617961 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet bc486f0c614c4bab94d923f2e7623a03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc486f0c614c4bab94d923f2e7623a03 already in progress: creating tablet
I20260617 20:17:01.618074 29376 tablet_replica.cc:333] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:17:01.618157 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5b2797384f7845969ee9744b444f1acc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5b2797384f7845969ee9744b444f1acc already in progress: creating tablet
I20260617 20:17:01.618278 29376 raft_consensus.cc:2243] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
W20260617 20:17:01.618358 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 8d7a76853e334a4081aa8ccc28361aca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d7a76853e334a4081aa8ccc28361aca already in progress: creating tablet
I20260617 20:17:01.618541 29376 raft_consensus.cc:2272] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.619112 29376 ts_tablet_manager.cc:1916] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:01.619647 29375 ts_tablet_manager.cc:1916] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:01.621220 29256 raft_consensus.cc:2468] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:01.630262 29127 raft_consensus.cc:3060] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.634073 29383 tablet_bootstrap.cc:492] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.634047 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73bdcc1cefd48f3b99e0c059c3a7467" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.634408 29383 ts_tablet_manager.cc:1403] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.004s
I20260617 20:17:01.634820 29379 tablet_bootstrap.cc:492] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
W20260617 20:17:01.634900 28925 leader_election.cc:343] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.635581 29379 ts_tablet_manager.cc:1403] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.076s user 0.009s sys 0.009s
I20260617 20:17:01.636412 29383 raft_consensus.cc:359] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.636823 29383 raft_consensus.cc:385] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.637017 29383 raft_consensus.cc:740] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.638219 29383 consensus_queue.cc:260] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.639708 29379 raft_consensus.cc:359] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.640666 29379 raft_consensus.cc:385] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.641018 29379 raft_consensus.cc:740] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.641680 29383 ts_tablet_manager.cc:1434] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260617 20:17:01.644201 30423 consensus_queue.cc:1048] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:01.645848 28925 leader_election.cc:343] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.646063 28925 leader_election.cc:304] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.646543 30201 raft_consensus.cc:2749] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.642095 29379 consensus_queue.cc:260] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:01.648717 28925 leader_election.cc:343] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.648720 29379 ts_tablet_manager.cc:1434] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20260617 20:17:01.648975 28925 leader_election.cc:304] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.649562 30201 raft_consensus.cc:2749] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.650255 29379 tablet_bootstrap.cc:492] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.651890 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d673bc9892c94725b270ef3b9dc768f4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
W20260617 20:17:01.652072 28925 leader_election.cc:343] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.652138 28985 raft_consensus.cc:2468] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:01.652235 28925 leader_election.cc:304] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.653604 30201 raft_consensus.cc:2749] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.643255 29383 tablet_bootstrap.cc:492] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:01.660974 29379 tablet_bootstrap.cc:654] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.660969 29383 tablet_bootstrap.cc:654] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.662266 29377 ts_tablet_manager.cc:1929] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:01.662422 29377 log.cc:1199] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/fc36f62aa0bf46278cb84ec8cb7eef55
I20260617 20:17:01.662789 29377 ts_tablet_manager.cc:1950] T fc36f62aa0bf46278cb84ec8cb7eef55 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:01.664522 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 695) took 2663 ms. Trace:
I20260617 20:17:01.664638 29377 rpcz_store.cc:276] 0617 20:16:59.000721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.000945 (+ 224us) service_pool.cc:224] Handling call
0617 20:17:01.572868 (+2571923us) ts_tablet_manager.cc:1151] Deleting tablet fc36f62aa0bf46278cb84ec8cb7eef55
0617 20:17:01.572878 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.613690 (+ 40812us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.662169 (+ 48479us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.664484 (+ 2315us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2571605}
I20260617 20:17:01.665056 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 697) took 2645 ms. Trace:
I20260617 20:17:01.665167 29377 rpcz_store.cc:276] 0617 20:16:59.019277 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.019338 (+ 61us) service_pool.cc:224] Handling call
0617 20:17:01.664914 (+2645576us) ts_tablet_manager.cc:1151] Deleting tablet 5eedf2442f964048b7a3a460b6b22f2a
0617 20:17:01.664924 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.665026 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2645367}
I20260617 20:17:01.665321 29375 ts_tablet_manager.cc:1929] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:01.665417 29375 log.cc:1199] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/8880f8eadaa44887a49adf0ef157965e
I20260617 20:17:01.665550 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 696) took 2648 ms. Trace:
I20260617 20:17:01.665705 29375 ts_tablet_manager.cc:1950] T 8880f8eadaa44887a49adf0ef157965e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:01.665647 29377 rpcz_store.cc:276] 0617 20:16:59.016747 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.020601 (+ 3854us) service_pool.cc:224] Handling call
0617 20:17:01.665418 (+2644817us) ts_tablet_manager.cc:1151] Deleting tablet fe6c261318b24a6caa3a376215f44f0f
0617 20:17:01.665429 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.665521 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2644576}
I20260617 20:17:01.665975 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 698) took 2638 ms. Trace:
I20260617 20:17:01.666074 29377 rpcz_store.cc:276] 0617 20:16:59.027180 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.027435 (+ 255us) service_pool.cc:224] Handling call
0617 20:17:01.665859 (+2638424us) ts_tablet_manager.cc:1151] Deleting tablet 91fac788a74346e28f7b7e5939459325
0617 20:17:01.665868 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.665946 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2638203}
I20260617 20:17:01.666431 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 694) took 2665 ms. Trace:
I20260617 20:17:01.666525 29377 rpcz_store.cc:276] 0617 20:16:59.000586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.037699 (+ 37113us) service_pool.cc:224] Handling call
0617 20:17:01.666300 (+2628601us) ts_tablet_manager.cc:1151] Deleting tablet 3b00d3c0adcf48a48ba3d7a3de018b80
0617 20:17:01.666309 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.666404 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2628335}
I20260617 20:17:01.668349 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet fc36f62aa0bf46278cb84ec8cb7eef55 (table default.Table_486a2491b91d4d4899c49ae5065acbcd [id=fe4c16ade5a04cc5b67a89de3e4ec53d]) successfully deleted
W20260617 20:17:01.668524 28654 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet dd8a7096a09147789ac203c150a19419 consensus state has no leader
W20260617 20:17:01.668690 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5eedf2442f964048b7a3a460b6b22f2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eedf2442f964048b7a3a460b6b22f2a already in progress: creating tablet
W20260617 20:17:01.668917 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet fe6c261318b24a6caa3a376215f44f0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe6c261318b24a6caa3a376215f44f0f already in progress: creating tablet
W20260617 20:17:01.669147 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 91fac788a74346e28f7b7e5939459325 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91fac788a74346e28f7b7e5939459325 already in progress: creating tablet
W20260617 20:17:01.669381 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3b00d3c0adcf48a48ba3d7a3de018b80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b00d3c0adcf48a48ba3d7a3de018b80 already in progress: creating tablet
I20260617 20:17:01.669826 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 702) took 2598 ms. Trace:
I20260617 20:17:01.670002 29377 rpcz_store.cc:276] 0617 20:16:59.070877 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.070976 (+ 99us) service_pool.cc:224] Handling call
0617 20:17:01.666741 (+2595765us) ts_tablet_manager.cc:1151] Deleting tablet ebd98889d08f4683ba4b2ee98a74254d
0617 20:17:01.666753 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.669789 (+ 3036us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2595545}
I20260617 20:17:01.670439 29377 tablet_replica.cc:333] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:17:01.670854 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet ebd98889d08f4683ba4b2ee98a74254d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebd98889d08f4683ba4b2ee98a74254d already in progress: creating tablet
I20260617 20:17:01.671273 29377 raft_consensus.cc:2243] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:01.671573 29377 raft_consensus.cc:2272] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.672382 29377 ts_tablet_manager.cc:1916] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:01.673614 29383 tablet_bootstrap.cc:492] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.673863 29383 ts_tablet_manager.cc:1403] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.001s
I20260617 20:17:01.675455 29383 raft_consensus.cc:359] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.675858 29383 raft_consensus.cc:385] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.675993 29383 raft_consensus.cc:740] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.676405 29383 consensus_queue.cc:260] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.677484 29383 ts_tablet_manager.cc:1434] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:01.677960 29383 tablet_bootstrap.cc:492] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:01.681751 29383 tablet_bootstrap.cc:654] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.690019 28925 leader_election.cc:304] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.690559 30201 raft_consensus.cc:2804] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:01.690858 30201 raft_consensus.cc:697] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:01.691123 30201 consensus_queue.cc:237] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.693266 30339 tablet.cc:1724] T 32c3a4c3bee5444697f5d53d51c62894 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:01.695130 29378 ts_tablet_manager.cc:1434] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.095s user 0.003s sys 0.000s
I20260617 20:17:01.695442 29378 tablet_bootstrap.cc:492] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:17:01.705502 30529 log.cc:927] Time spent T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
I20260617 20:17:01.706080 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 75519f97f1ce49ceb3a739ba7c7bc239 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]) successfully deleted
I20260617 20:17:01.706347 28925 leader_election.cc:304] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:17:01.706429 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3180f1336fd841d8b4cf7fdf94015955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3180f1336fd841d8b4cf7fdf94015955 already in progress: creating tablet
W20260617 20:17:01.706701 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 6afb3ed704bb4a269d92f1741455161b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6afb3ed704bb4a269d92f1741455161b already in progress: creating tablet
I20260617 20:17:01.706797 30480 raft_consensus.cc:2804] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:01.706969 30480 raft_consensus.cc:697] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:01.707281 30480 consensus_queue.cc:237] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:01.719305 29198 consensus_peers.cc:597] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.721390 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 628) took 4305 ms. Trace:
I20260617 20:17:01.721503 29375 rpcz_store.cc:276] 0617 20:16:57.415573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.415642 (+ 69us) service_pool.cc:224] Handling call
0617 20:17:01.616141 (+4200499us) ts_tablet_manager.cc:1151] Deleting tablet 8880f8eadaa44887a49adf0ef157965e
0617 20:17:01.616148 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.662144 (+ 45996us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.665246 (+ 3102us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.721368 (+ 56122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4200270}
I20260617 20:17:01.721928 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 629) took 4268 ms. Trace:
I20260617 20:17:01.722012 29375 rpcz_store.cc:276] 0617 20:16:57.453796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.453883 (+ 87us) service_pool.cc:224] Handling call
0617 20:17:01.721795 (+4267912us) ts_tablet_manager.cc:1151] Deleting tablet 6c0aa4861a51488db2d1a7041c25ae22
0617 20:17:01.721806 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.721912 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4267680}
I20260617 20:17:01.722270 29375 tablet_replica.cc:333] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:01.722476 29375 raft_consensus.cc:2243] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:01.722920 29375 raft_consensus.cc:2272] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.723510 29375 ts_tablet_manager.cc:1916] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:01.729453 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 8880f8eadaa44887a49adf0ef157965e (table default.Table_fcf0d313e34c4117a4d36e5638a1a4b4 [id=7a4a3c7360114f72b54f5dd645215114]) successfully deleted
W20260617 20:17:01.729765 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 6c0aa4861a51488db2d1a7041c25ae22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c0aa4861a51488db2d1a7041c25ae22 already in progress: creating tablet
I20260617 20:17:01.734840 29379 tablet_bootstrap.cc:492] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.736227 29379 ts_tablet_manager.cc:1403] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.087s user 0.020s sys 0.000s
I20260617 20:17:01.744356 30480 raft_consensus.cc:493] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.744656 30480 raft_consensus.cc:515] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.745563 30480 leader_election.cc:290] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.746877 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b427ba6320be4f2a929eaf18a56b4309" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.746517 29379 raft_consensus.cc:359] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.749859 29379 raft_consensus.cc:385] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.751098 29379 raft_consensus.cc:740] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.753093 29379 consensus_queue.cc:260] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.757285 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b427ba6320be4f2a929eaf18a56b4309" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.757637 30202 consensus_queue.cc:1048] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:01.757961 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73bdcc1cefd48f3b99e0c059c3a7467" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.758414 30410 raft_consensus.cc:493] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:17:01.758424 28925 leader_election.cc:343] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.758626 30410 raft_consensus.cc:515] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.759287 30410 leader_election.cc:290] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:01.759755 29197 leader_election.cc:304] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.760123 29379 ts_tablet_manager.cc:1434] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.024s user 0.001s sys 0.002s
I20260617 20:17:01.760563 30410 raft_consensus.cc:2804] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:01.760694 30410 raft_consensus.cc:493] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:01.760814 30410 raft_consensus.cc:3060] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.761353 29379 tablet_bootstrap.cc:492] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.770701 29377 ts_tablet_manager.cc:1929] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:01.770850 29377 log.cc:1199] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/dcd999d88d954e50810cc01b297a27a9
I20260617 20:17:01.771205 29377 ts_tablet_manager.cc:1950] T dcd999d88d954e50810cc01b297a27a9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:01.772480 29376 ts_tablet_manager.cc:1929] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:17:01.772666 29376 log.cc:1199] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/d2c0988a73d547d08d0924784bff9222
I20260617 20:17:01.773092 29376 ts_tablet_manager.cc:1950] T d2c0988a73d547d08d0924784bff9222 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:01.773401 30410 raft_consensus.cc:515] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.774067 30410 leader_election.cc:290] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:01.774489 30193 raft_consensus.cc:493] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.774626 30193 raft_consensus.cc:515] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.775188 30193 leader_election.cc:290] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.775434 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3726e55ed36f420ab63bcfb5a81c5aab" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.779886 29379 tablet_bootstrap.cc:654] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.780992 29383 tablet_bootstrap.cc:492] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.781685 29383 ts_tablet_manager.cc:1403] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.104s user 0.011s sys 0.007s
I20260617 20:17:01.786885 29383 raft_consensus.cc:359] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.787686 29383 raft_consensus.cc:385] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.787961 29383 raft_consensus.cc:740] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.788923 29383 consensus_queue.cc:260] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.790051 29383 ts_tablet_manager.cc:1434] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20260617 20:17:01.790503 29383 tablet_bootstrap.cc:492] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:01.791751 30193 raft_consensus.cc:493] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.791895 30193 raft_consensus.cc:515] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.792475 30193 leader_election.cc:290] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.793241 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e0c5d20a4548cc8124302aa38bcb21" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:01.794304 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ea9cfa1c5a42359e5fa8a2c4c433a4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:01.794942 30202 raft_consensus.cc:493] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.794942 30193 raft_consensus.cc:493] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.795064 30193 raft_consensus.cc:515] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.795097 30202 raft_consensus.cc:515] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.795637 30193 leader_election.cc:290] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.795673 30202 leader_election.cc:290] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.796568 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a1c96212014333935ec7f7c92a306c" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:01.797174 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8fa9f4c40b4ce9baa27a8837d3575c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.797271 29383 tablet_bootstrap.cc:654] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:01.798153 28925 leader_election.cc:343] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:01.798700 28925 leader_election.cc:343] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.798856 28925 leader_election.cc:304] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.799270 30202 raft_consensus.cc:2749] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:01.799759 28925 leader_election.cc:343] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.799932 28925 leader_election.cc:304] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.800683 30314 raft_consensus.cc:2749] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.802212 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d673bc9892c94725b270ef3b9dc768f4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:01.802453 28990 raft_consensus.cc:3060] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.804877 29379 tablet_bootstrap.cc:492] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.807653 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3726e55ed36f420ab63bcfb5a81c5aab" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:01.807919 28985 raft_consensus.cc:2468] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:01.810483 29378 tablet_bootstrap.cc:654] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.812031 30193 consensus_queue.cc:1048] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:01.815109 29383 tablet_bootstrap.cc:492] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.815328 29383 ts_tablet_manager.cc:1403] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.003s
I20260617 20:17:01.816604 29383 raft_consensus.cc:359] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.816932 29383 raft_consensus.cc:385] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.817019 29383 raft_consensus.cc:740] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.817334 29383 consensus_queue.cc:260] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.820032 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 705) took 2631 ms. Trace:
I20260617 20:17:01.820143 29377 rpcz_store.cc:276] 0617 20:16:59.188698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.191116 (+ 2418us) service_pool.cc:224] Handling call
0617 20:17:01.670365 (+2479249us) ts_tablet_manager.cc:1151] Deleting tablet dcd999d88d954e50810cc01b297a27a9
0617 20:17:01.670377 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.767747 (+ 97370us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.770634 (+ 2887us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.819968 (+ 49334us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2479047}
I20260617 20:17:01.820542 29377 tablet_replica.cc:333] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:01.821125 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet dcd999d88d954e50810cc01b297a27a9 (table default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a]) successfully deleted
I20260617 20:17:01.822232 29379 ts_tablet_manager.cc:1403] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.061s user 0.021s sys 0.001s
I20260617 20:17:01.826457 29383 ts_tablet_manager.cc:1434] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.011s user 0.001s sys 0.008s
I20260617 20:17:01.827349 29383 tablet_bootstrap.cc:492] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:01.831970 29383 tablet_bootstrap.cc:654] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.832880 29379 raft_consensus.cc:359] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.833145 29379 raft_consensus.cc:385] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.833251 29379 raft_consensus.cc:740] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.833391 30201 raft_consensus.cc:493] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.833570 30201 raft_consensus.cc:515] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.833568 29379 consensus_queue.cc:260] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.834393 29379 ts_tablet_manager.cc:1434] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:01.834509 30201 leader_election.cc:290] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.834714 29379 tablet_bootstrap.cc:492] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.836130 29379 tablet_bootstrap.cc:654] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.839038 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 06680ddfee82464da4926e51dadd00a5
I20260617 20:17:01.842135 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2a8f46e8ac4f4aa39544a9fe40b1fe" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.822970 29127 raft_consensus.cc:3060] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.842553 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet 06680ddfee82464da4926e51dadd00a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:01.842940 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 06680ddfee82464da4926e51dadd00a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:01.847318 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8fa9f4c40b4ce9baa27a8837d3575c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.848014 29383 tablet_bootstrap.cc:492] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.848562 29383 ts_tablet_manager.cc:1403] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.004s
I20260617 20:17:01.853359 29383 raft_consensus.cc:359] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.854369 29383 raft_consensus.cc:385] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.854696 29383 raft_consensus.cc:740] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.855796 29383 consensus_queue.cc:260] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:01.860318 28925 leader_election.cc:343] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.860869 29379 tablet_bootstrap.cc:492] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.860918 29383 ts_tablet_manager.cc:1434] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.012s user 0.001s sys 0.003s
I20260617 20:17:01.861013 29379 ts_tablet_manager.cc:1403] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.004s
I20260617 20:17:01.861394 29383 tablet_bootstrap.cc:492] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:01.861698 29379 raft_consensus.cc:359] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.861862 29379 raft_consensus.cc:385] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.861914 29379 raft_consensus.cc:740] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.862097 29379 consensus_queue.cc:260] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.862591 29379 ts_tablet_manager.cc:1434] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:01.862874 29379 tablet_bootstrap.cc:492] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.862864 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2a8f46e8ac4f4aa39544a9fe40b1fe" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.863050 29260 raft_consensus.cc:2468] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:01.863523 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e0c5d20a4548cc8124302aa38bcb21" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.864019 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ea9cfa1c5a42359e5fa8a2c4c433a4" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.864152 29379 tablet_bootstrap.cc:654] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.864192 29383 tablet_bootstrap.cc:654] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.864478 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33a1c96212014333935ec7f7c92a306c" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.868187 29375 ts_tablet_manager.cc:1929] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:01.868332 29375 log.cc:1199] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/5e53946c85ab4a8286a6e174cc411c5e
I20260617 20:17:01.869011 29375 ts_tablet_manager.cc:1950] T 5e53946c85ab4a8286a6e174cc411c5e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:01.869367 28990 raft_consensus.cc:2468] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:01.872565 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 663) took 3759 ms. Trace:
I20260617 20:17:01.872727 29376 rpcz_store.cc:276] 0617 20:16:58.112669 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.114147 (+ 1478us) service_pool.cc:224] Handling call
0617 20:17:01.618035 (+3503888us) ts_tablet_manager.cc:1151] Deleting tablet d2c0988a73d547d08d0924784bff9222
0617 20:17:01.618043 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.676427 (+ 58384us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.772391 (+ 95964us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.872545 (+100154us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3503698}
I20260617 20:17:01.873205 29376 tablet_replica.cc:333] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:01.873492 29376 raft_consensus.cc:2243] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:01.873703 29376 raft_consensus.cc:2272] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.874532 29376 ts_tablet_manager.cc:1916] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:01.876945 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 630) took 4423 ms. Trace:
I20260617 20:17:01.877086 29375 rpcz_store.cc:276] 0617 20:16:57.453938 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.454858 (+ 920us) service_pool.cc:224] Handling call
0617 20:17:01.722228 (+4267370us) ts_tablet_manager.cc:1151] Deleting tablet 5e53946c85ab4a8286a6e174cc411c5e
0617 20:17:01.722236 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.770625 (+ 48389us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.868125 (+ 97500us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.876927 (+ 8802us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4267174}
I20260617 20:17:01.877663 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 5e53946c85ab4a8286a6e174cc411c5e (table default.Table_2ca839bde234444b97808d82d7974e3c [id=e682c8658ea84718a5e3909a6f6b7246]) successfully deleted
I20260617 20:17:01.878173 29379 tablet_bootstrap.cc:492] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:01.878288 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 631) took 4413 ms. Trace:
I20260617 20:17:01.878407 29379 ts_tablet_manager.cc:1403] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.006s
I20260617 20:17:01.878582 29375 rpcz_store.cc:276] 0617 20:16:57.464777 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.464836 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:01.878168 (+4413332us) ts_tablet_manager.cc:1151] Deleting tablet 6c0aa4861a51488db2d1a7041c25ae22
0617 20:17:01.878179 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.878270 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4412987}
W20260617 20:17:01.879038 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 6c0aa4861a51488db2d1a7041c25ae22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6c0aa4861a51488db2d1a7041c25ae22 already in progress: creating tablet
I20260617 20:17:01.879421 29379 raft_consensus.cc:359] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:01.879585 29379 raft_consensus.cc:385] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.879632 29379 raft_consensus.cc:740] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.879771 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 632) took 4396 ms. Trace:
I20260617 20:17:01.879822 29379 consensus_queue.cc:260] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:01.879877 29375 rpcz_store.cc:276] 0617 20:16:57.483783 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.483842 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:01.879665 (+4395823us) ts_tablet_manager.cc:1151] Deleting tablet 5477576e46c84bb6b8a8c7053c61641c
0617 20:17:01.879674 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.879755 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4395600}
W20260617 20:17:01.880298 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5477576e46c84bb6b8a8c7053c61641c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5477576e46c84bb6b8a8c7053c61641c already in progress: creating tablet
I20260617 20:17:01.880632 29379 ts_tablet_manager.cc:1434] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:17:01.880944 29379 tablet_bootstrap.cc:492] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:01.881071 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 634) took 4372 ms. Trace:
I20260617 20:17:01.881119 29383 tablet_bootstrap.cc:492] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.881232 29375 rpcz_store.cc:276] 0617 20:16:57.508999 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.509063 (+ 64us) service_pool.cc:224] Handling call
0617 20:17:01.880967 (+4371904us) ts_tablet_manager.cc:1151] Deleting tablet a52873eade4048af81a8e51233b9d079
0617 20:17:01.880976 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.881054 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4371734}
I20260617 20:17:01.881366 29383 ts_tablet_manager.cc:1403] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.007s
W20260617 20:17:01.881832 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet a52873eade4048af81a8e51233b9d079 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a52873eade4048af81a8e51233b9d079 already in progress: creating tablet
I20260617 20:17:01.882172 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 636) took 4329 ms. Trace:
I20260617 20:17:01.882253 29375 rpcz_store.cc:276] 0617 20:16:57.552700 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.552759 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:01.882078 (+4329319us) ts_tablet_manager.cc:1151] Deleting tablet d19d34e3bbe3453ca6de6ed7e62f7af4
0617 20:17:01.882087 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.882157 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4329124}
I20260617 20:17:01.882454 29379 tablet_bootstrap.cc:654] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:01.882632 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d19d34e3bbe3453ca6de6ed7e62f7af4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d19d34e3bbe3453ca6de6ed7e62f7af4 already in progress: creating tablet
I20260617 20:17:01.882963 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 640) took 4204 ms. Trace:
I20260617 20:17:01.883035 29375 rpcz_store.cc:276] 0617 20:16:57.678940 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.678999 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:01.882874 (+4203875us) ts_tablet_manager.cc:1151] Deleting tablet b278ba32316c42d1b101e9803657af99
0617 20:17:01.882882 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.882949 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4108868}
W20260617 20:17:01.883384 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet b278ba32316c42d1b101e9803657af99 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b278ba32316c42d1b101e9803657af99 already in progress: creating tablet
I20260617 20:17:01.884735 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 645) took 4117 ms. Trace:
I20260617 20:17:01.884862 29375 rpcz_store.cc:276] 0617 20:16:57.766856 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.766943 (+ 87us) service_pool.cc:224] Handling call
0617 20:17:01.883586 (+4116643us) ts_tablet_manager.cc:1151] Deleting tablet 9574c6f0765b4329af28d72c8e94240a
0617 20:17:01.884642 (+ 1056us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.884719 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4109320}
I20260617 20:17:01.885243 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 641) took 4182 ms. Trace:
I20260617 20:17:01.885411 29375 rpcz_store.cc:276] 0617 20:16:57.702997 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.703055 (+ 58us) service_pool.cc:224] Handling call
0617 20:17:01.885152 (+4182097us) ts_tablet_manager.cc:1151] Deleting tablet 3180f1336fd841d8b4cf7fdf94015955
0617 20:17:01.885160 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.885228 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4110744}
W20260617 20:17:01.885491 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 9574c6f0765b4329af28d72c8e94240a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9574c6f0765b4329af28d72c8e94240a already in progress: creating tablet
I20260617 20:17:01.885771 30201 raft_consensus.cc:493] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.885967 30201 raft_consensus.cc:515] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.886967 30201 leader_election.cc:290] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:01.887727 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3180f1336fd841d8b4cf7fdf94015955 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3180f1336fd841d8b4cf7fdf94015955 already in progress: creating tablet
I20260617 20:17:01.889640 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 648) took 4118 ms. Trace:
I20260617 20:17:01.889765 29375 rpcz_store.cc:276] 0617 20:16:57.771027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.771210 (+ 183us) service_pool.cc:224] Handling call
0617 20:17:01.889541 (+4118331us) ts_tablet_manager.cc:1151] Deleting tablet 6afb3ed704bb4a269d92f1741455161b
0617 20:17:01.889550 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.889623 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4114939}
W20260617 20:17:01.890293 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 6afb3ed704bb4a269d92f1741455161b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6afb3ed704bb4a269d92f1741455161b already in progress: creating tablet
I20260617 20:17:01.890607 29375 tablet_replica.cc:333] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:01.890832 29375 raft_consensus.cc:2243] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:01.891096 29375 raft_consensus.cc:2272] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.891945 29375 ts_tablet_manager.cc:1916] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:01.892356 29377 raft_consensus.cc:2243] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:01.892854 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b002468734394d8181543368ac878c6f
I20260617 20:17:01.893024 29377 raft_consensus.cc:2272] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:01.895540 29378 tablet_bootstrap.cc:492] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:01.895056 29383 raft_consensus.cc:359] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.895663 29378 ts_tablet_manager.cc:1403] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.200s user 0.001s sys 0.003s
I20260617 20:17:01.895714 29383 raft_consensus.cc:385] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.895939 29383 raft_consensus.cc:740] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.896392 29378 raft_consensus.cc:359] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.896544 29378 raft_consensus.cc:385] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:01.896597 29378 raft_consensus.cc:740] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:01.896876 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet b002468734394d8181543368ac878c6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:01.896692 29383 consensus_queue.cc:260] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.898418 30480 consensus_queue.cc:1048] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:01.899034 29383 ts_tablet_manager.cc:1434] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.018s user 0.004s sys 0.000s
I20260617 20:17:01.899854 29383 tablet_bootstrap.cc:492] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:01.905576 29383 tablet_bootstrap.cc:654] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.916186 29377 ts_tablet_manager.cc:1916] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:01.918797 29198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 127083us
W20260617 20:17:01.919353 29198 leader_election.cc:343] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:01.920120 28925 leader_election.cc:343] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:01.920212 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c17aa7f99fc74838b9975c3e9289ccfd
I20260617 20:17:01.920233 28925 leader_election.cc:304] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.920692 28925 leader_election.cc:304] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.920768 28664 catalog_manager.cc:6784] ReplaceTablet: tablet c17aa7f99fc74838b9975c3e9289ccfd deleted and replaced by tablet ae8574874a194473bb5891e604a25ce8
I20260617 20:17:01.921420 30546 raft_consensus.cc:2749] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.921818 30546 raft_consensus.cc:2804] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:01.921916 30546 raft_consensus.cc:493] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:01.921973 30546 raft_consensus.cc:3060] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.921892 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b87313ed947a489785485464059c33f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:01.922502 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b87313ed947a489785485464059c33f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:01.921818 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet c17aa7f99fc74838b9975c3e9289ccfd with delete_type TABLET_DATA_DELETED (replaced by tablet ae8574874a194473bb5891e604a25ce8) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:01.925720 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet b002468734394d8181543368ac878c6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:01.925873 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet 06680ddfee82464da4926e51dadd00a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:01.925854 29197 leader_election.cc:304] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:01.926749 30201 raft_consensus.cc:493] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.926870 30201 raft_consensus.cc:515] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:01.928319 29197 consensus_peers.cc:597] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dcd999d88d954e50810cc01b297a27a9. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:01.928723 30201 leader_election.cc:290] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.932999 30423 raft_consensus.cc:2804] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:01.933584 30423 raft_consensus.cc:493] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:01.933871 30423 raft_consensus.cc:3060] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.935165 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c3496887f6a045e293698d09d9cc1c16
I20260617 20:17:01.935671 28662 catalog_manager.cc:6784] ReplaceTablet: tablet c3496887f6a045e293698d09d9cc1c16 deleted and replaced by tablet a3c31f1bba074ba580601b7e8c64ea0b
I20260617 20:17:01.935803 28662 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:60552 (request call id 965) took 1071 ms. Trace:
I20260617 20:17:01.935894 28662 rpcz_store.cc:276] 0617 20:17:00.864733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.163161 (+298428us) service_pool.cc:224] Handling call
0617 20:17:01.167363 (+ 4202us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bdd54b 00007fa11b639107 00007fa11b638e35 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:01.935769 (+768406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:01.927080 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:01.927162 (+ 82us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:01.927167 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:01.927169 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:01.927283 (+ 114us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:01.927290 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:01.927294 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:01.927413 (+ 119us) tablet.cc:701] Row locks acquired
0617 20:17:01.927416 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:01.927448 (+ 32us) write_op.cc:270] Start()
0617 20:17:01.927476 (+ 28us) write_op.cc:276] Timestamp: P: 1781727421927416 usec, L: 0
0617 20:17:01.927481 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 20:17:01.927667 (+ 186us) log.cc:844] Serialized 631 byte log entry
0617 20:17:01.933646 (+ 5979us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.934509 (+ 863us) write_op.cc:301] APPLY: starting
0617 20:17:01.934523 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.934559 (+ 36us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.934599 (+ 40us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.934688 (+ 89us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.934741 (+ 53us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:01.934748 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:01.934808 (+ 60us) log.cc:844] Serialized 29 byte log entry
0617 20:17:01.934859 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.934876 (+ 17us) write_op.cc:454] Released schema lock
0617 20:17:01.934883 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":8918272,"child_traces":[["op",{"apply.queue_time_us":826,"apply.run_cpu_time_us":434,"apply.run_wall_time_us":434,"num_ops":2,"prepare.queue_time_us":2781,"prepare.run_cpu_time_us":685,"prepare.run_wall_time_us":684,"raft.queue_time_us":413,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":6148,"threads_started":1}]]}
I20260617 20:17:01.937080 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet c3496887f6a045e293698d09d9cc1c16 with delete_type TABLET_DATA_DELETED (replaced by tablet a3c31f1bba074ba580601b7e8c64ea0b) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:01.897385 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee426100bb645f391be123aeb52e412" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.897811 29121 raft_consensus.cc:3060] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.901453 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet b002468734394d8181543368ac878c6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:01.909596 30294 raft_consensus.cc:493] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:01.944361 30294 raft_consensus.cc:515] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.945120 30294 leader_election.cc:290] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.929713 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet c17aa7f99fc74838b9975c3e9289ccfd with delete_type TABLET_DATA_DELETED (replaced by tablet ae8574874a194473bb5891e604a25ce8) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:01.934374 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d673bc9892c94725b270ef3b9dc768f4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:01.934899 29116 raft_consensus.cc:3060] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:01.946175 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_ae4ab5348d244f92a3ecd4fac3ca86b2 [id=06b76ab80c3b453986d047f7f1f832ac]) successfully deleted
W20260617 20:17:01.946408 29062 leader_election.cc:343] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: fc36f62aa0bf46278cb84ec8cb7eef55
I20260617 20:17:01.947129 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet c3496887f6a045e293698d09d9cc1c16 with delete_type TABLET_DATA_DELETED (replaced by tablet a3c31f1bba074ba580601b7e8c64ea0b) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:01.951480 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc3219639748d9a0d71d45ae22ab36" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:01.951957 29063 leader_election.cc:304] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.957540 29378 consensus_queue.cc:260] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.959143 30294 raft_consensus.cc:2749] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.959661 29063 leader_election.cc:304] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.964761 29378 ts_tablet_manager.cc:1434] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.069s user 0.002s sys 0.000s
I20260617 20:17:01.964864 28663 catalog_manager.cc:5696] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:17:01.965420 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet c3014c93d6804f3896f452f041cbedc9 (table default.Table_01fded33682b4e3f91e9f6e6e92031f6 [id=0a278273a6004aa7947a19674e45d123]). Expected version 3 got 0
I20260617 20:17:01.965519 30294 raft_consensus.cc:2749] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.965771 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:01.965950 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 3 got 0
I20260617 20:17:01.966270 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
I20260617 20:17:01.966441 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]). Expected version 1 got 0
I20260617 20:17:01.966718 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d673bc9892c94725b270ef3b9dc768f4 (table default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330]). Expected version 1 got 0
I20260617 20:17:01.966671 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee426100bb645f391be123aeb52e412" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:01.967069 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:17:01.967430 28663 catalog_manager.cc:5696] T 39ea9cfa1c5a42359e5fa8a2c4c433a4 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:17:01.969247 29063 leader_election.cc:304] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:01.969743 29378 tablet_bootstrap.cc:492] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:01.970719 30294 raft_consensus.cc:2749] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:01.978829 28881 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 06680ddfee82464da4926e51dadd00a5
I20260617 20:17:01.980178 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet 06680ddfee82464da4926e51dadd00a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:01.981755 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea0168fa86547f68c7fec880b8d8f1e (DEFAULT_TABLE table=default.Table_f168b2e932084d149c71a4b87f021c3d [id=e21edff75b2e411d80a8f97ab4ab7956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:01.982132 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea0168fa86547f68c7fec880b8d8f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:01.992821 29378 tablet_bootstrap.cc:654] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:01.975078 29377 ts_tablet_manager.cc:1929] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:01.978123 30546 raft_consensus.cc:515] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:01.980023 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet 06680ddfee82464da4926e51dadd00a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:01.993830 30546 leader_election.cc:290] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:01.994270 29377 log.cc:1199] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/f4de5dafb1474de1911148bb3b4527cf
I20260617 20:17:01.994663 29377 ts_tablet_manager.cc:1950] T f4de5dafb1474de1911148bb3b4527cf P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:01.996685 29383 tablet_bootstrap.cc:492] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:01.997045 29383 ts_tablet_manager.cc:1403] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.097s user 0.012s sys 0.027s
I20260617 20:17:01.997124 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea0168fa86547f68c7fec880b8d8f1e (DEFAULT_TABLE table=default.Table_f168b2e932084d149c71a4b87f021c3d [id=e21edff75b2e411d80a8f97ab4ab7956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:01.997512 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea0168fa86547f68c7fec880b8d8f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.004328 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ee6d0ff0a92e42e59d1be2988aa3e5b1" } new_table_name: "default.Table_6ead2c895ac049739a31aaabe45390fe" modify_external_catalogs: true
I20260617 20:17:02.009984 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_eb1362a8011c49d8979bb821d06c9c4e" } new_table_name: "default.Table_94e5e206c8b144c1816cbe3cc8338ffa" modify_external_catalogs: true
I20260617 20:17:02.011085 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7664154b784cf8addbe0df32da99f0 (DEFAULT_TABLE table=default.Table_487f14a2a0554f68af6b03801e647fac [id=6a8fb68aa5024673a1b88ae934abd00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.011620 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7664154b784cf8addbe0df32da99f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:02.013932 29198 leader_election.cc:343] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.016196 30526 raft_consensus.cc:493] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.016319 30526 raft_consensus.cc:515] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.016889 30526 leader_election.cc:290] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.017382 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ea6cac8d44b4b8d41e3e33e0fd6cb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.018220 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2a8f46e8ac4f4aa39544a9fe40b1fe" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:02.019317 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc36f62aa0bf46278cb84ec8cb7eef55" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:02.019665 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc3219639748d9a0d71d45ae22ab36" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:02.020036 30410 raft_consensus.cc:493] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.020169 30410 raft_consensus.cc:515] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.020541 30556 raft_consensus.cc:493] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.020792 30410 leader_election.cc:290] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.020736 30556 raft_consensus.cc:515] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.023959 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5faea831376646c1bdfcaf8fbbc7ca6d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:02.024869 29198 leader_election.cc:343] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.025271 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12ea6cac8d44b4b8d41e3e33e0fd6cb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:02.025552 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet c3496887f6a045e293698d09d9cc1c16 with delete_type TABLET_DATA_DELETED (replaced by tablet a3c31f1bba074ba580601b7e8c64ea0b) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.025626 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet c17aa7f99fc74838b9975c3e9289ccfd with delete_type TABLET_DATA_DELETED (replaced by tablet ae8574874a194473bb5891e604a25ce8) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.025626 29227 tablet_service.cc:1558] Processing DeleteTablet for tablet 06680ddfee82464da4926e51dadd00a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:01 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.025914 29197 leader_election.cc:304] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.026036 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7664154b784cf8addbe0df32da99f0 (DEFAULT_TABLE table=default.Table_487f14a2a0554f68af6b03801e647fac [id=6a8fb68aa5024673a1b88ae934abd00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.026036 29239 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea0168fa86547f68c7fec880b8d8f1e (DEFAULT_TABLE table=default.Table_f168b2e932084d149c71a4b87f021c3d [id=e21edff75b2e411d80a8f97ab4ab7956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.026413 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2a8f46e8ac4f4aa39544a9fe40b1fe" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:02.026549 29258 raft_consensus.cc:3060] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.027171 30253 raft_consensus.cc:2804] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:02.027281 30253 raft_consensus.cc:697] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:02.027268 29063 leader_election.cc:304] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.027486 30193 raft_consensus.cc:2749] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.028575 29383 raft_consensus.cc:359] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.028724 29383 raft_consensus.cc:385] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.028765 29383 raft_consensus.cc:740] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.029873 30253 consensus_queue.cc:237] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.033084 30556 leader_election.cc:290] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.035161 29063 leader_election.cc:304] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.035449 30193 raft_consensus.cc:2749] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.041677 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58213ec0a9364a91a15fc0329f28605b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:02.045203 29198 leader_election.cc:343] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.050168 30546 raft_consensus.cc:493] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.050333 30546 raft_consensus.cc:515] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.050935 30546 leader_election.cc:290] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:02.051455 28925 leader_election.cc:343] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:02.051784 28925 leader_election.cc:343] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.051836 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203666e6127b49ed92731bc87ce01798" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:02.052156 30202 raft_consensus.cc:493] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.052266 30202 raft_consensus.cc:515] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.052775 30202 leader_election.cc:290] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.054436 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d44524b02e6f4c1291bca50e9261459b
W20260617 20:17:02.054608 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dc11f416bf5647c78a5ab687cad53792 consensus state has no leader
I20260617 20:17:02.054641 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 716) took 2498 ms. Trace:
I20260617 20:17:02.054718 29377 rpcz_store.cc:276] 0617 20:16:59.555696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.555746 (+ 50us) service_pool.cc:224] Handling call
0617 20:17:01.820459 (+2264713us) ts_tablet_manager.cc:1151] Deleting tablet f4de5dafb1474de1911148bb3b4527cf
0617 20:17:01.820468 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.892692 (+ 72224us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x616000212254. stack: 00007ffae652a496 00007ffae652a250 00007ffae55553ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007ffaf25d07e0 00007ffaf391c933 00007ffaf64dfae7 00007ffaf6512bb4 00007ffaf64f35d0 00007ffaf64f335d 0000000000aa681c 00007ffae65709ff 00007ffae6573d1b 00007ffae6573b98
0617 20:17:01.971339 (+ 78647us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:01.974871 (+ 3532us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.054625 (+ 79754us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43489,"spinlock_wait_cycles":164686592,"tablet-delete.queue_time_us":2264521}
I20260617 20:17:02.055030 28661 catalog_manager.cc:6784] ReplaceTablet: tablet d44524b02e6f4c1291bca50e9261459b deleted and replaced by tablet 82ec75621f88424d963ffe235a5149f4
I20260617 20:17:02.055130 29377 tablet_replica.cc:333] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:02.055289 29377 raft_consensus.cc:2243] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:02.055414 29377 raft_consensus.cc:2272] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:02.055832 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet f4de5dafb1474de1911148bb3b4527cf (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]) successfully deleted
I20260617 20:17:02.058066 29377 ts_tablet_manager.cc:1916] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.061687 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]). Expected version 1 got 0
I20260617 20:17:02.062039 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
I20260617 20:17:02.062230 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 3 got 0
I20260617 20:17:02.062374 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:02.062547 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet ba3ad8de250a47da9c9a31dff7f495b5 (table default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]). Expected version 2 got 0
I20260617 20:17:02.069015 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet ba3ad8de250a47da9c9a31dff7f495b5 (table default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]). Expected version 2 got 0
I20260617 20:17:02.069871 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 3 got 0
I20260617 20:17:02.070201 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet c3014c93d6804f3896f452f041cbedc9 (table default.Table_01fded33682b4e3f91e9f6e6e92031f6 [id=0a278273a6004aa7947a19674e45d123]). Expected version 3 got 0
I20260617 20:17:02.071880 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203666e6127b49ed92731bc87ce01798" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:02.073937 29258 raft_consensus.cc:2468] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:02.078958 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet d44524b02e6f4c1291bca50e9261459b with delete_type TABLET_DATA_DELETED (replaced by tablet 82ec75621f88424d963ffe235a5149f4) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.079718 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet d44524b02e6f4c1291bca50e9261459b with delete_type TABLET_DATA_DELETED (replaced by tablet 82ec75621f88424d963ffe235a5149f4) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:02.080653 29376 ts_tablet_manager.cc:1929] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:02.080787 29376 log.cc:1199] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/f24954093a45411a9cbe39415fb1adb7
I20260617 20:17:02.081139 29376 ts_tablet_manager.cc:1950] T f24954093a45411a9cbe39415fb1adb7 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:02.081372 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet d44524b02e6f4c1291bca50e9261459b with delete_type TABLET_DATA_DELETED (replaced by tablet 82ec75621f88424d963ffe235a5149f4) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.089749 28669 catalog_manager.cc:5696] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:17:02.089823 29383 consensus_queue.cc:260] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.090377 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet ba3ad8de250a47da9c9a31dff7f495b5 (table default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]). Expected version 2 got 0
I20260617 20:17:02.090674 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d673bc9892c94725b270ef3b9dc768f4 (table default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330]). Expected version 1 got 0
I20260617 20:17:02.090842 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
I20260617 20:17:02.090983 29383 ts_tablet_manager.cc:1434] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.094s user 0.031s sys 0.003s
I20260617 20:17:02.091077 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:02.091276 28669 catalog_manager.cc:5696] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:17:02.091784 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet c3014c93d6804f3896f452f041cbedc9 (table default.Table_01fded33682b4e3f91e9f6e6e92031f6 [id=0a278273a6004aa7947a19674e45d123]). Expected version 3 got 0
I20260617 20:17:02.091989 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]). Expected version 2 got 0
I20260617 20:17:02.092224 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 27c20f436b9b4a8cb659215f9579af04 (table default.Table_3d19c23664c34aff8fce1a199ca71ac9 [id=f8657da5fd504f17aa1f82c1dba56187]). Expected version 1 got 0
I20260617 20:17:02.092483 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet ead0291870a443d9b76ea919a45a4303 (table default.Table_d353f219381d4d17a2927a233465454c [id=0ef22e22306747b28d49d58d0fa45620]). Expected version 4 got 0
I20260617 20:17:02.093415 30542 consensus_queue.cc:1048] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.096669 30294 raft_consensus.cc:493] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.096848 30294 raft_consensus.cc:515] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.097675 30294 leader_election.cc:290] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:02.098438 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 46482.5us
W20260617 20:17:02.098652 28925 leader_election.cc:343] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.098753 28925 leader_election.cc:304] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.100791 30202 raft_consensus.cc:2749] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:02.102123 28925 leader_election.cc:343] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.102651 28925 leader_election.cc:304] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.103223 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f7b878728a495f83b6584f8a6aca67" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:02.103740 30573 raft_consensus.cc:2749] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:02.104015 29062 leader_election.cc:343] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 89f7b878728a495f83b6584f8a6aca67
I20260617 20:17:02.104130 29062 leader_election.cc:304] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:02.104278 28925 leader_election.cc:343] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.104735 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5faea831376646c1bdfcaf8fbbc7ca6d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.104940 28985 raft_consensus.cc:2468] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:17:02.105154 28925 leader_election.cc:343] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.105859 29121 raft_consensus.cc:3060] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.106861 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c20f436b9b4a8cb659215f9579af04" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:02.108878 28925 leader_election.cc:343] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.109345 28925 leader_election.cc:304] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.110054 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7664154b784cf8addbe0df32da99f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.110280 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea0168fa86547f68c7fec880b8d8f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.112401 30570 raft_consensus.cc:2749] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:02.114084 28925 leader_election.cc:304] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.114605 30202 raft_consensus.cc:2749] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.114792 30202 raft_consensus.cc:2804] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:02.114902 30202 raft_consensus.cc:697] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:02.115149 30202 consensus_queue.cc:237] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:02.115176 28925 leader_election.cc:343] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.117426 30546 consensus_queue.cc:1048] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.125213 30314 raft_consensus.cc:493] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.125473 30314 raft_consensus.cc:515] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.126142 30314 leader_election.cc:290] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.126897 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17aa7f99fc74838b9975c3e9289ccfd" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:02.127813 28925 leader_election.cc:343] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.128697 29383 tablet_bootstrap.cc:492] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:02.130187 29383 tablet_bootstrap.cc:654] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.134732 29379 tablet_bootstrap.cc:492] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:02.134958 29379 ts_tablet_manager.cc:1403] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.254s user 0.031s sys 0.041s
I20260617 20:17:02.135838 29379 raft_consensus.cc:359] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.136132 29379 raft_consensus.cc:385] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.136240 29379 raft_consensus.cc:740] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.136550 29379 consensus_queue.cc:260] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.137122 29379 ts_tablet_manager.cc:1434] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:02.146335 29379 tablet_bootstrap.cc:492] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:02.147904 29379 tablet_bootstrap.cc:654] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.149741 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58213ec0a9364a91a15fc0329f28605b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.150050 28990 raft_consensus.cc:2468] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:02.152084 29383 tablet_bootstrap.cc:492] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:02.152412 29383 ts_tablet_manager.cc:1403] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.000s
W20260617 20:17:02.153499 29197 consensus_peers.cc:597] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 89f7b878728a495f83b6584f8a6aca67. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:02.153668 29197 leader_election.cc:304] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.154078 29197 leader_election.cc:304] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.154418 30410 consensus_queue.cc:1048] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.154609 30542 raft_consensus.cc:2804] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:02.154693 30542 raft_consensus.cc:493] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:02.154760 30542 raft_consensus.cc:3060] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.154918 30410 raft_consensus.cc:2804] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:02.154999 30410 raft_consensus.cc:493] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:02.155071 30410 raft_consensus.cc:3060] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.150832 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c20f436b9b4a8cb659215f9579af04" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:02.151387 29125 raft_consensus.cc:3060] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.151696 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17aa7f99fc74838b9975c3e9289ccfd" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:02.157326 29378 tablet_bootstrap.cc:492] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:02.157490 29378 ts_tablet_manager.cc:1403] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.188s user 0.003s sys 0.002s
I20260617 20:17:02.158293 29378 raft_consensus.cc:359] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.158576 29378 raft_consensus.cc:385] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.158674 29378 raft_consensus.cc:740] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.159116 29378 consensus_queue.cc:260] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.160171 29378 ts_tablet_manager.cc:1434] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:02.167053 29383 raft_consensus.cc:359] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:02.168151 29383 raft_consensus.cc:385] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.170158 29383 raft_consensus.cc:740] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.171705 29383 consensus_queue.cc:260] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:02.174489 29379 tablet_bootstrap.cc:492] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:02.174680 29379 ts_tablet_manager.cc:1403] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.004s
I20260617 20:17:02.175550 29379 raft_consensus.cc:359] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.175840 29379 raft_consensus.cc:385] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.175945 29379 raft_consensus.cc:740] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.176203 29379 consensus_queue.cc:260] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.176741 29379 ts_tablet_manager.cc:1434] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:17:02.177229 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 678) took 3907 ms. Trace:
I20260617 20:17:02.177068 29383 ts_tablet_manager.cc:1434] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.024s user 0.004s sys 0.000s
I20260617 20:17:02.177371 29376 rpcz_store.cc:276] 0617 20:16:58.270002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.270047 (+ 45us) service_pool.cc:224] Handling call
0617 20:17:01.873156 (+3603109us) ts_tablet_manager.cc:1151] Deleting tablet f24954093a45411a9cbe39415fb1adb7
0617 20:17:01.873166 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:01.978639 (+105473us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.080571 (+101932us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.177211 (+ 96640us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3602930}
I20260617 20:17:02.178081 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet f24954093a45411a9cbe39415fb1adb7 (table default.Table_7ccf01ded0f84e49b3d9791d7ba4096a [id=28985cea8424471d86e5a1c33ee903d5]) successfully deleted
I20260617 20:17:02.178797 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c7301f39e0a54609801e5454f391767b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:02.179368 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7301f39e0a54609801e5454f391767b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.180502 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7ea99b304a684f3c96d69b2c2457bbd2" } modify_external_catalogs: true
I20260617 20:17:02.180688 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7ea99b304a684f3c96d69b2c2457bbd2" } modify_external_catalogs: true
W20260617 20:17:02.181538 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61d5e895c4604795bb49a2ac99afdbf9 consensus state has no leader
I20260617 20:17:02.181946 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_89996edf26734b579b82eaf9bc18dbd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:02.182428 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89996edf26734b579b82eaf9bc18dbd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.178012 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 681) took 3888 ms. Trace:
I20260617 20:17:02.182700 29376 rpcz_store.cc:276] 0617 20:16:58.289156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.289199 (+ 43us) service_pool.cc:224] Handling call
0617 20:17:02.177897 (+3888698us) ts_tablet_manager.cc:1151] Deleting tablet 9370421288e2449fae454aec32883810
0617 20:17:02.177907 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.177997 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3887865}
I20260617 20:17:02.183111 29376 tablet_replica.cc:333] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:02.183352 29376 raft_consensus.cc:2243] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:02.183684 29376 raft_consensus.cc:2272] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:02.184427 29376 ts_tablet_manager.cc:1916] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.185536 30423 raft_consensus.cc:515] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.187119 29379 tablet_bootstrap.cc:492] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:17:02.188539 28657 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.252:46059, user_credentials={real_user=slave}} blocked reactor thread for 87384.1us
I20260617 20:17:02.188774 29379 tablet_bootstrap.cc:654] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.188861 28669 catalog_manager.cc:5696] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:17:02.189350 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]). Expected version 1 got 0
I20260617 20:17:02.189637 28669 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 3 got 0
I20260617 20:17:02.190008 28665 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_f7130590729b49af9644f1ffa516fe05 [id=6a948594185b42128136770dbe3f0ffb] alter complete (version 3)
I20260617 20:17:02.190359 28668 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_efb89ae603ed4713a25716af39bf03c3 [id=cd4abe077ee04673bad87834b3af273b] alter complete (version 3)
I20260617 20:17:02.190727 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 7efe079091784d7e8035659edd442ba6
I20260617 20:17:02.191207 28667 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:60552 (request call id 956) took 2424 ms. Trace:
I20260617 20:17:02.191329 28667 rpcz_store.cc:276] 0617 20:16:59.766679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.972670 (+1205991us) service_pool.cc:224] Handling call
0617 20:17:00.994546 (+ 21876us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd16b6 00007fa11b62e486 00007fa11b62e1b5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:00.994900 (+ 354us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:17:00.995023 (+ 123us) catalog_manager.cc:2840] Modifying in-memory table state
0617 20:17:00.995074 (+ 51us) catalog_manager.cc:2849] Locking tablets
0617 20:17:01.039103 (+ 44029us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 20:17:01.160837 (+121734us) catalog_manager.cc:2881] Removing table from by-name map
0617 20:17:01.160918 (+ 81us) catalog_manager.cc:2897] Committing in-memory state
0617 20:17:02.190663 (+1029745us) catalog_manager.cc:2901] Aborting table tasks
0617 20:17:02.191168 (+ 505us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:01.125087 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:01.125208 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:01.125212 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:01.125213 (+ 1us) tablet.cc:662] Decoding operations
0617 20:17:01.125322 (+ 109us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:01.125329 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:01.125333 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:01.125445 (+ 112us) tablet.cc:701] Row locks acquired
0617 20:17:01.125448 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:01.125488 (+ 40us) write_op.cc:270] Start()
0617 20:17:01.125515 (+ 27us) write_op.cc:276] Timestamp: P: 1781727421125443 usec, L: 0
0617 20:17:01.125518 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:01.125658 (+ 140us) log.cc:844] Serialized 799 byte log entry
0617 20:17:01.159936 (+ 34278us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.160479 (+ 543us) write_op.cc:301] APPLY: starting
0617 20:17:01.160490 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.160519 (+ 29us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.160548 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.160597 (+ 49us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.160622 (+ 25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 20:17:01.160629 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:01.160677 (+ 48us) log.cc:844] Serialized 29 byte log entry
0617 20:17:01.160713 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.160725 (+ 12us) write_op.cc:454] Released schema lock
0617 20:17:01.160730 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":49785600,"child_traces":[["op",{"apply.queue_time_us":512,"apply.run_cpu_time_us":301,"apply.run_wall_time_us":301,"num_ops":2,"prepare.queue_time_us":85219,"prepare.run_cpu_time_us":634,"prepare.run_wall_time_us":633,"replication_time_us":34403}]]}
I20260617 20:17:02.192097 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5973c3b62d2d4c1e9242f5a432e17719" } new_table_name: "default.Table_8a887192caa742b9a34884b64f306fee" modify_external_catalogs: true
I20260617 20:17:02.193327 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc8b1dc268b455ea263b67077e0bf6d (DEFAULT_TABLE table=default.Table_fbd010547fdb4650b1d982bc400ade26 [id=70b5ba2694c94a88ade075e6de307679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.193643 29375 ts_tablet_manager.cc:1929] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:17:02.193681 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc8b1dc268b455ea263b67077e0bf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.195695 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet 7efe079091784d7e8035659edd442ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:00 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:17:02.195713 28665 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.195:55493 (request call id 136) took 2322 ms (client timeout 1000 ms). Trace:
W20260617 20:17:02.195834 28665 rpcz_store.cc:269] 0617 20:16:59.872986 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.475537 (+602551us) service_pool.cc:224] Handling call
0617 20:17:00.632375 (+156838us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bcaf08 00007fa11b629ca6 00007fa11b6299d5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.195667 (+1563292us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:00.811705 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:00.811832 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:00.811837 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:00.811840 (+ 3us) tablet.cc:662] Decoding operations
0617 20:17:00.811935 (+ 95us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:00.811952 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:00.811956 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:00.812023 (+ 67us) tablet.cc:701] Row locks acquired
0617 20:17:00.812027 (+ 4us) write_op.cc:260] PREPARE: finished
0617 20:17:00.812066 (+ 39us) write_op.cc:270] Start()
0617 20:17:00.812101 (+ 35us) write_op.cc:276] Timestamp: P: 1781727420812042 usec, L: 0
0617 20:17:00.812104 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:00.812269 (+ 165us) log.cc:844] Serialized 536 byte log entry
0617 20:17:01.032315 (+220046us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.032624 (+ 309us) write_op.cc:301] APPLY: starting
0617 20:17:01.032646 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.032695 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.032765 (+ 70us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.032832 (+ 67us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.032875 (+ 43us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:01.032886 (+ 11us) write_op.cc:312] APPLY: finished
0617 20:17:01.033038 (+ 152us) log.cc:844] Serialized 23 byte log entry
0617 20:17:01.033169 (+ 131us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.033215 (+ 46us) write_op.cc:454] Released schema lock
0617 20:17:01.033225 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:01.040935 (+ 7710us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.040943 (+ 8us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 20:17:01.124538 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:01.124646 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:01.124651 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:01.124657 (+ 6us) tablet.cc:662] Decoding operations
0617 20:17:01.124733 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:01.124741 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:01.124745 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:01.124792 (+ 47us) tablet.cc:701] Row locks acquired
0617 20:17:01.124794 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:01.124820 (+ 26us) write_op.cc:270] Start()
0617 20:17:01.124844 (+ 24us) write_op.cc:276] Timestamp: P: 1781727421124777 usec, L: 0
0617 20:17:01.124848 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:01.124988 (+ 140us) log.cc:844] Serialized 356 byte log entry
0617 20:17:01.159866 (+ 34878us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.160014 (+ 148us) write_op.cc:301] APPLY: starting
0617 20:17:01.160028 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.160068 (+ 40us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.160090 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.160154 (+ 64us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.160187 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:01.160194 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:01.160270 (+ 76us) log.cc:844] Serialized 23 byte log entry
0617 20:17:01.160330 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.160344 (+ 14us) write_op.cc:454] Released schema lock
0617 20:17:01.160350 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:01.160417 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.160420 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"spinlock_wait_cycles":331923840,"child_traces":[["op",{"apply.queue_time_us":190,"apply.run_cpu_time_us":688,"apply.run_wall_time_us":8284,"num_ops":1,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":643,"prepare.run_wall_time_us":644,"replication_time_us":220171}],["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":395,"apply.run_wall_time_us":396,"num_ops":1,"prepare.queue_time_us":88391,"prepare.run_cpu_time_us":517,"prepare.run_wall_time_us":516,"replication_time_us":34989}]]}
W20260617 20:17:02.196544 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 9370421288e2449fae454aec32883810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9370421288e2449fae454aec32883810 already in progress: creating tablet
I20260617 20:17:02.196898 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a54a8950e6fd43248d608f5bb5f9b765" } new_table_name: "default.Table_8d0debb3585c4a1f80594e8f6e5600dd" modify_external_catalogs: true
I20260617 20:17:02.197369 29375 log.cc:1199] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/d2c0988a73d547d08d0924784bff9222
I20260617 20:17:02.197775 29375 ts_tablet_manager.cc:1950] T d2c0988a73d547d08d0924784bff9222 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:02.197861 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet c8d373f177494f1486fcae4a67a13041 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.198110 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc8b1dc268b455ea263b67077e0bf6d (DEFAULT_TABLE table=default.Table_fbd010547fdb4650b1d982bc400ade26 [id=70b5ba2694c94a88ade075e6de307679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.199532 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet b4240e14b48f4a43b7ce9c6512fc7ff2 with delete_type TABLET_DATA_DELETED (replaced by tablet cb8f218e9f2d44bfbfd843ac8517a152) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.199594 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 488b06f05d9b4273a61bcb2d6e0ad796 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f3032155e4e4ea8a23984f547d78752) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.199877 30570 raft_consensus.cc:493] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:02.200026 30570 raft_consensus.cc:515] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.201048 29383 tablet_bootstrap.cc:492] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:02.202108 30570 leader_election.cc:290] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.203349 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet 7efe079091784d7e8035659edd442ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:00 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.211009 29379 tablet_bootstrap.cc:492] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:02.211458 29379 ts_tablet_manager.cc:1403] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.003s
I20260617 20:17:02.213265 29379 raft_consensus.cc:359] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.213737 29379 raft_consensus.cc:385] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.213963 29379 raft_consensus.cc:740] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.214448 30423 leader_election.cc:290] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:02.214504 29379 consensus_queue.cc:260] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.215703 29379 ts_tablet_manager.cc:1434] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260617 20:17:02.216545 29379 tablet_bootstrap.cc:492] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:02.220474 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 6d62885cedcc4821ac430f1d6df3bded (DEFAULT_TABLE table=default.Table_0969f0a128834168ad1fde29b32e32d0 [id=ce09aecc32044c59a85905f3c8d82e42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.220886 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d62885cedcc4821ac430f1d6df3bded. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:02.221212 29527 leader_election.cc:336] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 87437cd320a4470fa0dedd43aa7ea3eb (127.27.245.253:38361): Timed out: RequestConsensusVote RPC to 127.27.245.253:38361 timed out after 0.739s (SENT)
I20260617 20:17:02.221391 29527 leader_election.cc:304] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5ea3f9265d84474ab3bced8dd5aecc5; no voters: 590225c8ea36448093b77385d238a34a, 87437cd320a4470fa0dedd43aa7ea3eb
I20260617 20:17:02.227478 29383 tablet_bootstrap.cc:654] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.227397 29379 tablet_bootstrap.cc:654] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.231666 30588 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260617 20:17:02.161631 28925 consensus_peers.cc:597] T 450b08b439814915ab4371770f49f45b P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:02.232012 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 70418.2us
I20260617 20:17:02.175675 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7664154b784cf8addbe0df32da99f0 (DEFAULT_TABLE table=default.Table_487f14a2a0554f68af6b03801e647fac [id=6a8fb68aa5024673a1b88ae934abd00e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.188247 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc8b1dc268b455ea263b67077e0bf6d (DEFAULT_TABLE table=default.Table_fbd010547fdb4650b1d982bc400ade26 [id=70b5ba2694c94a88ade075e6de307679]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.198606 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 7efe079091784d7e8035659edd442ba6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:00 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.202521 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8d04ef8acd4fcaa69df9253cd89462" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.233073 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf8d04ef8acd4fcaa69df9253cd89462" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:02.232355 28925 leader_election.cc:343] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.205469 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3726e55ed36f420ab63bcfb5a81c5aab" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:02.233278 28925 leader_election.cc:304] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.233358 28988 raft_consensus.cc:3060] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:02.233660 28925 leader_election.cc:343] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.233747 28925 leader_election.cc:304] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.233945 30546 raft_consensus.cc:2749] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.234071 30546 raft_consensus.cc:2749] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.211045 29377 ts_tablet_manager.cc:1929] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:02.234325 29377 log.cc:1199] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/f8e0c5d20a4548cc8124302aa38bcb21
I20260617 20:17:02.234577 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7664154b784cf8addbe0df32da99f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.234750 29377 ts_tablet_manager.cc:1950] T f8e0c5d20a4548cc8124302aa38bcb21 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:02.214139 30202 raft_consensus.cc:493] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.235018 30202 raft_consensus.cc:515] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.235858 29378 tablet_bootstrap.cc:492] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:02.236034 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc8b1dc268b455ea263b67077e0bf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.237257 29378 tablet_bootstrap.cc:654] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.238572 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d0e2ecc16e4285a1d8337a5336caf2" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:02.239391 28925 leader_election.cc:343] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.240059 30202 leader_election.cc:290] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.240088 29239 tablet_service.cc:1511] Processing CreateTablet for tablet 6d62885cedcc4821ac430f1d6df3bded (DEFAULT_TABLE table=default.Table_0969f0a128834168ad1fde29b32e32d0 [id=ce09aecc32044c59a85905f3c8d82e42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.240756 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3726e55ed36f420ab63bcfb5a81c5aab" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:02.241734 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 841664f40c02423095bb9e63b85006a6 (DEFAULT_TABLE table=default.Table_d4a84bed29104bb3a86225b6af000f69 [id=db0df08944d046dda77d502cfc65d5ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.242097 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841664f40c02423095bb9e63b85006a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.242612 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d0e2ecc16e4285a1d8337a5336caf2" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:02.242987 29063 leader_election.cc:304] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.243191 30570 raft_consensus.cc:2749] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260617 20:17:02.244230 28925 leader_election.cc:343] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.244359 28925 leader_election.cc:304] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.245463 30555 raft_consensus.cc:493] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.245582 30555 raft_consensus.cc:515] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:02.245839 30573 raft_consensus.cc:2749] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.246114 30555 leader_election.cc:290] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.246747 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73bdcc1cefd48f3b99e0c059c3a7467" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.246922 28983 raft_consensus.cc:2468] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:02.247578 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 6d62885cedcc4821ac430f1d6df3bded (DEFAULT_TABLE table=default.Table_0969f0a128834168ad1fde29b32e32d0 [id=ce09aecc32044c59a85905f3c8d82e42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.247936 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d62885cedcc4821ac430f1d6df3bded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.248296 29197 leader_election.cc:304] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:02.248517 29037 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:02.248549 30555 raft_consensus.cc:2804] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:02.248610 30555 raft_consensus.cc:493] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:02.248665 30555 raft_consensus.cc:3060] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:02.248972 29198 leader_election.cc:343] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.250090 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73bdcc1cefd48f3b99e0c059c3a7467" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:02.250548 29198 leader_election.cc:343] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.257928 28670 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_675137d48e694996a1fbfc31e4fd7c9b [id=7a5ce2f1ca114a508611d15c5a7c18c4] alter complete (version 2)
I20260617 20:17:02.261674 28666 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727] alter complete (version 1)
I20260617 20:17:02.266899 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 403095586c704ecaa2a9931295bd1330
I20260617 20:17:02.268286 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 403095586c704ecaa2a9931295bd1330 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.270027 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 403095586c704ecaa2a9931295bd1330 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:02.270514 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet 403095586c704ecaa2a9931295bd1330 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.271131 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_50b5db1ff0ab437f8ae21d80d7b14f64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:02.271922 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50b5db1ff0ab437f8ae21d80d7b14f64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.274268 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_efec5fea83174407a7f646486d5f4269"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:02.274394 28988 raft_consensus.cc:2468] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:17:02.274739 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efec5fea83174407a7f646486d5f4269 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.275863 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6c5c337c61df411ba27ebb1e7a4e8ec9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:02.276263 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c5c337c61df411ba27ebb1e7a4e8ec9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.278088 30542 raft_consensus.cc:515] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.278777 30542 leader_election.cc:290] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.280617 29197 leader_election.cc:304] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:17:02.280982 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2dc25c0259c2414f86594418d7e92e18 consensus state has no leader
I20260617 20:17:02.281416 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2a25294e78fe41a7ae7affa51831441f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:02.281888 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a25294e78fe41a7ae7affa51831441f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.285238 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc8b1dc268b455ea263b67077e0bf6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.289114 30423 raft_consensus.cc:2804] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:02.289235 30423 raft_consensus.cc:697] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:02.289476 30423 consensus_queue.cc:237] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.291335 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5faea831376646c1bdfcaf8fbbc7ca6d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:02.291507 28988 raft_consensus.cc:3060] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.288645 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5faea831376646c1bdfcaf8fbbc7ca6d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:02.292363 29198 leader_election.cc:343] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.295323 30202 consensus_queue.cc:1048] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.295559 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d62885cedcc4821ac430f1d6df3bded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.298815 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 649) took 4513 ms. Trace:
I20260617 20:17:02.298909 29375 rpcz_store.cc:276] 0617 20:16:57.785129 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.785176 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:01.890564 (+4105388us) ts_tablet_manager.cc:1151] Deleting tablet d2c0988a73d547d08d0924784bff9222
0617 20:17:01.890572 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.081642 (+191070us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.193571 (+111929us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.298793 (+105222us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4105221}
I20260617 20:17:02.299288 29375 tablet_replica.cc:333] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:02.299479 29375 raft_consensus.cc:2243] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:02.299613 29375 raft_consensus.cc:2272] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:02.300173 29375 ts_tablet_manager.cc:1916] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.306488 30570 raft_consensus.cc:493] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.306636 30570 raft_consensus.cc:515] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.307310 30570 leader_election.cc:290] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:02.308019 29063 leader_election.cc:343] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: b3278efaad07403ca0a2baecad46d0f1
I20260617 20:17:02.308202 30570 raft_consensus.cc:493] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:17:02.308174 29062 leader_election.cc:343] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b3278efaad07403ca0a2baecad46d0f1
I20260617 20:17:02.308303 30570 raft_consensus.cc:515] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:02.308303 29062 leader_election.cc:304] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.308670 30294 raft_consensus.cc:2749] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.308877 30570 leader_election.cc:290] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.309103 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b06f05d9b4273a61bcb2d6e0ad796" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:02.309209 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet d2c0988a73d547d08d0924784bff9222 (table default.Table_ae4ab5348d244f92a3ecd4fac3ca86b2 [id=06b76ab80c3b453986d047f7f1f832ac]) successfully deleted
I20260617 20:17:02.309384 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b06f05d9b4273a61bcb2d6e0ad796" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.309592 28983 raft_consensus.cc:2393] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:02.310159 29062 leader_election.cc:304] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.310621 30570 raft_consensus.cc:3060] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:02.313899 28925 consensus_peers.cc:597] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:02.320902 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 715) took 2765 ms. Trace:
I20260617 20:17:02.320998 29377 rpcz_store.cc:276] 0617 20:16:59.555614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.562725 (+ 7111us) service_pool.cc:224] Handling call
0617 20:17:02.055081 (+2492356us) ts_tablet_manager.cc:1151] Deleting tablet f8e0c5d20a4548cc8124302aa38bcb21
0617 20:17:02.055091 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.086620 (+ 31529us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.210976 (+124356us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.320878 (+109902us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408,"tablet-delete.queue_time_us":2492199}
I20260617 20:17:02.321699 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet f8e0c5d20a4548cc8124302aa38bcb21 (table default.Table_56731cc7022548f8a230b1f50b31109f [id=8b180a732c2a49c8a6dfd4218af43abf]) successfully deleted
I20260617 20:17:02.322573 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 719) took 2759 ms. Trace:
I20260617 20:17:02.322654 29377 rpcz_store.cc:276] 0617 20:16:59.562811 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.562859 (+ 48us) service_pool.cc:224] Handling call
0617 20:17:02.321318 (+2758459us) ts_tablet_manager.cc:1151] Deleting tablet 88ab6fe7319940fcabd315193c51e199
0617 20:17:02.322441 (+ 1123us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.322554 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2758285}
I20260617 20:17:02.322945 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 722) took 2754 ms. Trace:
I20260617 20:17:02.323004 29377 rpcz_store.cc:276] 0617 20:16:59.568459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.568500 (+ 41us) service_pool.cc:224] Handling call
0617 20:17:02.322856 (+2754356us) ts_tablet_manager.cc:1151] Deleting tablet 5f6435bac04e472c99e81b6e7e9a6012
0617 20:17:02.322864 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.322932 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2754198}
W20260617 20:17:02.323594 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 88ab6fe7319940fcabd315193c51e199 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88ab6fe7319940fcabd315193c51e199 already in progress: creating tablet
W20260617 20:17:02.323824 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5f6435bac04e472c99e81b6e7e9a6012 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f6435bac04e472c99e81b6e7e9a6012 already in progress: creating tablet
I20260617 20:17:02.325057 29377 tablet_replica.cc:333] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:02.325264 29377 raft_consensus.cc:2243] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:02.325449 29377 raft_consensus.cc:2272] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:02.325968 29377 ts_tablet_manager.cc:1916] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.325902 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 841664f40c02423095bb9e63b85006a6 (DEFAULT_TABLE table=default.Table_d4a84bed29104bb3a86225b6af000f69 [id=db0df08944d046dda77d502cfc65d5ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.332206 29233 tablet_service.cc:1511] Processing CreateTablet for tablet df7fdc0a9d1f4f7b9ca823cc72ae8d65 (DEFAULT_TABLE table=default.Table_883b608d1f174bd19a9e3d10a4c6ee3f [id=2727bf760ca44d7487975216690b2739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.332235 29096 tablet_service.cc:1511] Processing CreateTablet for tablet df7fdc0a9d1f4f7b9ca823cc72ae8d65 (DEFAULT_TABLE table=default.Table_883b608d1f174bd19a9e3d10a4c6ee3f [id=2727bf760ca44d7487975216690b2739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.332482 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 841664f40c02423095bb9e63b85006a6 (DEFAULT_TABLE table=default.Table_d4a84bed29104bb3a86225b6af000f69 [id=db0df08944d046dda77d502cfc65d5ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.330296 29378 tablet_bootstrap.cc:492] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:02.333685 28960 tablet_service.cc:1511] Processing CreateTablet for tablet df7fdc0a9d1f4f7b9ca823cc72ae8d65 (DEFAULT_TABLE table=default.Table_883b608d1f174bd19a9e3d10a4c6ee3f [id=2727bf760ca44d7487975216690b2739]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.334519 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 05e5918dcafc4accb0345a8389b65412 (DEFAULT_TABLE table=default.Table_81c229ec2c314f8c8f4fa879c0470861 [id=23716dc501554aaf8a4789901480247c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.334533 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 05e5918dcafc4accb0345a8389b65412 (DEFAULT_TABLE table=default.Table_81c229ec2c314f8c8f4fa879c0470861 [id=23716dc501554aaf8a4789901480247c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.335282 28966 tablet_service.cc:1511] Processing CreateTablet for tablet 108c9a1f329d48ad9f2a92c0a9ef07e2 (DEFAULT_TABLE table=default.Table_64b68bdc9cc04e1eb9ccc1ce83bf1035 [id=8c3f534be9cd4c8dacc5628028f0469e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.335302 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 05e5918dcafc4accb0345a8389b65412 (DEFAULT_TABLE table=default.Table_81c229ec2c314f8c8f4fa879c0470861 [id=23716dc501554aaf8a4789901480247c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.335592 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 108c9a1f329d48ad9f2a92c0a9ef07e2 (DEFAULT_TABLE table=default.Table_64b68bdc9cc04e1eb9ccc1ce83bf1035 [id=8c3f534be9cd4c8dacc5628028f0469e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.336231 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 88f20eb0a7284d318970d001fa9e83dd (DEFAULT_TABLE table=default.Table_287b99d05553492ea2ef943ec6e829b7 [id=e32642a0d72a44b1817195574c4ad00f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.336439 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 108c9a1f329d48ad9f2a92c0a9ef07e2 (DEFAULT_TABLE table=default.Table_64b68bdc9cc04e1eb9ccc1ce83bf1035 [id=8c3f534be9cd4c8dacc5628028f0469e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.336540 29378 ts_tablet_manager.cc:1403] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.101s user 0.008s sys 0.011s
I20260617 20:17:02.337363 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 88f20eb0a7284d318970d001fa9e83dd (DEFAULT_TABLE table=default.Table_287b99d05553492ea2ef943ec6e829b7 [id=e32642a0d72a44b1817195574c4ad00f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.337713 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 88f20eb0a7284d318970d001fa9e83dd (DEFAULT_TABLE table=default.Table_287b99d05553492ea2ef943ec6e829b7 [id=e32642a0d72a44b1817195574c4ad00f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.341518 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 371b85d5e6974d45b5ca122d9bf96201 (DEFAULT_TABLE table=default.Table_102ea82c80b64c00b6f6a79a87b687f7 [id=74c63621fa8d4b8894442b7897d714a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.342228 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 371b85d5e6974d45b5ca122d9bf96201 (DEFAULT_TABLE table=default.Table_102ea82c80b64c00b6f6a79a87b687f7 [id=74c63621fa8d4b8894442b7897d714a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.342350 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 371b85d5e6974d45b5ca122d9bf96201 (DEFAULT_TABLE table=default.Table_102ea82c80b64c00b6f6a79a87b687f7 [id=74c63621fa8d4b8894442b7897d714a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.342803 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 98871c8e8d6240e2bf8bd305bc986b81 (DEFAULT_TABLE table=default.Table_b9517f8356cc47a1b60d232b6cca9dc2 [id=3d58d8b3e80d42bc9ac7f1481831b490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.343026 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 98871c8e8d6240e2bf8bd305bc986b81 (DEFAULT_TABLE table=default.Table_b9517f8356cc47a1b60d232b6cca9dc2 [id=3d58d8b3e80d42bc9ac7f1481831b490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.343364 29107 tablet_service.cc:1511] Processing CreateTablet for tablet c83fa97268f045d6aa60413dfa96ebbd (DEFAULT_TABLE table=default.Table_d4ddf99bf0e44da4bd61741ec0ac2065 [id=cfcf57f5da064087ba790a7f348b4778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.343549 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 98871c8e8d6240e2bf8bd305bc986b81 (DEFAULT_TABLE table=default.Table_b9517f8356cc47a1b60d232b6cca9dc2 [id=3d58d8b3e80d42bc9ac7f1481831b490]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.344218 29230 tablet_service.cc:1511] Processing CreateTablet for tablet c83fa97268f045d6aa60413dfa96ebbd (DEFAULT_TABLE table=default.Table_d4ddf99bf0e44da4bd61741ec0ac2065 [id=cfcf57f5da064087ba790a7f348b4778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.344439 28967 tablet_service.cc:1511] Processing CreateTablet for tablet c83fa97268f045d6aa60413dfa96ebbd (DEFAULT_TABLE table=default.Table_d4ddf99bf0e44da4bd61741ec0ac2065 [id=cfcf57f5da064087ba790a7f348b4778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.351677 30423 consensus_queue.cc:1048] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.350956 29378 raft_consensus.cc:359] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.369467 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 8f058c309b87431d9517338c7484bbbd (DEFAULT_TABLE table=default.Table_f8f0f1f6368e4ae786c176f3dbc29a8a [id=729c8eb13beb4d0e98838d86ab258ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.370105 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 1d75020e2d2e427082beb79691e86de7 (DEFAULT_TABLE table=default.Table_8556e2b7c18a49e09b7a01b9683d4f58 [id=dd9bbf5c95fe461faf077a1efd67e0d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.370590 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6d25d728654de68061884976356d42 (DEFAULT_TABLE table=default.Table_041e671cc057444e808fc948556269c2 [id=c275e777ecd64ecebf32e9cd34239a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.371130 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 1d75020e2d2e427082beb79691e86de7 (DEFAULT_TABLE table=default.Table_8556e2b7c18a49e09b7a01b9683d4f58 [id=dd9bbf5c95fe461faf077a1efd67e0d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.371454 30423 consensus_queue.cc:1048] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.371793 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6d25d728654de68061884976356d42 (DEFAULT_TABLE table=default.Table_041e671cc057444e808fc948556269c2 [id=c275e777ecd64ecebf32e9cd34239a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.373242 30570 raft_consensus.cc:2749] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.373443 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e5918dcafc4accb0345a8389b65412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.373945 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108c9a1f329d48ad9f2a92c0a9ef07e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.374347 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f20eb0a7284d318970d001fa9e83dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.374760 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 371b85d5e6974d45b5ca122d9bf96201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.375186 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83fa97268f045d6aa60413dfa96ebbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.376780 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98871c8e8d6240e2bf8bd305bc986b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.377059 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7fdc0a9d1f4f7b9ca823cc72ae8d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.377758 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 659979f3f2684c82ae2ef15f9e3bec8d (DEFAULT_TABLE table=default.Table_47b418c88d02450e9238113d4fc932de [id=2b7e7c876e3c42eda2033e3d88820007]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.378122 30555 raft_consensus.cc:515] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:02.378882 30555 leader_election.cc:290] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.379220 29376 ts_tablet_manager.cc:1929] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:02.379309 29376 log.cc:1199] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/0bbef4cc28ef46288cfc7d1933c71710
I20260617 20:17:02.379550 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f20eb0a7284d318970d001fa9e83dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.379650 29376 ts_tablet_manager.cc:1950] T 0bbef4cc28ef46288cfc7d1933c71710 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:02.380003 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 371b85d5e6974d45b5ca122d9bf96201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.380167 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98871c8e8d6240e2bf8bd305bc986b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.380534 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83fa97268f045d6aa60413dfa96ebbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.380975 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73bdcc1cefd48f3b99e0c059c3a7467" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:02.381508 29198 leader_election.cc:343] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.381912 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841664f40c02423095bb9e63b85006a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.382002 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d75020e2d2e427082beb79691e86de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.382320 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7fdc0a9d1f4f7b9ca823cc72ae8d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.382509 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6d25d728654de68061884976356d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.382629 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6d25d728654de68061884976356d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.382668 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108c9a1f329d48ad9f2a92c0a9ef07e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.383016 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e5918dcafc4accb0345a8389b65412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.385435 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f058c309b87431d9517338c7484bbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.385820 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d75020e2d2e427082beb79691e86de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.387120 29383 tablet_bootstrap.cc:492] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:02.387917 29383 ts_tablet_manager.cc:1403] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.188s user 0.004s sys 0.010s
I20260617 20:17:02.371130 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 8f058c309b87431d9517338c7484bbbd (DEFAULT_TABLE table=default.Table_f8f0f1f6368e4ae786c176f3dbc29a8a [id=729c8eb13beb4d0e98838d86ab258ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.395555 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659979f3f2684c82ae2ef15f9e3bec8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.400859 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f058c309b87431d9517338c7484bbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.401047 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 659979f3f2684c82ae2ef15f9e3bec8d (DEFAULT_TABLE table=default.Table_47b418c88d02450e9238113d4fc932de [id=2b7e7c876e3c42eda2033e3d88820007]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.401422 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659979f3f2684c82ae2ef15f9e3bec8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.396986 29383 raft_consensus.cc:359] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.402134 29383 raft_consensus.cc:385] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.402891 29383 raft_consensus.cc:740] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.404898 29383 consensus_queue.cc:260] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.409407 29383 ts_tablet_manager.cc:1434] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
I20260617 20:17:02.411525 29383 tablet_bootstrap.cc:492] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:02.415649 29175 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:02.435444 29383 tablet_bootstrap.cc:654] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.437834 29104 tablet_service.cc:1511] Processing CreateTablet for tablet fc0081e8742248a0ba088006a905ce85 (DEFAULT_TABLE table=default.Table_8c61ed13b3864bfe8dc750eb3d6accd8 [id=80b783d8ec91433c904e27e8f78b6bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.352648 29378 raft_consensus.cc:385] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.450277 29378 raft_consensus.cc:740] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.369180 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6d25d728654de68061884976356d42 (DEFAULT_TABLE table=default.Table_041e671cc057444e808fc948556269c2 [id=c275e777ecd64ecebf32e9cd34239a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.373651 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841664f40c02423095bb9e63b85006a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.373095 28988 raft_consensus.cc:2468] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:02.450817 30555 raft_consensus.cc:493] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.450951 30555 raft_consensus.cc:515] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.368427 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 1d75020e2d2e427082beb79691e86de7 (DEFAULT_TABLE table=default.Table_8556e2b7c18a49e09b7a01b9683d4f58 [id=dd9bbf5c95fe461faf077a1efd67e0d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.451391 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d75020e2d2e427082beb79691e86de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.451586 30555 leader_election.cc:290] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.378017 29377 ts_tablet_manager.cc:1929] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:02.453439 29377 log.cc:1199] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/7f239f81c40743b2aaa70a361997db77
I20260617 20:17:02.453714 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6d25d728654de68061884976356d42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.453676 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18440a4a5c254a25b87f8632de9c92b9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:02.379345 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c73bdcc1cefd48f3b99e0c059c3a7467" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:02.453926 28990 raft_consensus.cc:3060] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.454205 29378 consensus_queue.cc:260] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.454438 29379 tablet_bootstrap.cc:492] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:02.454566 29379 ts_tablet_manager.cc:1403] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.238s user 0.012s sys 0.001s
I20260617 20:17:02.454769 29378 ts_tablet_manager.cc:1434] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.117s user 0.003s sys 0.000s
I20260617 20:17:02.455040 29378 tablet_bootstrap.cc:492] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:02.456427 29378 tablet_bootstrap.cc:654] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.428174 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 659979f3f2684c82ae2ef15f9e3bec8d (DEFAULT_TABLE table=default.Table_47b418c88d02450e9238113d4fc932de [id=2b7e7c876e3c42eda2033e3d88820007]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.456897 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659979f3f2684c82ae2ef15f9e3bec8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.367498 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 8f058c309b87431d9517338c7484bbbd (DEFAULT_TABLE table=default.Table_f8f0f1f6368e4ae786c176f3dbc29a8a [id=729c8eb13beb4d0e98838d86ab258ac9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.457485 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f058c309b87431d9517338c7484bbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.459677 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108c9a1f329d48ad9f2a92c0a9ef07e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.460927 29379 raft_consensus.cc:359] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.461076 29379 raft_consensus.cc:385] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.461120 29379 raft_consensus.cc:740] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.461321 29379 consensus_queue.cc:260] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.463189 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e5918dcafc4accb0345a8389b65412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.463850 29197 leader_election.cc:304] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.464493 30423 raft_consensus.cc:2804] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:02.464612 30423 raft_consensus.cc:697] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:02.464802 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18440a4a5c254a25b87f8632de9c92b9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.464850 30423 consensus_queue.cc:237] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.464965 28988 raft_consensus.cc:2468] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:02.465883 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c83fa97268f045d6aa60413dfa96ebbd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:02.466737 29198 leader_election.cc:343] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.469044 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88f20eb0a7284d318970d001fa9e83dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.471958 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98871c8e8d6240e2bf8bd305bc986b81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.471954 29197 leader_election.cc:304] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.472448 30555 raft_consensus.cc:2804] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:02.472533 30555 raft_consensus.cc:493] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:02.472611 30555 raft_consensus.cc:3060] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.453734 29377 ts_tablet_manager.cc:1950] T 7f239f81c40743b2aaa70a361997db77 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:02.473742 29375 ts_tablet_manager.cc:1929] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:02.473798 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 371b85d5e6974d45b5ca122d9bf96201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.473989 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0081e8742248a0ba088006a905ce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.476770 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7fdc0a9d1f4f7b9ca823cc72ae8d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.478341 28990 raft_consensus.cc:2468] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:02.478382 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 683) took 4176 ms. Trace:
I20260617 20:17:02.478461 29376 rpcz_store.cc:276] 0617 20:16:58.301952 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.301995 (+ 43us) service_pool.cc:224] Handling call
0617 20:17:02.183052 (+3881057us) ts_tablet_manager.cc:1151] Deleting tablet 0bbef4cc28ef46288cfc7d1933c71710
0617 20:17:02.183066 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.279686 (+ 96620us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.379168 (+ 99482us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.478362 (+ 99194us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3880733}
I20260617 20:17:02.478892 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 686) took 3778 ms. Trace:
I20260617 20:17:02.478958 29197 leader_election.cc:304] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.479187 30542 raft_consensus.cc:2804] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:02.479305 30542 raft_consensus.cc:697] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:02.479566 30542 consensus_queue.cc:237] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:02.479197 30410 raft_consensus.cc:515] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.481281 30410 leader_election.cc:290] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.478968 29376 rpcz_store.cc:276] 0617 20:16:58.700349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.700394 (+ 45us) service_pool.cc:224] Handling call
0617 20:17:02.478746 (+3778352us) ts_tablet_manager.cc:1151] Deleting tablet 0eaa60028a1647e580a987c3a0836a24
0617 20:17:02.478756 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.478873 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3778164}
I20260617 20:17:02.482164 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 685) took 3781 ms. Trace:
I20260617 20:17:02.482232 29376 rpcz_store.cc:276] 0617 20:16:58.700238 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.701736 (+ 1498us) service_pool.cc:224] Handling call
0617 20:17:02.482043 (+3780307us) ts_tablet_manager.cc:1151] Deleting tablet 0916139a64df436fafa18c7e86fbf91c
0617 20:17:02.482052 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.482148 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3780131}
I20260617 20:17:02.482519 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 689) took 3766 ms. Trace:
I20260617 20:17:02.482582 29376 rpcz_store.cc:276] 0617 20:16:58.716302 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.716362 (+ 60us) service_pool.cc:224] Handling call
0617 20:17:02.482429 (+3766067us) ts_tablet_manager.cc:1151] Deleting tablet 65747872eaac450cb3b8efb3a2d2694f
0617 20:17:02.482438 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.482505 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3765855}
I20260617 20:17:02.482839 29376 tablet_replica.cc:333] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:02.483012 29376 raft_consensus.cc:2243] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:02.483165 29376 raft_consensus.cc:2272] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:02.484882 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 0bbef4cc28ef46288cfc7d1933c71710 (table default.Table_e01af13e5b514cca8b4cfc05a15a949d [id=9850785700a84b33a30caf29ab508aea]) successfully deleted
I20260617 20:17:02.487713 29376 ts_tablet_manager.cc:1916] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.491355 29227 tablet_service.cc:1511] Processing CreateTablet for tablet fc0081e8742248a0ba088006a905ce85 (DEFAULT_TABLE table=default.Table_8c61ed13b3864bfe8dc750eb3d6accd8 [id=80b783d8ec91433c904e27e8f78b6bd6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:02.491729 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c09634384b5747659c34d25a489f6279 consensus state has no leader
I20260617 20:17:02.491928 28665 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60552 (request call id 986) took 1071 ms. Trace:
I20260617 20:17:02.492761 28665 rpcz_store.cc:276] 0617 20:17:01.420104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.196707 (+776603us) service_pool.cc:224] Handling call
0617 20:17:02.197078 (+ 371us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:17:02.197268 (+ 190us) catalog_manager.cc:3750] Apply alter schema
0617 20:17:02.203804 (+ 6536us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 20:17:02.203893 (+ 89us) catalog_manager.cc:3940] Updating metadata on disk
0617 20:17:02.486344 (+282451us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 20:17:02.491893 (+ 5549us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.204610 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.204727 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.204733 (+ 6us) write_op.cc:435] Acquired schema lock
0617 20:17:02.204736 (+ 3us) tablet.cc:662] Decoding operations
0617 20:17:02.204855 (+ 119us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.204868 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.204872 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:02.204948 (+ 76us) tablet.cc:701] Row locks acquired
0617 20:17:02.204950 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:02.204985 (+ 35us) write_op.cc:270] Start()
0617 20:17:02.205019 (+ 34us) write_op.cc:276] Timestamp: P: 1781727422204932 usec, L: 0
0617 20:17:02.205023 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.205237 (+ 214us) log.cc:844] Serialized 405 byte log entry
0617 20:17:02.485354 (+280117us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.485667 (+ 313us) write_op.cc:301] APPLY: starting
0617 20:17:02.485689 (+ 22us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.485745 (+ 56us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.485777 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.485899 (+ 122us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.485946 (+ 47us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:02.485957 (+ 11us) write_op.cc:312] APPLY: finished
0617 20:17:02.486067 (+ 110us) log.cc:844] Serialized 23 byte log entry
0617 20:17:02.486151 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.486175 (+ 24us) write_op.cc:454] Released schema lock
0617 20:17:02.486184 (+ 9us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.486279 (+ 95us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.486285 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":232,"apply.run_cpu_time_us":600,"apply.run_wall_time_us":600,"num_ops":1,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":725,"prepare.run_wall_time_us":703,"replication_time_us":274795}]]}
W20260617 20:17:02.494103 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 0eaa60028a1647e580a987c3a0836a24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0eaa60028a1647e580a987c3a0836a24 already in progress: creating tablet
W20260617 20:17:02.494421 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 0916139a64df436fafa18c7e86fbf91c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0916139a64df436fafa18c7e86fbf91c already in progress: creating tablet
W20260617 20:17:02.496783 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 65747872eaac450cb3b8efb3a2d2694f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65747872eaac450cb3b8efb3a2d2694f already in progress: creating tablet
I20260617 20:17:02.502406 29239 tablet_service.cc:1511] Processing CreateTablet for tablet 1d23b3cac3e540a48f4f8e44bd81756e (DEFAULT_TABLE table=default.Table_7b904ff553254117afb61cd5048f33a2 [id=24dc3c39fc64419ab0f47fa8358ad585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.505390 28665 catalog_manager.cc:5696] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:02.505959 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d673bc9892c94725b270ef3b9dc768f4 (table default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330]). Expected version 1 got 0
I20260617 20:17:02.506417 30569 raft_consensus.cc:493] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.506568 30569 raft_consensus.cc:515] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.506430 28665 catalog_manager.cc:5696] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:02.507218 30569 leader_election.cc:290] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.507517 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
I20260617 20:17:02.508941 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet ba3ad8de250a47da9c9a31dff7f495b5 (table default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]). Expected version 2 got 0
I20260617 20:17:02.510995 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 1d23b3cac3e540a48f4f8e44bd81756e (DEFAULT_TABLE table=default.Table_7b904ff553254117afb61cd5048f33a2 [id=24dc3c39fc64419ab0f47fa8358ad585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.511415 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0cfb6ce2374c1a8ae22f5f6028fe6c (DEFAULT_TABLE table=default.Table_fc1d88f958a0469686a6eb2def4897dd [id=3fa51dbd276946a1acfb91f97348743b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.511965 29379 ts_tablet_manager.cc:1434] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.057s user 0.002s sys 0.000s
I20260617 20:17:02.511910 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 1d23b3cac3e540a48f4f8e44bd81756e (DEFAULT_TABLE table=default.Table_7b904ff553254117afb61cd5048f33a2 [id=24dc3c39fc64419ab0f47fa8358ad585]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.512130 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58213ec0a9364a91a15fc0329f28605b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:02.512296 28990 raft_consensus.cc:3060] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:02.515146 29198 consensus_peers.cc:597] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:02.515161 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450b08b439814915ab4371770f49f45b" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.515064 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58213ec0a9364a91a15fc0329f28605b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:02.515269 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 730) took 2932 ms. Trace:
I20260617 20:17:02.515348 29377 rpcz_store.cc:276] 0617 20:16:59.583128 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.583172 (+ 44us) service_pool.cc:224] Handling call
0617 20:17:02.323209 (+2740037us) ts_tablet_manager.cc:1151] Deleting tablet 7f239f81c40743b2aaa70a361997db77
0617 20:17:02.325013 (+ 1804us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.373217 (+ 48204us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.377796 (+ 4579us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.515252 (+137456us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2739902}
I20260617 20:17:02.515719 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 734) took 2930 ms. Trace:
I20260617 20:17:02.516040 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 7f239f81c40743b2aaa70a361997db77 (table default.Table_2880530e29494f939769447dfb05fd16 [id=0ea926c7d87a4670902ad04acbe1cfef]) successfully deleted
I20260617 20:17:02.516767 28665 catalog_manager.cc:5696] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:02.517403 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d23b3cac3e540a48f4f8e44bd81756e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.517500 28952 tablet_service.cc:1511] Processing CreateTablet for tablet fc0081e8742248a0ba088006a905ce85 (DEFAULT_TABLE table=default.Table_8c61ed13b3864bfe8dc750eb3d6accd8 [id=80b783d8ec91433c904e27e8f78b6bd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.517820 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0081e8742248a0ba088006a905ce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.515795 29377 rpcz_store.cc:276] 0617 20:16:59.584900 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.584944 (+ 44us) service_pool.cc:224] Handling call
0617 20:17:02.515618 (+2930674us) ts_tablet_manager.cc:1151] Deleting tablet 5806949c371b41b0a162a4c8cbf6b435
0617 20:17:02.515627 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.515706 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2930529}
I20260617 20:17:02.518707 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 738) took 2880 ms. Trace:
I20260617 20:17:02.518771 29377 rpcz_store.cc:276] 0617 20:16:59.638493 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.638553 (+ 60us) service_pool.cc:224] Handling call
0617 20:17:02.518606 (+2880053us) ts_tablet_manager.cc:1151] Deleting tablet 663dbe73689d4849a85b68a79ea4062c
0617 20:17:02.518615 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.518692 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2879852}
I20260617 20:17:02.518982 29377 tablet_replica.cc:333] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:02.519135 29377 raft_consensus.cc:2243] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:02.519395 29377 raft_consensus.cc:2272] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:02.520473 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0cfb6ce2374c1a8ae22f5f6028fe6c (DEFAULT_TABLE table=default.Table_fc1d88f958a0469686a6eb2def4897dd [id=3fa51dbd276946a1acfb91f97348743b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.521140 29377 ts_tablet_manager.cc:1916] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.522061 29375 log.cc:1199] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/16d0360ec78844a1be3d5f51259bbcdf
I20260617 20:17:02.522405 29375 ts_tablet_manager.cc:1950] T 16d0360ec78844a1be3d5f51259bbcdf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:02.524199 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450b08b439814915ab4371770f49f45b" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:02.526047 29198 leader_election.cc:343] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.526940 29063 leader_election.cc:304] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.527309 30569 raft_consensus.cc:2749] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.529482 29379 tablet_bootstrap.cc:492] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:02.530288 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d23b3cac3e540a48f4f8e44bd81756e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.530468 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 655) took 4713 ms. Trace:
I20260617 20:17:02.530563 29375 rpcz_store.cc:276] 0617 20:16:57.816729 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.817415 (+ 686us) service_pool.cc:224] Handling call
0617 20:17:02.299240 (+4481825us) ts_tablet_manager.cc:1151] Deleting tablet 16d0360ec78844a1be3d5f51259bbcdf
0617 20:17:02.299251 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.373112 (+ 73861us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.473672 (+100560us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.530452 (+ 56780us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4481581}
I20260617 20:17:02.530885 29375 tablet_replica.cc:333] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:02.531077 29375 raft_consensus.cc:2243] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:02.531387 29375 pending_rounds.cc:70] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:17:02.531438 29375 pending_rounds.cc:77] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955506984411136 op_type: NO_OP noop_request { }
I20260617 20:17:02.531524 29375 raft_consensus.cc:2889] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:02.531598 29375 raft_consensus.cc:2272] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:02.532132 29375 ts_tablet_manager.cc:1916] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.533423 30314 raft_consensus.cc:493] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.533591 30314 raft_consensus.cc:515] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.534366 30314 leader_election.cc:290] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.535065 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0cfb6ce2374c1a8ae22f5f6028fe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.537853 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3032155e4e4ea8a23984f547d78752" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:02.538691 28925 leader_election.cc:343] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.539301 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3032155e4e4ea8a23984f547d78752" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:02.540143 28925 leader_election.cc:343] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.540268 28925 leader_election.cc:304] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.540802 30314 raft_consensus.cc:2749] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:02.520006 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5806949c371b41b0a162a4c8cbf6b435 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5806949c371b41b0a162a4c8cbf6b435 already in progress: creating tablet
I20260617 20:17:02.531845 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 16d0360ec78844a1be3d5f51259bbcdf (table default.Table_160815abfba040f29bfce92cd08c5e46 [id=a27723f7b3f545288e30fe60ff87669b]) successfully deleted
W20260617 20:17:02.557111 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 663dbe73689d4849a85b68a79ea4062c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 663dbe73689d4849a85b68a79ea4062c already in progress: creating tablet
I20260617 20:17:02.558936 29379 tablet_bootstrap.cc:654] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.558359 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:02.560503 28990 raft_consensus.cc:2468] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:02.560822 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc0081e8742248a0ba088006a905ce85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.561020 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0cfb6ce2374c1a8ae22f5f6028fe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.561394 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d23b3cac3e540a48f4f8e44bd81756e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.563165 30555 raft_consensus.cc:515] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.563786 30555 leader_election.cc:290] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.564502 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18440a4a5c254a25b87f8632de9c92b9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:02.564654 29125 raft_consensus.cc:3060] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.569378 30555 consensus_queue.cc:1048] T 090b8720e5df447aa0da147bd8dfaa8c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.577093 29383 tablet_bootstrap.cc:492] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:02.577229 29383 ts_tablet_manager.cc:1403] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.166s user 0.009s sys 0.000s
I20260617 20:17:02.577982 29383 raft_consensus.cc:359] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.578145 29383 raft_consensus.cc:385] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.578198 29383 raft_consensus.cc:740] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.578387 29383 consensus_queue.cc:260] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.578816 29383 ts_tablet_manager.cc:1434] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260617 20:17:02.580128 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 1e27a027e29845728fd09c9e6362efc0 (DEFAULT_TABLE table=default.Table_e3dc5d6e636a48dcb8ea35c12167a65c [id=687ab84417184ad2a95410c6c1ffc4a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.582357 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 06680ddfee82464da4926e51dadd00a5 (DEFAULT_TABLE table=default.Table_1d22b434bff34f6da7ebe3e45e5bbee2 [id=b6da105747214407ae21d24b164d4522]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.582360 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 30882d71f69648058ed2a12b101a5d6b (DEFAULT_TABLE table=default.Table_8767b23f3baa41c883f4884d81573ee8 [id=87863576402f427c91cd119026c041f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.583436 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 30882d71f69648058ed2a12b101a5d6b (DEFAULT_TABLE table=default.Table_8767b23f3baa41c883f4884d81573ee8 [id=87863576402f427c91cd119026c041f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.588325 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18440a4a5c254a25b87f8632de9c92b9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:02.588493 28990 raft_consensus.cc:3060] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.589783 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 1e27a027e29845728fd09c9e6362efc0 (DEFAULT_TABLE table=default.Table_e3dc5d6e636a48dcb8ea35c12167a65c [id=687ab84417184ad2a95410c6c1ffc4a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.591192 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_41df43a4da14469eabad96a692395510 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 3 got 0
I20260617 20:17:02.591950 29197 leader_election.cc:304] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.592417 30423 raft_consensus.cc:2804] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:02.592456 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet c3014c93d6804f3896f452f041cbedc9 (table default.Table_01fded33682b4e3f91e9f6e6e92031f6 [id=0a278273a6004aa7947a19674e45d123]). Expected version 3 got 0
I20260617 20:17:02.592540 30423 raft_consensus.cc:697] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:02.592753 30423 consensus_queue.cc:237] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.592825 28665 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]). Expected version 1 got 0
I20260617 20:17:02.600428 29121 raft_consensus.cc:3060] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.603950 30569 consensus_queue.cc:1048] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.606491 29125 raft_consensus.cc:2468] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:02.607400 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 1e27a027e29845728fd09c9e6362efc0 (DEFAULT_TABLE table=default.Table_e3dc5d6e636a48dcb8ea35c12167a65c [id=687ab84417184ad2a95410c6c1ffc4a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.607035 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 30882d71f69648058ed2a12b101a5d6b (DEFAULT_TABLE table=default.Table_8767b23f3baa41c883f4884d81573ee8 [id=87863576402f427c91cd119026c041f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.611503 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30882d71f69648058ed2a12b101a5d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.612715 30480 consensus_queue.cc:1048] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.613227 30480 consensus_queue.cc:1048] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.616103 29383 tablet_bootstrap.cc:492] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:02.617476 29379 tablet_bootstrap.cc:492] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:02.617601 29379 ts_tablet_manager.cc:1403] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.088s user 0.005s sys 0.007s
I20260617 20:17:02.618357 29379 raft_consensus.cc:359] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.618507 29379 raft_consensus.cc:385] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.618559 29379 raft_consensus.cc:740] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.618748 29379 consensus_queue.cc:260] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.619191 29379 ts_tablet_manager.cc:1434] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:17:02.619477 29379 tablet_bootstrap.cc:492] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:02.620965 29198 leader_election.cc:304] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:02.621605 30542 raft_consensus.cc:2804] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:02.621732 30542 raft_consensus.cc:697] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:02.621951 30542 consensus_queue.cc:237] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:02.622103 29062 consensus_peers.cc:597] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2db0467c5e64e38961d3b0e66375544. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:02.607705 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0cfb6ce2374c1a8ae22f5f6028fe6c (DEFAULT_TABLE table=default.Table_fc1d88f958a0469686a6eb2def4897dd [id=3fa51dbd276946a1acfb91f97348743b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.620435 28661 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 987) took 1153 ms. Trace:
I20260617 20:17:02.628700 28661 rpcz_store.cc:276] 0617 20:17:01.466544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.265975 (+799431us) service_pool.cc:224] Handling call
0617 20:17:02.271042 (+ 5067us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.272048 (+ 1006us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:02.272582 (+ 534us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:02.620151 (+347569us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:02.620264 (+ 113us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:02.620379 (+ 115us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.277671 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.277758 (+ 87us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.277763 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:02.277766 (+ 3us) tablet.cc:662] Decoding operations
0617 20:17:02.277854 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.277864 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.277869 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:02.277950 (+ 81us) tablet.cc:701] Row locks acquired
0617 20:17:02.277954 (+ 4us) write_op.cc:260] PREPARE: finished
0617 20:17:02.277987 (+ 33us) write_op.cc:270] Start()
0617 20:17:02.278030 (+ 43us) write_op.cc:276] Timestamp: P: 1781727422277963 usec, L: 0
0617 20:17:02.278035 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.278184 (+ 149us) log.cc:844] Serialized 433 byte log entry
0617 20:17:02.618580 (+340396us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.619732 (+ 1152us) write_op.cc:301] APPLY: starting
0617 20:17:02.619741 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.619768 (+ 27us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.619786 (+ 18us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.619891 (+ 105us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.619916 (+ 25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:02.619923 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:02.619974 (+ 51us) log.cc:844] Serialized 29 byte log entry
0617 20:17:02.620030 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.620060 (+ 30us) write_op.cc:454] Released schema lock
0617 20:17:02.620066 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.620125 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.620128 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":10906880,"child_traces":[["op",{"apply.queue_time_us":1121,"apply.run_cpu_time_us":385,"apply.run_wall_time_us":385,"num_ops":2,"prepare.queue_time_us":4506,"prepare.run_cpu_time_us":586,"prepare.run_wall_time_us":854,"replication_time_us":340525}]]}
I20260617 20:17:02.620766 28662 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 989) took 1139 ms. Trace:
I20260617 20:17:02.630049 28662 rpcz_store.cc:276] 0617 20:17:01.481204 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.267587 (+786383us) service_pool.cc:224] Handling call
0617 20:17:02.274185 (+ 6598us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.274823 (+ 638us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:02.275194 (+ 371us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:02.620554 (+345360us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:02.620640 (+ 86us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:02.620710 (+ 70us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.278555 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.278637 (+ 82us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.278641 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:02.278643 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.278710 (+ 67us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.278717 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.278721 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:02.278780 (+ 59us) tablet.cc:701] Row locks acquired
0617 20:17:02.278782 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:02.278809 (+ 27us) write_op.cc:270] Start()
0617 20:17:02.278834 (+ 25us) write_op.cc:276] Timestamp: P: 1781727422278785 usec, L: 0
0617 20:17:02.278837 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.278978 (+ 141us) log.cc:844] Serialized 433 byte log entry
0617 20:17:02.618633 (+339655us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.620181 (+ 1548us) write_op.cc:301] APPLY: starting
0617 20:17:02.620190 (+ 9us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.620216 (+ 26us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.620245 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.620328 (+ 83us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.620353 (+ 25us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:02.620359 (+ 6us) write_op.cc:312] APPLY: finished
0617 20:17:02.620415 (+ 56us) log.cc:844] Serialized 29 byte log entry
0617 20:17:02.620468 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.620480 (+ 12us) write_op.cc:454] Released schema lock
0617 20:17:02.620485 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":14615936,"child_traces":[["op",{"apply.queue_time_us":1518,"apply.run_cpu_time_us":353,"apply.run_wall_time_us":353,"num_ops":2,"prepare.queue_time_us":2970,"prepare.run_cpu_time_us":484,"prepare.run_wall_time_us":711,"replication_time_us":339781,"threads_started":1}]]}
I20260617 20:17:02.630667 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30882d71f69648058ed2a12b101a5d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.631472 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e27a027e29845728fd09c9e6362efc0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:02.631554 28925 consensus_peers.cc:597] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:02.632488 30410 raft_consensus.cc:493] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.632618 30410 raft_consensus.cc:515] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.632850 29117 raft_consensus.cc:3060] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.633388 30410 leader_election.cc:290] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.634815 30569 raft_consensus.cc:493] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.634945 30569 raft_consensus.cc:515] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.635525 30569 leader_election.cc:290] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.638144 30556 consensus_queue.cc:1048] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.641592 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e27a027e29845728fd09c9e6362efc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.641805 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0cfb6ce2374c1a8ae22f5f6028fe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.641853 28984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b427ba6320be4f2a929eaf18a56b4309" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.642167 28984 raft_consensus.cc:2468] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:02.643994 29376 ts_tablet_manager.cc:1929] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:02.644434 29376 log.cc:1199] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/9f9844fab126448895c4c9d4c3c78d76
I20260617 20:17:02.645053 29376 ts_tablet_manager.cc:1950] T 9f9844fab126448895c4c9d4c3c78d76 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:02.647583 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e27a027e29845728fd09c9e6362efc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.647962 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b427ba6320be4f2a929eaf18a56b4309" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:02.648310 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06680ddfee82464da4926e51dadd00a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.649787 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30882d71f69648058ed2a12b101a5d6b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:02.649973 29062 leader_election.cc:343] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c21b585707b146ed9c015d150d858681
I20260617 20:17:02.641466 28990 raft_consensus.cc:2468] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:02.650311 29125 raft_consensus.cc:3060] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:02.651585 29198 leader_election.cc:343] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.653501 29383 tablet_bootstrap.cc:654] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.655469 28663 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_87c7eb0a5f3843a4ae45931a17a7b234 [id=cb568e8af2da4807b99a6d07c57afca9] alter complete (version 3)
I20260617 20:17:02.656386 29378 tablet_bootstrap.cc:492] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:02.656550 29378 ts_tablet_manager.cc:1403] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.202s user 0.008s sys 0.000s
I20260617 20:17:02.657123 28670 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_7e36e71e8aca4a5e8813c465c31db50a [id=de24e09cee8e4f28998625c2697769b3] alter complete (version 1)
W20260617 20:17:02.660578 28670 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.195:55493 (request call id 137) took 1744 ms (client timeout 1000 ms). Trace:
I20260617 20:17:02.661784 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 64d4b8a353854196871cb6fcd8916d4c (DEFAULT_TABLE table=default.Table_95eb640bc73740e7b1c9475c7f7bcbe4 [id=c1092a9a835f4dc79f36cae5bb02e374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.662309 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d4b8a353854196871cb6fcd8916d4c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:02.664479 28666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.194:51601 (request call id 137) took 923 ms (client timeout 1000 ms). Trace:
I20260617 20:17:02.664788 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet fc36f62aa0bf46278cb84ec8cb7eef55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:02.664830 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet b19bce310bd24294b063b3b4f76b9f99 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:17:02.664565 28666 rpcz_store.cc:269] 0617 20:17:01.741339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.839614 (+ 98275us) service_pool.cc:224] Handling call
0617 20:17:02.664424 (+824810us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.179162 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.179271 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.179277 (+ 6us) write_op.cc:435] Acquired schema lock
0617 20:17:02.179279 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.179383 (+ 104us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.179395 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.179399 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:02.179461 (+ 62us) tablet.cc:701] Row locks acquired
0617 20:17:02.179463 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:02.179496 (+ 33us) write_op.cc:270] Start()
0617 20:17:02.179559 (+ 63us) write_op.cc:276] Timestamp: P: 1781727422179445 usec, L: 0
0617 20:17:02.179563 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.179726 (+ 163us) log.cc:844] Serialized 356 byte log entry
0617 20:17:02.256188 (+ 76462us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.260857 (+ 4669us) write_op.cc:301] APPLY: starting
0617 20:17:02.260874 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.260914 (+ 40us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.260968 (+ 54us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.261022 (+ 54us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.261058 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:02.261071 (+ 13us) write_op.cc:312] APPLY: finished
0617 20:17:02.261176 (+ 105us) log.cc:844] Serialized 23 byte log entry
0617 20:17:02.261475 (+ 299us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.261494 (+ 19us) write_op.cc:454] Released schema lock
0617 20:17:02.261503 (+ 9us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":4607,"apply.run_cpu_time_us":511,"apply.run_wall_time_us":2254,"num_ops":1,"prepare.queue_time_us":96834,"prepare.run_cpu_time_us":621,"prepare.run_wall_time_us":620,"replication_time_us":76604}]]}
I20260617 20:17:02.664978 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet d2db0467c5e64e38961d3b0e66375544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:02.665061 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f7b878728a495f83b6584f8a6aca67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:02.665216 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e53946c85ab4a8286a6e174cc411c5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:02.666136 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a1c96212014333935ec7f7c92a306c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:17:02.666404 28668 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.194:51601 (request call id 136) took 1931 ms (client timeout 1000 ms). Trace:
W20260617 20:17:02.666534 28668 rpcz_store.cc:269] 0617 20:17:00.735120 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.858095 (+122975us) service_pool.cc:224] Handling call
0617 20:17:00.988947 (+130852us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bcaf08 00007fa11b629ca6 00007fa11b6299d5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.666343 (+1677396us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:01.125760 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:01.125841 (+ 81us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:01.125845 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:01.125847 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:01.136340 (+ 10493us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:01.136355 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:01.136363 (+ 8us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:01.136445 (+ 82us) tablet.cc:701] Row locks acquired
0617 20:17:01.136449 (+ 4us) write_op.cc:260] PREPARE: finished
0617 20:17:01.136508 (+ 59us) write_op.cc:270] Start()
0617 20:17:01.136547 (+ 39us) write_op.cc:276] Timestamp: P: 1781727421136459 usec, L: 0
0617 20:17:01.136552 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 20:17:01.145825 (+ 9273us) log.cc:844] Serialized 356 byte log entry
0617 20:17:01.146020 (+ 195us) spinlock_profiling.cc:243] Waited 9.02 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fa11ccaaf22 00007fa11e08c305 00007fa11e08ae29 00007fa11e093250 00007fa11e09305d 0000000000aa681c 00007fa110c759ff 00007fa110c78d1b 00007fa110c78b98 0000000000aa681c
0617 20:17:01.161198 (+ 15178us) op_driver.cc:464] REPLICATION: finished
0617 20:17:01.161282 (+ 84us) write_op.cc:301] APPLY: starting
0617 20:17:01.161317 (+ 35us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:01.161347 (+ 30us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:01.161350 (+ 3us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:01.161386 (+ 36us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:01.161410 (+ 24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:01.161416 (+ 6us) write_op.cc:312] APPLY: finished
0617 20:17:01.161469 (+ 53us) log.cc:844] Serialized 23 byte log entry
0617 20:17:01.161536 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:01.161547 (+ 11us) write_op.cc:454] Released schema lock
0617 20:17:01.161552 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":14,"spinlock_wait_cycles":298963200,"child_traces":[["op",{"apply.queue_time_us":37,"apply.run_cpu_time_us":326,"apply.run_wall_time_us":327,"num_ops":1,"prepare.queue_time_us":85038,"prepare.run_cpu_time_us":1233,"prepare.run_wall_time_us":20291,"replication_time_us":24620,"spinlock_wait_cycles":20751232}]]}
I20260617 20:17:02.667235 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet 45dd4bd12bc6465ba1ee4047a6b3a2ac from {username='slave'} at 127.0.0.1:60552
W20260617 20:17:02.667964 29197 consensus_peers.cc:597] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8e0c5d20a4548cc8124302aa38bcb21. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:02.668285 29197 leader_election.cc:304] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.668880 29089 tablet_service.cc:1511] Processing CreateTablet for tablet ac3aad616b92480d877b463e0de56b72 (DEFAULT_TABLE table=default.Table_1404d8949a194779a7fe937bc4857a4a [id=5c83a4e7711c4b928e15a365aa351fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.669348 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3aad616b92480d877b463e0de56b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.672737 30556 raft_consensus.cc:2804] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:02.672854 30556 raft_consensus.cc:493] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:02.672770 30423 raft_consensus.cc:493] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.673084 30423 raft_consensus.cc:515] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.672936 30556 raft_consensus.cc:3060] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.673946 30423 leader_election.cc:290] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:17:02.674889 28925 consensus_peers.cc:597] T b5241ab75a034ee3b57c07185835a858 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:02.675981 29375 ts_tablet_manager.cc:1929] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:02.676388 29375 log.cc:1199] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/46ea43994a0a42fe9e16d7bc6a2118e6
W20260617 20:17:02.676853 29198 leader_election.cc:343] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 13ba94ec9e27403b974e5e6fea46e59e
I20260617 20:17:02.678056 29375 ts_tablet_manager.cc:1950] T 46ea43994a0a42fe9e16d7bc6a2118e6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:02.680336 29383 tablet_bootstrap.cc:492] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:02.680474 29383 ts_tablet_manager.cc:1403] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.000s
W20260617 20:17:02.680260 29063 leader_election.cc:343] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: c21b585707b146ed9c015d150d858681
I20260617 20:17:02.682386 29063 leader_election.cc:304] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.682678 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 06680ddfee82464da4926e51dadd00a5 (DEFAULT_TABLE table=default.Table_1d22b434bff34f6da7ebe3e45e5bbee2 [id=b6da105747214407ae21d24b164d4522]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.683116 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06680ddfee82464da4926e51dadd00a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.683288 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 06680ddfee82464da4926e51dadd00a5 (DEFAULT_TABLE table=default.Table_1d22b434bff34f6da7ebe3e45e5bbee2 [id=b6da105747214407ae21d24b164d4522]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.683625 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06680ddfee82464da4926e51dadd00a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.684006 30569 raft_consensus.cc:2749] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.684960 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 0bbef4cc28ef46288cfc7d1933c71710 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.679440 29379 tablet_bootstrap.cc:654] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.686556 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d9677bc184c30be1a11bfa85a97c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.686594 30423 raft_consensus.cc:493] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.686848 30423 raft_consensus.cc:515] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.687844 30423 leader_election.cc:290] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.688253 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe with delete_type TABLET_DATA_DELETED (replaced by tablet 5a20867de1214c0fb4cb8504e8361c5b) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.688423 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet f02529cd1e764a3886de27d86e9690e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.681370 29383 raft_consensus.cc:359] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.688588 29383 raft_consensus.cc:385] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.688668 29383 raft_consensus.cc:740] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.688879 29383 consensus_queue.cc:260] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.688944 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59430dd630b4ca6b573ea4230212abf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:02.690088 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 692) took 3972 ms. Trace:
W20260617 20:17:02.660720 28670 rpcz_store.cc:269] 0617 20:17:00.916046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.952557 (+ 36511us) service_pool.cc:224] Handling call
0617 20:17:01.029017 (+ 76460us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bcaf08 00007fa11b629ca6 00007fa11b6299d5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.660529 (+1631512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.078058 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.078194 (+ 136us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.078201 (+ 7us) write_op.cc:435] Acquired schema lock
0617 20:17:02.078203 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.078303 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.078317 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.078322 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:02.078396 (+ 74us) tablet.cc:701] Row locks acquired
0617 20:17:02.078399 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:02.078436 (+ 37us) write_op.cc:270] Start()
0617 20:17:02.078472 (+ 36us) write_op.cc:276] Timestamp: P: 1781727422078392 usec, L: 0
0617 20:17:02.078475 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.178875 (+100400us) log.cc:844] Serialized 356 byte log entry
0617 20:17:02.179088 (+ 213us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fa11ccaaf22 00007fa11e08c305 00007fa11e08ae29 00007fa11e093250 00007fa11e09305d 0000000000aa681c 00007fa110c759ff 00007fa110c78d1b 00007fa110c78b98 0000000000aa681c
0617 20:17:02.256092 (+ 77004us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.256898 (+ 806us) write_op.cc:301] APPLY: starting
0617 20:17:02.256926 (+ 28us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.256991 (+ 65us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.256996 (+ 5us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.257087 (+ 91us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.257136 (+ 49us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:02.257148 (+ 12us) write_op.cc:312] APPLY: finished
0617 20:17:02.257356 (+ 208us) log.cc:844] Serialized 23 byte log entry
0617 20:17:02.257682 (+ 326us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.257709 (+ 27us) write_op.cc:454] Released schema lock
0617 20:17:02.257719 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.260753 (+ 3034us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.260761 (+ 8us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 20:17:02.259197 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.259323 (+ 126us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.259328 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:02.259331 (+ 3us) tablet.cc:662] Decoding operations
0617 20:17:02.259423 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.259433 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.259437 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:02.259501 (+ 64us) tablet.cc:701] Row locks acquired
0617 20:17:02.259503 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:02.259544 (+ 41us) write_op.cc:270] Start()
0617 20:17:02.259572 (+ 28us) write_op.cc:276] Timestamp: P: 1781727422259517 usec, L: 0
0617 20:17:02.259576 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.270767 (+ 11191us) log.cc:844] Serialized 356 byte log entry
0617 20:17:02.273382 (+ 2615us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fa11ccaaf22 00007fa11e08c305 00007fa11e08ae29 00007fa11e093250 00007fa11e09305d 0000000000aa681c 00007fa110c759ff 00007fa110c78d1b 00007fa110c78b98 0000000000aa681c
0617 20:17:02.618446 (+345064us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.618831 (+ 385us) write_op.cc:301] APPLY: starting
0617 20:17:02.618850 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.618894 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.618896 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.618951 (+ 55us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.618985 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:02.618991 (+ 6us) write_op.cc:312] APPLY: finished
0617 20:17:02.619073 (+ 82us) log.cc:844] Serialized 23 byte log entry
0617 20:17:02.619150 (+ 77us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.619173 (+ 23us) write_op.cc:454] Released schema lock
0617 20:17:02.619180 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.619258 (+ 78us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.619262 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":24,"spinlock_wait_cycles":158915968,"child_traces":[["op",{"apply.queue_time_us":595,"apply.run_cpu_time_us":706,"apply.run_wall_time_us":3958,"num_ops":1,"prepare.queue_time_us":79,"prepare.run_cpu_time_us":2476,"prepare.run_wall_time_us":101071,"replication_time_us":177572,"spinlock_wait_cycles":230328576}],["op",{"apply.queue_time_us":312,"apply.run_cpu_time_us":421,"apply.run_wall_time_us":420,"num_ops":1,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":1111,"prepare.run_wall_time_us":14224,"replication_time_us":358835,"spinlock_wait_cycles":25194752}]]}
I20260617 20:17:02.690220 29376 rpcz_store.cc:276] 0617 20:16:58.717274 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.717419 (+ 145us) service_pool.cc:224] Handling call
0617 20:17:02.482786 (+3765367us) ts_tablet_manager.cc:1151] Deleting tablet 9f9844fab126448895c4c9d4c3c78d76
0617 20:17:02.482795 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.560625 (+ 77830us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.643899 (+ 83274us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.690075 (+ 46176us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3765132}
I20260617 20:17:02.690639 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 693) took 3973 ms. Trace:
I20260617 20:17:02.690708 29376 rpcz_store.cc:276] 0617 20:16:58.717387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.717787 (+ 400us) service_pool.cc:224] Handling call
0617 20:17:02.690524 (+3972737us) ts_tablet_manager.cc:1151] Deleting tablet f5387e3c30b24cb285ea5cc657981321
0617 20:17:02.690532 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.690625 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3972588}
I20260617 20:17:02.690876 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 64d4b8a353854196871cb6fcd8916d4c (DEFAULT_TABLE table=default.Table_95eb640bc73740e7b1c9475c7f7bcbe4 [id=c1092a9a835f4dc79f36cae5bb02e374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.691038 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 687) took 3974 ms. Trace:
I20260617 20:17:02.691100 29376 rpcz_store.cc:276] 0617 20:16:58.716156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.724561 (+ 8405us) service_pool.cc:224] Handling call
0617 20:17:02.690938 (+3966377us) ts_tablet_manager.cc:1151] Deleting tablet 29a176d1f3b0446984af141e02bac329
0617 20:17:02.690948 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.691025 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3966203}
I20260617 20:17:02.691298 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d4b8a353854196871cb6fcd8916d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.691318 29376 tablet_replica.cc:333] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:02.691478 29376 raft_consensus.cc:2243] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:02.691577 29383 ts_tablet_manager.cc:1434] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
W20260617 20:17:02.691643 30597 log.cc:927] Time spent T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260617 20:17:02.691766 29376 raft_consensus.cc:2272] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:02.691854 29383 tablet_bootstrap.cc:492] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:02.692418 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 64d4b8a353854196871cb6fcd8916d4c (DEFAULT_TABLE table=default.Table_95eb640bc73740e7b1c9475c7f7bcbe4 [id=c1092a9a835f4dc79f36cae5bb02e374]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.692418 30556 raft_consensus.cc:515] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:02.693014 28655 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 5bf67f3f62714cd3bb9cce3f207cc3b8 (table default.Table_cf5a1e5db7c2470ab6ad65a7d57777d1 [id=13717f883a3449dd9014fff544ad7d7a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5bf67f3f62714cd3bb9cce3f207cc3b8 consensus state has no leader
I20260617 20:17:02.693024 30556 leader_election.cc:290] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.694500 28967 tablet_service.cc:1558] Processing DeleteTablet for tablet 488b06f05d9b4273a61bcb2d6e0ad796 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f3032155e4e4ea8a23984f547d78752) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.694661 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.694774 28966 tablet_service.cc:1558] Processing DeleteTablet for tablet 58213ec0a9364a91a15fc0329f28605b with delete_type TABLET_DATA_DELETED (replaced by tablet 43462cf7003747d08e6b0e5db5999b3f) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.694913 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet f4de5dafb1474de1911148bb3b4527cf with delete_type TABLET_DATA_DELETED (replaced by tablet e7eb77c619e04c448a084638668dbb6a) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.695153 28959 tablet_service.cc:1558] Processing DeleteTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab with delete_type TABLET_DATA_DELETED (replaced by tablet b4dbefbe5234458cb299410ddb2c73a3) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.695652 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d9677bc184c30be1a11bfa85a97c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.695801 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 5faea831376646c1bdfcaf8fbbc7ca6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.696924 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet b427ba6320be4f2a929eaf18a56b4309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.697342 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d4b8a353854196871cb6fcd8916d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.698096 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.698546 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet adbc3219639748d9a0d71d45ae22ab36 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b00d3c0adcf48a48ba3d7a3de018b80) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.699190 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8fa9f4c40b4ce9baa27a8837d3575c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.699645 28959 tablet_service.cc:1558] Processing DeleteTablet for tablet 0eaa60028a1647e580a987c3a0836a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.699677 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cafcade995b407f84f56b8cd3ab6892 with delete_type TABLET_DATA_DELETED (replaced by tablet fb2a0578122c421ab45bf56edb7cffdb) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.699641 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f239f81c40743b2aaa70a361997db77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.699831 29376 ts_tablet_manager.cc:1916] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.700390 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 203666e6127b49ed92731bc87ce01798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.701753 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet dee426100bb645f391be123aeb52e412 with delete_type TABLET_DATA_DELETED (replaced by tablet c3496887f6a045e293698d09d9cc1c16) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.702494 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet e59430dd630b4ca6b573ea4230212abf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.698441 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 656) took 4877 ms. Trace:
I20260617 20:17:02.702816 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet fed593a3fa7742a18ccc2124c3ee0fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.702754 29375 rpcz_store.cc:276] 0617 20:16:57.821093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.821146 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:02.530842 (+4709696us) ts_tablet_manager.cc:1151] Deleting tablet 46ea43994a0a42fe9e16d7bc6a2118e6
0617 20:17:02.530851 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.573496 (+ 42645us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.675934 (+102438us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.698424 (+ 22490us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4709496}
I20260617 20:17:02.703385 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 664) took 4783 ms. Trace:
I20260617 20:17:02.703510 29375 rpcz_store.cc:276] 0617 20:16:57.919995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.920047 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:02.703264 (+4783217us) ts_tablet_manager.cc:1151] Deleting tablet f24954093a45411a9cbe39415fb1adb7
0617 20:17:02.703274 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.703369 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4783031}
I20260617 20:17:02.704085 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 666) took 4776 ms. Trace:
I20260617 20:17:02.704218 29375 rpcz_store.cc:276] 0617 20:16:57.927246 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:57.927298 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:02.703988 (+4776690us) ts_tablet_manager.cc:1151] Deleting tablet 9370421288e2449fae454aec32883810
0617 20:17:02.703995 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.704069 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4776507}
I20260617 20:17:02.704856 29375 tablet_replica.cc:333] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:02.705340 29375 raft_consensus.cc:2243] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:02.705595 29375 raft_consensus.cc:2272] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:02.708516 29198 leader_election.cc:343] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.709033 30423 consensus_queue.cc:1048] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:02.709982 29375 ts_tablet_manager.cc:1916] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.710348 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet f24954093a45411a9cbe39415fb1adb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.711062 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b427ba6320be4f2a929eaf18a56b4309" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:02.715463 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b427ba6320be4f2a929eaf18a56b4309" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:02.715662 28990 raft_consensus.cc:3060] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.716181 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59430dd630b4ca6b573ea4230212abf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.716378 28985 raft_consensus.cc:2468] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:02.717833 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet fc36f62aa0bf46278cb84ec8cb7eef55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.719211 29378 raft_consensus.cc:359] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.726411 29233 tablet_service.cc:1511] Processing CreateTablet for tablet ac3aad616b92480d877b463e0de56b72 (DEFAULT_TABLE table=default.Table_1404d8949a194779a7fe937bc4857a4a [id=5c83a4e7711c4b928e15a365aa351fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.732689 29378 raft_consensus.cc:385] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.732909 29378 raft_consensus.cc:740] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.733433 29378 consensus_queue.cc:260] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.734272 29378 ts_tablet_manager.cc:1434] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.078s user 0.003s sys 0.000s
I20260617 20:17:02.734665 29378 tablet_bootstrap.cc:492] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:02.743417 29121 raft_consensus.cc:3060] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:02.743541 28669 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.193:34505 (request call id 112) took 865 ms (client timeout 1000 ms). Trace:
W20260617 20:17:02.743960 28669 rpcz_store.cc:269] 0617 20:17:01.824480 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.893504 (+ 69024us) service_pool.cc:224] Handling call
0617 20:17:02.689983 (+796479us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.239925 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.240041 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.240048 (+ 7us) write_op.cc:435] Acquired schema lock
0617 20:17:02.240050 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.240190 (+ 140us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.240202 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.240206 (+ 4us) tablet.cc:685] Acquiring locks for 3 operations
0617 20:17:02.240325 (+ 119us) tablet.cc:701] Row locks acquired
0617 20:17:02.240328 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:02.240369 (+ 41us) write_op.cc:270] Start()
0617 20:17:02.240406 (+ 37us) write_op.cc:276] Timestamp: P: 1781727422240312 usec, L: 0
0617 20:17:02.240410 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.240591 (+ 181us) log.cc:844] Serialized 1302 byte log entry
0617 20:17:02.485503 (+244912us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.486364 (+ 861us) write_op.cc:301] APPLY: starting
0617 20:17:02.486377 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.491756 (+ 5379us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.491806 (+ 50us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.491884 (+ 78us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.491923 (+ 39us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0617 20:17:02.491930 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:02.492010 (+ 80us) log.cc:844] Serialized 35 byte log entry
0617 20:17:02.492084 (+ 74us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.492111 (+ 27us) write_op.cc:454] Released schema lock
0617 20:17:02.492122 (+ 11us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.492226 (+ 104us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.492233 (+ 7us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":819,"apply.run_cpu_time_us":615,"apply.run_wall_time_us":5844,"num_ops":3,"prepare.queue_time_us":1652,"prepare.run_cpu_time_us":750,"prepare.run_wall_time_us":746,"replication_time_us":245062}]]}
I20260617 20:17:02.744692 29197 leader_election.cc:304] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.745353 30294 raft_consensus.cc:493] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.745520 30294 raft_consensus.cc:515] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.746366 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 5d09b732e1cc4126bf7b0b17e5396607 (DEFAULT_TABLE table=default.Table_8c876d1d42224f5e83e8b62167dc4368 [id=e528939749d2480bad37529d55c39757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.749454 30294 leader_election.cc:290] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.750384 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d09b732e1cc4126bf7b0b17e5396607. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:02.746070 29198 leader_election.cc:343] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.752202 30423 raft_consensus.cc:2804] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:02.752323 30423 raft_consensus.cc:493] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:02.752417 30423 raft_consensus.cc:3060] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:02.753057 29197 leader_election.cc:343] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 13ba94ec9e27403b974e5e6fea46e59e
I20260617 20:17:02.753383 29197 leader_election.cc:304] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.753839 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 9f9844fab126448895c4c9d4c3c78d76 (table default.Table_5293e9d7c6ad4868b54d0aa5d41958b9 [id=8b51ca1875e847c5b75b682be93e6107]) successfully deleted
I20260617 20:17:02.754110 30555 raft_consensus.cc:2749] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:02.754125 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f5387e3c30b24cb285ea5cc657981321 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5387e3c30b24cb285ea5cc657981321 already in progress: creating tablet
W20260617 20:17:02.754472 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 29a176d1f3b0446984af141e02bac329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29a176d1f3b0446984af141e02bac329 already in progress: creating tablet
I20260617 20:17:02.754863 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 46ea43994a0a42fe9e16d7bc6a2118e6 (table default.Table_c7a5b7a15b93440a82590a995e13b32c [id=efd2f4062eb343f491281fdab6875c9e]) successfully deleted
W20260617 20:17:02.757210 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet f24954093a45411a9cbe39415fb1adb7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f24954093a45411a9cbe39415fb1adb7 already in progress: creating tablet
W20260617 20:17:02.757495 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 9370421288e2449fae454aec32883810 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9370421288e2449fae454aec32883810 already in progress: creating tablet
W20260617 20:17:02.758852 28663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.193:34505 (request call id 111) took 1979 ms (client timeout 1000 ms). Trace:
W20260617 20:17:02.758966 28663 rpcz_store.cc:269] 0617 20:17:00.779544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.861071 (+ 81527us) service_pool.cc:224] Handling call
0617 20:17:01.026061 (+164990us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bcaf08 00007fa11b629ca6 00007fa11b6299d5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.758526 (+1732465us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.003880 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.004002 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.004007 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:02.004009 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.004124 (+ 115us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.004136 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.004140 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:02.004366 (+ 226us) tablet.cc:701] Row locks acquired
0617 20:17:02.004369 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:02.004407 (+ 38us) write_op.cc:270] Start()
0617 20:17:02.004441 (+ 34us) write_op.cc:276] Timestamp: P: 1781727422004370 usec, L: 0
0617 20:17:02.004445 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.004589 (+ 144us) log.cc:844] Serialized 919 byte log entry
0617 20:17:02.052458 (+ 47869us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.053289 (+ 831us) write_op.cc:301] APPLY: starting
0617 20:17:02.053323 (+ 34us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.053362 (+ 39us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.053383 (+ 21us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.053430 (+ 47us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.053459 (+ 29us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 20:17:02.053465 (+ 6us) write_op.cc:312] APPLY: finished
0617 20:17:02.053529 (+ 64us) log.cc:844] Serialized 29 byte log entry
0617 20:17:02.053586 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.053599 (+ 13us) write_op.cc:454] Released schema lock
0617 20:17:02.053604 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.053660 (+ 56us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.053665 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 20:17:02.273449 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.273542 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.273547 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:02.273549 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.273649 (+ 100us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.273660 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.273664 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:02.273720 (+ 56us) tablet.cc:701] Row locks acquired
0617 20:17:02.273723 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:02.273755 (+ 32us) write_op.cc:270] Start()
0617 20:17:02.273785 (+ 30us) write_op.cc:276] Timestamp: P: 1781727422273730 usec, L: 0
0617 20:17:02.273789 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.273938 (+ 149us) log.cc:844] Serialized 356 byte log entry
0617 20:17:02.618523 (+344585us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.619331 (+ 808us) write_op.cc:301] APPLY: starting
0617 20:17:02.619343 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.619370 (+ 27us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.619403 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.619442 (+ 39us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.619470 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:02.619477 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:02.619536 (+ 59us) log.cc:844] Serialized 23 byte log entry
0617 20:17:02.619595 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.619607 (+ 12us) write_op.cc:454] Released schema lock
0617 20:17:02.619611 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.619675 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.619678 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":29,"spinlock_wait_cycles":348244864,"child_traces":[["op",{"apply.queue_time_us":797,"apply.run_cpu_time_us":364,"apply.run_wall_time_us":363,"num_ops":2,"prepare.queue_time_us":35523,"prepare.run_cpu_time_us":723,"prepare.run_wall_time_us":774,"replication_time_us":47995}],["op",{"apply.queue_time_us":774,"apply.run_cpu_time_us":337,"apply.run_wall_time_us":336,"num_ops":1,"prepare.queue_time_us":12760,"prepare.run_cpu_time_us":537,"prepare.run_wall_time_us":536,"replication_time_us":344714}]]}
I20260617 20:17:02.760509 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet aad5d2ab3e7d4453b4e1aa27acf7683d from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:02.768996 28664 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 988) took 1295 ms. Trace:
I20260617 20:17:02.769109 28664 rpcz_store.cc:276] 0617 20:17:01.473675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.266491 (+792816us) service_pool.cc:224] Handling call
0617 20:17:02.275799 (+ 9308us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.276374 (+ 575us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:02.276734 (+ 360us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:02.768739 (+492005us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:02.768848 (+ 109us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:02.768940 (+ 92us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.279297 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.279390 (+ 93us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.279394 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:02.279396 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.279464 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.279474 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.279481 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:02.279548 (+ 67us) tablet.cc:701] Row locks acquired
0617 20:17:02.279552 (+ 4us) write_op.cc:260] PREPARE: finished
0617 20:17:02.279582 (+ 30us) write_op.cc:270] Start()
0617 20:17:02.279610 (+ 28us) write_op.cc:276] Timestamp: P: 1781727422279557 usec, L: 0
0617 20:17:02.279614 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.279739 (+ 125us) log.cc:844] Serialized 433 byte log entry
0617 20:17:02.766259 (+486520us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.766507 (+ 248us) write_op.cc:301] APPLY: starting
0617 20:17:02.766526 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.766578 (+ 52us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.766636 (+ 58us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.766793 (+ 157us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.766834 (+ 41us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:02.766843 (+ 9us) write_op.cc:312] APPLY: finished
0617 20:17:02.766949 (+ 106us) log.cc:844] Serialized 29 byte log entry
0617 20:17:02.767034 (+ 85us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.767055 (+ 21us) write_op.cc:454] Released schema lock
0617 20:17:02.767063 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.767150 (+ 87us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.767155 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":20918016,"child_traces":[["op",{"apply.queue_time_us":161,"apply.run_cpu_time_us":631,"apply.run_wall_time_us":632,"num_ops":2,"prepare.queue_time_us":2207,"prepare.run_cpu_time_us":505,"prepare.run_wall_time_us":734,"replication_time_us":486605}]]}
I20260617 20:17:02.769616 28970 tablet_service.cc:1511] Processing CreateTablet for tablet ac3aad616b92480d877b463e0de56b72 (DEFAULT_TABLE table=default.Table_1404d8949a194779a7fe937bc4857a4a [id=5c83a4e7711c4b928e15a365aa351fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.769906 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f7ba6da717cb4d2f9cce7ff504334ae0" } modify_external_catalogs: true
I20260617 20:17:02.770092 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f7ba6da717cb4d2f9cce7ff504334ae0" } modify_external_catalogs: true
I20260617 20:17:02.771739 28667 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 990) took 1290 ms. Trace:
I20260617 20:17:02.771876 28667 rpcz_store.cc:276] 0617 20:17:01.481599 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.281230 (+799631us) service_pool.cc:224] Handling call
0617 20:17:02.281972 (+ 742us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:02.282362 (+ 390us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:02.771490 (+489128us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:02.771580 (+ 90us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:02.771693 (+ 113us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.283369 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.283464 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.283468 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:02.283471 (+ 3us) tablet.cc:662] Decoding operations
0617 20:17:02.283536 (+ 65us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.283543 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.283548 (+ 5us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:02.283605 (+ 57us) tablet.cc:701] Row locks acquired
0617 20:17:02.283607 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:02.283630 (+ 23us) write_op.cc:270] Start()
0617 20:17:02.283653 (+ 23us) write_op.cc:276] Timestamp: P: 1781727422283609 usec, L: 0
0617 20:17:02.283656 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.283780 (+ 124us) log.cc:844] Serialized 433 byte log entry
0617 20:17:02.766367 (+482587us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.767250 (+ 883us) write_op.cc:301] APPLY: starting
0617 20:17:02.767268 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.767314 (+ 46us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.767347 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.767483 (+ 136us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.767525 (+ 42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:02.767531 (+ 6us) write_op.cc:312] APPLY: finished
0617 20:17:02.767599 (+ 68us) log.cc:844] Serialized 29 byte log entry
0617 20:17:02.767647 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.767663 (+ 16us) write_op.cc:454] Released schema lock
0617 20:17:02.767670 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":819,"apply.run_cpu_time_us":488,"apply.run_wall_time_us":488,"num_ops":2,"prepare.queue_time_us":432,"prepare.run_cpu_time_us":471,"prepare.run_wall_time_us":704,"replication_time_us":482687}]]}
I20260617 20:17:02.772496 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_429e918201e84c0ab85d77c4cef3f02a" } modify_external_catalogs: true
I20260617 20:17:02.772682 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_429e918201e84c0ab85d77c4cef3f02a" } modify_external_catalogs: true
I20260617 20:17:02.775655 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_068e6f9e0da44fbba32efb8418d43f31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:02.776180 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_068e6f9e0da44fbba32efb8418d43f31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:17:02.777017 29063 leader_election.cc:343] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 640f53137c21443cbfc274c084ce13ef
I20260617 20:17:02.777366 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7b4739816cc340b5b1f9a29e08d5032d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:02.777928 30556 raft_consensus.cc:493] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:17:02.778012 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b4739816cc340b5b1f9a29e08d5032d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.778066 30556 raft_consensus.cc:515] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.778766 30556 leader_election.cc:290] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.779417 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead0291870a443d9b76ea919a45a4303" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:02.779809 28668 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:60552 (request call id 993) took 1274 ms. Trace:
I20260617 20:17:02.779912 28668 rpcz_store.cc:276] 0617 20:17:01.505359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.667145 (+1161786us) service_pool.cc:224] Handling call
0617 20:17:02.779572 (+112427us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bdd54b 00007fa11b639107 00007fa11b638e35 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.779777 (+ 205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257779456}
W20260617 20:17:02.780089 29198 leader_election.cc:343] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.780277 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0dc3002823be41b18039e536eb0d547b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:02.780706 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0dc3002823be41b18039e536eb0d547b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.780982 29310 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:02.781142 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 5d09b732e1cc4126bf7b0b17e5396607 (DEFAULT_TABLE table=default.Table_8c876d1d42224f5e83e8b62167dc4368 [id=e528939749d2480bad37529d55c39757]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:02.781487 29062 leader_election.cc:343] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 640f53137c21443cbfc274c084ce13ef
I20260617 20:17:02.781617 29062 leader_election.cc:304] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.782186 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_bf4ce88a9888453a8c775f1f1d264daa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:02.782312 30294 raft_consensus.cc:2749] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:02.782582 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf4ce88a9888453a8c775f1f1d264daa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.783958 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_68a5110f6e914dc5882d9f2cb6ab132d" } modify_external_catalogs: true
I20260617 20:17:02.784160 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_68a5110f6e914dc5882d9f2cb6ab132d" } modify_external_catalogs: true
I20260617 20:17:02.786758 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_41df43a4da14469eabad96a692395510" } new_table_name: "default.Table_fe8f1bae47eb40e8b88f9832e8b127b3" modify_external_catalogs: true
I20260617 20:17:02.795002 29383 tablet_bootstrap.cc:654] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.797479 30294 raft_consensus.cc:493] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.797642 30294 raft_consensus.cc:515] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.798334 30294 leader_election.cc:290] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.800613 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead0291870a443d9b76ea919a45a4303" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.800815 28983 raft_consensus.cc:2468] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:17:02.802804 29062 leader_election.cc:343] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f4de5dafb1474de1911148bb3b4527cf
I20260617 20:17:02.803601 29377 ts_tablet_manager.cc:1929] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:02.803721 29377 log.cc:1199] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/33a1c96212014333935ec7f7c92a306c
I20260617 20:17:02.804428 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3aad616b92480d877b463e0de56b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.805887 28990 raft_consensus.cc:2468] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:02.806569 29377 ts_tablet_manager.cc:1950] T 33a1c96212014333935ec7f7c92a306c P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:02.808786 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet aad5d2ab3e7d4453b4e1aa27acf7683d
I20260617 20:17:02.809736 28661 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 991) took 1305 ms. Trace:
I20260617 20:17:02.809814 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_edd43d9adb4a4c32b4de61db1c2c6885" } new_table_name: "default.Table_00f049c59fbd43bc8134a419c3d654a5" modify_external_catalogs: true
I20260617 20:17:02.809881 28661 rpcz_store.cc:276] 0617 20:17:01.504659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.629440 (+1124781us) service_pool.cc:224] Handling call
0617 20:17:02.775599 (+146159us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.776269 (+ 670us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:02.776742 (+ 473us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:02.809487 (+ 32745us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:02.809591 (+ 104us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:02.809688 (+ 97us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.791232 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.791331 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.791336 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:02.791339 (+ 3us) tablet.cc:662] Decoding operations
0617 20:17:02.791414 (+ 75us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.791422 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.791426 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:02.791507 (+ 81us) tablet.cc:701] Row locks acquired
0617 20:17:02.791509 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:02.791535 (+ 26us) write_op.cc:270] Start()
0617 20:17:02.791557 (+ 22us) write_op.cc:276] Timestamp: P: 1781727422791522 usec, L: 0
0617 20:17:02.791561 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.791678 (+ 117us) log.cc:844] Serialized 433 byte log entry
0617 20:17:02.807450 (+ 15772us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.808138 (+ 688us) write_op.cc:301] APPLY: starting
0617 20:17:02.808150 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.808182 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.808214 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.808317 (+ 103us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.808345 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:02.808353 (+ 8us) write_op.cc:312] APPLY: finished
0617 20:17:02.808409 (+ 56us) log.cc:844] Serialized 29 byte log entry
0617 20:17:02.808460 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.808476 (+ 16us) write_op.cc:454] Released schema lock
0617 20:17:02.808483 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.808555 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.808559 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":335410048,"child_traces":[["op",{"apply.queue_time_us":652,"apply.run_cpu_time_us":408,"apply.run_wall_time_us":408,"num_ops":2,"prepare.queue_time_us":14088,"prepare.run_cpu_time_us":500,"prepare.run_wall_time_us":501,"replication_time_us":15872}]]}
I20260617 20:17:02.810807 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_110205cd8f114a17b34c7a409cd777dd" } new_table_name: "default.Table_add57ff1d780483cb71151dbab223170" modify_external_catalogs: true
I20260617 20:17:02.812435 28663 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:60552 (request call id 997) took 1020 ms. Trace:
I20260617 20:17:02.812609 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 64538fdf51f94e8e985fec6202baac22
I20260617 20:17:02.813252 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet aad5d2ab3e7d4453b4e1aa27acf7683d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:02.812573 28663 rpcz_store.cc:276] 0617 20:17:01.791603 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.759811 (+968208us) service_pool.cc:224] Handling call
0617 20:17:02.790821 (+ 31010us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bdd54b 00007fa11b639107 00007fa11b638e35 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.812379 (+ 21558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69161344}
I20260617 20:17:02.813994 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_619b4975021e4a94b2fb7e5affbe4cef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:02.800076 30423 raft_consensus.cc:515] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:02.814628 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_619b4975021e4a94b2fb7e5affbe4cef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.814833 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet 64538fdf51f94e8e985fec6202baac22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:02.815143 30423 leader_election.cc:290] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.817139 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59430dd630b4ca6b573ea4230212abf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:02.818498 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c31a6d3cec584680a4f793abe57f6d24" } modify_external_catalogs: true
I20260617 20:17:02.818688 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c31a6d3cec584680a4f793abe57f6d24" } modify_external_catalogs: true
I20260617 20:17:02.819015 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet 64538fdf51f94e8e985fec6202baac22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:17:02.820587 29198 leader_election.cc:343] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.820703 29089 tablet_service.cc:1511] Processing CreateTablet for tablet add6e21cef3b4c02910486841e36ce4a (DEFAULT_TABLE table=default.Table_a2e469f758544195aa0ea203437c6a11 [id=f9528219361e47cd876e7723bc76650d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.822948 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 5d09b732e1cc4126bf7b0b17e5396607 (DEFAULT_TABLE table=default.Table_8c876d1d42224f5e83e8b62167dc4368 [id=e528939749d2480bad37529d55c39757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.823407 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d09b732e1cc4126bf7b0b17e5396607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.826030 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet aad5d2ab3e7d4453b4e1aa27acf7683d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.827309 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 403095586c704ecaa2a9931295bd1330 (DEFAULT_TABLE table=default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.828840 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 403095586c704ecaa2a9931295bd1330 (DEFAULT_TABLE table=default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.829950 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 403095586c704ecaa2a9931295bd1330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.829990 28958 tablet_service.cc:1511] Processing CreateTablet for tablet add6e21cef3b4c02910486841e36ce4a (DEFAULT_TABLE table=default.Table_a2e469f758544195aa0ea203437c6a11 [id=f9528219361e47cd876e7723bc76650d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.831684 29378 tablet_bootstrap.cc:654] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.832504 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add6e21cef3b4c02910486841e36ce4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.832695 30555 raft_consensus.cc:493] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.832858 30555 raft_consensus.cc:515] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.833554 30555 leader_election.cc:290] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.834908 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed593a3fa7742a18ccc2124c3ee0fb9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:02.835402 29198 leader_election.cc:343] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:02.836467 30424 log.cc:927] Time spent T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Append to log took a long time: real 0.101s user 0.000s sys 0.000s
I20260617 20:17:02.836539 29106 tablet_service.cc:1511] Processing CreateTablet for tablet a4d8a0034aa34b7b9e16ff087dacc4f7 (DEFAULT_TABLE table=default.Table_8a75e972290d447da9487d018bf2f205 [id=186b2fd455324d58a32cf586defc04a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.837597 29379 tablet_bootstrap.cc:492] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:02.850827 30555 raft_consensus.cc:493] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.850984 30555 raft_consensus.cc:515] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.851933 30555 leader_election.cc:290] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.852245 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 66b4232cd60142e0901264c663e94487 (DEFAULT_TABLE table=default.Table_56be7326decb482f8c632474abe1fba3 [id=b068fb664ccb41908426d488f2d1303c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.852830 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8fa9f4c40b4ce9baa27a8837d3575c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:02.849862 29379 ts_tablet_manager.cc:1403] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.230s user 0.005s sys 0.001s
W20260617 20:17:02.853346 29198 leader_election.cc:343] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.854146 28960 tablet_service.cc:1511] Processing CreateTablet for tablet a4d8a0034aa34b7b9e16ff087dacc4f7 (DEFAULT_TABLE table=default.Table_8a75e972290d447da9487d018bf2f205 [id=186b2fd455324d58a32cf586defc04a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.854575 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d8a0034aa34b7b9e16ff087dacc4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.855556 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e59430dd630b4ca6b573ea4230212abf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:02.855769 28988 raft_consensus.cc:3060] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.858639 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 75e3e15cade7403fa70096516d83c3c0 (DEFAULT_TABLE table=default.Table_f786ef7bfe62418fac5124168a78cac1 [id=d5615ff147d842878e2aa891b08cd460]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.862970 29108 tablet_service.cc:1511] Processing CreateTablet for tablet ab6e06eb2e7644168fa2d99a1890f6b6 (DEFAULT_TABLE table=default.Table_66545ee179e84436aea66f777fb80da9 [id=3f31b8564b28492c88c42f1534943265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.865181 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed593a3fa7742a18ccc2124c3ee0fb9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.865469 28990 raft_consensus.cc:2468] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:02.868139 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 75e3e15cade7403fa70096516d83c3c0 (DEFAULT_TABLE table=default.Table_f786ef7bfe62418fac5124168a78cac1 [id=d5615ff147d842878e2aa891b08cd460]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.868572 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e3e15cade7403fa70096516d83c3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.872329 29227 tablet_service.cc:1558] Processing DeleteTablet for tablet aad5d2ab3e7d4453b4e1aa27acf7683d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.874900 29227 tablet_service.cc:1558] Processing DeleteTablet for tablet 64538fdf51f94e8e985fec6202baac22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.878260 29227 tablet_service.cc:1511] Processing CreateTablet for tablet add6e21cef3b4c02910486841e36ce4a (DEFAULT_TABLE table=default.Table_a2e469f758544195aa0ea203437c6a11 [id=f9528219361e47cd876e7723bc76650d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.878261 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 266ff05cc91b43dfbb30ce9e961eeb54 (DEFAULT_TABLE table=default.Table_a1db08a35ad14d90b6f54df2495fa076 [id=59cf549dc5cf40a29b53f965c6bab0a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.879518 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 66b4232cd60142e0901264c663e94487 (DEFAULT_TABLE table=default.Table_56be7326decb482f8c632474abe1fba3 [id=b068fb664ccb41908426d488f2d1303c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.880015 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b4232cd60142e0901264c663e94487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.881186 29383 tablet_bootstrap.cc:492] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:02.879495 29379 raft_consensus.cc:359] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.882818 29379 raft_consensus.cc:385] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.881227 29239 tablet_service.cc:1511] Processing CreateTablet for tablet 403095586c704ecaa2a9931295bd1330 (DEFAULT_TABLE table=default.Table_7ea99b304a684f3c96d69b2c2457bbd2 [id=f373633ff0ce4822b7884195b431df9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.884330 29242 tablet_service.cc:1511] Processing CreateTablet for tablet a4d8a0034aa34b7b9e16ff087dacc4f7 (DEFAULT_TABLE table=default.Table_8a75e972290d447da9487d018bf2f205 [id=186b2fd455324d58a32cf586defc04a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.885674 29383 ts_tablet_manager.cc:1403] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.194s user 0.004s sys 0.000s
I20260617 20:17:02.884541 29379 raft_consensus.cc:740] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.886184 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 66b4232cd60142e0901264c663e94487 (DEFAULT_TABLE table=default.Table_56be7326decb482f8c632474abe1fba3 [id=b068fb664ccb41908426d488f2d1303c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.888183 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 75e3e15cade7403fa70096516d83c3c0 (DEFAULT_TABLE table=default.Table_f786ef7bfe62418fac5124168a78cac1 [id=d5615ff147d842878e2aa891b08cd460]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.887686 29379 consensus_queue.cc:260] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.890528 29232 tablet_service.cc:1511] Processing CreateTablet for tablet ab6e06eb2e7644168fa2d99a1890f6b6 (DEFAULT_TABLE table=default.Table_66545ee179e84436aea66f777fb80da9 [id=3f31b8564b28492c88c42f1534943265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.890669 28955 tablet_service.cc:1511] Processing CreateTablet for tablet ab6e06eb2e7644168fa2d99a1890f6b6 (DEFAULT_TABLE table=default.Table_66545ee179e84436aea66f777fb80da9 [id=3f31b8564b28492c88c42f1534943265]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.891233 29376 ts_tablet_manager.cc:1929] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:02.891292 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab6e06eb2e7644168fa2d99a1890f6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.891345 29376 log.cc:1199] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/0e6cee209a5a44d6b35eb50e9c33228f
I20260617 20:17:02.891695 29376 ts_tablet_manager.cc:1950] T 0e6cee209a5a44d6b35eb50e9c33228f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:02.891695 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 084bd5befcae496a93a5111f844a28ea (DEFAULT_TABLE table=default.Table_12eedf674e4d4de99a03e816f2b6475c [id=67fea9aec2234faca7f0af0743c8601d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.894140 28670 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 995) took 1337 ms. Trace:
I20260617 20:17:02.894272 28670 rpcz_store.cc:276] 0617 20:17:01.556701 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.690590 (+1133889us) service_pool.cc:224] Handling call
0617 20:17:02.777277 (+ 86687us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.778117 (+ 840us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:02.778611 (+ 494us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:02.893868 (+115257us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:02.893990 (+ 122us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:02.894090 (+ 100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.791759 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.791843 (+ 84us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.791848 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:02.791850 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.791909 (+ 59us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.791916 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.791920 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:02.791969 (+ 49us) tablet.cc:701] Row locks acquired
0617 20:17:02.791971 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:02.791992 (+ 21us) write_op.cc:270] Start()
0617 20:17:02.794558 (+ 2566us) write_op.cc:276] Timestamp: P: 1781727422791980 usec, L: 0
0617 20:17:02.794563 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.794701 (+ 138us) log.cc:844] Serialized 433 byte log entry
0617 20:17:02.892507 (+ 97806us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.892736 (+ 229us) write_op.cc:301] APPLY: starting
0617 20:17:02.892755 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.892804 (+ 49us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.892850 (+ 46us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.892967 (+ 117us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.893009 (+ 42us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:02.893020 (+ 11us) write_op.cc:312] APPLY: finished
0617 20:17:02.893100 (+ 80us) log.cc:844] Serialized 29 byte log entry
0617 20:17:02.893170 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.893192 (+ 22us) write_op.cc:454] Released schema lock
0617 20:17:02.893200 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.893279 (+ 79us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.893285 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":187975424,"child_traces":[["op",{"apply.queue_time_us":160,"apply.run_cpu_time_us":539,"apply.run_wall_time_us":539,"num_ops":2,"prepare.queue_time_us":12666,"prepare.run_cpu_time_us":492,"prepare.run_wall_time_us":2994,"replication_time_us":97901}]]}
I20260617 20:17:02.894853 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d8a0034aa34b7b9e16ff087dacc4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.895284 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3aad616b92480d877b463e0de56b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.897779 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add6e21cef3b4c02910486841e36ce4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.898206 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 403095586c704ecaa2a9931295bd1330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.898386 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e3e15cade7403fa70096516d83c3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.898708 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b4232cd60142e0901264c663e94487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.898800 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab6e06eb2e7644168fa2d99a1890f6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.899112 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e3e15cade7403fa70096516d83c3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.899477 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab6e06eb2e7644168fa2d99a1890f6b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.899842 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266ff05cc91b43dfbb30ce9e961eeb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.899909 30314 raft_consensus.cc:493] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:02.900024 30314 raft_consensus.cc:515] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.900238 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084bd5befcae496a93a5111f844a28ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.902735 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4de5dafb1474de1911148bb3b4527cf" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:02.904093 30314 leader_election.cc:290] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:02.905021 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 266ff05cc91b43dfbb30ce9e961eeb54 (DEFAULT_TABLE table=default.Table_a1db08a35ad14d90b6f54df2495fa076 [id=59cf549dc5cf40a29b53f965c6bab0a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.905174 28662 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60552 (request call id 992) took 1400 ms. Trace:
I20260617 20:17:02.905455 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d09b732e1cc4126bf7b0b17e5396607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.905464 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266ff05cc91b43dfbb30ce9e961eeb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.905282 28662 rpcz_store.cc:276] 0617 20:17:01.504817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.630673 (+1125856us) service_pool.cc:224] Handling call
0617 20:17:02.782126 (+151453us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd06c3 00007fa11b62c7c6 00007fa11b62c4f5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.782662 (+ 536us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:02.783027 (+ 365us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:02.897359 (+114332us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:02.905007 (+ 7648us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:02.905111 (+ 104us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.794788 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.794873 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.794878 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:02.794880 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.794943 (+ 63us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.794951 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.794955 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:02.795010 (+ 55us) tablet.cc:701] Row locks acquired
0617 20:17:02.795012 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:02.795034 (+ 22us) write_op.cc:270] Start()
0617 20:17:02.795054 (+ 20us) write_op.cc:276] Timestamp: P: 1781727422795022 usec, L: 0
0617 20:17:02.795058 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.795274 (+ 216us) log.cc:844] Serialized 433 byte log entry
0617 20:17:02.892592 (+ 97318us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.892855 (+ 263us) write_op.cc:301] APPLY: starting
0617 20:17:02.892871 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.892911 (+ 40us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.892962 (+ 51us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.893073 (+ 111us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.893107 (+ 34us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:02.893115 (+ 8us) write_op.cc:312] APPLY: finished
0617 20:17:02.893190 (+ 75us) log.cc:844] Serialized 29 byte log entry
0617 20:17:02.893240 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.893258 (+ 18us) write_op.cc:454] Released schema lock
0617 20:17:02.893265 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.893377 (+ 112us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.893381 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":347706112,"child_traces":[["op",{"apply.queue_time_us":203,"apply.run_cpu_time_us":527,"apply.run_wall_time_us":527,"num_ops":2,"prepare.queue_time_us":11410,"prepare.run_cpu_time_us":433,"prepare.run_wall_time_us":528,"replication_time_us":97516}]]}
I20260617 20:17:02.905289 29379 ts_tablet_manager.cc:1434] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.051s user 0.003s sys 0.001s
I20260617 20:17:02.906131 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_dc3d1baf230b4c32b23beb5d647a300d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:02.906726 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc3d1baf230b4c32b23beb5d647a300d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:02.894833 29375 ts_tablet_manager.cc:1929] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:02.907529 29375 log.cc:1199] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/0bbef4cc28ef46288cfc7d1933c71710
I20260617 20:17:02.906739 29197 leader_election.cc:304] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.907841 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 403095586c704ecaa2a9931295bd1330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.910037 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d8a0034aa34b7b9e16ff087dacc4f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.910117 30556 raft_consensus.cc:2804] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:02.910202 30556 raft_consensus.cc:493] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:02.910234 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 33d9cafa9d7c4a3f91f738e4654058b4
I20260617 20:17:02.910260 30556 raft_consensus.cc:3060] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.910612 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet add6e21cef3b4c02910486841e36ce4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.910811 28666 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:60552 (request call id 994) took 1365 ms. Trace:
I20260617 20:17:02.910920 28666 rpcz_store.cc:276] 0617 20:17:01.545341 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.683827 (+1138486us) service_pool.cc:224] Handling call
0617 20:17:02.783874 (+100047us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd16b6 00007fa11b62e486 00007fa11b62e1b5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.784268 (+ 394us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:17:02.784430 (+ 162us) catalog_manager.cc:2840] Modifying in-memory table state
0617 20:17:02.784494 (+ 64us) catalog_manager.cc:2849] Locking tablets
0617 20:17:02.784657 (+ 163us) catalog_manager.cc:2863] Removing table and tablets from system table
0617 20:17:02.897477 (+112820us) catalog_manager.cc:2881] Removing table from by-name map
0617 20:17:02.910128 (+ 12651us) catalog_manager.cc:2897] Committing in-memory state
0617 20:17:02.910166 (+ 38us) catalog_manager.cc:2901] Aborting table tasks
0617 20:17:02.910777 (+ 611us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.795361 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.795441 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.795446 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:02.795448 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.795544 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.795551 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.795555 (+ 4us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:02.795650 (+ 95us) tablet.cc:701] Row locks acquired
0617 20:17:02.795652 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:02.795676 (+ 24us) write_op.cc:270] Start()
0617 20:17:02.795697 (+ 21us) write_op.cc:276] Timestamp: P: 1781727422795663 usec, L: 0
0617 20:17:02.795700 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.795840 (+ 140us) log.cc:844] Serialized 734 byte log entry
0617 20:17:02.892648 (+ 96808us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.893387 (+ 739us) write_op.cc:301] APPLY: starting
0617 20:17:02.893399 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.893432 (+ 33us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.893482 (+ 50us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.893540 (+ 58us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.893575 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0617 20:17:02.893586 (+ 11us) write_op.cc:312] APPLY: finished
0617 20:17:02.893645 (+ 59us) log.cc:844] Serialized 29 byte log entry
0617 20:17:02.893687 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.893702 (+ 15us) write_op.cc:454] Released schema lock
0617 20:17:02.893708 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:02.893775 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.893781 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":217968512,"child_traces":[["op",{"apply.queue_time_us":704,"apply.run_cpu_time_us":377,"apply.run_wall_time_us":378,"num_ops":2,"prepare.queue_time_us":9932,"prepare.run_cpu_time_us":527,"prepare.run_wall_time_us":526,"replication_time_us":96928}]]}
I20260617 20:17:02.912235 28669 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:60552 (request call id 996) took 1347 ms. Trace:
I20260617 20:17:02.912338 28669 rpcz_store.cc:276] 0617 20:17:01.564524 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.744540 (+1180016us) service_pool.cc:224] Handling call
0617 20:17:02.786694 (+ 42154us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bd2956 00007fa11b630146 00007fa11b62fe75 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:02.786913 (+ 219us) catalog_manager.cc:2418] Looking up, locking, and authorizing table
0617 20:17:02.787111 (+ 198us) catalog_manager.cc:3750] Apply alter schema
0617 20:17:02.787257 (+ 146us) catalog_manager.cc:3782] Acquired catalog manager lock
0617 20:17:02.787306 (+ 49us) catalog_manager.cc:3940] Updating metadata on disk
0617 20:17:02.897528 (+110222us) catalog_manager.cc:3971] Committing alterations to in-memory state
0617 20:17:02.912203 (+ 14675us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:02.795923 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:02.796000 (+ 77us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:02.796004 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:02.796006 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:02.796090 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:02.796097 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:02.796101 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:02.796149 (+ 48us) tablet.cc:701] Row locks acquired
0617 20:17:02.796153 (+ 4us) write_op.cc:260] PREPARE: finished
0617 20:17:02.796182 (+ 29us) write_op.cc:270] Start()
0617 20:17:02.796204 (+ 22us) write_op.cc:276] Timestamp: P: 1781727422796167 usec, L: 0
0617 20:17:02.796206 (+ 2us) op_driver.cc:348] REPLICATION: starting
0617 20:17:02.797121 (+ 915us) log.cc:844] Serialized 405 byte log entry
0617 20:17:02.892715 (+ 95594us) op_driver.cc:464] REPLICATION: finished
0617 20:17:02.893451 (+ 736us) write_op.cc:301] APPLY: starting
0617 20:17:02.893468 (+ 17us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:02.893496 (+ 28us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:02.893520 (+ 24us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:02.893567 (+ 47us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:02.893593 (+ 26us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:02.893600 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:02.893680 (+ 80us) log.cc:844] Serialized 23 byte log entry
0617 20:17:02.893724 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:02.893736 (+ 12us) write_op.cc:454] Released schema lock
0617 20:17:02.893752 (+ 16us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":96426368,"child_traces":[["op",{"apply.queue_time_us":699,"apply.run_cpu_time_us":364,"apply.run_wall_time_us":364,"num_ops":1,"prepare.queue_time_us":8242,"prepare.run_cpu_time_us":503,"prepare.run_wall_time_us":1511,"replication_time_us":96488}]]}
I20260617 20:17:02.909963 29379 tablet_bootstrap.cc:492] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:02.914544 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 737) took 3276 ms. Trace:
I20260617 20:17:02.914640 29377 rpcz_store.cc:276] 0617 20:16:59.637612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.640939 (+ 3327us) service_pool.cc:224] Handling call
0617 20:17:02.518947 (+2878008us) ts_tablet_manager.cc:1151] Deleting tablet 33a1c96212014333935ec7f7c92a306c
0617 20:17:02.518954 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.650516 (+131562us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.803540 (+153024us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.914517 (+110977us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2877839}
I20260617 20:17:02.915531 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 33d9cafa9d7c4a3f91f738e4654058b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:02.915652 29377 tablet_replica.cc:333] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:02.915843 29377 raft_consensus.cc:2243] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:02.916013 29377 raft_consensus.cc:2272] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:02.916746 29377 ts_tablet_manager.cc:1916] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.916937 29197 leader_election.cc:304] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.917907 30555 raft_consensus.cc:2804] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:02.918056 30555 raft_consensus.cc:697] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:02.918267 30555 consensus_queue.cc:237] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.919940 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a2e469f758544195aa0ea203437c6a11" } modify_external_catalogs: true
I20260617 20:17:02.920135 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a2e469f758544195aa0ea203437c6a11" } modify_external_catalogs: true
I20260617 20:17:02.921512 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5b91f4d24aeb4208b2b9082d421fd325" } new_table_name: "default.Table_9628d76200d64a67a8095ff0895ab927" modify_external_catalogs: true
I20260617 20:17:02.922694 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2e2690c2f00244619623efaab2c222f4" } new_table_name: "default.Table_3f7fdf1b1e004f69b2631f83900e4619" modify_external_catalogs: true
I20260617 20:17:02.930915 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeae97639fd4e6290768dae12f6a4ce" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:02.931061 29116 raft_consensus.cc:3060] T 450b08b439814915ab4371770f49f45b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.932538 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
W20260617 20:17:02.933903 28925 leader_election.cc:343] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.934275 29383 raft_consensus.cc:359] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.934502 29383 raft_consensus.cc:385] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.934559 29383 raft_consensus.cc:740] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.934796 29383 consensus_queue.cc:260] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.935333 29383 ts_tablet_manager.cc:1434] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.049s user 0.001s sys 0.000s
I20260617 20:17:02.935637 29383 tablet_bootstrap.cc:492] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:02.938225 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]). Expected version 1 got 0
I20260617 20:17:02.939607 29197 leader_election.cc:304] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.941009 30555 raft_consensus.cc:2804] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:02.941237 30555 raft_consensus.cc:493] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:02.941489 30555 raft_consensus.cc:3060] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:02.941972 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:02.943085 29063 leader_election.cc:304] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.944909 30193 raft_consensus.cc:2749] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.945384 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeae97639fd4e6290768dae12f6a4ce" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:02.945478 29375 ts_tablet_manager.cc:1950] T 0bbef4cc28ef46288cfc7d1933c71710 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:02.947129 29379 tablet_bootstrap.cc:654] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.948045 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b4232cd60142e0901264c663e94487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.950678 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 266ff05cc91b43dfbb30ce9e961eeb54 (DEFAULT_TABLE table=default.Table_a1db08a35ad14d90b6f54df2495fa076 [id=59cf549dc5cf40a29b53f965c6bab0a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.951053 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266ff05cc91b43dfbb30ce9e961eeb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.953590 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 084bd5befcae496a93a5111f844a28ea (DEFAULT_TABLE table=default.Table_12eedf674e4d4de99a03e816f2b6475c [id=67fea9aec2234faca7f0af0743c8601d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.953922 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084bd5befcae496a93a5111f844a28ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.956758 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 33d9cafa9d7c4a3f91f738e4654058b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.956928 29240 tablet_service.cc:1558] Processing DeleteTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.957053 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab with delete_type TABLET_DATA_DELETED (replaced by tablet b4dbefbe5234458cb299410ddb2c73a3) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.957760 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet e59430dd630b4ca6b573ea4230212abf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.958110 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe with delete_type TABLET_DATA_DELETED (replaced by tablet 5a20867de1214c0fb4cb8504e8361c5b) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.959110 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f9844fab126448895c4c9d4c3c78d76 with delete_type TABLET_DATA_DELETED (replaced by tablet cdd24a60a91b43cd9e31ecca3d21ec60) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.960501 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet 58213ec0a9364a91a15fc0329f28605b with delete_type TABLET_DATA_DELETED (replaced by tablet 43462cf7003747d08e6b0e5db5999b3f) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.961148 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet 5faea831376646c1bdfcaf8fbbc7ca6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.962314 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8fa9f4c40b4ce9baa27a8837d3575c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:02.962531 28990 raft_consensus.cc:2468] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:02.963195 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 33d9cafa9d7c4a3f91f738e4654058b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:02.964097 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 87d0e2ecc16e4285a1d8337a5336caf2 (table default.Table_724f440ee4704ab9b73c964377608058 [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]). Expected version 1 got 0
I20260617 20:17:02.939152 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet 91c99389d24d4a8d8c934f0a9b9c2825 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:02.965075 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet fed593a3fa7742a18ccc2124c3ee0fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:02.965476 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet f24954093a45411a9cbe39415fb1adb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:17:02.965951 28925 leader_election.cc:343] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:02.966101 28925 leader_election.cc:304] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:02.966341 30546 raft_consensus.cc:2749] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:02.962811 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 33a1c96212014333935ec7f7c92a306c (table default.Table_f73d839e67c548629526669e7310da0c [id=cdf84135aed8448bafc93456dd9cdfc2]) successfully deleted
I20260617 20:17:02.967478 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 0f3032155e4e4ea8a23984f547d78752 (table default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca]). Expected version 2 got 0
I20260617 20:17:02.967712 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet c3014c93d6804f3896f452f041cbedc9 (table default.Table_01fded33682b4e3f91e9f6e6e92031f6 [id=0a278273a6004aa7947a19674e45d123]). Expected version 3 got 0
I20260617 20:17:02.968355 29197 leader_election.cc:304] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:02.969184 30410 raft_consensus.cc:2804] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:02.969274 30410 raft_consensus.cc:493] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:02.969369 30410 raft_consensus.cc:3060] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:02.972126 29198 consensus_peers.cc:597] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:02.974227 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 702) took 4031 ms. Trace:
I20260617 20:17:02.974326 29376 rpcz_store.cc:276] 0617 20:16:58.942667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.942725 (+ 58us) service_pool.cc:224] Handling call
0617 20:17:02.691283 (+3748558us) ts_tablet_manager.cc:1151] Deleting tablet 0e6cee209a5a44d6b35eb50e9c33228f
0617 20:17:02.691290 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.795886 (+104596us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.891170 (+ 95284us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.974209 (+ 83039us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3748354}
I20260617 20:17:02.974669 29376 tablet_replica.cc:333] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:02.974896 29376 raft_consensus.cc:2243] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:02.975049 29376 raft_consensus.cc:2272] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:02.975421 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 0e6cee209a5a44d6b35eb50e9c33228f (table default.Table_81cf092bd1634c3a82380616f225e4d6 [id=313f374332bf42b5bafbd20afd819a30]) successfully deleted
I20260617 20:17:02.975579 29376 ts_tablet_manager.cc:1916] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:02.975818 29383 tablet_bootstrap.cc:654] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.978026 29378 tablet_bootstrap.cc:492] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:02.978145 29378 ts_tablet_manager.cc:1403] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.244s user 0.003s sys 0.006s
I20260617 20:17:02.978847 29378 raft_consensus.cc:359] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.979012 29378 raft_consensus.cc:385] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:02.979058 29378 raft_consensus.cc:740] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:02.979242 29378 consensus_queue.cc:260] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.980073 29378 ts_tablet_manager.cc:1434] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:02.980511 29378 tablet_bootstrap.cc:492] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:02.982996 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 084bd5befcae496a93a5111f844a28ea (DEFAULT_TABLE table=default.Table_12eedf674e4d4de99a03e816f2b6475c [id=67fea9aec2234faca7f0af0743c8601d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.985848 30556 raft_consensus.cc:515] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:02.986521 30556 leader_election.cc:290] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:02.988176 29104 tablet_service.cc:1511] Processing CreateTablet for tablet edf884e801d74362ad05435a76efcc1f (DEFAULT_TABLE table=default.Table_fd65529645494ac38960b878c8dce40a [id=0570d9579adb4b55a90478060a36d81b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:02.988582 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf884e801d74362ad05435a76efcc1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:02.992973 29378 tablet_bootstrap.cc:654] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:02.993841 28988 raft_consensus.cc:2468] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:02.995488 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead0291870a443d9b76ea919a45a4303" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:03.001132 29198 leader_election.cc:343] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.006686 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead0291870a443d9b76ea919a45a4303" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:03.006928 28985 raft_consensus.cc:3060] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.009907 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 668) took 5001 ms. Trace:
I20260617 20:17:03.010046 29234 tablet_service.cc:1511] Processing CreateTablet for tablet edf884e801d74362ad05435a76efcc1f (DEFAULT_TABLE table=default.Table_fd65529645494ac38960b878c8dce40a [id=0570d9579adb4b55a90478060a36d81b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.010016 29375 rpcz_store.cc:276] 0617 20:16:58.008699 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.019340 (+ 10641us) service_pool.cc:224] Handling call
0617 20:17:02.704800 (+4685460us) ts_tablet_manager.cc:1151] Deleting tablet 0bbef4cc28ef46288cfc7d1933c71710
0617 20:17:02.704810 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.800601 (+ 95791us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:02.894778 (+ 94177us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.009882 (+115104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4653149}
I20260617 20:17:03.011597 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 48caf549502b4493b73ba33aeccc1a5a (DEFAULT_TABLE table=default.Table_3099db3fe67f428d9b61e60303d756f2 [id=bf33219f4b4f449f8fc11bcea9b04f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.011950 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 0bbef4cc28ef46288cfc7d1933c71710 (table default.Table_e01af13e5b514cca8b4cfc05a15a949d [id=9850785700a84b33a30caf29ab508aea]) successfully deleted
I20260617 20:17:03.012571 29197 leader_election.cc:304] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:03.015025 30556 raft_consensus.cc:2804] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:03.015164 30556 raft_consensus.cc:697] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:03.015431 29383 tablet_bootstrap.cc:492] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:03.015410 30556 consensus_queue.cc:237] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.015744 30546 raft_consensus.cc:493] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.015870 30546 raft_consensus.cc:515] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.016211 28952 tablet_service.cc:1511] Processing CreateTablet for tablet edf884e801d74362ad05435a76efcc1f (DEFAULT_TABLE table=default.Table_fd65529645494ac38960b878c8dce40a [id=0570d9579adb4b55a90478060a36d81b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.016489 30546 leader_election.cc:290] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.016745 29383 ts_tablet_manager.cc:1403] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.081s user 0.004s sys 0.000s
I20260617 20:17:03.017094 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet cbeae97639fd4e6290768dae12f6a4ce with delete_type TABLET_DATA_DELETED (replaced by tablet cc547148aa124907a5e5def6941f734c) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.017827 29383 raft_consensus.cc:359] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.017982 29383 raft_consensus.cc:385] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.018029 29383 raft_consensus.cc:740] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.018004 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 48caf549502b4493b73ba33aeccc1a5a (DEFAULT_TABLE table=default.Table_3099db3fe67f428d9b61e60303d756f2 [id=bf33219f4b4f449f8fc11bcea9b04f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.018185 29383 consensus_queue.cc:260] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.020378 30294 raft_consensus.cc:493] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:03.020502 29383 ts_tablet_manager.cc:1434] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:17:03.020525 30294 raft_consensus.cc:515] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.021265 30294 leader_election.cc:290] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.021376 29383 tablet_bootstrap.cc:492] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:03.022548 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d9de6a2fb47e18d86649e45ba80b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.023192 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 33a1c96212014333935ec7f7c92a306c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.023530 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48caf549502b4493b73ba33aeccc1a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.023691 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf884e801d74362ad05435a76efcc1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.032868 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "593d9de6a2fb47e18d86649e45ba80b9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:03.033638 28925 leader_election.cc:343] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.034293 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4240e14b48f4a43b7ce9c6512fc7ff2" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:03.041451 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "593d9de6a2fb47e18d86649e45ba80b9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:03.043306 28925 leader_election.cc:343] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.043428 28925 leader_election.cc:304] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:03.043650 30546 raft_consensus.cc:2749] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:03.043789 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4240e14b48f4a43b7ce9c6512fc7ff2" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:03.045828 30637 tablet.cc:1724] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:03.047079 29383 tablet_bootstrap.cc:654] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.048439 29090 tablet_service.cc:1511] Processing CreateTablet for tablet c1562c10a72f4bb2b8f88d79fb75f6ff (DEFAULT_TABLE table=default.Table_5970f728d64e408e83358eb27947ecc7 [id=673bf1a902ce4f54938b68a4c5cd01a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.049690 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_10083b9d580b48efac85dba92bf6c202"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.050293 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80bc9fa552114c2f90f77c67ab63b0e6 has no consensus state
W20260617 20:17:03.050346 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10083b9d580b48efac85dba92bf6c202 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.050676 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7ba6c34c2fdb41c7a28dd9b7d555eeba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.051199 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ba6c34c2fdb41c7a28dd9b7d555eeba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.056291 28963 tablet_service.cc:1511] Processing CreateTablet for tablet c1562c10a72f4bb2b8f88d79fb75f6ff (DEFAULT_TABLE table=default.Table_5970f728d64e408e83358eb27947ecc7 [id=673bf1a902ce4f54938b68a4c5cd01a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.056998 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 48caf549502b4493b73ba33aeccc1a5a (DEFAULT_TABLE table=default.Table_3099db3fe67f428d9b61e60303d756f2 [id=bf33219f4b4f449f8fc11bcea9b04f4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.058501 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 4372081172384c9f96388d38208d9853 (DEFAULT_TABLE table=default.Table_b6faf540da644f658eb715d3ffacd616 [id=8ebd35bd7b464cd489f6a15d0e70800e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.059552 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7534d57f1740af8b211d646488c90f (DEFAULT_TABLE table=default.Table_1b519a3c00d6483097bb906c3bb288dc [id=30c5ab49c17f429686ebd9f937c0c9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.060390 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7534d57f1740af8b211d646488c90f (DEFAULT_TABLE table=default.Table_1b519a3c00d6483097bb906c3bb288dc [id=30c5ab49c17f429686ebd9f937c0c9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.061578 29108 tablet_service.cc:1511] Processing CreateTablet for tablet e5003302863d4390b423054685c8c24b (DEFAULT_TABLE table=default.Table_321214072f004f76a346e51f39acde1f [id=4bed2d5737114eeda76e61e6a4a3fddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.062085 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 5884c83d394c40008c2d2c7ee5dcf2d7 (DEFAULT_TABLE table=default.Table_74a72450663a45a99d4b9e8a250bd9db [id=1d4c9a9b22e44723ae5c2ed384191a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.062413 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 4372081172384c9f96388d38208d9853 (DEFAULT_TABLE table=default.Table_b6faf540da644f658eb715d3ffacd616 [id=8ebd35bd7b464cd489f6a15d0e70800e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.062614 28954 tablet_service.cc:1511] Processing CreateTablet for tablet e5003302863d4390b423054685c8c24b (DEFAULT_TABLE table=default.Table_321214072f004f76a346e51f39acde1f [id=4bed2d5737114eeda76e61e6a4a3fddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.067052 29063 leader_election.cc:304] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:03.067466 30569 raft_consensus.cc:2749] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:03.073464 30635 tablet.cc:1724] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:03.074447 30556 raft_consensus.cc:493] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.076200 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5884c83d394c40008c2d2c7ee5dcf2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.077059 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4372081172384c9f96388d38208d9853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.077751 29375 tablet_replica.cc:333] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:03.077939 29375 raft_consensus.cc:2243] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.078075 29375 raft_consensus.cc:2272] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.076411 30556 raft_consensus.cc:515] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.078560 29375 ts_tablet_manager.cc:1916] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.080155 30555 raft_consensus.cc:515] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.080297 28985 raft_consensus.cc:2468] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:03.080729 30555 leader_election.cc:290] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:03.080988 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5003302863d4390b423054685c8c24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.083341 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1562c10a72f4bb2b8f88d79fb75f6ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.084331 29377 ts_tablet_manager.cc:1929] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:03.084475 29377 log.cc:1199] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/c12ea6cac8d44b4b8d41e3e33e0fd6cb
I20260617 20:17:03.084870 29377 ts_tablet_manager.cc:1950] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:03.085280 30556 leader_election.cc:290] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:03.088630 29235 tablet_service.cc:1511] Processing CreateTablet for tablet c1562c10a72f4bb2b8f88d79fb75f6ff (DEFAULT_TABLE table=default.Table_5970f728d64e408e83358eb27947ecc7 [id=673bf1a902ce4f54938b68a4c5cd01a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.088970 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1562c10a72f4bb2b8f88d79fb75f6ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.098309 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19bce310bd24294b063b3b4f76b9f99" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:03.098510 29117 raft_consensus.cc:2468] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:03.099004 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4372081172384c9f96388d38208d9853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.099213 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5003302863d4390b423054685c8c24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.099495 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7534d57f1740af8b211d646488c90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.101420 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 084bd5befcae496a93a5111f844a28ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.101784 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48caf549502b4493b73ba33aeccc1a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.102171 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1562c10a72f4bb2b8f88d79fb75f6ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.102342 29198 leader_election.cc:304] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:17:03.102530 28925 consensus_peers.cc:597] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:03.102681 30555 raft_consensus.cc:2804] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 20:17:03.102948 30555 raft_consensus.cc:493] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:03.103024 30555 raft_consensus.cc:3060] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Advancing to term 2
I20260617 20:17:03.103915 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed593a3fa7742a18ccc2124c3ee0fb9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:03.104431 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 4372081172384c9f96388d38208d9853 (DEFAULT_TABLE table=default.Table_b6faf540da644f658eb715d3ffacd616 [id=8ebd35bd7b464cd489f6a15d0e70800e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.104770 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4372081172384c9f96388d38208d9853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.105266 29383 tablet_bootstrap.cc:492] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:03.105463 29383 ts_tablet_manager.cc:1403] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.084s user 0.005s sys 0.000s
W20260617 20:17:03.105700 29198 leader_election.cc:343] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.106527 29383 raft_consensus.cc:359] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.106694 29383 raft_consensus.cc:385] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.106748 29383 raft_consensus.cc:740] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.106954 29383 consensus_queue.cc:260] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.107470 29383 ts_tablet_manager.cc:1434] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:03.107723 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf884e801d74362ad05435a76efcc1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.107730 29383 tablet_bootstrap.cc:492] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:03.113667 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7534d57f1740af8b211d646488c90f (DEFAULT_TABLE table=default.Table_1b519a3c00d6483097bb906c3bb288dc [id=30c5ab49c17f429686ebd9f937c0c9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.114005 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7534d57f1740af8b211d646488c90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.130098 29242 tablet_service.cc:1511] Processing CreateTablet for tablet e5003302863d4390b423054685c8c24b (DEFAULT_TABLE table=default.Table_321214072f004f76a346e51f39acde1f [id=4bed2d5737114eeda76e61e6a4a3fddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.130575 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5003302863d4390b423054685c8c24b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.134819 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
I20260617 20:17:03.135218 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet e79c6804fbb34f5baebdb366f2e0b1bf
I20260617 20:17:03.139858 29383 tablet_bootstrap.cc:654] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.141891 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet e79c6804fbb34f5baebdb366f2e0b1bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:17:03.137663 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1bf654918dc148cdbca0e420e337478b consensus state has no leader
I20260617 20:17:03.142886 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_62b5e2225918452592675fc7e49ea2e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:03.149725 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:03.150319 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]). Expected version 1 got 0
W20260617 20:17:03.149989 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62b5e2225918452592675fc7e49ea2e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.152066 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet c3014c93d6804f3896f452f041cbedc9 (table default.Table_01fded33682b4e3f91e9f6e6e92031f6 [id=0a278273a6004aa7947a19674e45d123]). Expected version 3 got 0
I20260617 20:17:03.154204 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_088c2b4ca59e4dd49f684c9f6648bc57"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.155087 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_088c2b4ca59e4dd49f684c9f6648bc57 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.171556 28667 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet c3014c93d6804f3896f452f041cbedc9 (table default.Table_01fded33682b4e3f91e9f6e6e92031f6 [id=0a278273a6004aa7947a19674e45d123]). Expected version 3 got 0
I20260617 20:17:03.172461 28667 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
I20260617 20:17:03.173586 28970 tablet_service.cc:1558] Processing DeleteTablet for tablet e79c6804fbb34f5baebdb366f2e0b1bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.174084 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 5d93449f5d5d41fb9883db3bce10f969 (DEFAULT_TABLE table=default.Table_ef916ebf00b449979408f9dab4fb264e [id=3b1ee3a0a7f54dfd921749144e963305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.175616 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 5884c83d394c40008c2d2c7ee5dcf2d7 (DEFAULT_TABLE table=default.Table_74a72450663a45a99d4b9e8a250bd9db [id=1d4c9a9b22e44723ae5c2ed384191a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.177246 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 739) took 3521 ms. Trace:
I20260617 20:17:03.177434 29377 rpcz_store.cc:276] 0617 20:16:59.655929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.657272 (+ 1343us) service_pool.cc:224] Handling call
0617 20:17:02.914954 (+3257682us) ts_tablet_manager.cc:1151] Deleting tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb
0617 20:17:02.914977 (+ 23us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:02.990457 (+ 75480us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.084269 (+ 93812us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.177231 (+ 92962us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3257432}
I20260617 20:17:03.178225 30555 raft_consensus.cc:515] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.182651 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb (table default.Table_fe54346acedc4aee9fe8151c12a389fc [id=32c61aa9610e428fa8d5c794b078e0a1]) successfully deleted
I20260617 20:17:03.177946 29377 tablet_replica.cc:333] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:03.183178 29377 raft_consensus.cc:2243] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.183422 29377 raft_consensus.cc:2272] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.184656 29377 ts_tablet_manager.cc:1916] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.184870 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet b4240e14b48f4a43b7ce9c6512fc7ff2 with delete_type TABLET_DATA_DELETED (replaced by tablet cb8f218e9f2d44bfbfd843ac8517a152) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.185617 30555 leader_election.cc:290] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:03.187455 29383 tablet_bootstrap.cc:492] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:03.187597 29383 ts_tablet_manager.cc:1403] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.080s user 0.006s sys 0.001s
I20260617 20:17:03.188097 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet e79c6804fbb34f5baebdb366f2e0b1bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:03.188412 29383 raft_consensus.cc:359] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.188580 29383 raft_consensus.cc:385] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.188642 29383 raft_consensus.cc:740] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.188844 29383 consensus_queue.cc:260] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.188931 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.189364 29383 ts_tablet_manager.cc:1434] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:03.189662 29383 tablet_bootstrap.cc:492] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:03.190038 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 5884c83d394c40008c2d2c7ee5dcf2d7 (DEFAULT_TABLE table=default.Table_74a72450663a45a99d4b9e8a250bd9db [id=1d4c9a9b22e44723ae5c2ed384191a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.190421 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5884c83d394c40008c2d2c7ee5dcf2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.191327 29383 tablet_bootstrap.cc:654] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.192375 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.192965 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19bce310bd24294b063b3b4f76b9f99" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:03.193120 29116 raft_consensus.cc:3060] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Advancing to term 2
I20260617 20:17:03.196036 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet cf8d04ef8acd4fcaa69df9253cd89462 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.198589 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 5d93449f5d5d41fb9883db3bce10f969 (DEFAULT_TABLE table=default.Table_ef916ebf00b449979408f9dab4fb264e [id=3b1ee3a0a7f54dfd921749144e963305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.197767 29197 leader_election.cc:304] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:03.199891 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48caf549502b4493b73ba33aeccc1a5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.200388 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7534d57f1740af8b211d646488c90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.201000 30555 raft_consensus.cc:2804] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:03.201121 30555 raft_consensus.cc:697] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:03.201390 30555 consensus_queue.cc:237] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.202291 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d93449f5d5d41fb9883db3bce10f969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.202782 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5884c83d394c40008c2d2c7ee5dcf2d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.203293 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 488b06f05d9b4273a61bcb2d6e0ad796 with delete_type TABLET_DATA_DELETED (replaced by tablet 0f3032155e4e4ea8a23984f547d78752) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.203545 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.213536 29378 tablet_bootstrap.cc:492] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:03.214479 29378 ts_tablet_manager.cc:1403] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.234s user 0.024s sys 0.001s
I20260617 20:17:03.218741 29383 tablet_bootstrap.cc:492] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:03.219034 29383 ts_tablet_manager.cc:1403] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.001s
I20260617 20:17:03.219676 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb with delete_type TABLET_DATA_DELETED (replaced by tablet 77f685eeac48402888cbc8ef97fb4b94) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.221140 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed593a3fa7742a18ccc2124c3ee0fb9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:03.221335 28985 raft_consensus.cc:3060] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.225445 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet f4de5dafb1474de1911148bb3b4527cf with delete_type TABLET_DATA_DELETED (replaced by tablet e7eb77c619e04c448a084638668dbb6a) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.226161 29379 tablet_bootstrap.cc:492] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:03.226305 29379 ts_tablet_manager.cc:1403] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.318s user 0.010s sys 0.006s
I20260617 20:17:03.227056 29379 raft_consensus.cc:359] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.227219 29379 raft_consensus.cc:385] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.227272 29379 raft_consensus.cc:740] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.227470 29379 consensus_queue.cc:260] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.228075 29383 raft_consensus.cc:359] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.228451 29383 raft_consensus.cc:385] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.228641 29383 raft_consensus.cc:740] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.229065 29383 consensus_queue.cc:260] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.231606 29379 ts_tablet_manager.cc:1434] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 20:17:03.231897 29379 tablet_bootstrap.cc:492] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:03.231334 29383 ts_tablet_manager.cc:1434] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260617 20:17:03.233320 29379 tablet_bootstrap.cc:654] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.234175 30641 tablet.cc:1724] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:03.234498 29378 raft_consensus.cc:359] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.236179 29383 tablet_bootstrap.cc:492] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:03.236565 29378 raft_consensus.cc:385] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.237411 29378 raft_consensus.cc:740] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.239164 29378 consensus_queue.cc:260] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.244567 29378 ts_tablet_manager.cc:1434] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.029s user 0.002s sys 0.001s
I20260617 20:17:03.246912 29378 tablet_bootstrap.cc:492] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.248916 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_33c8a66e7ef746d4ad74e64b0e4a656d" } modify_external_catalogs: true
I20260617 20:17:03.249126 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_33c8a66e7ef746d4ad74e64b0e4a656d" } modify_external_catalogs: true
I20260617 20:17:03.251045 29383 tablet_bootstrap.cc:654] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.251588 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 91c99389d24d4a8d8c934f0a9b9c2825
I20260617 20:17:03.252143 28665 catalog_manager.cc:6784] ReplaceTablet: tablet 91c99389d24d4a8d8c934f0a9b9c2825 deleted and replaced by tablet 2860409277a0423cadadd79363713fd3
I20260617 20:17:03.252628 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 91c99389d24d4a8d8c934f0a9b9c2825 with delete_type TABLET_DATA_DELETED (replaced by tablet 2860409277a0423cadadd79363713fd3) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.252597 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e1570318e62a4455991ccbddfea26e31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.253153 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1570318e62a4455991ccbddfea26e31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.258059 29378 tablet_bootstrap.cc:654] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:03.259526 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 consensus state has no leader
I20260617 20:17:03.259930 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_11103f92f9184eae915572b6fcf56089" } modify_external_catalogs: true
I20260617 20:17:03.260138 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_11103f92f9184eae915572b6fcf56089" } modify_external_catalogs: true
I20260617 20:17:03.261549 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet add6e21cef3b4c02910486841e36ce4a
I20260617 20:17:03.262266 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 5a09fbb3e8eb4b66acba0d6b572713ef from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:03.263039 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet add6e21cef3b4c02910486841e36ce4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:17:03.263574 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71049338f673401bad32204d232bfe43 consensus state has no leader
I20260617 20:17:03.263949 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8c9ad175c7d645afb125d140eb250bfc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.264535 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c9ad175c7d645afb125d140eb250bfc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.267313 29090 tablet_service.cc:1558] Processing DeleteTablet for tablet 91c99389d24d4a8d8c934f0a9b9c2825 with delete_type TABLET_DATA_DELETED (replaced by tablet 2860409277a0423cadadd79363713fd3) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.267467 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet add6e21cef3b4c02910486841e36ce4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.269550 29379 tablet_bootstrap.cc:492] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:03.269676 29379 ts_tablet_manager.cc:1403] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.001s
I20260617 20:17:03.271977 29379 raft_consensus.cc:359] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.272202 29379 raft_consensus.cc:385] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.272259 29379 raft_consensus.cc:740] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.272449 29379 consensus_queue.cc:260] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.273044 29379 ts_tablet_manager.cc:1434] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:17:03.273330 29379 tablet_bootstrap.cc:492] T b5241ab75a034ee3b57c07185835a858 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:03.275004 29379 tablet_bootstrap.cc:654] T b5241ab75a034ee3b57c07185835a858 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.276368 29378 tablet_bootstrap.cc:492] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:03.277168 29378 ts_tablet_manager.cc:1403] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.001s
I20260617 20:17:03.280369 29383 tablet_bootstrap.cc:492] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:03.280467 29116 raft_consensus.cc:2468] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 2.
I20260617 20:17:03.280529 29383 ts_tablet_manager.cc:1403] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.002s
I20260617 20:17:03.281387 29383 raft_consensus.cc:359] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.281478 29198 leader_election.cc:304] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:03.281571 29383 raft_consensus.cc:385] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.281627 29383 raft_consensus.cc:740] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.281777 30555 raft_consensus.cc:2804] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260617 20:17:03.281805 29383 consensus_queue.cc:260] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.282514 30410 raft_consensus.cc:515] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.282528 30555 raft_consensus.cc:697] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:03.283057 30410 leader_election.cc:290] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:03.283290 29383 ts_tablet_manager.cc:1434] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260617 20:17:03.283306 30555 consensus_queue.cc:237] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.283988 28985 raft_consensus.cc:2468] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:03.285104 29383 tablet_bootstrap.cc:492] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:03.287037 29383 tablet_bootstrap.cc:654] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.291002 29375 ts_tablet_manager.cc:1929] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:03.291093 29375 log.cc:1199] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/c8d373f177494f1486fcae4a67a13041
I20260617 20:17:03.291417 29375 ts_tablet_manager.cc:1950] T c8d373f177494f1486fcae4a67a13041 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:03.293848 29378 raft_consensus.cc:359] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.294059 29378 raft_consensus.cc:385] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.294111 29378 raft_consensus.cc:740] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.294302 29378 consensus_queue.cc:260] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.295028 29378 ts_tablet_manager.cc:1434] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.017s user 0.001s sys 0.000s
I20260617 20:17:03.295038 29116 raft_consensus.cc:3060] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.295338 29378 tablet_bootstrap.cc:492] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.297041 29378 tablet_bootstrap.cc:654] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.314421 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8fa9f4c40b4ce9baa27a8837d3575c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:03.315387 30546 raft_consensus.cc:493] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.315542 30546 raft_consensus.cc:515] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.316133 30546 leader_election.cc:290] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.316636 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa123fc62a594dd19f20b520760fe6c4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:03.317392 29378 tablet_bootstrap.cc:492] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
W20260617 20:17:03.317534 28925 leader_election.cc:343] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.317582 29378 ts_tablet_manager.cc:1403] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.004s
I20260617 20:17:03.318467 29378 raft_consensus.cc:359] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.318840 28667 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_fe8f1bae47eb40e8b88f9832e8b127b3 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 4 got 3
W20260617 20:17:03.320360 29198 leader_election.cc:343] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.321086 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 5d93449f5d5d41fb9883db3bce10f969 (DEFAULT_TABLE table=default.Table_ef916ebf00b449979408f9dab4fb264e [id=3b1ee3a0a7f54dfd921749144e963305]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:03.321177 30635 tablet.cc:1724] T d4130f3529ef4adaa4cedf12e53b6895 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:03.321835 29378 raft_consensus.cc:385] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.322243 29378 raft_consensus.cc:740] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.322539 30637 tablet.cc:1724] T d4130f3529ef4adaa4cedf12e53b6895 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:03.323796 29378 consensus_queue.cc:260] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.327364 29378 ts_tablet_manager.cc:1434] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260617 20:17:03.329128 29378 tablet_bootstrap.cc:492] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.329099 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6a488f8547fe46278096d8acc2c1753f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.329744 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a488f8547fe46278096d8acc2c1753f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.331306 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d1285d94ca754303ba4dedcdaae5af7a" } modify_external_catalogs: true
I20260617 20:17:03.331480 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d1285d94ca754303ba4dedcdaae5af7a" } modify_external_catalogs: true
I20260617 20:17:03.333077 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4efc16d51f0249de859da13faef23f7a" } new_table_name: "default.Table_d99a8e190b524b4086d8c7686477e583" modify_external_catalogs: true
I20260617 20:17:03.339890 29378 tablet_bootstrap.cc:654] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.341111 29227 tablet_service.cc:1558] Processing DeleteTablet for tablet add6e21cef3b4c02910486841e36ce4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:03.342022 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d93449f5d5d41fb9883db3bce10f969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:03.343611 30314 consensus_queue.cc:1048] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:03.345810 29197 leader_election.cc:343] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b19bce310bd24294b063b3b4f76b9f99
W20260617 20:17:03.346920 29197 consensus_peers.cc:597] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:03.347076 29377 ts_tablet_manager.cc:1929] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:03.347193 29377 log.cc:1199] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/b4240e14b48f4a43b7ce9c6512fc7ff2
I20260617 20:17:03.347537 30294 raft_consensus.cc:493] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.347568 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8fa9f4c40b4ce9baa27a8837d3575c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:03.347726 28985 raft_consensus.cc:3060] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.347666 30294 raft_consensus.cc:515] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.348248 30294 leader_election.cc:290] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.348493 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 670) took 5267 ms. Trace:
I20260617 20:17:03.348574 29375 rpcz_store.cc:276] 0617 20:16:58.081100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.089370 (+ 8270us) service_pool.cc:224] Handling call
0617 20:17:03.072314 (+4982944us) ts_tablet_manager.cc:1151] Deleting tablet c8d373f177494f1486fcae4a67a13041
0617 20:17:03.077707 (+ 5393us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x61800000ed18. stack: 00007fedbe6d0496 00007fedbe6d0250 00007fedbd6fb3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fedbe6c5f2d 00007fedbe6c6f9e 00007fedd257b1ad 00007fedd24fa1d3 00007fedce683e96 00007fedce685229 00007fedce6b8bb4 00007fedce6995d0 00007fedce69935d 0000000000aa681c
0617 20:17:03.077716 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.178814 (+101098us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.290936 (+112122us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.348477 (+ 57541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11783040,"tablet-delete.queue_time_us":4920532}
W20260617 20:17:03.348762 29197 leader_election.cc:343] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: b19bce310bd24294b063b3b4f76b9f99
I20260617 20:17:03.348981 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 673) took 4944 ms. Trace:
I20260617 20:17:03.349047 29375 rpcz_store.cc:276] 0617 20:16:58.404821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.405429 (+ 608us) service_pool.cc:224] Handling call
0617 20:17:03.348866 (+4943437us) ts_tablet_manager.cc:1151] Deleting tablet 0916139a64df436fafa18c7e86fbf91c
0617 20:17:03.348875 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.348967 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4943109}
I20260617 20:17:03.349363 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 674) took 4929 ms. Trace:
I20260617 20:17:03.349426 29375 rpcz_store.cc:276] 0617 20:16:58.419496 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.426228 (+ 6732us) service_pool.cc:224] Handling call
0617 20:17:03.349244 (+4923016us) ts_tablet_manager.cc:1151] Deleting tablet 0eaa60028a1647e580a987c3a0836a24
0617 20:17:03.349253 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.349350 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4922788}
I20260617 20:17:03.349669 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 675) took 4910 ms. Trace:
I20260617 20:17:03.349721 29375 rpcz_store.cc:276] 0617 20:16:58.439547 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.439959 (+ 412us) service_pool.cc:224] Handling call
0617 20:17:03.349591 (+4909632us) ts_tablet_manager.cc:1151] Deleting tablet 29a176d1f3b0446984af141e02bac329
0617 20:17:03.349598 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.349659 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4873024}
I20260617 20:17:03.349952 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 677) took 4893 ms. Trace:
I20260617 20:17:03.350031 29375 rpcz_store.cc:276] 0617 20:16:58.456946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.457013 (+ 67us) service_pool.cc:224] Handling call
0617 20:17:03.349874 (+4892861us) ts_tablet_manager.cc:1151] Deleting tablet 65747872eaac450cb3b8efb3a2d2694f
0617 20:17:03.349880 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.349940 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4873164}
I20260617 20:17:03.350292 28985 raft_consensus.cc:2468] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:03.350322 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 679) took 4821 ms. Trace:
I20260617 20:17:03.350381 29375 rpcz_store.cc:276] 0617 20:16:58.529038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.529088 (+ 50us) service_pool.cc:224] Handling call
0617 20:17:03.350238 (+4821150us) ts_tablet_manager.cc:1151] Deleting tablet f5387e3c30b24cb285ea5cc657981321
0617 20:17:03.350246 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.350309 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4820977}
I20260617 20:17:03.350593 29375 tablet_replica.cc:333] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:03.350790 29375 raft_consensus.cc:2243] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.350966 29375 raft_consensus.cc:2272] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.351500 29375 ts_tablet_manager.cc:1916] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.351527 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet c8d373f177494f1486fcae4a67a13041 (table default.Table_fb580c3d4089464aa53ff2360464aaae [id=9abd27ea648b4d3f9fb79584fe4e9fb8]) successfully deleted
W20260617 20:17:03.351819 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 0916139a64df436fafa18c7e86fbf91c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0916139a64df436fafa18c7e86fbf91c already in progress: creating tablet
I20260617 20:17:03.351997 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d93449f5d5d41fb9883db3bce10f969. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:03.352038 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 0eaa60028a1647e580a987c3a0836a24 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0eaa60028a1647e580a987c3a0836a24 already in progress: creating tablet
W20260617 20:17:03.352223 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 29a176d1f3b0446984af141e02bac329 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 29a176d1f3b0446984af141e02bac329 already in progress: creating tablet
W20260617 20:17:03.352550 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 65747872eaac450cb3b8efb3a2d2694f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65747872eaac450cb3b8efb3a2d2694f already in progress: creating tablet
I20260617 20:17:03.352582 30410 consensus_queue.cc:1048] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:03.352883 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet f5387e3c30b24cb285ea5cc657981321 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f5387e3c30b24cb285ea5cc657981321 already in progress: creating tablet
I20260617 20:17:03.352914 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet 91c99389d24d4a8d8c934f0a9b9c2825 with delete_type TABLET_DATA_DELETED (replaced by tablet 2860409277a0423cadadd79363713fd3) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:03.347572 29377 ts_tablet_manager.cc:1950] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:03.354058 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 740) took 3696 ms. Trace:
I20260617 20:17:03.354156 29377 rpcz_store.cc:276] 0617 20:16:59.657761 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.657820 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:03.177907 (+3520087us) ts_tablet_manager.cc:1151] Deleting tablet b4240e14b48f4a43b7ce9c6512fc7ff2
0617 20:17:03.177916 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.315551 (+137635us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.347015 (+ 31464us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.354035 (+ 7020us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3519941}
I20260617 20:17:03.354651 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet b4240e14b48f4a43b7ce9c6512fc7ff2 (table default.Table_d3c4a4f115524492993663ad7da2da7a [id=c35dbd440308443187b41417db2068f9]) successfully deleted
W20260617 20:17:03.356922 29062 leader_election.cc:343] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: af9c687fe56f42af82dd4728ca53cd32
I20260617 20:17:03.357867 29383 tablet_bootstrap.cc:492] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:03.358006 29383 ts_tablet_manager.cc:1403] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.073s user 0.007s sys 0.002s
I20260617 20:17:03.358001 29197 leader_election.cc:304] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:03.363085 30410 raft_consensus.cc:2804] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:03.363205 30410 raft_consensus.cc:697] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:03.363415 30410 consensus_queue.cc:237] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.364214 28670 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]). Expected version 1 got 0
I20260617 20:17:03.364414 28670 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:03.364668 28670 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_fe8f1bae47eb40e8b88f9832e8b127b3 [id=d037cdc970c044ec92ca7b0b46be209f]). Expected version 4 got 3
I20260617 20:17:03.364871 28670 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
I20260617 20:17:03.367005 29383 raft_consensus.cc:359] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.367259 29383 raft_consensus.cc:385] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.367465 29383 raft_consensus.cc:740] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.367944 29383 consensus_queue.cc:260] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.369156 29383 ts_tablet_manager.cc:1434] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20260617 20:17:03.369858 29383 tablet_bootstrap.cc:492] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:03.370704 29375 ts_tablet_manager.cc:1929] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:03.372198 29375 log.cc:1199] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/c21b585707b146ed9c015d150d858681
I20260617 20:17:03.372699 29375 ts_tablet_manager.cc:1950] T c21b585707b146ed9c015d150d858681 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:03.373016 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 692) took 4508 ms. Trace:
I20260617 20:17:03.373152 29375 rpcz_store.cc:276] 0617 20:16:58.864077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.864373 (+ 296us) service_pool.cc:224] Handling call
0617 20:17:03.350554 (+4486181us) ts_tablet_manager.cc:1151] Deleting tablet c21b585707b146ed9c015d150d858681
0617 20:17:03.350561 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.364469 (+ 13908us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.370651 (+ 6182us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.372997 (+ 2346us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4452879}
I20260617 20:17:03.373922 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet c21b585707b146ed9c015d150d858681 (table default.Table_fbaeb71321364cca9f5c971ee3419519 [id=cd2fab71637e4b968e9957070c30c936]) successfully deleted
I20260617 20:17:03.376284 29375 tablet_replica.cc:333] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:03.376498 29375 raft_consensus.cc:2243] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.376705 29375 raft_consensus.cc:2272] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.377233 29375 ts_tablet_manager.cc:1916] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.379684 29378 tablet_bootstrap.cc:492] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:03.379873 29378 ts_tablet_manager.cc:1403] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.001s
I20260617 20:17:03.380998 29378 raft_consensus.cc:359] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.381247 29378 raft_consensus.cc:385] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.381368 29378 raft_consensus.cc:740] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.381635 29378 consensus_queue.cc:260] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.381882 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d9677bc184c30be1a11bfa85a97c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.382233 29378 ts_tablet_manager.cc:1434] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:03.387836 29383 tablet_bootstrap.cc:654] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.390172 29379 tablet_bootstrap.cc:492] T b5241ab75a034ee3b57c07185835a858 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:03.390297 29379 ts_tablet_manager.cc:1403] T b5241ab75a034ee3b57c07185835a858 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.117s user 0.002s sys 0.004s
I20260617 20:17:03.391052 29379 raft_consensus.cc:359] T b5241ab75a034ee3b57c07185835a858 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.391216 29379 raft_consensus.cc:385] T b5241ab75a034ee3b57c07185835a858 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.391278 29379 raft_consensus.cc:740] T b5241ab75a034ee3b57c07185835a858 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.391491 29379 consensus_queue.cc:260] T b5241ab75a034ee3b57c07185835a858 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.391984 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa123fc62a594dd19f20b520760fe6c4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:03.392187 29258 raft_consensus.cc:2468] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:03.392405 29377 tablet_replica.cc:333] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:03.392526 29379 ts_tablet_manager.cc:1434] T b5241ab75a034ee3b57c07185835a858 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:17:03.392625 29377 raft_consensus.cc:2243] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.392795 29379 tablet_bootstrap.cc:492] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:03.392786 29377 raft_consensus.cc:2272] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.393409 29377 ts_tablet_manager.cc:1916] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:03.398386 29063 consensus_peers.cc:597] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f9844fab126448895c4c9d4c3c78d76. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:03.401114 29379 tablet_bootstrap.cc:654] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.408890 28925 leader_election.cc:304] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:03.409384 30546 raft_consensus.cc:2804] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:03.409495 30546 raft_consensus.cc:493] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:03.409590 30546 raft_consensus.cc:3060] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.410153 29378 tablet_bootstrap.cc:492] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.411892 29378 tablet_bootstrap.cc:654] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.412060 30546 raft_consensus.cc:515] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.412662 30546 leader_election.cc:290] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.414242 29377 ts_tablet_manager.cc:1929] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:03.414952 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa123fc62a594dd19f20b520760fe6c4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:03.419149 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d192d11683dc4b558cd3c3f965e657f9
I20260617 20:17:03.421346 29377 log.cc:1199] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/cf8d04ef8acd4fcaa69df9253cd89462
I20260617 20:17:03.421777 29377 ts_tablet_manager.cc:1950] T cf8d04ef8acd4fcaa69df9253cd89462 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:03.422307 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c141dde259d44f4c88db5236190259a7
I20260617 20:17:03.422921 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5a09fbb3e8eb4b66acba0d6b572713ef
I20260617 20:17:03.423969 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fcd950bebde64e8bafd0dae2ec3f7149"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:03.429440 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet d192d11683dc4b558cd3c3f965e657f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.429688 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet c141dde259d44f4c88db5236190259a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:17:03.430581 28925 leader_election.cc:343] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.430651 29376 ts_tablet_manager.cc:1929] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:03.430981 29376 log.cc:1199] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/13ba94ec9e27403b974e5e6fea46e59e
I20260617 20:17:03.431782 29376 ts_tablet_manager.cc:1950] T 13ba94ec9e27403b974e5e6fea46e59e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:03.432154 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 703) took 4489 ms. Trace:
I20260617 20:17:03.434172 29378 tablet_bootstrap.cc:492] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:03.434391 29378 ts_tablet_manager.cc:1403] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.003s
I20260617 20:17:03.435369 29378 raft_consensus.cc:359] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.435622 29376 rpcz_store.cc:276] 0617 20:16:58.943130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.943177 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:02.974628 (+4031451us) ts_tablet_manager.cc:1151] Deleting tablet 13ba94ec9e27403b974e5e6fea46e59e
0617 20:17:02.974637 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.026779 (+ 52142us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.430588 (+403809us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.432134 (+ 1546us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4031288}
I20260617 20:17:03.435936 29378 raft_consensus.cc:385] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.436082 29378 raft_consensus.cc:740] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.436357 29376 tablet_replica.cc:333] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:03.436656 29378 consensus_queue.cc:260] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.437117 29376 raft_consensus.cc:2243] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.437613 29378 ts_tablet_manager.cc:1434] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:17:03.437826 29376 raft_consensus.cc:2272] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.440116 29376 ts_tablet_manager.cc:1916] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.448395 29379 tablet_bootstrap.cc:492] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:03.448558 29379 ts_tablet_manager.cc:1403] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.000s
I20260617 20:17:03.449278 29378 tablet_bootstrap.cc:492] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.449450 29379 raft_consensus.cc:359] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.449620 29379 raft_consensus.cc:385] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.449674 29379 raft_consensus.cc:740] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.451896 29375 ts_tablet_manager.cc:1929] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:03.453711 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 742) took 3715 ms. Trace:
I20260617 20:17:03.453830 29377 rpcz_store.cc:276] 0617 20:16:59.737803 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.737857 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:03.354462 (+3616605us) ts_tablet_manager.cc:1151] Deleting tablet cf8d04ef8acd4fcaa69df9253cd89462
0617 20:17:03.392343 (+ 37881us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.396300 (+ 3957us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.414164 (+ 17864us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.453656 (+ 39492us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3616426}
I20260617 20:17:03.454272 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 752) took 2496 ms. Trace:
I20260617 20:17:03.454356 29377 rpcz_store.cc:276] 0617 20:17:00.957644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.957701 (+ 57us) service_pool.cc:224] Handling call
0617 20:17:03.454117 (+2496416us) ts_tablet_manager.cc:1151] Deleting tablet 1ed860fa375848708beb31ff89056214
0617 20:17:03.454126 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.454224 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2496214}
I20260617 20:17:03.454383 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet cf8d04ef8acd4fcaa69df9253cd89462 (table default.Table_4de9b511b49b48cca1674d8532df65cd [id=7ba43f49c1924ed0acfb4c453dc8d0f9]) successfully deleted
I20260617 20:17:03.454633 29377 tablet_replica.cc:333] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:03.454849 29377 raft_consensus.cc:2243] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 20:17:03.454856 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 1ed860fa375848708beb31ff89056214 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ed860fa375848708beb31ff89056214 already in progress: creating tablet
I20260617 20:17:03.455022 29377 raft_consensus.cc:2272] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.455567 29377 ts_tablet_manager.cc:1916] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.458460 29378 tablet_bootstrap.cc:654] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:03.465483 29198 consensus_peers.cc:597] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:03.468194 28669 master_service.cc:960] ReplaceTablet: received request to replace tablet 14a5e5917a414c99b25ea2efeab4063d from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:03.468436 29377 ts_tablet_manager.cc:1929] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:03.468746 28666 catalog_manager.cc:6784] ReplaceTablet: tablet 5a09fbb3e8eb4b66acba0d6b572713ef deleted and replaced by tablet dfa3b652083d4112b69d305ba90730a9
I20260617 20:17:03.469100 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ac91b73059814eb6b58292b2e1558ace" } new_table_name: "default.Table_213292c85f774f9cadad87077963c82a" modify_external_catalogs: true
I20260617 20:17:03.471657 29376 ts_tablet_manager.cc:1929] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:03.472544 29376 log.cc:1199] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/d2db0467c5e64e38961d3b0e66375544
I20260617 20:17:03.473805 29376 ts_tablet_manager.cc:1950] T d2db0467c5e64e38961d3b0e66375544 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:03.474727 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 704) took 4531 ms. Trace:
I20260617 20:17:03.477803 29376 rpcz_store.cc:276] 0617 20:16:58.943521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.943568 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:03.436306 (+4492738us) ts_tablet_manager.cc:1151] Deleting tablet d2db0467c5e64e38961d3b0e66375544
0617 20:17:03.436316 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.443240 (+ 6924us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.471577 (+ 28337us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.474696 (+ 3119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4492588}
I20260617 20:17:03.470860 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a09fbb3e8eb4b66acba0d6b572713ef with delete_type TABLET_DATA_DELETED (replaced by tablet dfa3b652083d4112b69d305ba90730a9) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.478289 29376 tablet_replica.cc:333] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:03.478322 29377 log.cc:1199] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/64bb6d176a4845eca312848ae5104647
I20260617 20:17:03.478560 29376 raft_consensus.cc:2243] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 LEADER]: Raft consensus shutting down.
I20260617 20:17:03.479001 29377 ts_tablet_manager.cc:1950] T 64bb6d176a4845eca312848ae5104647 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:03.478971 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_87e22bfc578e47a49cb67beea659b86e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.479679 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87e22bfc578e47a49cb67beea659b86e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.479889 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 753) took 2488 ms. Trace:
I20260617 20:17:03.480083 29376 pending_rounds.cc:70] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:17:03.480230 29376 pending_rounds.cc:77] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7297955525774409728 op_type: NO_OP noop_request { }
I20260617 20:17:03.480418 29376 raft_consensus.cc:2889] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:03.480592 29376 raft_consensus.cc:2272] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.480587 29378 tablet_bootstrap.cc:492] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:03.480671 29375 log.cc:1199] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/b3278efaad07403ca0a2baecad46d0f1
I20260617 20:17:03.471692 29099 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a09fbb3e8eb4b66acba0d6b572713ef with delete_type TABLET_DATA_DELETED (replaced by tablet dfa3b652083d4112b69d305ba90730a9) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.480777 29378 ts_tablet_manager.cc:1403] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.007s
I20260617 20:17:03.473553 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet c141dde259d44f4c88db5236190259a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.479350 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet d192d11683dc4b558cd3c3f965e657f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.451203 29379 consensus_queue.cc:260] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.481630 29379 ts_tablet_manager.cc:1434] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s
I20260617 20:17:03.481592 29378 raft_consensus.cc:359] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.481783 29378 raft_consensus.cc:385] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.481863 29378 raft_consensus.cc:740] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:17:03.482122 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcd950bebde64e8bafd0dae2ec3f7149 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.482151 29379 tablet_bootstrap.cc:492] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:03.482088 29378 consensus_queue.cc:260] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.484740 29378 ts_tablet_manager.cc:1434] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
W20260617 20:17:03.484903 29198 consensus_peers.cc:597] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:03.485050 29378 tablet_bootstrap.cc:492] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.486719 29378 tablet_bootstrap.cc:654] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.487558 29377 rpcz_store.cc:276] 0617 20:17:00.991139 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.991196 (+ 57us) service_pool.cc:224] Handling call
0617 20:17:03.454572 (+2463376us) ts_tablet_manager.cc:1151] Deleting tablet 64bb6d176a4845eca312848ae5104647
0617 20:17:03.454580 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.465632 (+ 11052us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.468371 (+ 2739us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.479853 (+ 11482us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2463199}
I20260617 20:17:03.488096 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 754) took 2350 ms. Trace:
I20260617 20:17:03.488185 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 64bb6d176a4845eca312848ae5104647 (table default.Table_12cb16608a854819a7e0834654f128bb [id=6e89910c5d7a4969a79960d34eff437c]) successfully deleted
I20260617 20:17:03.488243 29377 rpcz_store.cc:276] 0617 20:17:01.138031 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.138095 (+ 64us) service_pool.cc:224] Handling call
0617 20:17:03.487956 (+2349861us) ts_tablet_manager.cc:1151] Deleting tablet 5a20867de1214c0fb4cb8504e8361c5b
0617 20:17:03.487965 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.488060 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2349666}
W20260617 20:17:03.488826 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5a20867de1214c0fb4cb8504e8361c5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a20867de1214c0fb4cb8504e8361c5b already in progress: creating tablet
I20260617 20:17:03.489256 29379 tablet_bootstrap.cc:654] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.489262 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 755) took 1646 ms. Trace:
I20260617 20:17:03.489457 29377 rpcz_store.cc:276] 0617 20:17:01.842426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.842482 (+ 56us) service_pool.cc:224] Handling call
0617 20:17:03.489116 (+1646634us) ts_tablet_manager.cc:1151] Deleting tablet 06680ddfee82464da4926e51dadd00a5
0617 20:17:03.489127 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.489215 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1646423}
W20260617 20:17:03.489956 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 06680ddfee82464da4926e51dadd00a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06680ddfee82464da4926e51dadd00a5 already in progress: creating tablet
I20260617 20:17:03.490365 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 756) took 1593 ms. Trace:
I20260617 20:17:03.490549 29376 ts_tablet_manager.cc:1916] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.487597 29375 ts_tablet_manager.cc:1950] T b3278efaad07403ca0a2baecad46d0f1 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:03.495260 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 693) took 4631 ms. Trace:
I20260617 20:17:03.504951 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a09fbb3e8eb4b66acba0d6b572713ef with delete_type TABLET_DATA_DELETED (replaced by tablet dfa3b652083d4112b69d305ba90730a9) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:03.505642 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet c141dde259d44f4c88db5236190259a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:03.504848 29375 rpcz_store.cc:276] 0617 20:16:58.864154 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.864580 (+ 426us) service_pool.cc:224] Handling call
0617 20:17:03.374257 (+4509677us) ts_tablet_manager.cc:1151] Deleting tablet b3278efaad07403ca0a2baecad46d0f1
0617 20:17:03.376245 (+ 1988us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.436127 (+ 59882us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.451825 (+ 15698us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.495234 (+ 43409us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4476509}
I20260617 20:17:03.505990 29227 tablet_service.cc:1558] Processing DeleteTablet for tablet d192d11683dc4b558cd3c3f965e657f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:03.508306 30410 consensus_queue.cc:1048] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:03.511102 29383 tablet_bootstrap.cc:492] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:03.511068 29375 tablet_replica.cc:333] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:03.511308 29383 ts_tablet_manager.cc:1403] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.142s user 0.003s sys 0.002s
I20260617 20:17:03.513408 29375 raft_consensus.cc:2243] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:03.510372 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet b3278efaad07403ca0a2baecad46d0f1 (table default.Table_ec9b81dbecf641cf9110b33876e99612 [id=35f8afdc04fb4a1ebb52996f33d62d43]) successfully deleted
I20260617 20:17:03.490491 29377 rpcz_store.cc:276] 0617 20:17:01.896767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.896826 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:03.490236 (+1593410us) ts_tablet_manager.cc:1151] Deleting tablet b002468734394d8181543368ac878c6f
0617 20:17:03.490244 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.490331 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1593248}
I20260617 20:17:03.518811 29375 pending_rounds.cc:70] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
W20260617 20:17:03.519469 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet b002468734394d8181543368ac878c6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b002468734394d8181543368ac878c6f already in progress: creating tablet
I20260617 20:17:03.519589 29375 pending_rounds.cc:77] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955508270600192 op_type: NO_OP noop_request { }
I20260617 20:17:03.519991 29375 raft_consensus.cc:2889] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:03.520052 29377 tablet_replica.cc:333] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:03.520502 29377 raft_consensus.cc:2243] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.522284 30641 tablet.cc:1724] T d4130f3529ef4adaa4cedf12e53b6895 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:03.522640 29377 raft_consensus.cc:2272] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.523430 29377 ts_tablet_manager.cc:1916] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.527205 29375 raft_consensus.cc:2272] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.527827 29375 ts_tablet_manager.cc:1916] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.529026 29377 ts_tablet_manager.cc:1929] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:03.529048 29383 raft_consensus.cc:359] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.530036 29383 raft_consensus.cc:385] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.530572 29383 raft_consensus.cc:740] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.531144 29383 consensus_queue.cc:260] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.532732 29383 ts_tablet_manager.cc:1434] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.021s user 0.002s sys 0.002s
I20260617 20:17:03.533507 29383 tablet_bootstrap.cc:492] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:03.537595 29379 tablet_bootstrap.cc:492] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:03.537735 29379 ts_tablet_manager.cc:1403] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.001s
I20260617 20:17:03.541636 29197 leader_election.cc:304] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:03.542743 30555 raft_consensus.cc:2804] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:03.543025 30556 consensus_queue.cc:1048] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:03.543289 30555 raft_consensus.cc:697] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:03.543576 30555 consensus_queue.cc:237] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.549070 30569 raft_consensus.cc:493] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.549213 30569 raft_consensus.cc:515] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.549880 30569 leader_election.cc:290] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.535765 29378 tablet_bootstrap.cc:492] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:03.550222 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24e4b91def8642b7a8a063c06f43e060" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:03.552358 29378 ts_tablet_manager.cc:1403] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.067s user 0.004s sys 0.000s
I20260617 20:17:03.553194 29378 raft_consensus.cc:359] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.553407 29378 raft_consensus.cc:385] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.553494 29378 raft_consensus.cc:740] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.553716 29378 consensus_queue.cc:260] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.554029 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3f7fdf1b1e004f69b2631f83900e4619" } modify_external_catalogs: true
I20260617 20:17:03.554214 29378 ts_tablet_manager.cc:1434] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:03.554235 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3f7fdf1b1e004f69b2631f83900e4619" } modify_external_catalogs: true
I20260617 20:17:03.554546 29377 log.cc:1199] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/c17aa7f99fc74838b9975c3e9289ccfd
I20260617 20:17:03.554895 29377 ts_tablet_manager.cc:1950] T c17aa7f99fc74838b9975c3e9289ccfd P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:17:03.555335 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 160dbee15c874758b461f9a7b7ee5d59 consensus state has no leader
I20260617 20:17:03.555419 29378 tablet_bootstrap.cc:492] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.555744 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f7130590729b49af9644f1ffa516fe05" } new_table_name: "default.Table_b25f36c0ba1247f5a4b85a5b4add8420" modify_external_catalogs: true
I20260617 20:17:03.557173 29378 tablet_bootstrap.cc:654] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.559758 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d5e5d246ea0e474e81edfc7e88001321
I20260617 20:17:03.560406 30410 raft_consensus.cc:493] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.560464 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f0db2ca25413465891e96ea21ba8f22a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:03.560592 30410 raft_consensus.cc:515] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:03.560973 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0db2ca25413465891e96ea21ba8f22a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.561376 30410 leader_election.cc:290] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:03.562285 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet d5e5d246ea0e474e81edfc7e88001321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.562314 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f239f81c40743b2aaa70a361997db77" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:03.563079 29198 leader_election.cc:343] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.563408 29379 raft_consensus.cc:359] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.563654 29379 raft_consensus.cc:385] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.563771 29379 raft_consensus.cc:740] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.564033 29379 consensus_queue.cc:260] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.565339 29379 ts_tablet_manager.cc:1434] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.028s user 0.002s sys 0.000s
I20260617 20:17:03.565860 29379 tablet_bootstrap.cc:492] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:03.565852 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet d5e5d246ea0e474e81edfc7e88001321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.568395 29376 ts_tablet_manager.cc:1929] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260617 20:17:03.568578 29376 log.cc:1199] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/b19bce310bd24294b063b3b4f76b9f99
I20260617 20:17:03.569034 29376 ts_tablet_manager.cc:1950] T b19bce310bd24294b063b3b4f76b9f99 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:03.570852 29037 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:03.572319 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_efb89ae603ed4713a25716af39bf03c3" } new_table_name: "default.Table_0ea7c7718805448cbcc37cfd8539684e" modify_external_catalogs: true
I20260617 20:17:03.570590 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 705) took 4626 ms. Trace:
I20260617 20:17:03.576082 29376 rpcz_store.cc:276] 0617 20:16:58.944037 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.944083 (+ 46us) service_pool.cc:224] Handling call
0617 20:17:03.478216 (+4534133us) ts_tablet_manager.cc:1151] Deleting tablet b19bce310bd24294b063b3b4f76b9f99
0617 20:17:03.478228 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.493384 (+ 15156us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.567957 (+ 74573us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.570557 (+ 2600us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4751,"tablet-delete.queue_time_us":4533972}
I20260617 20:17:03.579399 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 710) took 4531 ms. Trace:
I20260617 20:17:03.579559 29376 rpcz_store.cc:276] 0617 20:16:59.047948 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.061045 (+ 13097us) service_pool.cc:224] Handling call
0617 20:17:03.577578 (+4516533us) ts_tablet_manager.cc:1151] Deleting tablet 3b00d3c0adcf48a48ba3d7a3de018b80
0617 20:17:03.577588 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.579356 (+ 1768us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4514964}
I20260617 20:17:03.580026 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 711) took 4518 ms. Trace:
W20260617 20:17:03.581424 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a522f064b9f944d1802f8b730f208ed0 consensus state has no leader
I20260617 20:17:03.581677 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 6ea0168fa86547f68c7fec880b8d8f1e from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:03.581632 29376 rpcz_store.cc:276] 0617 20:16:59.061536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.061597 (+ 61us) service_pool.cc:224] Handling call
0617 20:17:03.579904 (+4518307us) ts_tablet_manager.cc:1151] Deleting tablet fe6c261318b24a6caa3a376215f44f0f
0617 20:17:03.579913 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.579990 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4517166}
I20260617 20:17:03.582175 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 712) took 4520 ms. Trace:
I20260617 20:17:03.582340 29376 rpcz_store.cc:276] 0617 20:16:59.061626 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.063811 (+ 2185us) service_pool.cc:224] Handling call
0617 20:17:03.582043 (+4518232us) ts_tablet_manager.cc:1151] Deleting tablet 5eedf2442f964048b7a3a460b6b22f2a
0617 20:17:03.582052 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.582136 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4518055}
I20260617 20:17:03.582630 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 757) took 1661 ms. Trace:
I20260617 20:17:03.582787 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 713) took 4518 ms. Trace:
I20260617 20:17:03.582959 29376 rpcz_store.cc:276] 0617 20:16:59.064926 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.067591 (+ 2665us) service_pool.cc:224] Handling call
0617 20:17:03.582642 (+4515051us) ts_tablet_manager.cc:1151] Deleting tablet 91fac788a74346e28f7b7e5939459325
0617 20:17:03.582654 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.582737 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4514827}
W20260617 20:17:03.583287 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2860409277a0423cadadd79363713fd3 has no consensus state
I20260617 20:17:03.583686 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f47ba95e589c47759a3ca685e8e9a067"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:03.585500 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 717) took 4470 ms. Trace:
W20260617 20:17:03.586674 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f47ba95e589c47759a3ca685e8e9a067 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.585881 29376 rpcz_store.cc:276] 0617 20:16:59.114578 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.114766 (+ 188us) service_pool.cc:224] Handling call
0617 20:17:03.585365 (+4470599us) ts_tablet_manager.cc:1151] Deleting tablet ebd98889d08f4683ba4b2ee98a74254d
0617 20:17:03.585376 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.585458 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4470408}
I20260617 20:17:03.588356 29376 tablet_replica.cc:333] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:03.588496 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5c012c3bc3674a6a84abd599c0b09e5e" } modify_external_catalogs: true
I20260617 20:17:03.588673 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5c012c3bc3674a6a84abd599c0b09e5e" } modify_external_catalogs: true
I20260617 20:17:03.588707 29376 raft_consensus.cc:2243] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:03.589149 29376 raft_consensus.cc:2272] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.589288 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_81c229ec2c314f8c8f4fa879c0470861" } new_table_name: "default.Table_d02f66937c674c3598da361d82db321f" modify_external_catalogs: true
I20260617 20:17:03.590018 29376 ts_tablet_manager.cc:1916] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.593078 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c67156b0dace4897967975f7f41f09fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.593679 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c67156b0dace4897967975f7f41f09fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.599336 29376 ts_tablet_manager.cc:1929] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:03.599538 29376 log.cc:1199] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/dcd999d88d954e50810cc01b297a27a9
I20260617 20:17:03.600132 29376 ts_tablet_manager.cc:1950] T dcd999d88d954e50810cc01b297a27a9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:03.600566 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 719) took 4209 ms. Trace:
I20260617 20:17:03.600733 29376 rpcz_store.cc:276] 0617 20:16:59.391097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.391526 (+ 429us) service_pool.cc:224] Handling call
0617 20:17:03.588274 (+4196748us) ts_tablet_manager.cc:1151] Deleting tablet dcd999d88d954e50810cc01b297a27a9
0617 20:17:03.588288 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.594637 (+ 6349us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.598919 (+ 4282us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.600528 (+ 1609us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4196579}
I20260617 20:17:03.601239 29376 tablet_replica.cc:333] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:03.601708 29376 raft_consensus.cc:2243] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.601979 29376 raft_consensus.cc:2272] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.602721 29376 ts_tablet_manager.cc:1916] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.605250 30294 raft_consensus.cc:493] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.605443 30294 raft_consensus.cc:515] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.606153 30294 leader_election.cc:290] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.606551 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 13ba94ec9e27403b974e5e6fea46e59e (table default.Table_6791b989125046d893a9c24ae1e65c12 [id=e495b17f9a99422e9e29cf49befb762a]) successfully deleted
I20260617 20:17:03.606841 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet d2db0467c5e64e38961d3b0e66375544 (table default.Table_3a768181eca84e2f9d6eb43239795801 [id=d18d30df8d4644899355b7c8c2f387e6]) successfully deleted
W20260617 20:17:03.610946 29063 leader_election.cc:343] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: af9c687fe56f42af82dd4728ca53cd32
I20260617 20:17:03.611083 29063 leader_election.cc:304] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:03.608641 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5faea831376646c1bdfcaf8fbbc7ca6d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:03.611809 28985 raft_consensus.cc:2393] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:03.612142 29377 rpcz_store.cc:276] 0617 20:17:01.921572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.921764 (+ 192us) service_pool.cc:224] Handling call
0617 20:17:03.519965 (+1598201us) ts_tablet_manager.cc:1151] Deleting tablet c17aa7f99fc74838b9975c3e9289ccfd
0617 20:17:03.519977 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.526298 (+ 6321us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.528963 (+ 2665us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.582575 (+ 53612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816,"tablet-delete.queue_time_us":1595180}
I20260617 20:17:03.612572 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet c17aa7f99fc74838b9975c3e9289ccfd (table default.Table_762c733e4f8445ad97f36fc9ee70147a [id=f62d71842e284523bbca857af62a367a]) successfully deleted
I20260617 20:17:03.613011 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 758) took 1676 ms. Trace:
I20260617 20:17:03.613111 29377 rpcz_store.cc:276] 0617 20:17:01.936978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.937031 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:03.612868 (+1675837us) ts_tablet_manager.cc:1151] Deleting tablet c3496887f6a045e293698d09d9cc1c16
0617 20:17:03.612881 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.612968 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1675670}
I20260617 20:17:03.613242 30294 raft_consensus.cc:493] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:17:03.613622 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet c3496887f6a045e293698d09d9cc1c16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3496887f6a045e293698d09d9cc1c16 already in progress: creating tablet
I20260617 20:17:03.613692 30294 raft_consensus.cc:515] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.613969 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 759) took 1634 ms. Trace:
I20260617 20:17:03.614060 29377 rpcz_store.cc:276] 0617 20:17:01.979917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.979971 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:03.613845 (+1633874us) ts_tablet_manager.cc:1151] Deleting tablet 06680ddfee82464da4926e51dadd00a5
0617 20:17:03.613854 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.613929 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1620403}
I20260617 20:17:03.614269 30294 leader_election.cc:290] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:03.614464 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 06680ddfee82464da4926e51dadd00a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06680ddfee82464da4926e51dadd00a5 already in progress: creating tablet
I20260617 20:17:03.614948 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090b8720e5df447aa0da147bd8dfaa8c" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:03.615566 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 761) took 1559 ms. Trace:
I20260617 20:17:03.615679 29377 rpcz_store.cc:276] 0617 20:17:02.055696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.081266 (+ 25570us) service_pool.cc:224] Handling call
0617 20:17:03.615407 (+1534141us) ts_tablet_manager.cc:1151] Deleting tablet d44524b02e6f4c1291bca50e9261459b
0617 20:17:03.615418 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.615522 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1533888}
W20260617 20:17:03.616143 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d44524b02e6f4c1291bca50e9261459b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d44524b02e6f4c1291bca50e9261459b already in progress: creating tablet
I20260617 20:17:03.616473 29377 tablet_replica.cc:333] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:03.616736 29377 raft_consensus.cc:2243] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:03.617157 29377 raft_consensus.cc:2272] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.623601 29379 tablet_bootstrap.cc:654] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:03.627228 29198 consensus_peers.cc:597] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:03.629534 29378 tablet_bootstrap.cc:492] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:03.629719 29378 ts_tablet_manager.cc:1403] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.074s user 0.007s sys 0.002s
I20260617 20:17:03.630574 29378 raft_consensus.cc:359] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.630813 29378 raft_consensus.cc:385] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.630888 29378 raft_consensus.cc:740] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.632309 30294 raft_consensus.cc:2749] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:03.637247 29383 tablet_bootstrap.cc:654] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.638963 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet b19bce310bd24294b063b3b4f76b9f99 (table default.Table_5716b279b26c4d29a3259333d3661d7d [id=e0633fd70c974a2d8ec482e122a7cd55]) successfully deleted
W20260617 20:17:03.639369 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3b00d3c0adcf48a48ba3d7a3de018b80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b00d3c0adcf48a48ba3d7a3de018b80 already in progress: creating tablet
I20260617 20:17:03.639379 30555 raft_consensus.cc:493] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.639525 30555 raft_consensus.cc:515] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:03.639642 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet fe6c261318b24a6caa3a376215f44f0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe6c261318b24a6caa3a376215f44f0f already in progress: creating tablet
W20260617 20:17:03.639899 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5eedf2442f964048b7a3a460b6b22f2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eedf2442f964048b7a3a460b6b22f2a already in progress: creating tablet
I20260617 20:17:03.640141 30555 leader_election.cc:290] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:03.640139 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 91fac788a74346e28f7b7e5939459325 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91fac788a74346e28f7b7e5939459325 already in progress: creating tablet
W20260617 20:17:03.640374 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet ebd98889d08f4683ba4b2ee98a74254d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebd98889d08f4683ba4b2ee98a74254d already in progress: creating tablet
W20260617 20:17:03.644240 29063 consensus_peers.cc:597] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2db0467c5e64e38961d3b0e66375544. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:03.644901 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02529cd1e764a3886de27d86e9690e3" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:03.645495 29121 raft_consensus.cc:3060] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.647197 29378 consensus_queue.cc:260] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.647889 29377 ts_tablet_manager.cc:1916] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:03.650478 29198 leader_election.cc:343] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.650733 29378 ts_tablet_manager.cc:1434] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.021s user 0.000s sys 0.002s
I20260617 20:17:03.651134 29378 tablet_bootstrap.cc:492] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.654527 30314 raft_consensus.cc:493] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.654726 30314 raft_consensus.cc:515] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:03.654985 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05e5918dcafc4accb0345a8389b65412 consensus state has no leader
I20260617 20:17:03.655517 30314 leader_election.cc:290] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.655419 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c2d261c0ee9147409da728ff7de82e89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.656106 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2d261c0ee9147409da728ff7de82e89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.657963 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_122065b5c3db4c0eae386133c84b7940"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.658501 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_122065b5c3db4c0eae386133c84b7940 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.660213 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_143ae9e7e1ec4c7abc9cd48b0623f7b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.660775 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_143ae9e7e1ec4c7abc9cd48b0623f7b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.676563 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa123fc62a594dd19f20b520760fe6c4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:03.676779 29258 raft_consensus.cc:3060] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.678218 29377 ts_tablet_manager.cc:1929] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:03.678345 29377 log.cc:1199] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/7efe079091784d7e8035659edd442ba6
I20260617 20:17:03.679396 29258 raft_consensus.cc:2468] T fa123fc62a594dd19f20b520760fe6c4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:03.683835 29378 tablet_bootstrap.cc:654] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.683951 29375 ts_tablet_manager.cc:1929] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:03.684047 29375 log.cc:1199] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/1a725364bb9646e6bc80fc4f67d04a16
I20260617 20:17:03.684389 29375 ts_tablet_manager.cc:1950] T 1a725364bb9646e6bc80fc4f67d04a16 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:03.684698 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 694) took 4820 ms. Trace:
I20260617 20:17:03.684772 29375 rpcz_store.cc:276] 0617 20:16:58.864219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.864669 (+ 450us) service_pool.cc:224] Handling call
0617 20:17:03.510814 (+4646145us) ts_tablet_manager.cc:1151] Deleting tablet 1a725364bb9646e6bc80fc4f67d04a16
0617 20:17:03.510923 (+ 109us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.569312 (+ 58389us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.683897 (+114585us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.684682 (+ 785us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4613016}
I20260617 20:17:03.685206 29375 tablet_replica.cc:333] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:03.685395 29375 raft_consensus.cc:2243] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.685540 29375 raft_consensus.cc:2272] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.686008 29375 ts_tablet_manager.cc:1916] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.689538 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 1a725364bb9646e6bc80fc4f67d04a16 (table default.Table_8c70a2be0e4b406880787a57850701ca [id=a8259ff095ae4a3e99259235698d998f]) successfully deleted
I20260617 20:17:03.690775 30683 raft_consensus.cc:493] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.691323 29119 raft_consensus.cc:3060] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.691769 30677 raft_consensus.cc:493] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.691941 30677 raft_consensus.cc:515] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.692458 30683 raft_consensus.cc:515] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.692638 30677 leader_election.cc:290] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.693656 30683 leader_election.cc:290] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:03.691493 29118 raft_consensus.cc:3060] T b5241ab75a034ee3b57c07185835a858 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.693804 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb0759ee9a34f3d96623bbe6dcc46d9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:03.695955 28925 leader_election.cc:343] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.697374 29377 ts_tablet_manager.cc:1950] T 7efe079091784d7e8035659edd442ba6 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:03.697897 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 764) took 1499 ms. Trace:
I20260617 20:17:03.699029 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f823290351d542179b8bcc683d7acf6a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:03.699523 29377 rpcz_store.cc:276] 0617 20:17:02.198176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.198548 (+ 372us) service_pool.cc:224] Handling call
0617 20:17:03.616401 (+1417853us) ts_tablet_manager.cc:1151] Deleting tablet 7efe079091784d7e8035659edd442ba6
0617 20:17:03.616413 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.675214 (+ 58801us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.678138 (+ 2924us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.697855 (+ 19717us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1383330}
I20260617 20:17:03.699676 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3032155e4e4ea8a23984f547d78752" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:03.700646 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 7efe079091784d7e8035659edd442ba6 (table default.Table_6bb71611d01f469a95325bc9bbcd5251 [id=f0df4d60a326473a8fc3d040ed7324d7]) successfully deleted
I20260617 20:17:03.701212 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 769) took 1433 ms. Trace:
W20260617 20:17:03.702126 28655 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 80bc9fa552114c2f90f77c67ab63b0e6 (table default.Table_00f049c59fbd43bc8134a419c3d654a5 [id=da1befcdf0ba45d1b52d9236dfbbde60], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 80bc9fa552114c2f90f77c67ab63b0e6 has no consensus state
I20260617 20:17:03.702886 29377 rpcz_store.cc:276] 0617 20:17:02.268152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.268203 (+ 51us) service_pool.cc:224] Handling call
0617 20:17:03.701036 (+1432833us) ts_tablet_manager.cc:1151] Deleting tablet 403095586c704ecaa2a9931295bd1330
0617 20:17:03.701047 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.701162 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1432596}
I20260617 20:17:03.703374 29383 tablet_bootstrap.cc:492] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
W20260617 20:17:03.703548 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 403095586c704ecaa2a9931295bd1330 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 403095586c704ecaa2a9931295bd1330 already in progress: creating tablet
W20260617 20:17:03.703558 28925 leader_election.cc:343] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:03.703537 29198 leader_election.cc:343] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.702759 29378 tablet_bootstrap.cc:492] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:03.704128 29378 ts_tablet_manager.cc:1403] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.003s
I20260617 20:17:03.704180 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb0759ee9a34f3d96623bbe6dcc46d9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:03.704320 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f823290351d542179b8bcc683d7acf6a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:03.704404 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet d5e5d246ea0e474e81edfc7e88001321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:03.704648 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24e4b91def8642b7a8a063c06f43e060" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:03.704666 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5faea831376646c1bdfcaf8fbbc7ca6d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:03.705199 28925 leader_election.cc:304] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:03.703538 29383 ts_tablet_manager.cc:1403] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.170s user 0.004s sys 0.000s
I20260617 20:17:03.705515 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "090b8720e5df447aa0da147bd8dfaa8c" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:03.706504 30314 raft_consensus.cc:2804] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:03.706676 30314 raft_consensus.cc:697] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:03.706895 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3032155e4e4ea8a23984f547d78752" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:03.707104 28987 raft_consensus.cc:2468] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:03.706984 30314 consensus_queue.cc:237] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.707762 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02529cd1e764a3886de27d86e9690e3" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:03.710357 28989 raft_consensus.cc:2468] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:03.715636 29378 raft_consensus.cc:359] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.715847 29378 raft_consensus.cc:385] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.715937 29378 raft_consensus.cc:740] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.724704 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cdb98c9b862142e289f947e9d07a2a53"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.725286 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdb98c9b862142e289f947e9d07a2a53 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.726688 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet c83fa97268f045d6aa60413dfa96ebbd from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:03.728259 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f8f0f1f6368e4ae786c176f3dbc29a8a" } modify_external_catalogs: true
I20260617 20:17:03.728408 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f8f0f1f6368e4ae786c176f3dbc29a8a" } modify_external_catalogs: true
I20260617 20:17:03.733919 30683 consensus_queue.cc:1048] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:03.733919 30555 consensus_queue.cc:1048] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:03.734375 30683 raft_consensus.cc:493] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.734509 30683 raft_consensus.cc:515] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.735132 30683 leader_election.cc:290] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:03.735950 30683 consensus_queue.cc:1048] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:03.736043 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d0e2ecc16e4285a1d8337a5336caf2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:03.736560 29198 leader_election.cc:343] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.736727 30423 consensus_queue.cc:1048] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:03.735452 29383 raft_consensus.cc:359] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.743007 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_59007bd54d0f4bc291fa36712918f213" } modify_external_catalogs: true
I20260617 20:17:03.743224 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_59007bd54d0f4bc291fa36712918f213" } modify_external_catalogs: true
I20260617 20:17:03.739044 29383 raft_consensus.cc:385] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.747340 29383 raft_consensus.cc:740] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
W20260617 20:17:03.747136 29197 leader_election.cc:343] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 7f239f81c40743b2aaa70a361997db77
I20260617 20:17:03.749897 29197 leader_election.cc:304] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:03.752413 30423 raft_consensus.cc:2749] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:03.751329 29383 consensus_queue.cc:260] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.718146 29378 consensus_queue.cc:260] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.756340 29378 ts_tablet_manager.cc:1434] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.052s user 0.001s sys 0.001s
I20260617 20:17:03.756822 29378 tablet_bootstrap.cc:492] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.759169 29378 tablet_bootstrap.cc:654] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.764108 30641 tablet.cc:1724] T ba3ad8de250a47da9c9a31dff7f495b5 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:03.765455 30698 raft_consensus.cc:493] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.765633 30698 raft_consensus.cc:515] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.766064 29377 tablet_replica.cc:333] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:03.766299 30698 leader_election.cc:290] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.765254 29383 ts_tablet_manager.cc:1434] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.059s user 0.004s sys 0.000s
I20260617 20:17:03.770073 30423 consensus_queue.cc:1048] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:03.773420 29383 tablet_bootstrap.cc:492] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:03.772450 29197 leader_election.cc:304] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:03.784396 30423 raft_consensus.cc:2804] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260617 20:17:03.784616 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 78907.3us
I20260617 20:17:03.784765 30423 raft_consensus.cc:493] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:03.784968 30423 raft_consensus.cc:3060] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.785593 30637 tablet.cc:1724] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:03.788064 30423 raft_consensus.cc:515] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.789538 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3032155e4e4ea8a23984f547d78752" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:03.790108 29198 leader_election.cc:343] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:03.791247 28925 leader_election.cc:343] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.791471 28925 leader_election.cc:304] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:03.792011 28925 leader_election.cc:343] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.792199 28925 leader_election.cc:304] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:03.791170 29197 leader_election.cc:304] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:03.792541 30677 raft_consensus.cc:2749] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:03.792732 30677 raft_consensus.cc:2749] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:03.793758 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938b61a0f6dc4d178971034fd18c1674" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:03.794479 30683 raft_consensus.cc:2804] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:03.794839 29116 raft_consensus.cc:3060] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:03.794819 28925 leader_election.cc:343] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.795928 30635 tablet.cc:1724] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:03.796645 30683 raft_consensus.cc:493] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:03.796787 30683 raft_consensus.cc:3060] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.797446 29063 leader_election.cc:304] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:03.798841 29063 leader_election.cc:304] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:03.800390 30683 raft_consensus.cc:515] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.801425 30678 raft_consensus.cc:493] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.801631 30678 raft_consensus.cc:515] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.802301 30678 leader_election.cc:290] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:03.802639 30683 leader_election.cc:290] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:03.805686 29127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeae97639fd4e6290768dae12f6a4ce" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:03.805727 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02529cd1e764a3886de27d86e9690e3" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:03.805929 29063 leader_election.cc:304] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:03.806442 29198 leader_election.cc:343] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:03.806726 29198 leader_election.cc:343] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.816262 29375 ts_tablet_manager.cc:1929] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:03.816476 29375 log.cc:1199] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/640f53137c21443cbfc274c084ce13ef
I20260617 20:17:03.816902 29375 ts_tablet_manager.cc:1950] T 640f53137c21443cbfc274c084ce13ef P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:03.817529 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 695) took 4953 ms. Trace:
I20260617 20:17:03.817708 29375 rpcz_store.cc:276] 0617 20:16:58.864314 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.864747 (+ 433us) service_pool.cc:224] Handling call
0617 20:17:03.685162 (+4820415us) ts_tablet_manager.cc:1151] Deleting tablet 640f53137c21443cbfc274c084ce13ef
0617 20:17:03.685170 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.724317 (+ 39147us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.816196 (+ 91879us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.817505 (+ 1309us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4787327}
I20260617 20:17:03.818380 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 640f53137c21443cbfc274c084ce13ef (table default.Table_7d193ca323a14554af974ae3b173fa07 [id=2d1a8cb755fb4625b83e93bca0e70898]) successfully deleted
I20260617 20:17:03.818982 29375 tablet_replica.cc:333] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:03.819316 29375 raft_consensus.cc:2243] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:03.819655 29375 pending_rounds.cc:70] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:17:03.819749 29375 pending_rounds.cc:77] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955507821776896 op_type: NO_OP noop_request { }
I20260617 20:17:03.819886 29375 raft_consensus.cc:2889] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:03.820009 29375 raft_consensus.cc:2272] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.820199 29383 tablet_bootstrap.cc:654] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.826624 30637 tablet.cc:1724] T e58fbec4a9f14ddda42b5a4c0263972c P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:03.826823 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938b61a0f6dc4d178971034fd18c1674" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:03.830578 29379 tablet_bootstrap.cc:492] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:03.830737 29379 ts_tablet_manager.cc:1403] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.265s user 0.009s sys 0.003s
I20260617 20:17:03.831498 30637 tablet.cc:1719] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:03.831631 29379 raft_consensus.cc:359] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.831810 29379 raft_consensus.cc:385] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.831880 29379 raft_consensus.cc:740] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.832145 30569 raft_consensus.cc:2749] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:03.832849 29379 consensus_queue.cc:260] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.833973 29379 ts_tablet_manager.cc:1434] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:03.838030 30423 leader_election.cc:290] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:03.841187 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 3e11c8b69b704e959e4463f565bf89ab
I20260617 20:17:03.841724 29378 tablet_bootstrap.cc:492] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:03.841884 29378 ts_tablet_manager.cc:1403] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.003s
I20260617 20:17:03.842198 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fc2cdea718fc4d83ab66e9c4d231a8f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:03.842620 29378 raft_consensus.cc:359] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:03.842772 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc2cdea718fc4d83ab66e9c4d231a8f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.842806 29378 raft_consensus.cc:385] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.842877 29378 raft_consensus.cc:740] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.844215 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e11c8b69b704e959e4463f565bf89ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.851644 28986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d0e2ecc16e4285a1d8337a5336caf2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:03.851913 28986 raft_consensus.cc:2468] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:03.853336 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 519719a748f441c58689172dffb54394
I20260617 20:17:03.854295 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_322d72936e094dd184fd2d62cdb77743" } new_table_name: "default.Table_1be0a0d75ff04898884097a3fee41047" modify_external_catalogs: true
I20260617 20:17:03.856418 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 519719a748f441c58689172dffb54394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.856500 29377 raft_consensus.cc:2243] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:03.861495 30314 raft_consensus.cc:493] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.861737 30314 raft_consensus.cc:515] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.863507 30314 leader_election.cc:290] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.864207 29377 raft_consensus.cc:2272] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:03.864856 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26be48e94e504f489743b58516257e84 consensus state has no leader
I20260617 20:17:03.865922 29377 ts_tablet_manager.cc:1916] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.865269 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0f470f9601d84ae29158e563c73bce2d" } modify_external_catalogs: true
I20260617 20:17:03.866955 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0f470f9601d84ae29158e563c73bce2d" } modify_external_catalogs: true
I20260617 20:17:03.866331 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_563901834a78414a94502af30f72e0d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.867844 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_563901834a78414a94502af30f72e0d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.868897 30637 tablet.cc:1724] T ba3ad8de250a47da9c9a31dff7f495b5 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:03.882210 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_519cbb2c93394f968d1b274487015f44"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.883049 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_519cbb2c93394f968d1b274487015f44 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.887547 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3032155e4e4ea8a23984f547d78752" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:03.887795 28990 raft_consensus.cc:3060] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.890241 30423 raft_consensus.cc:493] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.890434 28990 raft_consensus.cc:2468] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:03.890497 30423 raft_consensus.cc:515] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.835207 30569 raft_consensus.cc:493] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:03.891631 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203666e6127b49ed92731bc87ce01798" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:03.891580 30569 raft_consensus.cc:515] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.891701 30423 leader_election.cc:290] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:17:03.892050 29198 leader_election.cc:343] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.892282 30569 leader_election.cc:290] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:03.843187 30635 tablet.cc:1724] T ba3ad8de250a47da9c9a31dff7f495b5 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:03.845042 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e11c8b69b704e959e4463f565bf89ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.854421 30193 raft_consensus.cc:2749] T 090b8720e5df447aa0da147bd8dfaa8c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:03.857189 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 519719a748f441c58689172dffb54394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:03.864866 30294 raft_consensus.cc:2749] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:03.895625 29378 consensus_queue.cc:260] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.896201 29378 ts_tablet_manager.cc:1434] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.054s user 0.002s sys 0.000s
I20260617 20:17:03.896502 29378 tablet_bootstrap.cc:492] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.896920 30641 tablet.cc:1724] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:03.898240 29378 tablet_bootstrap.cc:654] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.898355 30635 tablet.cc:1724] T e58fbec4a9f14ddda42b5a4c0263972c P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:03.901767 30711 tablet.cc:1719] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:03.904807 29376 ts_tablet_manager.cc:1929] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:03.905032 29376 log.cc:1199] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/fc36f62aa0bf46278cb84ec8cb7eef55
I20260617 20:17:03.905546 29376 ts_tablet_manager.cc:1950] T fc36f62aa0bf46278cb84ec8cb7eef55 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:03.905947 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 731) took 4404 ms. Trace:
I20260617 20:17:03.906108 29376 rpcz_store.cc:276] 0617 20:16:59.501852 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.540052 (+ 38200us) service_pool.cc:224] Handling call
0617 20:17:03.601167 (+4061115us) ts_tablet_manager.cc:1151] Deleting tablet fc36f62aa0bf46278cb84ec8cb7eef55
0617 20:17:03.601179 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.776508 (+175329us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.904719 (+128211us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.905902 (+ 1183us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4060888}
I20260617 20:17:03.906656 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 735) took 4364 ms. Trace:
I20260617 20:17:03.906807 29376 rpcz_store.cc:276] 0617 20:16:59.542581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.542635 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:03.906516 (+4363881us) ts_tablet_manager.cc:1151] Deleting tablet 88ab6fe7319940fcabd315193c51e199
0617 20:17:03.906526 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.906621 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4363715}
I20260617 20:17:03.907182 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 738) took 4362 ms. Trace:
I20260617 20:17:03.907315 29376 rpcz_store.cc:276] 0617 20:16:59.544899 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.544953 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:03.907067 (+4362114us) ts_tablet_manager.cc:1151] Deleting tablet 5f6435bac04e472c99e81b6e7e9a6012
0617 20:17:03.907075 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.907138 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4361937}
I20260617 20:17:03.914258 29375 ts_tablet_manager.cc:1916] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.918469 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 6ea0168fa86547f68c7fec880b8d8f1e
I20260617 20:17:03.874392 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370db89a92a6455190edaf80e5a56205" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:03.919647 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ea0168fa86547f68c7fec880b8d8f1e with delete_type TABLET_DATA_DELETED (replaced by tablet 0b194772c9054192b7639cbab5f86ca8) from {username='slave'} at 127.0.0.1:43332
W20260617 20:17:03.920230 28925 leader_election.cc:343] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.920939 29379 tablet_bootstrap.cc:492] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:03.921602 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeae97639fd4e6290768dae12f6a4ce" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:03.921859 28989 raft_consensus.cc:2468] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:03.923167 29379 tablet_bootstrap.cc:654] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:03.924705 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203666e6127b49ed92731bc87ce01798" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:03.924886 28983 raft_consensus.cc:2468] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:03.925414 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f02529cd1e764a3886de27d86e9690e3" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:03.925628 28989 raft_consensus.cc:3060] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:03.926476 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet fc36f62aa0bf46278cb84ec8cb7eef55 (table default.Table_486a2491b91d4d4899c49ae5065acbcd [id=fe4c16ade5a04cc5b67a89de3e4ec53d]) successfully deleted
W20260617 20:17:03.926767 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 88ab6fe7319940fcabd315193c51e199 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88ab6fe7319940fcabd315193c51e199 already in progress: creating tablet
I20260617 20:17:03.928536 28989 raft_consensus.cc:2468] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:03.929132 28665 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 (table default.Table_9cd011070f8848eeb76b111f2e64f60f [id=475aa0d2f8044cd8b52cf31085dda15d]). Expected version 1 got 0
I20260617 20:17:03.931871 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_654bcfb3ac7749e48f76f25e93335840" } new_table_name: "default.Table_0016b41ee33e4881852a29e9a5ae7da1" modify_external_catalogs: true
W20260617 20:17:03.933463 30424 log.cc:927] Time spent T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Append to log took a long time: real 0.116s user 0.001s sys 0.001s
I20260617 20:17:03.934049 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d673bc9892c94725b270ef3b9dc768f4 (table default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330]). Expected version 1 got 0
I20260617 20:17:03.935429 29175 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:03.935429 28670 catalog_manager.cc:5696] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } }
I20260617 20:17:03.936039 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]). Expected version 2 got 0
I20260617 20:17:03.937605 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]). Expected version 1 got 0
I20260617 20:17:03.938181 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:03.938211 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed593a3fa7742a18ccc2124c3ee0fb9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:03.938534 28990 raft_consensus.cc:2393] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:03.939249 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ea0168fa86547f68c7fec880b8d8f1e with delete_type TABLET_DATA_DELETED (replaced by tablet 0b194772c9054192b7639cbab5f86ca8) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.940878 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet ead0291870a443d9b76ea919a45a4303 (table default.Table_d353f219381d4d17a2927a233465454c [id=0ef22e22306747b28d49d58d0fa45620]). Expected version 4 got 0
I20260617 20:17:03.941452 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet ba3ad8de250a47da9c9a31dff7f495b5 (table default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]). Expected version 2 got 0
W20260617 20:17:03.919368 29198 consensus_peers.cc:597] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:03.931370 28667 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_fe8f1bae47eb40e8b88f9832e8b127b3 [id=d037cdc970c044ec92ca7b0b46be209f] alter complete (version 4)
I20260617 20:17:03.921149 30641 tablet.cc:1724] T e58fbec4a9f14ddda42b5a4c0263972c P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:03.921275 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370db89a92a6455190edaf80e5a56205" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:03.941967 29376 tablet_replica.cc:333] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:03.925477 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fed593a3fa7742a18ccc2124c3ee0fb9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:03.925820 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e11c8b69b704e959e4463f565bf89ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:03.942260 29376 raft_consensus.cc:2243] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.942488 29376 raft_consensus.cc:2272] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.943102 29376 ts_tablet_manager.cc:1916] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.946580 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 370db89a92a6455190edaf80e5a56205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.946810 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a5e5917a414c99b25ea2efeab4063d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.947471 28666 catalog_manager.cc:6784] ReplaceTablet: tablet 6ea0168fa86547f68c7fec880b8d8f1e deleted and replaced by tablet 0b194772c9054192b7639cbab5f86ca8
I20260617 20:17:03.946993 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
I20260617 20:17:03.951036 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_abaa4ebadc654b7a85405d8114046356" } new_table_name: "default.Table_8bc2da3ec59547e290194b2ec6184b7f" modify_external_catalogs: true
W20260617 20:17:03.951282 28925 leader_election.cc:343] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:03.951408 28925 leader_election.cc:304] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:03.951488 29378 tablet_bootstrap.cc:492] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:03.951632 30677 raft_consensus.cc:2749] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:03.951813 29378 ts_tablet_manager.cc:1403] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.000s
I20260617 20:17:03.953083 29378 raft_consensus.cc:359] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.953329 29378 raft_consensus.cc:385] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:03.953446 29378 raft_consensus.cc:740] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:03.953657 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8e6d066264d0412f9b74d0ffff011db9" } new_table_name: "default.Table_904b2e0f8c594d039717f494c0d47a1d" modify_external_catalogs: true
I20260617 20:17:03.953711 29378 consensus_queue.cc:260] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:03.954246 29378 ts_tablet_manager.cc:1434] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:03.954536 29378 tablet_bootstrap.cc:492] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:03.959560 29375 ts_tablet_manager.cc:1929] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:03.979103 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b7e3bb8cd7df47aea4746f74f1ca2dc1
I20260617 20:17:03.981370 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.981932 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c83fa97268f045d6aa60413dfa96ebbd
I20260617 20:17:03.982321 28662 catalog_manager.cc:6784] ReplaceTablet: tablet c83fa97268f045d6aa60413dfa96ebbd deleted and replaced by tablet afbdb8d7562742e6903465afa71efa25
I20260617 20:17:03.983783 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet c83fa97268f045d6aa60413dfa96ebbd with delete_type TABLET_DATA_DELETED (replaced by tablet afbdb8d7562742e6903465afa71efa25) from {username='slave'} at 127.0.0.1:55834
W20260617 20:17:03.983978 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0f2a0705c8e341739696d5ea028e2728 consensus state has no leader
I20260617 20:17:03.985234 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 8f058c309b87431d9517338c7484bbbd
I20260617 20:17:03.986578 29375 log.cc:1199] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/0859e56b5b7a483ea5e751f0468cbab8
I20260617 20:17:03.986896 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f058c309b87431d9517338c7484bbbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:03.987301 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_45681900e4bb466c8665d7200abc0eb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.988078 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45681900e4bb466c8665d7200abc0eb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.989657 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_7e36e71e8aca4a5e8813c465c31db50a" } new_table_name: "default.Table_87d2647a76934415a43629381e657e1e" modify_external_catalogs: true
I20260617 20:17:03.990034 29375 ts_tablet_manager.cc:1950] T 0859e56b5b7a483ea5e751f0468cbab8 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:03.990357 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 690) took 5126 ms. Trace:
I20260617 20:17:03.990433 29375 rpcz_store.cc:276] 0617 20:16:58.863916 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.864854 (+ 938us) service_pool.cc:224] Handling call
0617 20:17:03.818935 (+4954081us) ts_tablet_manager.cc:1151] Deleting tablet 0859e56b5b7a483ea5e751f0468cbab8
0617 20:17:03.818945 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.956744 (+137799us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.959509 (+ 2765us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.990339 (+ 30830us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4921055}
I20260617 20:17:03.990820 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 689) took 5126 ms. Trace:
I20260617 20:17:03.990893 29375 rpcz_store.cc:276] 0617 20:16:58.863849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.864976 (+ 1127us) service_pool.cc:224] Handling call
0617 20:17:03.990727 (+5125751us) ts_tablet_manager.cc:1151] Deleting tablet 7e48a4a827d44afca912dc8723be4542
0617 20:17:03.990736 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.990804 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5092802}
I20260617 20:17:03.991190 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 688) took 5127 ms. Trace:
I20260617 20:17:03.991274 29375 rpcz_store.cc:276] 0617 20:16:58.863750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.865083 (+ 1333us) service_pool.cc:224] Handling call
0617 20:17:03.991116 (+5126033us) ts_tablet_manager.cc:1151] Deleting tablet d738ab2f8c784c76947a3a76bd040219
0617 20:17:03.991124 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.991176 (+ 52us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5093144}
I20260617 20:17:03.991562 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 691) took 5127 ms. Trace:
I20260617 20:17:03.991496 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e0d3bd7023894d139716d67bbe5357d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:03.991631 29375 rpcz_store.cc:276] 0617 20:16:58.863992 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.865208 (+ 1216us) service_pool.cc:224] Handling call
0617 20:17:03.991492 (+5126284us) ts_tablet_manager.cc:1151] Deleting tablet 3e80e776263c4a91ae7fffa9d0f4ebd4
0617 20:17:03.991500 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.991549 (+ 49us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5093471}
I20260617 20:17:03.991859 29375 tablet_replica.cc:333] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
W20260617 20:17:03.991973 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0d3bd7023894d139716d67bbe5357d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.992008 29375 raft_consensus.cc:2243] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:03.992147 29375 raft_consensus.cc:2272] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:03.992676 29375 ts_tablet_manager.cc:1916] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:03.993332 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2a1a4568e12941bf8abda5bc5f6a3477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.993798 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a1a4568e12941bf8abda5bc5f6a3477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:17:03.995407 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 80d778641c354c679ee9e7d7b3eae3b5 consensus state has no leader
I20260617 20:17:03.995762 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e449fc7e82964090996a0aa1e86bc42d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:03.996220 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e449fc7e82964090996a0aa1e86bc42d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:03.998576 29377 ts_tablet_manager.cc:1929] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:03.998770 29377 log.cc:1199] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/ea2a8f46e8ac4f4aa39544a9fe40b1fe
I20260617 20:17:04.001539 29378 tablet_bootstrap.cc:654] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.001546 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.002673 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet c83fa97268f045d6aa60413dfa96ebbd with delete_type TABLET_DATA_DELETED (replaced by tablet afbdb8d7562742e6903465afa71efa25) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.004360 30693 raft_consensus.cc:493] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.004599 30693 raft_consensus.cc:515] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.005110 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f058c309b87431d9517338c7484bbbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.005350 30693 leader_election.cc:290] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.005395 29376 ts_tablet_manager.cc:1929] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:04.005609 29376 log.cc:1199] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/7f239f81c40743b2aaa70a361997db77
I20260617 20:17:04.005949 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a5e5917a414c99b25ea2efeab4063d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.006052 29376 ts_tablet_manager.cc:1950] T 7f239f81c40743b2aaa70a361997db77 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:04.006083 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 0859e56b5b7a483ea5e751f0468cbab8 (table default.Table_1ee5913d94914aba95dc4be83307dbe1 [id=4052e9bb44674d6b9936c1c6f004488f]) successfully deleted
I20260617 20:17:04.006382 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 744) took 4457 ms. Trace:
I20260617 20:17:04.006546 29376 rpcz_store.cc:276] 0617 20:16:59.548919 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.548970 (+ 51us) service_pool.cc:224] Handling call
0617 20:17:03.941802 (+4392832us) ts_tablet_manager.cc:1151] Deleting tablet 7f239f81c40743b2aaa70a361997db77
0617 20:17:03.941895 (+ 93us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.948745 (+ 6850us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.005279 (+ 56534us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.006343 (+ 1064us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4392664}
W20260617 20:17:04.006656 28925 leader_election.cc:343] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.006896 29377 ts_tablet_manager.cc:1950] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:04.007105 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 748) took 4455 ms. Trace:
I20260617 20:17:04.007246 29376 rpcz_store.cc:276] 0617 20:16:59.551506 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.796640 (+245134us) service_pool.cc:224] Handling call
0617 20:17:04.006963 (+4210323us) ts_tablet_manager.cc:1151] Deleting tablet 5806949c371b41b0a162a4c8cbf6b435
0617 20:17:04.006975 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.007069 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4210139}
I20260617 20:17:04.007942 29379 tablet_bootstrap.cc:492] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:04.008088 29379 ts_tablet_manager.cc:1403] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.087s user 0.003s sys 0.000s
I20260617 20:17:04.008786 29379 raft_consensus.cc:359] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.008952 29379 raft_consensus.cc:385] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.009025 29379 raft_consensus.cc:740] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.009262 29379 consensus_queue.cc:260] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.010685 30693 raft_consensus.cc:493] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.010819 30693 raft_consensus.cc:515] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.011366 30693 leader_election.cc:290] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:04.013733 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 7e48a4a827d44afca912dc8723be4542 because the tablet was not found. No further retry: Not found: Tablet not found: 7e48a4a827d44afca912dc8723be4542
W20260617 20:17:04.014021 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d738ab2f8c784c76947a3a76bd040219 because the tablet was not found. No further retry: Not found: Tablet not found: d738ab2f8c784c76947a3a76bd040219
I20260617 20:17:04.014153 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219d85e4fd9b4ba3baf1e08d2b18a32c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:04.014237 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3e80e776263c4a91ae7fffa9d0f4ebd4 because the tablet was not found. No further retry: Not found: Tablet not found: 3e80e776263c4a91ae7fffa9d0f4ebd4
I20260617 20:17:04.013363 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 75c59cf5f5e8486baf1e038a44657f33
W20260617 20:17:04.014904 28925 leader_election.cc:343] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.015885 29379 ts_tablet_manager.cc:1434] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260617 20:17:04.016268 29379 tablet_bootstrap.cc:492] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:04.018180 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c59cf5f5e8486baf1e038a44657f33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.020716 29376 tablet_replica.cc:333] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:04.020994 29376 raft_consensus.cc:2243] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.021353 29378 tablet_bootstrap.cc:492] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.021417 29376 raft_consensus.cc:2272] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.021552 29378 ts_tablet_manager.cc:1403] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.067s user 0.003s sys 0.000s
I20260617 20:17:04.019413 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c59cf5f5e8486baf1e038a44657f33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.022794 29379 tablet_bootstrap.cc:654] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.022763 29378 raft_consensus.cc:359] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.022976 29378 raft_consensus.cc:385] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.023066 29378 raft_consensus.cc:740] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.023386 29378 consensus_queue.cc:260] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.023936 29378 ts_tablet_manager.cc:1434] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:04.024230 29378 tablet_bootstrap.cc:492] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.025405 29376 ts_tablet_manager.cc:1916] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.025754 29378 tablet_bootstrap.cc:654] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.036208 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 793) took 1348 ms. Trace:
I20260617 20:17:04.036401 29377 rpcz_store.cc:276] 0617 20:17:02.688040 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.688213 (+ 173us) service_pool.cc:224] Handling call
0617 20:17:03.765983 (+1077770us) ts_tablet_manager.cc:1151] Deleting tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe
0617 20:17:03.765995 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:03.858188 (+ 92193us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x616000193f54. stack: 00007ffae652a496 00007ffae652a250 00007ffae55553ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007ffaf25d07e0 00007ffaf391c933 00007ffaf64dfae7 00007ffaf6512bb4 00007ffaf64f35d0 00007ffaf64f335d 0000000000aa681c 00007ffae65709ff 00007ffae6573d1b 00007ffae6573b98
0617 20:17:03.869710 (+ 11522us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:03.998525 (+128815us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.036184 (+ 37659us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207527680,"tablet-delete.queue_time_us":1077597}
I20260617 20:17:04.037142 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe (table default.Table_a6787e5dc20a42b6812d3cd0acc6112c [id=c0e83fb2a91448d7937ba0ba68a48fba]) successfully deleted
I20260617 20:17:04.039150 29377 tablet_replica.cc:333] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:04.039347 29377 raft_consensus.cc:2243] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:04.039499 29377 raft_consensus.cc:2272] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.039973 29377 ts_tablet_manager.cc:1916] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.042865 29375 ts_tablet_manager.cc:1929] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:04.043052 29375 log.cc:1199] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/af9c687fe56f42af82dd4728ca53cd32
I20260617 20:17:04.043414 29375 ts_tablet_manager.cc:1950] T af9c687fe56f42af82dd4728ca53cd32 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:17:04.044238 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 351860a39ac74dfaa95cd4d918980c23 consensus state has no leader
I20260617 20:17:04.044272 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 696) took 5128 ms. Trace:
I20260617 20:17:04.044348 29375 rpcz_store.cc:276] 0617 20:16:58.916308 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.916376 (+ 68us) service_pool.cc:224] Handling call
0617 20:17:03.991814 (+5075438us) ts_tablet_manager.cc:1151] Deleting tablet af9c687fe56f42af82dd4728ca53cd32
0617 20:17:03.991822 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.022042 (+ 30220us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.042807 (+ 20765us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.044249 (+ 1442us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5075192}
I20260617 20:17:04.046283 29378 tablet_bootstrap.cc:492] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.046499 29378 ts_tablet_manager.cc:1403] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.002s
I20260617 20:17:04.047156 29379 tablet_bootstrap.cc:492] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:04.047286 29379 ts_tablet_manager.cc:1403] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
I20260617 20:17:04.047432 29378 raft_consensus.cc:359] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.047664 29378 raft_consensus.cc:385] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.047763 29378 raft_consensus.cc:740] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.047966 29379 raft_consensus.cc:359] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.048144 29379 raft_consensus.cc:385] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.048195 29379 raft_consensus.cc:740] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.048235 29378 consensus_queue.cc:260] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.048393 29379 consensus_queue.cc:260] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.048802 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet af9c687fe56f42af82dd4728ca53cd32 (table default.Table_b69715660a0e44959e855ca44fb09056 [id=6fe28533c9a445a88d8bcb86636c4905]) successfully deleted
I20260617 20:17:04.048874 29375 tablet_replica.cc:333] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:04.048890 29378 ts_tablet_manager.cc:1434] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:04.049062 29375 raft_consensus.cc:2243] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.049157 29378 tablet_bootstrap.cc:492] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.049393 29375 raft_consensus.cc:2272] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.049413 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3f639bb9ece9443ea9d7f7cf5ec04be4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:04.050139 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f639bb9ece9443ea9d7f7cf5ec04be4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:04.050705 29378 tablet_bootstrap.cc:654] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.054059 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1b6116659f754549b9c833b7b5f49b48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:04.054864 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b6116659f754549b9c833b7b5f49b48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:04.051149 29379 ts_tablet_manager.cc:1434] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:17:04.059947 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2c8a0fe63c440493b357e73f763357 (DEFAULT_TABLE table=default.Table_bf4ce88a9888453a8c775f1f1d264daa [id=1d8700d6c96e48d7986478065e73fef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.061657 29379 tablet_bootstrap.cc:492] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:04.061882 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2c8a0fe63c440493b357e73f763357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.062637 29376 ts_tablet_manager.cc:1929] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.062773 29376 log.cc:1199] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/c12ea6cac8d44b4b8d41e3e33e0fd6cb
I20260617 20:17:04.063156 29376 ts_tablet_manager.cc:1950] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:04.063479 29379 tablet_bootstrap.cc:654] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.063546 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 752) took 4402 ms. Trace:
I20260617 20:17:04.063632 29376 rpcz_store.cc:276] 0617 20:16:59.660590 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.083921 (+423331us) service_pool.cc:224] Handling call
0617 20:17:04.020639 (+3936718us) ts_tablet_manager.cc:1151] Deleting tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb
0617 20:17:04.020649 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.032283 (+ 11634us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.062532 (+ 30249us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.063510 (+ 978us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3936525}
I20260617 20:17:04.063985 29376 tablet_replica.cc:333] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:04.064180 29376 raft_consensus.cc:2243] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.064518 29376 raft_consensus.cc:2272] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.065060 29376 ts_tablet_manager.cc:1916] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.065644 29375 ts_tablet_manager.cc:1916] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.071089 29377 ts_tablet_manager.cc:1929] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:04.072034 29377 log.cc:1199] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/f02529cd1e764a3886de27d86e9690e3
I20260617 20:17:04.072410 29377 ts_tablet_manager.cc:1950] T f02529cd1e764a3886de27d86e9690e3 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:04.074512 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 794) took 1386 ms. Trace:
I20260617 20:17:04.075358 29377 rpcz_store.cc:276] 0617 20:17:02.688169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.688398 (+ 229us) service_pool.cc:224] Handling call
0617 20:17:04.037499 (+1349101us) ts_tablet_manager.cc:1151] Deleting tablet f02529cd1e764a3886de27d86e9690e3
0617 20:17:04.039046 (+ 1547us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.044235 (+ 5189us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.070978 (+ 26743us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.074491 (+ 3513us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1349002}
I20260617 20:17:04.076053 29377 tablet_replica.cc:333] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:04.076516 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet f02529cd1e764a3886de27d86e9690e3 (table default.Table_fcf0d313e34c4117a4d36e5638a1a4b4 [id=7a4a3c7360114f72b54f5dd645215114]) successfully deleted
I20260617 20:17:04.077787 29377 raft_consensus.cc:2243] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:04.078227 29377 raft_consensus.cc:2272] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.078935 29377 ts_tablet_manager.cc:1916] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.084496 29379 tablet_bootstrap.cc:492] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:04.084684 29379 ts_tablet_manager.cc:1403] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s
I20260617 20:17:04.085475 29379 raft_consensus.cc:359] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.085704 29379 raft_consensus.cc:385] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.085799 29379 raft_consensus.cc:740] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.086094 29379 consensus_queue.cc:260] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.089509 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]). Expected version 1 got 0
I20260617 20:17:04.090085 28666 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:04.090593 29379 ts_tablet_manager.cc:1434] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 20:17:04.091622 29379 tablet_bootstrap.cc:492] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:04.093924 29375 ts_tablet_manager.cc:1929] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.097421 29375 log.cc:1199] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/9f9844fab126448895c4c9d4c3c78d76
I20260617 20:17:04.097844 29375 ts_tablet_manager.cc:1950] T 9f9844fab126448895c4c9d4c3c78d76 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:04.097714 28661 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d673bc9892c94725b270ef3b9dc768f4 (table default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330]). Expected version 1 got 0
I20260617 20:17:04.098668 29379 tablet_bootstrap.cc:654] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.100520 29376 ts_tablet_manager.cc:1929] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.100656 29376 log.cc:1199] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/f8e0c5d20a4548cc8124302aa38bcb21
I20260617 20:17:04.101033 29376 ts_tablet_manager.cc:1950] T f8e0c5d20a4548cc8124302aa38bcb21 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:04.101397 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 753) took 4440 ms. Trace:
I20260617 20:17:04.101516 29376 rpcz_store.cc:276] 0617 20:16:59.660658 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.084124 (+423466us) service_pool.cc:224] Handling call
0617 20:17:04.063921 (+3979797us) ts_tablet_manager.cc:1151] Deleting tablet f8e0c5d20a4548cc8124302aa38bcb21
0617 20:17:04.063930 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.084179 (+ 20249us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.100438 (+ 16259us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.101363 (+ 925us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3979679}
I20260617 20:17:04.102108 29376 tablet_replica.cc:333] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:04.102360 29376 raft_consensus.cc:2243] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:04.102569 29376 raft_consensus.cc:2272] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.103143 29376 ts_tablet_manager.cc:1916] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.109910 29383 tablet_bootstrap.cc:492] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:04.110059 29383 ts_tablet_manager.cc:1403] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.339s user 0.006s sys 0.000s
I20260617 20:17:04.110940 29383 raft_consensus.cc:359] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.111255 29383 raft_consensus.cc:385] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.111340 29383 raft_consensus.cc:740] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.111531 29383 consensus_queue.cc:260] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.112044 29383 ts_tablet_manager.cc:1434] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:04.112524 29383 tablet_bootstrap.cc:492] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:04.098668 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 697) took 5159 ms. Trace:
I20260617 20:17:04.112628 29375 rpcz_store.cc:276] 0617 20:16:58.938829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.938894 (+ 65us) service_pool.cc:224] Handling call
0617 20:17:04.048823 (+5109929us) ts_tablet_manager.cc:1151] Deleting tablet 9f9844fab126448895c4c9d4c3c78d76
0617 20:17:04.048840 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.074829 (+ 25989us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.093869 (+ 19040us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.098650 (+ 4781us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840,"tablet-delete.queue_time_us":5109685}
I20260617 20:17:04.113016 29375 tablet_replica.cc:333] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:04.113204 29375 raft_consensus.cc:2243] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.113531 29375 pending_rounds.cc:70] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:17:04.113576 29375 pending_rounds.cc:77] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955512540184576 op_type: NO_OP noop_request { }
I20260617 20:17:04.113656 29375 raft_consensus.cc:2889] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:04.113726 29375 raft_consensus.cc:2272] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.114290 29375 ts_tablet_manager.cc:1916] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.117807 29383 tablet_bootstrap.cc:654] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.103642 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e259b984fdf44bde85b3546242987b20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:04.119051 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 9f9844fab126448895c4c9d4c3c78d76 (table default.Table_5293e9d7c6ad4868b54d0aa5d41958b9 [id=8b51ca1875e847c5b75b682be93e6107]) successfully deleted
I20260617 20:17:04.119920 29375 ts_tablet_manager.cc:1929] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.120304 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet 519719a748f441c58689172dffb54394 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.120445 29197 leader_election.cc:304] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:04.120906 30423 raft_consensus.cc:2804] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:04.121021 30423 raft_consensus.cc:493] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:04.121130 30423 raft_consensus.cc:3060] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.123967 30423 raft_consensus.cc:515] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.124929 30423 leader_election.cc:290] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:04.130400 29377 ts_tablet_manager.cc:1929] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.131357 29377 log.cc:1199] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/488b06f05d9b4273a61bcb2d6e0ad796
I20260617 20:17:04.132459 29377 ts_tablet_manager.cc:1950] T 488b06f05d9b4273a61bcb2d6e0ad796 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:04.133644 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 800) took 1439 ms. Trace:
I20260617 20:17:04.134681 29377 rpcz_store.cc:276] 0617 20:17:02.694354 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.694472 (+ 118us) service_pool.cc:224] Handling call
0617 20:17:04.076005 (+1381533us) ts_tablet_manager.cc:1151] Deleting tablet 488b06f05d9b4273a61bcb2d6e0ad796
0617 20:17:04.076015 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.101950 (+ 25935us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.130336 (+ 28386us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.133625 (+ 3289us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1381380}
I20260617 20:17:04.139535 29197 leader_election.cc:304] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:04.140410 30556 raft_consensus.cc:2804] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:04.140547 30556 raft_consensus.cc:697] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:04.140784 30556 consensus_queue.cc:237] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.142017 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2c8a0fe63c440493b357e73f763357 (DEFAULT_TABLE table=default.Table_bf4ce88a9888453a8c775f1f1d264daa [id=1d8700d6c96e48d7986478065e73fef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.142426 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2c8a0fe63c440493b357e73f763357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.144325 29378 tablet_bootstrap.cc:492] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.144477 29378 ts_tablet_manager.cc:1403] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.095s user 0.008s sys 0.009s
I20260617 20:17:04.143260 29197 leader_election.cc:304] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:04.143632 28661 catalog_manager.cc:5696] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:17:04.145354 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 488b06f05d9b4273a61bcb2d6e0ad796 (table default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca]) successfully deleted
I20260617 20:17:04.145272 29378 raft_consensus.cc:359] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.145474 29378 raft_consensus.cc:385] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.145527 29378 raft_consensus.cc:740] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:17:04.145900 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e259b984fdf44bde85b3546242987b20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:04.145850 29378 consensus_queue.cc:260] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.146459 29378 ts_tablet_manager.cc:1434] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:17:04.146795 29378 tablet_bootstrap.cc:492] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.147390 30683 raft_consensus.cc:2804] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:04.147554 30683 raft_consensus.cc:493] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:04.147720 30683 raft_consensus.cc:3060] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.151033 30683 raft_consensus.cc:515] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.151918 30683 leader_election.cc:290] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:04.153545 29378 tablet_bootstrap.cc:654] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.154531 28661 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]). Expected version 2 got 0
I20260617 20:17:04.157617 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 7e92c53710da422da9777635d4478100 (DEFAULT_TABLE table=default.Table_7b4739816cc340b5b1f9a29e08d5032d [id=4e09fd32f7a44b49bb9dbeb71dae470d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.167202 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 29a1074073ca48529275baaa3a065b4d (DEFAULT_TABLE table=default.Table_068e6f9e0da44fbba32efb8418d43f31 [id=652e7bce101f468aaf1d8d011bb396c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.167483 29378 tablet_bootstrap.cc:492] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.167608 29378 ts_tablet_manager.cc:1403] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20260617 20:17:04.168324 29378 raft_consensus.cc:359] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.168495 29378 raft_consensus.cc:385] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.168548 29378 raft_consensus.cc:740] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.168934 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 0e328704dd1c402d999d5a7421b4bf80 (DEFAULT_TABLE table=default.Table_2a25294e78fe41a7ae7affa51831441f [id=3f6be16f12bc4b4c8560d7f09e341caa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.168913 29378 consensus_queue.cc:260] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.169252 30683 raft_consensus.cc:493] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.169461 30683 raft_consensus.cc:515] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.169750 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e328704dd1c402d999d5a7421b4bf80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.170113 30683 leader_election.cc:290] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:04.170636 29378 ts_tablet_manager.cc:1434] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:04.170907 29378 tablet_bootstrap.cc:492] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.172252 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet dd89c8452c444af99d8bce0c7cbf8ce1 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:04.172530 29378 tablet_bootstrap.cc:654] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.172904 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet ee5b41c446444389821a2ebb85c1bf8b from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:04.173434 29377 tablet_replica.cc:333] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:04.173537 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 4281bbef1efb4986a23c6fb24e62e49c (DEFAULT_TABLE table=default.Table_efec5fea83174407a7f646486d5f4269 [id=5ed8eef48a4a4304921b94f69b6f967b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.173635 29377 raft_consensus.cc:2243] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:04.173784 29377 raft_consensus.cc:2272] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.173861 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4281bbef1efb4986a23c6fb24e62e49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.126137 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d0e2ecc16e4285a1d8337a5336caf2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:04.141680 29379 tablet_bootstrap.cc:492] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:04.174168 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 7381c348acbd462b8e04587b2eb948b6 (DEFAULT_TABLE table=default.Table_6c5c337c61df411ba27ebb1e7a4e8ec9 [id=cc73212423a64c5eab12af219ad5af5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.174331 29379 ts_tablet_manager.cc:1403] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.083s user 0.003s sys 0.003s
I20260617 20:17:04.174463 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7381c348acbd462b8e04587b2eb948b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.175040 29379 raft_consensus.cc:359] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.175195 29379 raft_consensus.cc:385] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.175238 29379 raft_consensus.cc:740] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.175403 29379 consensus_queue.cc:260] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.142735 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 7e92c53710da422da9777635d4478100 (DEFAULT_TABLE table=default.Table_7b4739816cc340b5b1f9a29e08d5032d [id=4e09fd32f7a44b49bb9dbeb71dae470d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.152079 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeae97639fd4e6290768dae12f6a4ce" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:04.166044 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 29a1074073ca48529275baaa3a065b4d (DEFAULT_TABLE table=default.Table_068e6f9e0da44fbba32efb8418d43f31 [id=652e7bce101f468aaf1d8d011bb396c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.176002 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a1074073ca48529275baaa3a065b4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:04.177678 29198 leader_election.cc:343] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.168324 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 0e328704dd1c402d999d5a7421b4bf80 (DEFAULT_TABLE table=default.Table_2a25294e78fe41a7ae7affa51831441f [id=3f6be16f12bc4b4c8560d7f09e341caa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:04.177947 29198 leader_election.cc:343] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.178031 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e328704dd1c402d999d5a7421b4bf80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.178189 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a1074073ca48529275baaa3a065b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.178886 29378 tablet_bootstrap.cc:492] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.178992 29378 ts_tablet_manager.cc:1403] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260617 20:17:04.179715 29378 raft_consensus.cc:359] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.179872 29378 raft_consensus.cc:385] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.179919 29378 raft_consensus.cc:740] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.180244 29378 consensus_queue.cc:260] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.180356 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14113dd9098456599d7b72626bedcd6" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.171155 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 7381c348acbd462b8e04587b2eb948b6 (DEFAULT_TABLE table=default.Table_6c5c337c61df411ba27ebb1e7a4e8ec9 [id=cc73212423a64c5eab12af219ad5af5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.180711 29378 ts_tablet_manager.cc:1434] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:17:04.180823 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7381c348acbd462b8e04587b2eb948b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.181633 29378 tablet_bootstrap.cc:492] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:17:04.181897 29198 leader_election.cc:343] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.183698 29378 tablet_bootstrap.cc:654] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.183676 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 4281bbef1efb4986a23c6fb24e62e49c (DEFAULT_TABLE table=default.Table_efec5fea83174407a7f646486d5f4269 [id=5ed8eef48a4a4304921b94f69b6f967b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.184065 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4281bbef1efb4986a23c6fb24e62e49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.187158 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e92c53710da422da9777635d4478100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.188592 29125 raft_consensus.cc:3060] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.191587 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e92c53710da422da9777635d4478100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.195091 29121 raft_consensus.cc:3060] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.196377 29378 tablet_bootstrap.cc:492] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.196528 29378 ts_tablet_manager.cc:1403] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20260617 20:17:04.197366 29378 raft_consensus.cc:359] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.197548 29378 raft_consensus.cc:385] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.197598 29378 raft_consensus.cc:740] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.197803 29378 consensus_queue.cc:260] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.198310 29378 ts_tablet_manager.cc:1434] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:04.198618 29378 tablet_bootstrap.cc:492] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.200371 30683 consensus_queue.cc:1048] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:04.201433 29378 tablet_bootstrap.cc:654] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.201933 29377 ts_tablet_manager.cc:1916] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.206676 29379 ts_tablet_manager.cc:1434] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20260617 20:17:04.206985 29379 tablet_bootstrap.cc:492] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:04.209465 29379 tablet_bootstrap.cc:654] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.211687 29375 log.cc:1199] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/67a3124306094c72ad78e5473aa35bdb
I20260617 20:17:04.212237 29375 ts_tablet_manager.cc:1950] T 67a3124306094c72ad78e5473aa35bdb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:04.213543 29378 tablet_bootstrap.cc:492] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.213744 29378 ts_tablet_manager.cc:1403] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.003s
I20260617 20:17:04.213897 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 698) took 5274 ms. Trace:
I20260617 20:17:04.214586 29378 raft_consensus.cc:359] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.214919 29378 raft_consensus.cc:385] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.215130 29378 raft_consensus.cc:740] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.215320 29375 rpcz_store.cc:276] 0617 20:16:58.939753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.939800 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:04.112960 (+5173160us) ts_tablet_manager.cc:1151] Deleting tablet 67a3124306094c72ad78e5473aa35bdb
0617 20:17:04.112973 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.117168 (+ 4195us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.119870 (+ 2702us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.213882 (+ 94012us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5173003}
I20260617 20:17:04.215387 29378 consensus_queue.cc:260] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.215875 29378 ts_tablet_manager.cc:1434] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:04.216199 29378 tablet_bootstrap.cc:492] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.217926 29378 tablet_bootstrap.cc:654] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.221043 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 67a3124306094c72ad78e5473aa35bdb (table default.Table_2b054c3c845f4657a3339cf535372c22 [id=904de84620c746dd8bc86909459d3506]) successfully deleted
I20260617 20:17:04.221526 29375 tablet_replica.cc:333] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:04.222126 29375 raft_consensus.cc:2243] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.222947 29375 pending_rounds.cc:70] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:17:04.223987 29375 pending_rounds.cc:77] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955511821074432 op_type: NO_OP noop_request { }
I20260617 20:17:04.224426 29375 raft_consensus.cc:2889] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:04.224779 29375 raft_consensus.cc:2272] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.225591 29375 ts_tablet_manager.cc:1916] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.242074 29376 ts_tablet_manager.cc:1929] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.242323 29376 log.cc:1199] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/33a1c96212014333935ec7f7c92a306c
I20260617 20:17:04.242851 29376 ts_tablet_manager.cc:1950] T 33a1c96212014333935ec7f7c92a306c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:04.243718 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 754) took 4582 ms. Trace:
I20260617 20:17:04.243898 29376 rpcz_store.cc:276] 0617 20:16:59.660723 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.084249 (+423526us) service_pool.cc:224] Handling call
0617 20:17:04.101961 (+4017712us) ts_tablet_manager.cc:1151] Deleting tablet 33a1c96212014333935ec7f7c92a306c
0617 20:17:04.101980 (+ 19us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.134384 (+ 32404us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.241991 (+107607us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.243670 (+ 1679us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4017609}
I20260617 20:17:04.244342 29376 tablet_replica.cc:333] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:04.244599 29376 raft_consensus.cc:2243] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:04.243736 30693 raft_consensus.cc:493] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.245906 30693 raft_consensus.cc:515] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.246563 30693 leader_election.cc:290] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.239048 29377 ts_tablet_manager.cc:1929] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.247624 29377 log.cc:1199] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/18440a4a5c254a25b87f8632de9c92b9
I20260617 20:17:04.248155 29377 ts_tablet_manager.cc:1950] T 18440a4a5c254a25b87f8632de9c92b9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:04.248539 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 796) took 1554 ms. Trace:
I20260617 20:17:04.250280 29377 rpcz_store.cc:276] 0617 20:17:02.694098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.694636 (+ 538us) service_pool.cc:224] Handling call
0617 20:17:04.173386 (+1478750us) ts_tablet_manager.cc:1151] Deleting tablet 18440a4a5c254a25b87f8632de9c92b9
0617 20:17:04.173395 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.230121 (+ 56726us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.238981 (+ 8860us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.248523 (+ 9542us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1478648}
I20260617 20:17:04.250946 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 18440a4a5c254a25b87f8632de9c92b9 (table default.Table_c7b9c867be6c4fa3b58557f0b4d1876b [id=4ed00f8c66674fc99d8742599241bb77]) successfully deleted
I20260617 20:17:04.251291 29377 tablet_replica.cc:333] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:04.251519 29377 raft_consensus.cc:2243] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:04.251694 29377 pending_rounds.cc:70] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: Trying to abort 1 pending ops.
I20260617 20:17:04.251768 29377 pending_rounds.cc:77] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955522942537728 op_type: NO_OP noop_request { }
I20260617 20:17:04.251886 29377 raft_consensus.cc:2889] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:04.252000 29377 raft_consensus.cc:2272] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.253968 29377 ts_tablet_manager.cc:1916] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.227883 29379 tablet_bootstrap.cc:492] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:04.247359 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2797384f7845969ee9744b444f1acc" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.255466 29379 ts_tablet_manager.cc:1403] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.049s user 0.000s sys 0.004s
I20260617 20:17:04.255869 29378 tablet_bootstrap.cc:492] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
W20260617 20:17:04.255980 28925 leader_election.cc:343] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.256058 29378 ts_tablet_manager.cc:1403] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.040s user 0.006s sys 0.002s
I20260617 20:17:04.257422 29378 raft_consensus.cc:359] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.257586 29378 raft_consensus.cc:385] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.257638 29378 raft_consensus.cc:740] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.257836 29378 consensus_queue.cc:260] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.258157 29379 raft_consensus.cc:359] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:04.258263 29378 ts_tablet_manager.cc:1434] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:04.258313 29379 raft_consensus.cc:385] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.258376 29379 raft_consensus.cc:740] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.258556 29378 tablet_bootstrap.cc:492] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.258560 29379 consensus_queue.cc:260] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:04.258984 29379 ts_tablet_manager.cc:1434] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260617 20:17:04.259218 29379 tablet_bootstrap.cc:492] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:04.260432 30693 raft_consensus.cc:493] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.261837 29378 tablet_bootstrap.cc:654] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.262221 29376 raft_consensus.cc:2272] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.260538 30693 raft_consensus.cc:515] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.262902 29376 ts_tablet_manager.cc:1916] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.263295 30693 leader_election.cc:290] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.268265 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64538fdf51f94e8e985fec6202baac22" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:04.268893 28925 leader_election.cc:343] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.271337 29379 tablet_bootstrap.cc:654] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.255795 29197 leader_election.cc:304] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:04.273999 30556 raft_consensus.cc:2804] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:04.274111 30556 raft_consensus.cc:493] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:04.274199 30556 raft_consensus.cc:3060] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.277037 30556 raft_consensus.cc:515] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.278661 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203666e6127b49ed92731bc87ce01798" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:04.278684 30556 leader_election.cc:290] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:17:04.279189 29198 leader_election.cc:343] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.280228 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 7f16576b43f9457e8e58dabd2103f433 (DEFAULT_TABLE table=default.Table_89996edf26734b579b82eaf9bc18dbd0 [id=8486a38e5e0344b4ab9c222ea975ac2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.280476 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 7f16576b43f9457e8e58dabd2103f433 (DEFAULT_TABLE table=default.Table_89996edf26734b579b82eaf9bc18dbd0 [id=8486a38e5e0344b4ab9c222ea975ac2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.280709 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f16576b43f9457e8e58dabd2103f433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.280885 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f16576b43f9457e8e58dabd2103f433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.281364 29378 tablet_bootstrap.cc:492] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.281482 29378 ts_tablet_manager.cc:1403] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.002s
I20260617 20:17:04.282172 29378 raft_consensus.cc:359] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.282313 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 351860a39ac74dfaa95cd4d918980c23 (DEFAULT_TABLE table=default.Table_904b2e0f8c594d039717f494c0d47a1d [id=306bb3660c38430d9f1f414b05d94a34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.282667 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351860a39ac74dfaa95cd4d918980c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.286501 28965 tablet_service.cc:1511] Processing CreateTablet for tablet e22695cd32c44283888eaaae0c10a9c6 (DEFAULT_TABLE table=default.Table_e4bae15c95f24a148e48b458b3ffd46d [id=e68eecbfbae442c493ec7dbf49c718f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.286818 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22695cd32c44283888eaaae0c10a9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.287078 29107 tablet_service.cc:1511] Processing CreateTablet for tablet e22695cd32c44283888eaaae0c10a9c6 (DEFAULT_TABLE table=default.Table_e4bae15c95f24a148e48b458b3ffd46d [id=e68eecbfbae442c493ec7dbf49c718f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.287326 29091 tablet_service.cc:1511] Processing CreateTablet for tablet f5636950d5d445c297b7e3286645d013 (DEFAULT_TABLE table=default.Table_83dad09bc9d6404d8bb9f0cbcf719f08 [id=c4224ca184794bd2ae291ed645b924d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.287403 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22695cd32c44283888eaaae0c10a9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.287609 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5636950d5d445c297b7e3286645d013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.287848 29090 tablet_service.cc:1511] Processing CreateTablet for tablet e997dd0d85eb4e9d9e2205d3997f2df3 (DEFAULT_TABLE table=default.Table_f83bfe624dc64693998c453f0f0c42fd [id=756fa2b70ecd4112ad896545476251be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.288120 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e997dd0d85eb4e9d9e2205d3997f2df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.282320 29378 raft_consensus.cc:385] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.288602 29378 raft_consensus.cc:740] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.288787 29378 consensus_queue.cc:260] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.289217 29378 ts_tablet_manager.cc:1434] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20260617 20:17:04.289553 28960 tablet_service.cc:1511] Processing CreateTablet for tablet f5636950d5d445c297b7e3286645d013 (DEFAULT_TABLE table=default.Table_83dad09bc9d6404d8bb9f0cbcf719f08 [id=c4224ca184794bd2ae291ed645b924d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.290184 29378 tablet_bootstrap.cc:492] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.290273 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 01bd5ecfb2bf4e2eb4ff984272003fb9 (DEFAULT_TABLE table=default.Table_28f33cd39a814646bedf696c7f0db67c [id=52f1243091174b5885f65dc87f1afbbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.290223 28952 tablet_service.cc:1511] Processing CreateTablet for tablet e997dd0d85eb4e9d9e2205d3997f2df3 (DEFAULT_TABLE table=default.Table_f83bfe624dc64693998c453f0f0c42fd [id=756fa2b70ecd4112ad896545476251be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.290982 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5636950d5d445c297b7e3286645d013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.291087 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 01bd5ecfb2bf4e2eb4ff984272003fb9 (DEFAULT_TABLE table=default.Table_28f33cd39a814646bedf696c7f0db67c [id=52f1243091174b5885f65dc87f1afbbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.291391 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01bd5ecfb2bf4e2eb4ff984272003fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.291828 29378 tablet_bootstrap.cc:654] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.293474 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca84d3c8b8f43978692bcc61956d2b5 (DEFAULT_TABLE table=default.Table_9f2d0c2b8bf04f54b37f0d9a0fb8358f [id=57654be5cdc64d239e728492003dc3a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.293617 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9a733fbbdd4e95a02eb064c4cea68d (DEFAULT_TABLE table=default.Table_c7301f39e0a54609801e5454f391767b [id=32a68fccc83848e2a7c85692a0ad59a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.293757 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca84d3c8b8f43978692bcc61956d2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.293898 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9a733fbbdd4e95a02eb064c4cea68d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.301529 29125 raft_consensus.cc:3060] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.302804 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e997dd0d85eb4e9d9e2205d3997f2df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.305496 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01bd5ecfb2bf4e2eb4ff984272003fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.308348 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 351860a39ac74dfaa95cd4d918980c23 (DEFAULT_TABLE table=default.Table_904b2e0f8c594d039717f494c0d47a1d [id=306bb3660c38430d9f1f414b05d94a34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.308665 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351860a39ac74dfaa95cd4d918980c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.309725 30423 consensus_queue.cc:1048] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:04.316967 29379 tablet_bootstrap.cc:492] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:04.317185 29379 ts_tablet_manager.cc:1403] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.058s user 0.001s sys 0.002s
I20260617 20:17:04.317652 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9a733fbbdd4e95a02eb064c4cea68d (DEFAULT_TABLE table=default.Table_c7301f39e0a54609801e5454f391767b [id=32a68fccc83848e2a7c85692a0ad59a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.318094 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9a733fbbdd4e95a02eb064c4cea68d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.318022 29379 raft_consensus.cc:359] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.318190 29379 raft_consensus.cc:385] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.318249 29379 raft_consensus.cc:740] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.318437 29379 consensus_queue.cc:260] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.320433 29379 ts_tablet_manager.cc:1434] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:04.324397 29379 tablet_bootstrap.cc:492] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:04.331954 29376 ts_tablet_manager.cc:1929] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.332199 29376 log.cc:1199] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/f4de5dafb1474de1911148bb3b4527cf
I20260617 20:17:04.332712 29376 ts_tablet_manager.cc:1950] T f4de5dafb1474de1911148bb3b4527cf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:04.332988 29383 tablet_bootstrap.cc:492] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:04.332906 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca84d3c8b8f43978692bcc61956d2b5 (DEFAULT_TABLE table=default.Table_9f2d0c2b8bf04f54b37f0d9a0fb8358f [id=57654be5cdc64d239e728492003dc3a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.333141 29383 ts_tablet_manager.cc:1403] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.221s user 0.004s sys 0.000s
I20260617 20:17:04.334067 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_563901834a78414a94502af30f72e0d2" } modify_external_catalogs: true
I20260617 20:17:04.334350 29379 tablet_bootstrap.cc:654] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.340199 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca84d3c8b8f43978692bcc61956d2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.344801 29099 tablet_service.cc:1511] Processing CreateTablet for tablet ac29f4bbb2e2426da906ef60a950ccc3 (DEFAULT_TABLE table=default.Table_9a706992e1f74b07b585f66b6491d7e3 [id=763ed9048a1747ca897515ce507ae459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.333276 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 755) took 4672 ms. Trace:
W20260617 20:17:04.338179 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 80622.1us
I20260617 20:17:04.346095 29376 rpcz_store.cc:276] 0617 20:16:59.660790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.084353 (+423563us) service_pool.cc:224] Handling call
0617 20:17:04.244267 (+4159914us) ts_tablet_manager.cc:1151] Deleting tablet f4de5dafb1474de1911148bb3b4527cf
0617 20:17:04.244277 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.265881 (+ 21604us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.331864 (+ 65983us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.333181 (+ 1317us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4159830}
I20260617 20:17:04.346401 29197 leader_election.cc:304] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:04.346858 30678 raft_consensus.cc:2804] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:04.347011 30678 raft_consensus.cc:697] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:04.347239 30678 consensus_queue.cc:237] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.347950 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac29f4bbb2e2426da906ef60a950ccc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.346453 29376 tablet_replica.cc:333] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:04.350826 29376 raft_consensus.cc:2243] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.351318 29376 raft_consensus.cc:2272] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.351914 29376 ts_tablet_manager.cc:1916] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.355527 29378 tablet_bootstrap.cc:492] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.355655 29378 ts_tablet_manager.cc:1403] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.066s user 0.007s sys 0.000s
I20260617 20:17:04.356336 29378 raft_consensus.cc:359] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.356496 29378 raft_consensus.cc:385] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.356544 29378 raft_consensus.cc:740] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.356734 29378 consensus_queue.cc:260] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.357203 29378 ts_tablet_manager.cc:1434] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:17:04.368984 30693 raft_consensus.cc:493] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.369122 30693 raft_consensus.cc:515] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.369743 30693 leader_election.cc:290] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.370489 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c73ae1007d44ce958ad02fa5787651" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:04.370991 28925 leader_election.cc:343] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:04.372103 28925 leader_election.cc:343] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.372200 28925 leader_election.cc:304] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:04.372658 30693 raft_consensus.cc:2749] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:04.373039 29063 leader_election.cc:304] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:04.373350 30193 raft_consensus.cc:2749] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:04.344887 29383 raft_consensus.cc:359] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.374388 29383 raft_consensus.cc:385] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.374476 29383 raft_consensus.cc:740] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.375972 30410 raft_consensus.cc:493] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.376175 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219d85e4fd9b4ba3baf1e08d2b18a32c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.377004 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2797384f7845969ee9744b444f1acc" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.377188 30641 tablet.cc:1719] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:04.376129 30410 raft_consensus.cc:515] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.377743 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a5e5917a414c99b25ea2efeab4063d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.377914 30410 leader_election.cc:290] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:04.378432 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64538fdf51f94e8e985fec6202baac22" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.379176 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c73ae1007d44ce958ad02fa5787651" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.381471 29377 ts_tablet_manager.cc:1929] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.381623 29377 log.cc:1199] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/58213ec0a9364a91a15fc0329f28605b
I20260617 20:17:04.382061 29377 ts_tablet_manager.cc:1950] T 58213ec0a9364a91a15fc0329f28605b P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:04.383752 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc3219639748d9a0d71d45ae22ab36" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:04.384459 29198 leader_election.cc:343] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.384668 30693 raft_consensus.cc:493] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.384800 30693 raft_consensus.cc:515] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.385027 29376 ts_tablet_manager.cc:1929] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.385138 29376 log.cc:1199] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/89f7b878728a495f83b6584f8a6aca67
I20260617 20:17:04.385481 30693 leader_election.cc:290] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.386087 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f6dcc384154d41866cf8060cf05837" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:04.386544 28925 leader_election.cc:343] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.388208 29375 ts_tablet_manager.cc:1929] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.390918 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d0e2ecc16e4285a1d8337a5336caf2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:04.391084 28983 raft_consensus.cc:3060] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.393579 28983 raft_consensus.cc:2468] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:04.394030 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbeae97639fd4e6290768dae12f6a4ce" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:04.393989 29383 consensus_queue.cc:260] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.394191 28988 raft_consensus.cc:3060] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.394506 29383 ts_tablet_manager.cc:1434] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.061s user 0.003s sys 0.000s
I20260617 20:17:04.394812 29383 tablet_bootstrap.cc:492] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:04.396584 29383 tablet_bootstrap.cc:654] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.396684 28988 raft_consensus.cc:2468] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:04.396876 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14113dd9098456599d7b72626bedcd6" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:04.397069 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203666e6127b49ed92731bc87ce01798" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:04.397167 28981 raft_consensus.cc:3060] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.397738 29378 tablet_bootstrap.cc:492] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.398808 29376 ts_tablet_manager.cc:1950] T 89f7b878728a495f83b6584f8a6aca67 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:04.399125 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 756) took 4738 ms. Trace:
I20260617 20:17:04.399214 29376 rpcz_store.cc:276] 0617 20:16:59.660861 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.084437 (+423576us) service_pool.cc:224] Handling call
0617 20:17:04.346383 (+4261946us) ts_tablet_manager.cc:1151] Deleting tablet 89f7b878728a495f83b6584f8a6aca67
0617 20:17:04.346396 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.382176 (+ 35780us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.384954 (+ 2778us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.399087 (+ 14133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4261851}
I20260617 20:17:04.399511 29376 tablet_replica.cc:333] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:04.399727 28981 raft_consensus.cc:2468] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:04.399752 29376 raft_consensus.cc:2243] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.400048 29376 raft_consensus.cc:2272] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.402173 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_563901834a78414a94502af30f72e0d2" } modify_external_catalogs: true
I20260617 20:17:04.403059 29376 ts_tablet_manager.cc:1916] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:04.403340 28655 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 62587.1us
I20260617 20:17:04.404688 28965 tablet_service.cc:1511] Processing CreateTablet for tablet ac29f4bbb2e2426da906ef60a950ccc3 (DEFAULT_TABLE table=default.Table_9a706992e1f74b07b585f66b6491d7e3 [id=763ed9048a1747ca897515ce507ae459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.405071 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac29f4bbb2e2426da906ef60a950ccc3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:04.411394 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5f6435bac04e472c99e81b6e7e9a6012 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f6435bac04e472c99e81b6e7e9a6012 already in progress: creating tablet
I20260617 20:17:04.411541 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2a0705c8e341739696d5ea028e2728 (DEFAULT_TABLE table=default.Table_0016b41ee33e4881852a29e9a5ae7da1 [id=f58da0cf9be14bf99ee86cbbacf3dda0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.411626 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 7f239f81c40743b2aaa70a361997db77 (table default.Table_2880530e29494f939769447dfb05fd16 [id=0ea926c7d87a4670902ad04acbe1cfef]) successfully deleted
W20260617 20:17:04.411813 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5806949c371b41b0a162a4c8cbf6b435 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5806949c371b41b0a162a4c8cbf6b435 already in progress: creating tablet
I20260617 20:17:04.411895 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2a0705c8e341739696d5ea028e2728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.412009 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb (table default.Table_fe54346acedc4aee9fe8151c12a389fc [id=32c61aa9610e428fa8d5c794b078e0a1]) successfully deleted
I20260617 20:17:04.412173 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet f8e0c5d20a4548cc8124302aa38bcb21 (table default.Table_56731cc7022548f8a230b1f50b31109f [id=8b180a732c2a49c8a6dfd4218af43abf]) successfully deleted
I20260617 20:17:04.412688 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 33a1c96212014333935ec7f7c92a306c (table default.Table_f73d839e67c548629526669e7310da0c [id=cdf84135aed8448bafc93456dd9cdfc2]) successfully deleted
I20260617 20:17:04.412969 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet f4de5dafb1474de1911148bb3b4527cf (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]) successfully deleted
I20260617 20:17:04.413180 28952 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4092872f00406db21748740131eb3e (DEFAULT_TABLE table=default.Table_86ee1dcdebe4461692b1cc1234cc4965 [id=6a1430fa99ea4bbe98f5513393111db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.413552 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4092872f00406db21748740131eb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.413584 28958 tablet_service.cc:1511] Processing CreateTablet for tablet b1064bce50b64aa9afe8bb249545c5ab (DEFAULT_TABLE table=default.Table_a39fd5d8d0904a738db01e4866ba504f [id=78555f751c8c43c2aba4b8de7ae26ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.413902 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1064bce50b64aa9afe8bb249545c5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.413916 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_e7c6fb0fbdc84455826b618b3d85ddb4" } new_table_name: "default.Table_3463b514edb64b81813246ee4f8ed157" modify_external_catalogs: true
I20260617 20:17:04.415390 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9f2d0c2b8bf04f54b37f0d9a0fb8358f" } modify_external_catalogs: true
I20260617 20:17:04.409832 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a2980fa5162245c081e94675f6a1fd9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:04.416313 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 697c247751f2404d839d0b973c6ba7b6 (DEFAULT_TABLE table=default.Table_b1dbf26dd897427fb16163fa330af154 [id=9aadc9d3022d495c893d9293d28b2d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.416648 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697c247751f2404d839d0b973c6ba7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.417536 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 17d1d5603a9d4aa8bb41c651025fad16 (DEFAULT_TABLE table=default.Table_83cd5e3f2921420f822eee497a0087d5 [id=40c032065fd44e7eb34da35cc4e451eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.417846 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d1d5603a9d4aa8bb41c651025fad16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.420382 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9f2d0c2b8bf04f54b37f0d9a0fb8358f" } modify_external_catalogs: true
I20260617 20:17:04.421569 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 03f9ef2626b641bf895f7da11a7a652e (DEFAULT_TABLE table=default.Table_b87313ed947a489785485464059c33f9 [id=bfa8263671b84608b42d9967fc75076a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.421873 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f9ef2626b641bf895f7da11a7a652e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:04.422463 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2980fa5162245c081e94675f6a1fd9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:04.425551 28956 tablet_service.cc:1511] Processing CreateTablet for tablet a3c31f1bba074ba580601b7e8c64ea0b (DEFAULT_TABLE table=default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.425875 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c31f1bba074ba580601b7e8c64ea0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.427588 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_02d45e2cbb6a42f893c6227bbaa2a9f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:04.428862 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02d45e2cbb6a42f893c6227bbaa2a9f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:04.433861 29375 log.cc:1199] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/4e27c5834baa48ed953fccef54e6c52b
I20260617 20:17:04.434775 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 795) took 1740 ms. Trace:
I20260617 20:17:04.435194 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d673bc9892c94725b270ef3b9dc768f4 (table default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330]). Expected version 1 got 0
I20260617 20:17:04.419188 30193 raft_consensus.cc:493] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.421602 29379 tablet_bootstrap.cc:492] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:04.431370 29121 raft_consensus.cc:3060] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.435557 30193 raft_consensus.cc:515] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.436156 30193 leader_election.cc:290] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.438488 28979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3726e55ed36f420ab63bcfb5a81c5aab" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:04.438762 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:04.439198 29379 ts_tablet_manager.cc:1403] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.115s user 0.001s sys 0.004s
I20260617 20:17:04.439352 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]). Expected version 1 got 0
I20260617 20:17:04.439890 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 87d0e2ecc16e4285a1d8337a5336caf2 (table default.Table_724f440ee4704ab9b73c964377608058 [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]). Expected version 1 got 0
I20260617 20:17:04.440110 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_87d2647a76934415a43629381e657e1e [id=de24e09cee8e4f28998625c2697769b3]). Expected version 2 got 1
I20260617 20:17:04.440574 29379 raft_consensus.cc:359] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.440727 29379 raft_consensus.cc:385] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.440779 29379 raft_consensus.cc:740] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.441022 29379 consensus_queue.cc:260] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.441515 29379 ts_tablet_manager.cc:1434] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:04.441975 29379 tablet_bootstrap.cc:492] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:04.443245 29379 tablet_bootstrap.cc:654] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.443694 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2a0705c8e341739696d5ea028e2728 (DEFAULT_TABLE table=default.Table_0016b41ee33e4881852a29e9a5ae7da1 [id=f58da0cf9be14bf99ee86cbbacf3dda0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.444036 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2a0705c8e341739696d5ea028e2728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.443971 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 260b9cfb79684b168c20652392856808 (DEFAULT_TABLE table=default.Table_619b4975021e4a94b2fb7e5affbe4cef [id=845b578a03fd4bae95a9be628a2f1194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.444080 28956 tablet_service.cc:1511] Processing CreateTablet for tablet bc48e61d2d3d4bca8051eafaa49c6534 (DEFAULT_TABLE table=default.Table_bd0b72adbbe6450ea5af79b717033ff7 [id=0c5b63bc129d49cbb0994843cc2ef6c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.444296 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 260b9cfb79684b168c20652392856808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.444432 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4092872f00406db21748740131eb3e (DEFAULT_TABLE table=default.Table_86ee1dcdebe4461692b1cc1234cc4965 [id=6a1430fa99ea4bbe98f5513393111db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.444590 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa78288e42844a8ac19b961f2028c60 (DEFAULT_TABLE table=default.Table_50b5db1ff0ab437f8ae21d80d7b14f64 [id=781947c106f041dda409062a199c828b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.444748 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4092872f00406db21748740131eb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.444893 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa78288e42844a8ac19b961f2028c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.449486 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc48e61d2d3d4bca8051eafaa49c6534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.449498 29375 ts_tablet_manager.cc:1950] T 4e27c5834baa48ed953fccef54e6c52b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:04.449790 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 700) took 5507 ms. Trace:
I20260617 20:17:04.449864 29375 rpcz_store.cc:276] 0617 20:16:58.942115 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:58.942296 (+ 181us) service_pool.cc:224] Handling call
0617 20:17:04.221478 (+5279182us) ts_tablet_manager.cc:1151] Deleting tablet 4e27c5834baa48ed953fccef54e6c52b
0617 20:17:04.221488 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.347270 (+125782us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.388160 (+ 40890us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.449774 (+ 61614us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5279014}
I20260617 20:17:04.450273 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 17d1d5603a9d4aa8bb41c651025fad16 (DEFAULT_TABLE table=default.Table_83cd5e3f2921420f822eee497a0087d5 [id=40c032065fd44e7eb34da35cc4e451eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.450664 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 03f9ef2626b641bf895f7da11a7a652e (DEFAULT_TABLE table=default.Table_b87313ed947a489785485464059c33f9 [id=bfa8263671b84608b42d9967fc75076a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.450881 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d1d5603a9d4aa8bb41c651025fad16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.451100 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 697c247751f2404d839d0b973c6ba7b6 (DEFAULT_TABLE table=default.Table_b1dbf26dd897427fb16163fa330af154 [id=9aadc9d3022d495c893d9293d28b2d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.451385 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697c247751f2404d839d0b973c6ba7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.453514 29090 tablet_service.cc:1511] Processing CreateTablet for tablet bc48e61d2d3d4bca8051eafaa49c6534 (DEFAULT_TABLE table=default.Table_bd0b72adbbe6450ea5af79b717033ff7 [id=0c5b63bc129d49cbb0994843cc2ef6c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.453833 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc48e61d2d3d4bca8051eafaa49c6534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.434875 29377 rpcz_store.cc:276] 0617 20:17:02.694021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.694754 (+ 733us) service_pool.cc:224] Handling call
0617 20:17:04.251245 (+1556491us) ts_tablet_manager.cc:1151] Deleting tablet 58213ec0a9364a91a15fc0329f28605b
0617 20:17:04.251254 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.272093 (+ 20839us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.381413 (+109320us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.434755 (+ 53342us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1556402}
I20260617 20:17:04.456758 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 58213ec0a9364a91a15fc0329f28605b (table default.Table_d4f8ff9bb47c440b96251b7d063e73f6 [id=b267380ca82144ebbc909227070c204e]) successfully deleted
I20260617 20:17:04.456902 29108 tablet_service.cc:1511] Processing CreateTablet for tablet b1064bce50b64aa9afe8bb249545c5ab (DEFAULT_TABLE table=default.Table_a39fd5d8d0904a738db01e4866ba504f [id=78555f751c8c43c2aba4b8de7ae26ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.457120 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 797) took 1762 ms. Trace:
I20260617 20:17:04.457190 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1064bce50b64aa9afe8bb249545c5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.457192 29377 rpcz_store.cc:276] 0617 20:17:02.694160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.694890 (+ 730us) service_pool.cc:224] Handling call
0617 20:17:04.457015 (+1762125us) ts_tablet_manager.cc:1151] Deleting tablet f4de5dafb1474de1911148bb3b4527cf
0617 20:17:04.457027 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.457103 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1762024}
I20260617 20:17:04.457525 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 260b9cfb79684b168c20652392856808 (DEFAULT_TABLE table=default.Table_619b4975021e4a94b2fb7e5affbe4cef [id=845b578a03fd4bae95a9be628a2f1194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.457633 29377 tablet_replica.cc:333] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:04.457623 30556 consensus_queue.cc:1048] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:04.457837 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 260b9cfb79684b168c20652392856808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.457828 29377 raft_consensus.cc:2243] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:04.457989 29377 raft_consensus.cc:2272] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.458964 29117 raft_consensus.cc:3060] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.461555 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa78288e42844a8ac19b961f2028c60 (DEFAULT_TABLE table=default.Table_50b5db1ff0ab437f8ae21d80d7b14f64 [id=781947c106f041dda409062a199c828b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.461839 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa78288e42844a8ac19b961f2028c60. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:04.462419 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f4de5dafb1474de1911148bb3b4527cf because the tablet was not found. No further retry: Not found: Tablet not found: f4de5dafb1474de1911148bb3b4527cf
I20260617 20:17:04.465369 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 4e27c5834baa48ed953fccef54e6c52b (table default.Table_56f5d206c3934a59a6ef16d7c15e3de6 [id=6c3209da79fb4c518d0583b668a9209e]) successfully deleted
I20260617 20:17:04.466934 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 0259cf955d74419d92f1fe0da519cf72 (DEFAULT_TABLE table=default.Table_0dc3002823be41b18039e536eb0d547b [id=dbc091c9fea64e68b8218477cc22f456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.467295 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0259cf955d74419d92f1fe0da519cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.468103 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f9ef2626b641bf895f7da11a7a652e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.469563 28960 tablet_service.cc:1511] Processing CreateTablet for tablet ae8574874a194473bb5891e604a25ce8 (DEFAULT_TABLE table=default.Table_762c733e4f8445ad97f36fc9ee70147a [id=f62d71842e284523bbca857af62a367a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.469976 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8574874a194473bb5891e604a25ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.473450 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet ee5b41c446444389821a2ebb85c1bf8b
I20260617 20:17:04.473552 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 82ec75621f88424d963ffe235a5149f4 (DEFAULT_TABLE table=default.Table_5bb2dea5397f4dee834759955006f657 [id=bbd9142963fd450583aef1d8d715e35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.473990 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ec75621f88424d963ffe235a5149f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.474006 28668 catalog_manager.cc:6784] ReplaceTablet: tablet ee5b41c446444389821a2ebb85c1bf8b deleted and replaced by tablet cb95c048212948dfb00baafbd0c691d9
I20260617 20:17:04.474141 29091 tablet_service.cc:1511] Processing CreateTablet for tablet a3c31f1bba074ba580601b7e8c64ea0b (DEFAULT_TABLE table=default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.474535 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c31f1bba074ba580601b7e8c64ea0b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:04.475648 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e765deb9fe84707a5e9e2964310a36d consensus state has no leader
I20260617 20:17:04.477032 28669 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 9a7551eb6ea9418482d5822d85c646c9
I20260617 20:17:04.478549 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 0259cf955d74419d92f1fe0da519cf72 (DEFAULT_TABLE table=default.Table_0dc3002823be41b18039e536eb0d547b [id=dbc091c9fea64e68b8218477cc22f456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.479028 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0259cf955d74419d92f1fe0da519cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.479079 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet ee5b41c446444389821a2ebb85c1bf8b with delete_type TABLET_DATA_DELETED (replaced by tablet cb95c048212948dfb00baafbd0c691d9) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.479635 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 8ca84d3c8b8f43978692bcc61956d2b5
I20260617 20:17:04.481627 29095 tablet_service.cc:1511] Processing CreateTablet for tablet ae8574874a194473bb5891e604a25ce8 (DEFAULT_TABLE table=default.Table_762c733e4f8445ad97f36fc9ee70147a [id=f62d71842e284523bbca857af62a367a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.482051 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ca84d3c8b8f43978692bcc61956d2b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.482143 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8574874a194473bb5891e604a25ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.482357 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3d19c23664c34aff8fce1a199ca71ac9" } modify_external_catalogs: true
I20260617 20:17:04.482519 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3d19c23664c34aff8fce1a199ca71ac9" } modify_external_catalogs: true
I20260617 20:17:04.483906 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fbeeaf93389f4790acf4f3353d0952d8" } new_table_name: "default.Table_3dc2c3ecaddb44aab8d117d29872dfd5" modify_external_catalogs: true
I20260617 20:17:04.485443 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f2cdd74a01354e0597f1e2d7bc5458c6" } new_table_name: "default.Table_c0dd8c6e7ae243adbcd9f5963255065f" modify_external_catalogs: true
I20260617 20:17:04.485550 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 82ec75621f88424d963ffe235a5149f4 (DEFAULT_TABLE table=default.Table_5bb2dea5397f4dee834759955006f657 [id=bbd9142963fd450583aef1d8d715e35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.485889 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ec75621f88424d963ffe235a5149f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.486542 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2ad82bac5fac4ab8964031a88138d64d" } modify_external_catalogs: true
I20260617 20:17:04.486696 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2ad82bac5fac4ab8964031a88138d64d" } modify_external_catalogs: true
I20260617 20:17:04.488201 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_afafb0c05ae94a57a881021813c028a4" } modify_external_catalogs: true
I20260617 20:17:04.488340 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_afafb0c05ae94a57a881021813c028a4" } modify_external_catalogs: true
I20260617 20:17:04.489540 29098 tablet_service.cc:1511] Processing CreateTablet for tablet 80bc9fa552114c2f90f77c67ab63b0e6 (DEFAULT_TABLE table=default.Table_00f049c59fbd43bc8134a419c3d654a5 [id=da1befcdf0ba45d1b52d9236dfbbde60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.489876 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bc9fa552114c2f90f77c67ab63b0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.493646 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fdeeb511d87e4fcc8659b17d363c9834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:04.450268 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 705) took 5430 ms. Trace:
W20260617 20:17:04.494349 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdeeb511d87e4fcc8659b17d363c9834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:04.494256 29375 rpcz_store.cc:276] 0617 20:16:59.019919 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.019990 (+ 71us) service_pool.cc:224] Handling call
0617 20:17:04.450146 (+5430156us) ts_tablet_manager.cc:1151] Deleting tablet 3b00d3c0adcf48a48ba3d7a3de018b80
0617 20:17:04.450161 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.450250 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5429964}
I20260617 20:17:04.494802 29375 tablet_replica.cc:333] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:04.495024 29375 raft_consensus.cc:2243] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:04.495194 29375 raft_consensus.cc:2272] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.495878 29375 ts_tablet_manager.cc:1916] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.500078 29377 ts_tablet_manager.cc:1916] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.502018 29378 tablet_bootstrap.cc:654] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.502693 30693 raft_consensus.cc:493] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.502830 30693 raft_consensus.cc:515] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.503439 30693 leader_election.cc:290] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.504272 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e20a1092b746a8b8ddd4386a682229" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.505071 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3726e55ed36f420ab63bcfb5a81c5aab" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.506505 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet dcd999d88d954e50810cc01b297a27a9 with delete_type TABLET_DATA_DELETED (replaced by tablet 403095586c704ecaa2a9931295bd1330) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.507012 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ea0168fa86547f68c7fec880b8d8f1e with delete_type TABLET_DATA_DELETED (replaced by tablet 0b194772c9054192b7639cbab5f86ca8) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.507558 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet c83fa97268f045d6aa60413dfa96ebbd with delete_type TABLET_DATA_DELETED (replaced by tablet afbdb8d7562742e6903465afa71efa25) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.507738 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 29a1074073ca48529275baaa3a065b4d (DEFAULT_TABLE table=default.Table_068e6f9e0da44fbba32efb8418d43f31 [id=652e7bce101f468aaf1d8d011bb396c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.507813 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c59cf5f5e8486baf1e038a44657f33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.507972 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet d2db0467c5e64e38961d3b0e66375544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.508183 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8fa9f4c40b4ce9baa27a8837d3575c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.508162 29236 tablet_service.cc:1511] Processing CreateTablet for tablet 0e328704dd1c402d999d5a7421b4bf80 (DEFAULT_TABLE table=default.Table_2a25294e78fe41a7ae7affa51831441f [id=3f6be16f12bc4b4c8560d7f09e341caa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.508353 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 203666e6127b49ed92731bc87ce01798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.508513 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet b427ba6320be4f2a929eaf18a56b4309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.508790 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 1f2c8a0fe63c440493b357e73f763357 (DEFAULT_TABLE table=default.Table_bf4ce88a9888453a8c775f1f1d264daa [id=1d8700d6c96e48d7986478065e73fef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.509191 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9a733fbbdd4e95a02eb064c4cea68d (DEFAULT_TABLE table=default.Table_c7301f39e0a54609801e5454f391767b [id=32a68fccc83848e2a7c85692a0ad59a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.509472 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 7e92c53710da422da9777635d4478100 (DEFAULT_TABLE table=default.Table_7b4739816cc340b5b1f9a29e08d5032d [id=4e09fd32f7a44b49bb9dbeb71dae470d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.509634 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 7f16576b43f9457e8e58dabd2103f433 (DEFAULT_TABLE table=default.Table_89996edf26734b579b82eaf9bc18dbd0 [id=8486a38e5e0344b4ab9c222ea975ac2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.509768 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f058c309b87431d9517338c7484bbbd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.509896 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.510118 29239 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e6cee209a5a44d6b35eb50e9c33228f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.511556 29233 tablet_service.cc:1511] Processing CreateTablet for tablet f5636950d5d445c297b7e3286645d013 (DEFAULT_TABLE table=default.Table_83dad09bc9d6404d8bb9f0cbcf719f08 [id=c4224ca184794bd2ae291ed645b924d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.511725 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 4281bbef1efb4986a23c6fb24e62e49c (DEFAULT_TABLE table=default.Table_efec5fea83174407a7f646486d5f4269 [id=5ed8eef48a4a4304921b94f69b6f967b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:04.512147 28925 leader_election.cc:343] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.513646 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 80bc9fa552114c2f90f77c67ab63b0e6 (DEFAULT_TABLE table=default.Table_00f049c59fbd43bc8134a419c3d654a5 [id=da1befcdf0ba45d1b52d9236dfbbde60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.514043 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bc9fa552114c2f90f77c67ab63b0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.441094 28664 catalog_manager.cc:5696] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:04.515002 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet ead0291870a443d9b76ea919a45a4303 (table default.Table_d353f219381d4d17a2927a233465454c [id=0ef22e22306747b28d49d58d0fa45620]). Expected version 4 got 0
I20260617 20:17:04.520151 29378 tablet_bootstrap.cc:492] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.520329 29378 ts_tablet_manager.cc:1403] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.123s user 0.004s sys 0.001s
I20260617 20:17:04.521075 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 01bd5ecfb2bf4e2eb4ff984272003fb9 (DEFAULT_TABLE table=default.Table_28f33cd39a814646bedf696c7f0db67c [id=52f1243091174b5885f65dc87f1afbbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.521337 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 0f3032155e4e4ea8a23984f547d78752 (table default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca]). Expected version 2 got 0
I20260617 20:17:04.521366 29239 tablet_service.cc:1511] Processing CreateTablet for tablet e997dd0d85eb4e9d9e2205d3997f2df3 (DEFAULT_TABLE table=default.Table_f83bfe624dc64693998c453f0f0c42fd [id=756fa2b70ecd4112ad896545476251be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.522130 28664 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]). Expected version 2 got 0
I20260617 20:17:04.522797 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_491c157766b745998a68831e0c610a6b" } new_table_name: "default.Table_fd7a383258db4d0387bbef3727e3e319" modify_external_catalogs: true
I20260617 20:17:04.524462 28666 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_01fded33682b4e3f91e9f6e6e92031f6 [id=0a278273a6004aa7947a19674e45d123] alter complete (version 3)
I20260617 20:17:04.524461 29226 tablet_service.cc:1511] Processing CreateTablet for tablet ac29f4bbb2e2426da906ef60a950ccc3 (DEFAULT_TABLE table=default.Table_9a706992e1f74b07b585f66b6491d7e3 [id=763ed9048a1747ca897515ce507ae459]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.524670 29224 tablet_service.cc:1511] Processing CreateTablet for tablet e22695cd32c44283888eaaae0c10a9c6 (DEFAULT_TABLE table=default.Table_e4bae15c95f24a148e48b458b3ffd46d [id=e68eecbfbae442c493ec7dbf49c718f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.525089 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 0f2a0705c8e341739696d5ea028e2728 (DEFAULT_TABLE table=default.Table_0016b41ee33e4881852a29e9a5ae7da1 [id=f58da0cf9be14bf99ee86cbbacf3dda0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.525246 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 351860a39ac74dfaa95cd4d918980c23 (DEFAULT_TABLE table=default.Table_904b2e0f8c594d039717f494c0d47a1d [id=306bb3660c38430d9f1f414b05d94a34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.525431 29243 tablet_service.cc:1511] Processing CreateTablet for tablet 7381c348acbd462b8e04587b2eb948b6 (DEFAULT_TABLE table=default.Table_6c5c337c61df411ba27ebb1e7a4e8ec9 [id=cc73212423a64c5eab12af219ad5af5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.525694 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 351860a39ac74dfaa95cd4d918980c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.525900 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7381c348acbd462b8e04587b2eb948b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.527376 29228 tablet_service.cc:1511] Processing CreateTablet for tablet b1064bce50b64aa9afe8bb249545c5ab (DEFAULT_TABLE table=default.Table_a39fd5d8d0904a738db01e4866ba504f [id=78555f751c8c43c2aba4b8de7ae26ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.527706 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1064bce50b64aa9afe8bb249545c5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.529597 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29a1074073ca48529275baaa3a065b4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.530998 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e328704dd1c402d999d5a7421b4bf80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.533494 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f2c8a0fe63c440493b357e73f763357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.537865 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e92c53710da422da9777635d4478100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.541507 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f16576b43f9457e8e58dabd2103f433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.541759 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01bd5ecfb2bf4e2eb4ff984272003fb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.541955 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5636950d5d445c297b7e3286645d013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.542202 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e997dd0d85eb4e9d9e2205d3997f2df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.545536 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac29f4bbb2e2426da906ef60a950ccc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.545677 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f2a0705c8e341739696d5ea028e2728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.548537 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 8ca84d3c8b8f43978692bcc61956d2b5 (DEFAULT_TABLE table=default.Table_9f2d0c2b8bf04f54b37f0d9a0fb8358f [id=57654be5cdc64d239e728492003dc3a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.548766 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 17d1d5603a9d4aa8bb41c651025fad16 (DEFAULT_TABLE table=default.Table_83cd5e3f2921420f822eee497a0087d5 [id=40c032065fd44e7eb34da35cc4e451eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.548883 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ca84d3c8b8f43978692bcc61956d2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.549073 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d1d5603a9d4aa8bb41c651025fad16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.549470 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22695cd32c44283888eaaae0c10a9c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.554011 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9a733fbbdd4e95a02eb064c4cea68d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.525069 29378 raft_consensus.cc:359] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.555047 29378 raft_consensus.cc:385] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.555117 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4281bbef1efb4986a23c6fb24e62e49c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.555135 29378 raft_consensus.cc:740] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.555366 29378 consensus_queue.cc:260] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.555940 29378 ts_tablet_manager.cc:1434] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.035s user 0.001s sys 0.000s
I20260617 20:17:04.556521 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4092872f00406db21748740131eb3e (DEFAULT_TABLE table=default.Table_86ee1dcdebe4461692b1cc1234cc4965 [id=6a1430fa99ea4bbe98f5513393111db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.556869 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4092872f00406db21748740131eb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.557154 29378 tablet_bootstrap.cc:492] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.567747 29241 tablet_service.cc:1511] Processing CreateTablet for tablet a3c31f1bba074ba580601b7e8c64ea0b (DEFAULT_TABLE table=default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.568202 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c31f1bba074ba580601b7e8c64ea0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.577888 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 697c247751f2404d839d0b973c6ba7b6 (DEFAULT_TABLE table=default.Table_b1dbf26dd897427fb16163fa330af154 [id=9aadc9d3022d495c893d9293d28b2d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.577888 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 03f9ef2626b641bf895f7da11a7a652e (DEFAULT_TABLE table=default.Table_b87313ed947a489785485464059c33f9 [id=bfa8263671b84608b42d9967fc75076a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.578315 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 697c247751f2404d839d0b973c6ba7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.579202 29229 tablet_service.cc:1511] Processing CreateTablet for tablet bc48e61d2d3d4bca8051eafaa49c6534 (DEFAULT_TABLE table=default.Table_bd0b72adbbe6450ea5af79b717033ff7 [id=0c5b63bc129d49cbb0994843cc2ef6c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.585328 29378 tablet_bootstrap.cc:654] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.587320 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f9ef2626b641bf895f7da11a7a652e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.587812 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc48e61d2d3d4bca8051eafaa49c6534. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.593326 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet ee5b41c446444389821a2ebb85c1bf8b with delete_type TABLET_DATA_DELETED (replaced by tablet cb95c048212948dfb00baafbd0c691d9) from {username='slave'} at 127.0.0.1:43332
W20260617 20:17:04.596820 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3b00d3c0adcf48a48ba3d7a3de018b80 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b00d3c0adcf48a48ba3d7a3de018b80 already in progress: creating tablet
I20260617 20:17:04.605505 30693 raft_consensus.cc:493] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.605695 30693 raft_consensus.cc:515] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.606360 30693 leader_election.cc:290] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.607384 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ca84d3c8b8f43978692bcc61956d2b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.613833 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3897179e7724fdeb87a979ae4ef2091" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:04.614362 28925 leader_election.cc:343] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.620158 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 260b9cfb79684b168c20652392856808 (DEFAULT_TABLE table=default.Table_619b4975021e4a94b2fb7e5affbe4cef [id=845b578a03fd4bae95a9be628a2f1194]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.623919 29376 ts_tablet_manager.cc:1929] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.624040 29376 log.cc:1199] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/cf8d04ef8acd4fcaa69df9253cd89462
I20260617 20:17:04.628180 29376 ts_tablet_manager.cc:1950] T cf8d04ef8acd4fcaa69df9253cd89462 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:04.628803 29379 tablet_bootstrap.cc:492] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:04.628814 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 2fa78288e42844a8ac19b961f2028c60 (DEFAULT_TABLE table=default.Table_50b5db1ff0ab437f8ae21d80d7b14f64 [id=781947c106f041dda409062a199c828b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.628963 29379 ts_tablet_manager.cc:1403] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.187s user 0.004s sys 0.003s
I20260617 20:17:04.629691 29379 raft_consensus.cc:359] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.629884 29379 raft_consensus.cc:385] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.629967 29379 raft_consensus.cc:740] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.630193 29379 consensus_queue.cc:260] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.630810 29379 ts_tablet_manager.cc:1434] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:04.631114 29379 tablet_bootstrap.cc:492] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:04.634104 30693 raft_consensus.cc:493] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.634253 30693 raft_consensus.cc:515] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.634927 30693 leader_election.cc:290] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.635778 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6f05ae7d624efba571d059ce2f1c91" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:04.636184 28925 leader_election.cc:343] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.642228 29117 raft_consensus.cc:3060] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.643412 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 0259cf955d74419d92f1fe0da519cf72 (DEFAULT_TABLE table=default.Table_0dc3002823be41b18039e536eb0d547b [id=dbc091c9fea64e68b8218477cc22f456]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.657989 29377 ts_tablet_manager.cc:1929] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.658149 29377 log.cc:1199] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/3726e55ed36f420ab63bcfb5a81c5aab
I20260617 20:17:04.658545 29377 ts_tablet_manager.cc:1950] T 3726e55ed36f420ab63bcfb5a81c5aab P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:04.659353 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 792) took 1971 ms. Trace:
I20260617 20:17:04.659463 29377 rpcz_store.cc:276] 0617 20:17:02.687935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.689381 (+ 1446us) service_pool.cc:224] Handling call
0617 20:17:04.457590 (+1768209us) ts_tablet_manager.cc:1151] Deleting tablet 3726e55ed36f420ab63bcfb5a81c5aab
0617 20:17:04.457598 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.586652 (+129054us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.657911 (+ 71259us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.659303 (+ 1392us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1762350}
I20260617 20:17:04.659827 29377 tablet_replica.cc:333] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:04.659962 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 3726e55ed36f420ab63bcfb5a81c5aab (table default.Table_fbaeb71321364cca9f5c971ee3419519 [id=cd2fab71637e4b968e9957070c30c936]) successfully deleted
I20260617 20:17:04.660044 29377 raft_consensus.cc:2243] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.660336 29377 raft_consensus.cc:2272] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.665489 29375 ts_tablet_manager.cc:1929] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.665707 29375 log.cc:1199] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/0e6cee209a5a44d6b35eb50e9c33228f
I20260617 20:17:04.666164 29375 ts_tablet_manager.cc:1950] T 0e6cee209a5a44d6b35eb50e9c33228f P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:04.666989 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 706) took 5645 ms. Trace:
I20260617 20:17:04.685330 29225 tablet_service.cc:1511] Processing CreateTablet for tablet ae8574874a194473bb5891e604a25ce8 (DEFAULT_TABLE table=default.Table_762c733e4f8445ad97f36fc9ee70147a [id=f62d71842e284523bbca857af62a367a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.686317 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 82ec75621f88424d963ffe235a5149f4 (DEFAULT_TABLE table=default.Table_5bb2dea5397f4dee834759955006f657 [id=bbd9142963fd450583aef1d8d715e35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.686471 29232 tablet_service.cc:1558] Processing DeleteTablet for tablet ee5b41c446444389821a2ebb85c1bf8b with delete_type TABLET_DATA_DELETED (replaced by tablet cb95c048212948dfb00baafbd0c691d9) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.686677 29231 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ca84d3c8b8f43978692bcc61956d2b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:04.692837 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fa78288e42844a8ac19b961f2028c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.693427 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 260b9cfb79684b168c20652392856808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.693377 29375 rpcz_store.cc:276] 0617 20:16:59.021575 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.021627 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:04.494732 (+5473105us) ts_tablet_manager.cc:1151] Deleting tablet 0e6cee209a5a44d6b35eb50e9c33228f
0617 20:17:04.494742 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.632301 (+137559us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.665413 (+ 33112us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.666951 (+ 1538us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5472926}
I20260617 20:17:04.693872 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 0e6cee209a5a44d6b35eb50e9c33228f (table default.Table_81cf092bd1634c3a82380616f225e4d6 [id=313f374332bf42b5bafbd20afd819a30]) successfully deleted
I20260617 20:17:04.695741 29063 leader_election.cc:304] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:04.696210 30193 raft_consensus.cc:2749] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:04.696516 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 89f7b878728a495f83b6584f8a6aca67 (table default.Table_bb7f63dd419f420bb7bed4cf3bd9042e [id=6fb9858b817a4575abd3b84a32027d90]) successfully deleted
I20260617 20:17:04.697418 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 757) took 5036 ms. Trace:
I20260617 20:17:04.697494 29376 rpcz_store.cc:276] 0617 20:16:59.660933 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.084533 (+423600us) service_pool.cc:224] Handling call
0617 20:17:04.399450 (+4314917us) ts_tablet_manager.cc:1151] Deleting tablet cf8d04ef8acd4fcaa69df9253cd89462
0617 20:17:04.399458 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.424309 (+ 24851us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.599157 (+174848us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.697401 (+ 98244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16987,"tablet-delete.queue_time_us":4314836}
I20260617 20:17:04.697871 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 758) took 5036 ms. Trace:
I20260617 20:17:04.697893 30674 raft_consensus.cc:493] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.697942 29376 rpcz_store.cc:276] 0617 20:16:59.661012 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.084616 (+423604us) service_pool.cc:224] Handling call
0617 20:17:04.697751 (+4613135us) ts_tablet_manager.cc:1151] Deleting tablet 663dbe73689d4849a85b68a79ea4062c
0617 20:17:04.697759 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.697855 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4613056}
I20260617 20:17:04.698032 30674 raft_consensus.cc:515] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.698244 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 770) took 3613 ms. Trace:
I20260617 20:17:04.698308 29376 rpcz_store.cc:276] 0617 20:17:01.085104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.085185 (+ 81us) service_pool.cc:224] Handling call
0617 20:17:04.698148 (+3612963us) ts_tablet_manager.cc:1151] Deleting tablet 1ed860fa375848708beb31ff89056214
0617 20:17:04.698155 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.698228 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3612741}
I20260617 20:17:04.698527 29376 tablet_replica.cc:333] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:04.698710 29376 raft_consensus.cc:2243] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.699025 30678 consensus_queue.cc:1048] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:04.699283 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0259cf955d74419d92f1fe0da519cf72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.699901 30423 consensus_queue.cc:1048] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:04.700253 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 80bc9fa552114c2f90f77c67ab63b0e6 (DEFAULT_TABLE table=default.Table_00f049c59fbd43bc8134a419c3d654a5 [id=da1befcdf0ba45d1b52d9236dfbbde60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:04.700572 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bc9fa552114c2f90f77c67ab63b0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.703639 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8574874a194473bb5891e604a25ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.704674 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ec75621f88424d963ffe235a5149f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:04.705415 30410 consensus_queue.cc:1048] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260617 20:17:04.705631 30556 raft_consensus.cc:493] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.705735 30556 raft_consensus.cc:515] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.706310 30556 leader_election.cc:290] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:04.707187 29383 tablet_bootstrap.cc:492] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:04.710978 29383 ts_tablet_manager.cc:1403] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.316s user 0.015s sys 0.016s
W20260617 20:17:04.709830 29197 consensus_peers.cc:597] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: SHUTDOWN. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:04.713366 29197 leader_election.cc:304] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:04.713642 30410 raft_consensus.cc:2804] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:04.713752 30410 raft_consensus.cc:697] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:04.709932 30556 consensus_queue.cc:1048] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:04.713738 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "593d9de6a2fb47e18d86649e45ba80b9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.713976 30410 consensus_queue.cc:237] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.714473 29197 leader_election.cc:304] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:04.714664 30556 raft_consensus.cc:2804] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:04.714757 30556 raft_consensus.cc:697] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:04.714959 30556 consensus_queue.cc:237] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.709419 29376 raft_consensus.cc:2272] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:04.715477 29197 leader_election.cc:343] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.715586 29197 leader_election.cc:304] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:04.715651 29376 ts_tablet_manager.cc:1916] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.715755 30678 raft_consensus.cc:2749] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:04.716038 29197 leader_election.cc:304] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:04.716218 30678 raft_consensus.cc:2804] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:04.716297 30678 raft_consensus.cc:697] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:04.716478 30678 consensus_queue.cc:237] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.673272 29379 tablet_bootstrap.cc:654] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:04.730057 28657 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 2860409277a0423cadadd79363713fd3 (table default.Table_b25f36c0ba1247f5a4b85a5b4add8420 [id=6a948594185b42128136770dbe3f0ffb], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2860409277a0423cadadd79363713fd3 has no consensus state
I20260617 20:17:04.730971 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 707) took 5708 ms. Trace:
I20260617 20:17:04.731189 29375 rpcz_store.cc:276] 0617 20:16:59.022197 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.022248 (+ 51us) service_pool.cc:224] Handling call
0617 20:17:04.730807 (+5708559us) ts_tablet_manager.cc:1151] Deleting tablet fe6c261318b24a6caa3a376215f44f0f
0617 20:17:04.730818 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.730928 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5708387}
W20260617 20:17:04.731943 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet fe6c261318b24a6caa3a376215f44f0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe6c261318b24a6caa3a376215f44f0f already in progress: creating tablet
I20260617 20:17:04.732438 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 708) took 5709 ms. Trace:
I20260617 20:17:04.732574 29375 rpcz_store.cc:276] 0617 20:16:59.022770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.022882 (+ 112us) service_pool.cc:224] Handling call
0617 20:17:04.732293 (+5709411us) ts_tablet_manager.cc:1151] Deleting tablet 5eedf2442f964048b7a3a460b6b22f2a
0617 20:17:04.732303 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.732400 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5709251}
W20260617 20:17:04.733053 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5eedf2442f964048b7a3a460b6b22f2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5eedf2442f964048b7a3a460b6b22f2a already in progress: creating tablet
I20260617 20:17:04.733531 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 709) took 5699 ms. Trace:
I20260617 20:17:04.733827 30193 raft_consensus.cc:493] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.733963 30193 raft_consensus.cc:515] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.734658 30193 leader_election.cc:290] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.733664 29375 rpcz_store.cc:276] 0617 20:16:59.034374 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.034429 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:04.733415 (+5698986us) ts_tablet_manager.cc:1151] Deleting tablet 91fac788a74346e28f7b7e5939459325
0617 20:17:04.733424 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.733496 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5698788}
W20260617 20:17:04.735414 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 91fac788a74346e28f7b7e5939459325 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 91fac788a74346e28f7b7e5939459325 already in progress: creating tablet
I20260617 20:17:04.735826 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 713) took 5664 ms. Trace:
I20260617 20:17:04.735960 29375 rpcz_store.cc:276] 0617 20:16:59.070998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.071053 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:04.735705 (+5664652us) ts_tablet_manager.cc:1151] Deleting tablet ebd98889d08f4683ba4b2ee98a74254d
0617 20:17:04.735714 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.735788 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5664440}
W20260617 20:17:04.736435 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet ebd98889d08f4683ba4b2ee98a74254d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebd98889d08f4683ba4b2ee98a74254d already in progress: creating tablet
I20260617 20:17:04.736766 29375 tablet_replica.cc:333] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:04.737021 29375 raft_consensus.cc:2243] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:04.737279 29375 raft_consensus.cc:2272] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.737970 29375 ts_tablet_manager.cc:1916] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.667493 30693 raft_consensus.cc:493] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.742046 30693 raft_consensus.cc:515] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.742746 30693 leader_election.cc:290] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.684377 30314 raft_consensus.cc:493] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.742937 30314 raft_consensus.cc:515] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.743465 30314 leader_election.cc:290] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.684527 30546 raft_consensus.cc:493] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.743716 30546 raft_consensus.cc:515] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.744199 30546 leader_election.cc:290] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:04.694751 28925 leader_election.cc:343] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.745711 28925 leader_election.cc:304] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:04.746007 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 51268us
W20260617 20:17:04.746449 28925 leader_election.cc:343] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.746555 28925 leader_election.cc:304] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:04.695840 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc3219639748d9a0d71d45ae22ab36" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:04.746971 30755 raft_consensus.cc:2749] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:04.747099 28988 raft_consensus.cc:2468] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:04.747319 30755 raft_consensus.cc:2749] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:04.746994 28925 leader_election.cc:343] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.747814 28925 leader_election.cc:304] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:04.748018 30755 raft_consensus.cc:2749] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:04.748183 28925 leader_election.cc:343] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.748275 28925 leader_election.cc:304] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:04.748497 30755 raft_consensus.cc:2749] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:04.748657 28925 leader_election.cc:343] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.748749 28925 leader_election.cc:304] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:04.748963 30755 raft_consensus.cc:2749] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:04.699370 29378 tablet_bootstrap.cc:492] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.749504 29378 ts_tablet_manager.cc:1403] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.192s user 0.015s sys 0.012s
I20260617 20:17:04.750429 29378 raft_consensus.cc:359] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.750633 29378 raft_consensus.cc:385] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.751744 29377 ts_tablet_manager.cc:1916] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.752157 30674 leader_election.cc:290] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:04.763466 29376 ts_tablet_manager.cc:1929] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:04.765806 29376 log.cc:1199] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/64bb6d176a4845eca312848ae5104647
I20260617 20:17:04.767593 29376 ts_tablet_manager.cc:1950] T 64bb6d176a4845eca312848ae5104647 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
W20260617 20:17:04.768093 29198 leader_election.cc:343] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.770370 30641 tablet.cc:1724] T 227d8a0d46294108a6b98a1a4b67fd6d P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:04.770519 29383 raft_consensus.cc:359] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.770680 29383 raft_consensus.cc:385] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.770737 29383 raft_consensus.cc:740] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.770929 29383 consensus_queue.cc:260] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.771409 29383 ts_tablet_manager.cc:1434] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.054s user 0.000s sys 0.001s
I20260617 20:17:04.771659 29383 tablet_bootstrap.cc:492] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:04.772961 29383 tablet_bootstrap.cc:654] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.777462 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 771) took 3691 ms. Trace:
I20260617 20:17:04.777604 29376 rpcz_store.cc:276] 0617 20:17:01.085685 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.085754 (+ 69us) service_pool.cc:224] Handling call
0617 20:17:04.698492 (+3612738us) ts_tablet_manager.cc:1151] Deleting tablet 64bb6d176a4845eca312848ae5104647
0617 20:17:04.698500 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.718874 (+ 20374us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.763411 (+ 44537us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.777446 (+ 14035us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2327,"tablet-delete.queue_time_us":3612581}
I20260617 20:17:04.779696 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 772) took 3328 ms. Trace:
I20260617 20:17:04.779834 29376 rpcz_store.cc:276] 0617 20:17:01.451196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.451242 (+ 46us) service_pool.cc:224] Handling call
0617 20:17:04.779578 (+3328336us) ts_tablet_manager.cc:1151] Deleting tablet 5a20867de1214c0fb4cb8504e8361c5b
0617 20:17:04.779587 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.779681 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3328140}
I20260617 20:17:04.780174 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 775) took 2854 ms. Trace:
I20260617 20:17:04.780342 29376 rpcz_store.cc:276] 0617 20:17:01.925569 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.925669 (+ 100us) service_pool.cc:224] Handling call
0617 20:17:04.780090 (+2854421us) ts_tablet_manager.cc:1151] Deleting tablet b002468734394d8181543368ac878c6f
0617 20:17:04.780098 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.780163 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2854249}
I20260617 20:17:04.780890 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 774) took 2856 ms. Trace:
I20260617 20:17:04.781476 29376 rpcz_store.cc:276] 0617 20:17:01.925133 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.925830 (+ 697us) service_pool.cc:224] Handling call
0617 20:17:04.780807 (+2854977us) ts_tablet_manager.cc:1151] Deleting tablet 06680ddfee82464da4926e51dadd00a5
0617 20:17:04.780815 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.780878 (+ 63us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2854724}
I20260617 20:17:04.782105 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 777) took 2756 ms. Trace:
I20260617 20:17:04.782219 29376 rpcz_store.cc:276] 0617 20:17:02.025448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.025503 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:04.782017 (+2756514us) ts_tablet_manager.cc:1151] Deleting tablet c3496887f6a045e293698d09d9cc1c16
0617 20:17:04.782025 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.782093 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2756336}
I20260617 20:17:04.782567 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 778) took 2757 ms. Trace:
I20260617 20:17:04.782686 29376 rpcz_store.cc:276] 0617 20:17:02.025555 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.025595 (+ 40us) service_pool.cc:224] Handling call
0617 20:17:04.782487 (+2756892us) ts_tablet_manager.cc:1151] Deleting tablet 06680ddfee82464da4926e51dadd00a5
0617 20:17:04.782495 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.782557 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2756710}
I20260617 20:17:04.783000 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 776) took 2757 ms. Trace:
I20260617 20:17:04.783095 29376 rpcz_store.cc:276] 0617 20:17:02.025329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.025584 (+ 255us) service_pool.cc:224] Handling call
0617 20:17:04.782921 (+2757337us) ts_tablet_manager.cc:1151] Deleting tablet c17aa7f99fc74838b9975c3e9289ccfd
0617 20:17:04.782929 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.782989 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":304,"tablet-delete.queue_time_us":2757144}
I20260617 20:17:04.783424 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 781) took 2704 ms. Trace:
I20260617 20:17:04.783524 29376 rpcz_store.cc:276] 0617 20:17:02.078832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.078894 (+ 62us) service_pool.cc:224] Handling call
0617 20:17:04.783346 (+2704452us) ts_tablet_manager.cc:1151] Deleting tablet d44524b02e6f4c1291bca50e9261459b
0617 20:17:04.783353 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.783412 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2704243}
I20260617 20:17:04.783815 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 784) took 2586 ms. Trace:
I20260617 20:17:04.783926 29376 rpcz_store.cc:276] 0617 20:17:02.197726 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.197798 (+ 72us) service_pool.cc:224] Handling call
0617 20:17:04.783755 (+2585957us) ts_tablet_manager.cc:1151] Deleting tablet c8d373f177494f1486fcae4a67a13041
0617 20:17:04.783762 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.783804 (+ 42us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2585774}
I20260617 20:17:04.784201 29376 tablet_replica.cc:333] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:04.784428 29376 raft_consensus.cc:2243] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.784833 29376 raft_consensus.cc:2272] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.786077 29376 ts_tablet_manager.cc:1916] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.750725 29378 raft_consensus.cc:740] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.755093 30693 raft_consensus.cc:493] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.798025 29378 consensus_queue.cc:260] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.798650 29378 ts_tablet_manager.cc:1434] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.049s user 0.001s sys 0.001s
I20260617 20:17:04.798992 29378 tablet_bootstrap.cc:492] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:17:04.760995 28925 consensus_peers.cc:597] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:04.810859 29378 tablet_bootstrap.cc:654] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.812659 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 27c20f436b9b4a8cb659215f9579af04
I20260617 20:17:04.815292 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9f236274be424e44818107f2fed5331c" } new_table_name: "default.Table_8b3f418465f142c784a9c20784e64477" modify_external_catalogs: true
I20260617 20:17:04.816663 30693 raft_consensus.cc:515] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.817777 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet cc547148aa124907a5e5def6941f734c
I20260617 20:17:04.818218 30693 leader_election.cc:290] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.819496 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet 211d0b0897f14ff4929ed55cd2f27b94 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:04.829557 29378 tablet_bootstrap.cc:492] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:04.829533 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet ccd6f76a201e40f8be224a93c701fea9
I20260617 20:17:04.829691 29378 ts_tablet_manager.cc:1403] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.008s
I20260617 20:17:04.830470 29377 ts_tablet_manager.cc:1929] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.832021 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8b8bdf1cd4e041fcb6260ee95e42b92b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:04.832885 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b8bdf1cd4e041fcb6260ee95e42b92b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:04.750386 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde88371f4454a4bb3053c6cd1afb801" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.750604 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c59cf5f5e8486baf1e038a44657f33" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.766155 29118 raft_consensus.cc:3060] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.766050 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee426100bb645f391be123aeb52e412" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.766433 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb408723f7a346c3b5ea13cad237b44e" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:04.769161 29062 leader_election.cc:343] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f24954093a45411a9cbe39415fb1adb7
W20260617 20:17:04.834270 29062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 65105.2us
I20260617 20:17:04.781400 30766 tablet.cc:1724] T 227d8a0d46294108a6b98a1a4b67fd6d P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260617 20:17:04.835332 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 380ccd1d167744248a1ccad80788d0a0 consensus state has no leader
I20260617 20:17:04.836143 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a9e8442cc84b4609b3c6c8d4dfd6d32a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:04.836592 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9e8442cc84b4609b3c6c8d4dfd6d32a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:17:04.838655 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e9876434d9640ce9a4b30336c499241 consensus state has no leader
I20260617 20:17:04.839476 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_e610c8b1186543a1ba5ab1899c8b672a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:04.840036 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e610c8b1186543a1ba5ab1899c8b672a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:04.813501 29379 tablet_bootstrap.cc:492] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:04.813786 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet 27c20f436b9b4a8cb659215f9579af04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.857681 29379 ts_tablet_manager.cc:1403] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.227s user 0.002s sys 0.002s
I20260617 20:17:04.858489 29379 raft_consensus.cc:359] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.858672 29379 raft_consensus.cc:385] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.858739 29379 raft_consensus.cc:740] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.858958 29379 consensus_queue.cc:260] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.859407 29379 ts_tablet_manager.cc:1434] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:17:04.859687 29379 tablet_bootstrap.cc:492] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:04.861066 29379 tablet_bootstrap.cc:654] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.817800 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6af49cb484f59ad1f32235753e1db" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.818627 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet cc547148aa124907a5e5def6941f734c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.830845 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet ccd6f76a201e40f8be224a93c701fea9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:17:04.837390 29198 leader_election.cc:343] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.870258 30556 raft_consensus.cc:493] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.870287 30423 consensus_queue.cc:1048] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:04.870474 30556 raft_consensus.cc:515] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.871207 30556 leader_election.cc:290] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:17:04.860929 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 143633us
W20260617 20:17:04.871807 29197 consensus_peers.cc:597] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3726e55ed36f420ab63bcfb5a81c5aab. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:04.871965 29197 consensus_peers.cc:597] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18440a4a5c254a25b87f8632de9c92b9. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:04.872433 29197 leader_election.cc:304] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:04.872812 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219d85e4fd9b4ba3baf1e08d2b18a32c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.873075 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e20a1092b746a8b8ddd4386a682229" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.873214 30423 raft_consensus.cc:2804] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:04.873274 30423 raft_consensus.cc:493] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:04.873371 30423 raft_consensus.cc:3060] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:04.874269 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3897179e7724fdeb87a979ae4ef2091" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.875373 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6f05ae7d624efba571d059ce2f1c91" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.875936 30423 raft_consensus.cc:515] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.876498 30423 leader_election.cc:290] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:04.876618 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb408723f7a346c3b5ea13cad237b44e" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.877202 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde88371f4454a4bb3053c6cd1afb801" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.877373 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f6dcc384154d41866cf8060cf05837" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.878285 29260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c59cf5f5e8486baf1e038a44657f33" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.878340 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc3219639748d9a0d71d45ae22ab36" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:04.878664 29198 leader_election.cc:343] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:04.879283 29198 leader_election.cc:343] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.881834 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_07e0f258ed6b45a7ad99bcf9bb2c3b75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:04.882472 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07e0f258ed6b45a7ad99bcf9bb2c3b75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:17:04.883435 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc7cb1160fe94c2baf9775a193ef4c77 consensus state has no leader
I20260617 20:17:04.883610 28666 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f] alter complete (version 2)
I20260617 20:17:04.883874 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_6d055567cac04381821aa61e52e1df04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:04.884539 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d055567cac04381821aa61e52e1df04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:17:04.885152 28666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.194:51601 (request call id 141) took 937 ms (client timeout 1000 ms). Trace:
I20260617 20:17:04.885423 28661 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_0ea7c7718805448cbcc37cfd8539684e [id=cd4abe077ee04673bad87834b3af273b] alter complete (version 4)
W20260617 20:17:04.885260 28666 rpcz_store.cc:269] 0617 20:17:03.947568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.947638 (+ 70us) service_pool.cc:224] Handling call
0617 20:17:03.957021 (+ 9383us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 00007fa1201106bd 00007fa1201107b3 00007fa11ccd8b21 00007fa124a3d95d 00007fa124bcaf08 00007fa11b629ca6 00007fa11b6299d5 00007fa117d3988e 00007fa117d3876e 00007fa117d3e9a8 00007fa117d3f30f
0617 20:17:04.885092 (+928071us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:04.407661 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:04.407759 (+ 98us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:04.407765 (+ 6us) write_op.cc:435] Acquired schema lock
0617 20:17:04.407768 (+ 3us) tablet.cc:662] Decoding operations
0617 20:17:04.407869 (+ 101us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:04.407886 (+ 17us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:04.407891 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:04.407975 (+ 84us) tablet.cc:701] Row locks acquired
0617 20:17:04.407977 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:04.408027 (+ 50us) write_op.cc:270] Start()
0617 20:17:04.408063 (+ 36us) write_op.cc:276] Timestamp: P: 1781727424408007 usec, L: 0
0617 20:17:04.408066 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:04.408265 (+ 199us) log.cc:844] Serialized 356 byte log entry
0617 20:17:04.425600 (+ 17335us) op_driver.cc:464] REPLICATION: finished
0617 20:17:04.426220 (+ 620us) write_op.cc:301] APPLY: starting
0617 20:17:04.426233 (+ 13us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:04.426258 (+ 25us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:04.428099 (+ 1841us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:04.428148 (+ 49us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:04.428176 (+ 28us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:04.428183 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:04.428241 (+ 58us) log.cc:844] Serialized 23 byte log entry
0617 20:17:04.428298 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:04.428312 (+ 14us) write_op.cc:454] Released schema lock
0617 20:17:04.428319 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:04.429890 (+ 1571us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:04.429895 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 20:17:04.599782 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:04.599921 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:04.599927 (+ 6us) write_op.cc:435] Acquired schema lock
0617 20:17:04.599929 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:04.601146 (+ 1217us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:04.601160 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:04.601165 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:04.622296 (+ 21131us) tablet.cc:701] Row locks acquired
0617 20:17:04.622301 (+ 5us) write_op.cc:260] PREPARE: finished
0617 20:17:04.622378 (+ 77us) write_op.cc:270] Start()
0617 20:17:04.622418 (+ 40us) write_op.cc:276] Timestamp: P: 1781727424622343 usec, L: 0
0617 20:17:04.622422 (+ 4us) op_driver.cc:348] REPLICATION: starting
0617 20:17:04.622628 (+ 206us) log.cc:844] Serialized 356 byte log entry
0617 20:17:04.880019 (+257391us) op_driver.cc:464] REPLICATION: finished
0617 20:17:04.881716 (+ 1697us) write_op.cc:301] APPLY: starting
0617 20:17:04.881730 (+ 14us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:04.881767 (+ 37us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:04.881802 (+ 35us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:04.881847 (+ 45us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:04.881878 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:04.881889 (+ 11us) write_op.cc:312] APPLY: finished
0617 20:17:04.881943 (+ 54us) log.cc:844] Serialized 23 byte log entry
0617 20:17:04.881989 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:04.882008 (+ 19us) write_op.cc:454] Released schema lock
0617 20:17:04.882015 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:04.882079 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:04.882085 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"spinlock_wait_cycles":13817216,"child_traces":[["op",{"apply.queue_time_us":582,"apply.run_cpu_time_us":371,"apply.run_wall_time_us":2163,"num_ops":1,"prepare.queue_time_us":315426,"prepare.run_cpu_time_us":709,"prepare.run_wall_time_us":709,"raft.queue_time_us":1118,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":17516}],["op",{"apply.queue_time_us":1658,"apply.run_cpu_time_us":355,"apply.run_wall_time_us":354,"num_ops":1,"prepare.queue_time_us":74223,"prepare.run_cpu_time_us":2195,"prepare.run_wall_time_us":22936,"replication_time_us":257575}]]}
I20260617 20:17:04.896545 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet 6afb3ed704bb4a269d92f1741455161b from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:04.897135 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_143cff941bb14515ba8932f1263aedce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:04.897961 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_143cff941bb14515ba8932f1263aedce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:04.899735 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 67a3124306094c72ad78e5473aa35bdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:17:04.898718 28661 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.193:34505 (request call id 117) took 889 ms (client timeout 1000 ms). Trace:
I20260617 20:17:04.899983 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e27c5834baa48ed953fccef54e6c52b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.900297 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet e59430dd630b4ca6b573ea4230212abf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.900426 29108 tablet_service.cc:1558] Processing DeleteTablet for tablet 0859e56b5b7a483ea5e751f0468cbab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:48 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.900297 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 5faea831376646c1bdfcaf8fbbc7ca6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:17:04.899945 28661 rpcz_store.cc:269] 0617 20:17:04.008760 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.015763 (+ 7003us) service_pool.cc:224] Handling call
0617 20:17:04.898661 (+882898us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:04.408396 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:04.408488 (+ 92us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:04.408493 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:04.408495 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:04.408569 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:04.408577 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:04.408582 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:04.408629 (+ 47us) tablet.cc:701] Row locks acquired
0617 20:17:04.408632 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:04.408662 (+ 30us) write_op.cc:270] Start()
0617 20:17:04.408687 (+ 25us) write_op.cc:276] Timestamp: P: 1781727424408653 usec, L: 0
0617 20:17:04.408690 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:04.423872 (+ 15182us) log.cc:844] Serialized 536 byte log entry
0617 20:17:04.430051 (+ 6179us) op_driver.cc:464] REPLICATION: finished
0617 20:17:04.430145 (+ 94us) write_op.cc:301] APPLY: starting
0617 20:17:04.430156 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:04.430184 (+ 28us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:04.430213 (+ 29us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:04.430254 (+ 41us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:04.430278 (+ 24us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:04.430285 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:04.430350 (+ 65us) log.cc:844] Serialized 23 byte log entry
0617 20:17:04.430401 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:04.430412 (+ 11us) write_op.cc:454] Released schema lock
0617 20:17:04.430418 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:04.430487 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:04.430490 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
0617 20:17:04.622752 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:04.622861 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:04.622867 (+ 6us) write_op.cc:435] Acquired schema lock
0617 20:17:04.622869 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:04.622961 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:04.622970 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:04.622974 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:04.623023 (+ 49us) tablet.cc:701] Row locks acquired
0617 20:17:04.623028 (+ 5us) write_op.cc:260] PREPARE: finished
0617 20:17:04.623058 (+ 30us) write_op.cc:270] Start()
0617 20:17:04.623089 (+ 31us) write_op.cc:276] Timestamp: P: 1781727424623031 usec, L: 0
0617 20:17:04.623095 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 20:17:04.623261 (+ 166us) log.cc:844] Serialized 356 byte log entry
0617 20:17:04.880078 (+256817us) op_driver.cc:464] REPLICATION: finished
0617 20:17:04.882137 (+ 2059us) write_op.cc:301] APPLY: starting
0617 20:17:04.882148 (+ 11us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:04.882180 (+ 32us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:04.882206 (+ 26us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:04.882247 (+ 41us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:04.882278 (+ 31us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:04.882289 (+ 11us) write_op.cc:312] APPLY: finished
0617 20:17:04.882347 (+ 58us) log.cc:844] Serialized 23 byte log entry
0617 20:17:04.882391 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:04.882419 (+ 28us) write_op.cc:454] Released schema lock
0617 20:17:04.882426 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:04.882529 (+ 103us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:04.882535 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5733,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":57,"apply.run_cpu_time_us":333,"apply.run_wall_time_us":332,"num_ops":1,"prepare.queue_time_us":252940,"prepare.run_cpu_time_us":630,"prepare.run_wall_time_us":15549,"replication_time_us":21339}],["op",{"apply.queue_time_us":2028,"apply.run_cpu_time_us":355,"apply.run_wall_time_us":354,"num_ops":1,"prepare.queue_time_us":95614,"prepare.run_cpu_time_us":577,"prepare.run_wall_time_us":577,"replication_time_us":256962}]]}
I20260617 20:17:04.900961 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b16811c4e5c6448194a1adf7df3d96a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:04.901490 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b16811c4e5c6448194a1adf7df3d96a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:04.902567 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet fed593a3fa7742a18ccc2124c3ee0fb9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.910041 29375 ts_tablet_manager.cc:1929] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:04.830860 29378 raft_consensus.cc:359] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.910427 29378 raft_consensus.cc:385] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.910532 29378 raft_consensus.cc:740] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.910746 29378 consensus_queue.cc:260] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.911276 29378 ts_tablet_manager.cc:1434] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.082s user 0.001s sys 0.000s
W20260617 20:17:04.836808 28925 leader_election.cc:343] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.910440 29377 log.cc:1199] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/8a5d9677bc184c30be1a11bfa85a97c8
W20260617 20:17:04.911424 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 74644.4us
W20260617 20:17:04.911628 28925 leader_election.cc:343] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.911746 29377 ts_tablet_manager.cc:1950] T 8a5d9677bc184c30be1a11bfa85a97c8 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:17:04.911806 28925 leader_election.cc:343] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:04.911978 28925 leader_election.cc:343] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.845561 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet cc547148aa124907a5e5def6941f734c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.845712 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet ccd6f76a201e40f8be224a93c701fea9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.846247 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 27c20f436b9b4a8cb659215f9579af04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.892838 30756 raft_consensus.cc:493] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.912496 30756 raft_consensus.cc:515] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.912665 29378 tablet_bootstrap.cc:492] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:04.913100 30756 leader_election.cc:290] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.913208 30756 raft_consensus.cc:493] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.913338 30756 raft_consensus.cc:515] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.913822 30756 leader_election.cc:290] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.914037 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 799) took 2219 ms. Trace:
I20260617 20:17:04.914191 29378 tablet_bootstrap.cc:654] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.914100 29377 rpcz_store.cc:276] 0617 20:17:02.694282 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.694415 (+ 133us) service_pool.cc:224] Handling call
0617 20:17:04.659750 (+1965335us) ts_tablet_manager.cc:1151] Deleting tablet 8a5d9677bc184c30be1a11bfa85a97c8
0617 20:17:04.659762 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.827534 (+167772us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.830400 (+ 2866us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.914025 (+ 83625us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1963990}
I20260617 20:17:04.914382 29377 tablet_replica.cc:333] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:04.914572 29377 raft_consensus.cc:2243] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:04.914723 29377 raft_consensus.cc:2272] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.916345 29376 ts_tablet_manager.cc:1929] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.916460 29376 log.cc:1199] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/b4240e14b48f4a43b7ce9c6512fc7ff2
I20260617 20:17:04.916803 29376 ts_tablet_manager.cc:1950] T b4240e14b48f4a43b7ce9c6512fc7ff2 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:04.917608 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 785) took 2719 ms. Trace:
I20260617 20:17:04.917702 29376 rpcz_store.cc:276] 0617 20:17:02.198090 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.199486 (+ 1396us) service_pool.cc:224] Handling call
0617 20:17:04.784157 (+2584671us) ts_tablet_manager.cc:1151] Deleting tablet b4240e14b48f4a43b7ce9c6512fc7ff2
0617 20:17:04.784164 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.875967 (+ 91803us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.916277 (+ 40310us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.917586 (+ 1309us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2584510}
I20260617 20:17:04.918097 29376 tablet_replica.cc:333] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:04.918716 29377 ts_tablet_manager.cc:1916] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:04.897111 28664 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.195:55493 (request call id 140) took 784 ms (client timeout 1000 ms). Trace:
W20260617 20:17:04.927167 28664 rpcz_store.cc:269] 0617 20:17:04.112216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.150880 (+ 38664us) service_pool.cc:224] Handling call
0617 20:17:04.897036 (+746156us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:04.623391 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:04.623476 (+ 85us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:04.623480 (+ 4us) write_op.cc:435] Acquired schema lock
0617 20:17:04.623482 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:04.623562 (+ 80us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:04.623569 (+ 7us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:04.623574 (+ 5us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:04.623614 (+ 40us) tablet.cc:701] Row locks acquired
0617 20:17:04.623616 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:04.623638 (+ 22us) write_op.cc:270] Start()
0617 20:17:04.623659 (+ 21us) write_op.cc:276] Timestamp: P: 1781727424623614 usec, L: 0
0617 20:17:04.623662 (+ 3us) op_driver.cc:348] REPLICATION: starting
0617 20:17:04.623804 (+ 142us) log.cc:844] Serialized 536 byte log entry
0617 20:17:04.880137 (+256333us) op_driver.cc:464] REPLICATION: finished
0617 20:17:04.882590 (+ 2453us) write_op.cc:301] APPLY: starting
0617 20:17:04.882602 (+ 12us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:04.882636 (+ 34us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:04.882670 (+ 34us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:04.882711 (+ 41us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:04.882744 (+ 33us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:04.882755 (+ 11us) write_op.cc:312] APPLY: finished
0617 20:17:04.882816 (+ 61us) log.cc:844] Serialized 23 byte log entry
0617 20:17:04.882860 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:04.882873 (+ 13us) write_op.cc:454] Released schema lock
0617 20:17:04.882880 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:04.882941 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:04.882947 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":2419,"apply.run_cpu_time_us":344,"apply.run_wall_time_us":344,"num_ops":1,"prepare.queue_time_us":83617,"prepare.run_cpu_time_us":472,"prepare.run_wall_time_us":471,"replication_time_us":256454}]]}
I20260617 20:17:04.915735 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaddd6519dc490c8358be629b21a2d9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.915946 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ca961cfea54a7187cc7ea8d16a627f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:04.927338 29379 tablet_bootstrap.cc:492] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
W20260617 20:17:04.929163 28925 leader_election.cc:343] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.929335 29379 ts_tablet_manager.cc:1403] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.000s
W20260617 20:17:04.929551 28925 leader_election.cc:343] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.930217 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab with delete_type TABLET_DATA_DELETED (replaced by tablet b4dbefbe5234458cb299410ddb2c73a3) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.930445 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet f823290351d542179b8bcc683d7acf6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.930645 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f6dcc384154d41866cf8060cf05837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.930655 29379 raft_consensus.cc:359] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.928778 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 8a5d9677bc184c30be1a11bfa85a97c8 (table default.Table_2cc66b9f491541379d5bb95e9d64b6db [id=bc7497631072430ca5571972468880f7]) successfully deleted
I20260617 20:17:04.930846 29379 raft_consensus.cc:385] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.930941 29379 raft_consensus.cc:740] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.931198 29379 consensus_queue.cc:260] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.931831 29379 ts_tablet_manager.cc:1434] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:17:04.932108 29379 tablet_bootstrap.cc:492] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:04.932265 30424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Bootstrap replayed 1/1 log segments. Stats: ops{read=525 overwritten=0 applied=525 ignored=0} inserts{seen=503 ignored=0} mutations{seen=604 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260617 20:17:04.932255 29375 log.cc:1199] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/dcd999d88d954e50810cc01b297a27a9
I20260617 20:17:04.932803 29375 ts_tablet_manager.cc:1950] T dcd999d88d954e50810cc01b297a27a9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:04.932996 30424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: Bootstrap complete.
I20260617 20:17:04.933123 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 715) took 5737 ms. Trace:
I20260617 20:17:04.934198 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 211d0b0897f14ff4929ed55cd2f27b94
I20260617 20:17:04.936159 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2797384f7845969ee9744b444f1acc with delete_type TABLET_DATA_DELETED (replaced by tablet 9dad85a23c0a45218fcd6ac04c12831a) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.936345 28956 tablet_service.cc:1558] Processing DeleteTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.936504 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 58213ec0a9364a91a15fc0329f28605b with delete_type TABLET_DATA_DELETED (replaced by tablet 43462cf7003747d08e6b0e5db5999b3f) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.936650 28955 tablet_service.cc:1558] Processing DeleteTablet for tablet 39ca961cfea54a7187cc7ea8d16a627f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.936807 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 938b61a0f6dc4d178971034fd18c1674 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.936951 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 211d0b0897f14ff4929ed55cd2f27b94 with delete_type TABLET_DATA_DELETED (replaced by tablet 0332617d0db44eda9166a88e75539d16) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:04.940850 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 211d0b0897f14ff4929ed55cd2f27b94 with delete_type TABLET_DATA_DELETED (replaced by tablet 0332617d0db44eda9166a88e75539d16) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:04.941540 30678 raft_consensus.cc:493] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.941700 30678 raft_consensus.cc:515] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.942377 30678 leader_election.cc:290] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:04.942692 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cafcade995b407f84f56b8cd3ab6892" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:04.943181 29198 leader_election.cc:343] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.944350 28663 catalog_manager.cc:6784] ReplaceTablet: tablet 211d0b0897f14ff4929ed55cd2f27b94 deleted and replaced by tablet 0332617d0db44eda9166a88e75539d16
I20260617 20:17:04.947175 29383 tablet_bootstrap.cc:492] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:04.947351 29383 ts_tablet_manager.cc:1403] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.176s user 0.000s sys 0.003s
I20260617 20:17:04.948195 29383 raft_consensus.cc:359] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.948364 29383 raft_consensus.cc:385] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.948480 29383 raft_consensus.cc:740] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.948729 29383 consensus_queue.cc:260] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.949198 29383 ts_tablet_manager.cc:1434] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:17:04.949617 29383 tablet_bootstrap.cc:492] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:04.951061 29379 tablet_bootstrap.cc:654] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.951308 29383 tablet_bootstrap.cc:654] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.951922 29175 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:04.955618 28667 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet d673bc9892c94725b270ef3b9dc768f4 (table default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330]). Expected version 1 got 0
I20260617 20:17:04.955901 28667 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]). Expected version 2 got 0
I20260617 20:17:04.933202 29375 rpcz_store.cc:276] 0617 20:16:59.195520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.195578 (+ 58us) service_pool.cc:224] Handling call
0617 20:17:04.736706 (+5541128us) ts_tablet_manager.cc:1151] Deleting tablet dcd999d88d954e50810cc01b297a27a9
0617 20:17:04.736715 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.864210 (+127495us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.909955 (+ 45745us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.933093 (+ 23138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5540957}
I20260617 20:17:04.956110 28667 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet ead0291870a443d9b76ea919a45a4303 (table default.Table_d353f219381d4d17a2927a233465454c [id=0ef22e22306747b28d49d58d0fa45620]). Expected version 4 got 0
I20260617 20:17:04.956769 29375 tablet_replica.cc:333] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
W20260617 20:17:04.957798 29198 consensus_peers.cc:597] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:04.958068 29375 raft_consensus.cc:2243] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.958258 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_87c7eb0a5f3843a4ae45931a17a7b234" } new_table_name: "default.Table_3198a4e3806449bc8871764c181d5ebf" modify_external_catalogs: true
I20260617 20:17:04.958431 29375 pending_rounds.cc:70] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:17:04.958566 29375 pending_rounds.cc:77] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955513367851008 op_type: NO_OP noop_request { }
I20260617 20:17:04.958752 29375 raft_consensus.cc:2889] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:04.958921 29375 raft_consensus.cc:2272] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:04.959482 29375 ts_tablet_manager.cc:1916] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.959705 29376 raft_consensus.cc:2243] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:04.960009 29376 raft_consensus.cc:2272] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:04.960695 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3e20a1092b746a8b8ddd4386a682229 consensus state has no leader
I20260617 20:17:04.961006 29383 tablet_bootstrap.cc:492] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:04.961445 29376 ts_tablet_manager.cc:1916] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:04.961125 29383 ts_tablet_manager.cc:1403] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260617 20:17:04.961571 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cdca7e869e14460f90d0a273c55a4670" } modify_external_catalogs: true
I20260617 20:17:04.961835 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_cdca7e869e14460f90d0a273c55a4670" } modify_external_catalogs: true
I20260617 20:17:04.962368 29383 raft_consensus.cc:359] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.962522 29383 raft_consensus.cc:385] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:04.962584 29383 raft_consensus.cc:740] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:04.962771 29383 consensus_queue.cc:260] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.963979 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8c876d1d42224f5e83e8b62167dc4368" } modify_external_catalogs: true
I20260617 20:17:04.964252 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8c876d1d42224f5e83e8b62167dc4368" } modify_external_catalogs: true
I20260617 20:17:04.964829 29383 ts_tablet_manager.cc:1434] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:04.965111 29383 tablet_bootstrap.cc:492] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:04.967321 30294 raft_consensus.cc:493] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.967502 30693 raft_consensus.cc:493] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:04.967481 30294 raft_consensus.cc:515] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.967654 30693 raft_consensus.cc:515] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:04.968089 30294 leader_election.cc:290] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.968340 30693 leader_election.cc:290] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:04.968977 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17684c0e6b545d1a22801071b6a72ac" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:04.969460 28925 leader_election.cc:343] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:04.969872 29377 ts_tablet_manager.cc:1929] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 20:17:04.970381 29062 leader_election.cc:343] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: ea2a8f46e8ac4f4aa39544a9fe40b1fe
I20260617 20:17:04.971978 29383 tablet_bootstrap.cc:654] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:04.975926 29375 ts_tablet_manager.cc:1929] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:04.993352 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6af49cb484f59ad1f32235753e1db" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.995023 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaddd6519dc490c8358be629b21a2d9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.995875 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ca961cfea54a7187cc7ea8d16a627f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.996534 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17684c0e6b545d1a22801071b6a72ac" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:04.997463 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet cf8d04ef8acd4fcaa69df9253cd89462 (table default.Table_4de9b511b49b48cca1674d8532df65cd [id=7ba43f49c1924ed0acfb4c453dc8d0f9]) successfully deleted
W20260617 20:17:04.998174 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 663dbe73689d4849a85b68a79ea4062c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 663dbe73689d4849a85b68a79ea4062c already in progress: creating tablet
W20260617 20:17:04.998809 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 1ed860fa375848708beb31ff89056214 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ed860fa375848708beb31ff89056214 already in progress: creating tablet
I20260617 20:17:05.002544 28979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "593d9de6a2fb47e18d86649e45ba80b9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.002729 28979 raft_consensus.cc:2468] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:05.003701 29378 tablet_bootstrap.cc:492] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:05.003854 29378 ts_tablet_manager.cc:1403] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.091s user 0.005s sys 0.020s
I20260617 20:17:05.004735 29378 raft_consensus.cc:359] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:05.004911 29378 raft_consensus.cc:385] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.004969 29378 raft_consensus.cc:740] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.005172 29378 consensus_queue.cc:260] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:05.005880 29378 ts_tablet_manager.cc:1434] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260617 20:17:05.006228 29378 tablet_bootstrap.cc:492] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:05.007921 29378 tablet_bootstrap.cc:654] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.015268 29383 tablet_bootstrap.cc:492] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:05.015520 29383 ts_tablet_manager.cc:1403] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.050s user 0.007s sys 0.007s
I20260617 20:17:05.016396 29383 raft_consensus.cc:359] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.017341 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 74c73ae1007d44ce958ad02fa5787651 (table default.Table_59e33a772ea84e4286330690b0973bf4 [id=0586dbd68a634d83ab9b00d2ba7f38af]). Expected version 2 got 0
I20260617 20:17:05.017822 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet a3e20a1092b746a8b8ddd4386a682229 (table default.Table_8b3f418465f142c784a9c20784e64477 [id=a3772e01cb314c7e88e85833d727617d]). Expected version 2 got 0
I20260617 20:17:05.018038 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]). Expected version 1 got 0
I20260617 20:17:05.018445 29383 raft_consensus.cc:385] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.018534 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]). Expected version 2 got 0
I20260617 20:17:05.018584 29383 raft_consensus.cc:740] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.019104 29383 consensus_queue.cc:260] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.023116 29378 tablet_bootstrap.cc:492] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:05.023326 29378 ts_tablet_manager.cc:1403] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.001s
I20260617 20:17:05.024226 29378 raft_consensus.cc:359] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.024477 29378 raft_consensus.cc:385] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.024582 29378 raft_consensus.cc:740] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.024863 29378 consensus_queue.cc:260] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.025472 29378 ts_tablet_manager.cc:1434] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:05.026017 29378 tablet_bootstrap.cc:492] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:05.027469 29378 tablet_bootstrap.cc:654] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.028131 29383 ts_tablet_manager.cc:1434] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20260617 20:17:05.028462 29383 tablet_bootstrap.cc:492] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:05.029660 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3f075eeaca7944f5a62ec0392ebea2d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.030428 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f075eeaca7944f5a62ec0392ebea2d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.031673 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_aa47b2f6d9c446669f0a2ba8447cb83f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.032174 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa47b2f6d9c446669f0a2ba8447cb83f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.033370 28661 master_service.cc:960] ReplaceTablet: received request to replace tablet 938b61a0f6dc4d178971034fd18c1674 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:05.033862 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c0dd8c6e7ae243adbcd9f5963255065f" } modify_external_catalogs: true
I20260617 20:17:05.034011 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c0dd8c6e7ae243adbcd9f5963255065f" } modify_external_catalogs: true
I20260617 20:17:05.034637 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fbd010547fdb4650b1d982bc400ade26" } modify_external_catalogs: true
I20260617 20:17:05.034777 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fbd010547fdb4650b1d982bc400ade26" } modify_external_catalogs: true
I20260617 20:17:05.036183 29383 tablet_bootstrap.cc:654] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:05.042343 28636 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 48048.8us
I20260617 20:17:05.048944 29376 ts_tablet_manager.cc:1929] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:05.053354 29377 log.cc:1199] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/5faea831376646c1bdfcaf8fbbc7ca6d
I20260617 20:17:05.053929 29377 ts_tablet_manager.cc:1950] T 5faea831376646c1bdfcaf8fbbc7ca6d P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:05.054868 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 798) took 2360 ms. Trace:
I20260617 20:17:05.055032 29377 rpcz_store.cc:276] 0617 20:17:02.694221 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.694452 (+ 231us) service_pool.cc:224] Handling call
0617 20:17:04.914341 (+2219889us) ts_tablet_manager.cc:1151] Deleting tablet 5faea831376646c1bdfcaf8fbbc7ca6d
0617 20:17:04.914350 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.964968 (+ 50618us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.969823 (+ 4855us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.054847 (+ 85024us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2218469}
I20260617 20:17:05.055239 30424 raft_consensus.cc:359] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:05.056303 29377 tablet_replica.cc:333] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:05.057086 28670 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f6435bac04e472c99e81b6e7e9a6012 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:04.990461 30294 raft_consensus.cc:493] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.057658 30294 raft_consensus.cc:515] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.057699 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_10083b9d580b48efac85dba92bf6c202" } modify_external_catalogs: true
I20260617 20:17:05.057894 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_10083b9d580b48efac85dba92bf6c202" } modify_external_catalogs: true
I20260617 20:17:05.058259 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5bc8b1dc268b455ea263b67077e0bf6d
I20260617 20:17:05.058405 30294 leader_election.cc:290] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.059187 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8c61ed13b3864bfe8dc750eb3d6accd8" } new_table_name: "default.Table_fd36630af298479ea72ee90aac680893" modify_external_catalogs: true
I20260617 20:17:05.045563 29379 tablet_bootstrap.cc:492] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:05.059913 29379 ts_tablet_manager.cc:1403] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.128s user 0.001s sys 0.003s
I20260617 20:17:05.060707 29379 raft_consensus.cc:359] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.060886 29379 raft_consensus.cc:385] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.061064 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bc8b1dc268b455ea263b67077e0bf6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.061102 29379 raft_consensus.cc:740] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.061344 29379 consensus_queue.cc:260] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.061841 29379 ts_tablet_manager.cc:1434] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:05.063023 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ec9b81dbecf641cf9110b33876e99612" } new_table_name: "default.Table_0db02a7ec7e94e95826a6132d5527a3a" modify_external_catalogs: true
I20260617 20:17:05.066717 30424 raft_consensus.cc:740] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87437cd320a4470fa0dedd43aa7ea3eb, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.067152 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 5faea831376646c1bdfcaf8fbbc7ca6d (table default.Table_230ee4baedc44720869f17501e15a05e [id=aa54066da9fc4f3db61a51b59db1afb6]) successfully deleted
I20260617 20:17:05.061357 29375 log.cc:1199] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/75519f97f1ce49ceb3a739ba7c7bc239
I20260617 20:17:05.067534 30693 raft_consensus.cc:493] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.067655 30693 raft_consensus.cc:515] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.067932 29375 ts_tablet_manager.cc:1950] T 75519f97f1ce49ceb3a739ba7c7bc239 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:05.068264 30693 leader_election.cc:290] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.068758 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bc8b1dc268b455ea263b67077e0bf6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.069013 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a3d9ae347845dfa9357010819ebc58" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.069067 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5d09b732e1cc4126bf7b0b17e5396607
I20260617 20:17:05.069284 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b427ba6320be4f2a929eaf18a56b4309" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.050669 29383 tablet_bootstrap.cc:492] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
W20260617 20:17:05.069624 28925 leader_election.cc:343] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.069657 29376 log.cc:1199] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/488b06f05d9b4273a61bcb2d6e0ad796
I20260617 20:17:05.069731 29383 ts_tablet_manager.cc:1403] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.001s
I20260617 20:17:05.069859 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d09b732e1cc4126bf7b0b17e5396607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.070564 29383 raft_consensus.cc:359] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.070729 29383 raft_consensus.cc:385] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.070788 29383 raft_consensus.cc:740] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.070994 29383 consensus_queue.cc:260] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.071367 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d09b732e1cc4126bf7b0b17e5396607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.071489 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5
I20260617 20:17:05.071861 29376 ts_tablet_manager.cc:1950] T 488b06f05d9b4273a61bcb2d6e0ad796 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:05.072536 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.071862 29383 ts_tablet_manager.cc:1434] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:05.073179 29383 tablet_bootstrap.cc:492] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:05.073655 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.075130 29383 tablet_bootstrap.cc:654] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.076998 29379 tablet_bootstrap.cc:492] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:05.079991 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 725) took 5688 ms. Trace:
I20260617 20:17:05.080154 29375 rpcz_store.cc:276] 0617 20:16:59.391701 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.398799 (+ 7098us) service_pool.cc:224] Handling call
0617 20:17:04.956705 (+5557906us) ts_tablet_manager.cc:1151] Deleting tablet 75519f97f1ce49ceb3a739ba7c7bc239
0617 20:17:04.956715 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.973265 (+ 16550us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:04.975869 (+ 2604us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.079954 (+104085us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5557728}
I20260617 20:17:05.080718 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 75519f97f1ce49ceb3a739ba7c7bc239 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]) successfully deleted
I20260617 20:17:05.081149 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 730) took 5638 ms. Trace:
I20260617 20:17:05.085428 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 786) took 2885 ms. Trace:
I20260617 20:17:05.085580 29376 rpcz_store.cc:276] 0617 20:17:02.199494 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.199547 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:04.918050 (+2718503us) ts_tablet_manager.cc:1151] Deleting tablet 488b06f05d9b4273a61bcb2d6e0ad796
0617 20:17:04.918060 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:04.964494 (+ 46434us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.048890 (+ 84396us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.085408 (+ 36518us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2718335}
W20260617 20:17:05.087352 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08290c23fff5449481789b29d15c4781 consensus state has no leader
I20260617 20:17:05.087396 29375 rpcz_store.cc:276] 0617 20:16:59.442250 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.442574 (+ 324us) service_pool.cc:224] Handling call
0617 20:17:05.081019 (+5638445us) ts_tablet_manager.cc:1151] Deleting tablet 88ab6fe7319940fcabd315193c51e199
0617 20:17:05.081028 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.081116 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5638209}
W20260617 20:17:05.087859 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc0081e8742248a0ba088006a905ce85 consensus state has no leader
I20260617 20:17:05.087558 29383 tablet_bootstrap.cc:492] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:05.088271 29383 ts_tablet_manager.cc:1403] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.000s
I20260617 20:17:05.088301 29376 tablet_replica.cc:333] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:05.088496 29376 raft_consensus.cc:2243] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 20:17:05.088908 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 88ab6fe7319940fcabd315193c51e199 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88ab6fe7319940fcabd315193c51e199 already in progress: creating tablet
I20260617 20:17:05.089375 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 731) took 5623 ms. Trace:
I20260617 20:17:05.089108 29383 raft_consensus.cc:359] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.089568 29383 raft_consensus.cc:385] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.089645 29383 raft_consensus.cc:740] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.089855 29375 rpcz_store.cc:276] 0617 20:16:59.465521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.465578 (+ 57us) service_pool.cc:224] Handling call
0617 20:17:05.089193 (+5623615us) ts_tablet_manager.cc:1151] Deleting tablet 5f6435bac04e472c99e81b6e7e9a6012
0617 20:17:05.089203 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.089345 (+ 142us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5623234}
I20260617 20:17:05.089756 29376 raft_consensus.cc:2272] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:05.089874 29383 consensus_queue.cc:260] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.090643 29376 ts_tablet_manager.cc:1916] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:05.091116 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5f6435bac04e472c99e81b6e7e9a6012 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f6435bac04e472c99e81b6e7e9a6012 already in progress: creating tablet
I20260617 20:17:05.091468 29375 tablet_replica.cc:333] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:05.093130 29375 raft_consensus.cc:2243] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:05.090751 29383 ts_tablet_manager.cc:1434] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:05.093564 29383 tablet_bootstrap.cc:492] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:05.094540 29375 raft_consensus.cc:2272] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:05.095438 29383 tablet_bootstrap.cc:654] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.095464 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee426100bb645f391be123aeb52e412" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.095561 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 64bb6d176a4845eca312848ae5104647 (table default.Table_12cb16608a854819a7e0834654f128bb [id=6e89910c5d7a4969a79960d34eff437c]) successfully deleted
I20260617 20:17:05.095675 28981 raft_consensus.cc:2468] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:17:05.095788 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5a20867de1214c0fb4cb8504e8361c5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a20867de1214c0fb4cb8504e8361c5b already in progress: creating tablet
W20260617 20:17:05.095995 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet b002468734394d8181543368ac878c6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b002468734394d8181543368ac878c6f already in progress: creating tablet
W20260617 20:17:05.096199 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 06680ddfee82464da4926e51dadd00a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06680ddfee82464da4926e51dadd00a5 already in progress: creating tablet
W20260617 20:17:05.096403 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet c3496887f6a045e293698d09d9cc1c16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3496887f6a045e293698d09d9cc1c16 already in progress: creating tablet
W20260617 20:17:05.096596 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 06680ddfee82464da4926e51dadd00a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06680ddfee82464da4926e51dadd00a5 already in progress: creating tablet
W20260617 20:17:05.096784 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet c17aa7f99fc74838b9975c3e9289ccfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c17aa7f99fc74838b9975c3e9289ccfd already in progress: creating tablet
W20260617 20:17:05.096966 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d44524b02e6f4c1291bca50e9261459b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d44524b02e6f4c1291bca50e9261459b already in progress: creating tablet
W20260617 20:17:05.097111 28925 leader_election.cc:343] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:05.097177 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet c8d373f177494f1486fcae4a67a13041 because the tablet was not found. No further retry: Not found: Tablet not found: c8d373f177494f1486fcae4a67a13041
I20260617 20:17:05.097220 28925 leader_election.cc:304] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:05.097743 28925 leader_election.cc:343] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.097862 28925 leader_election.cc:304] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:05.098235 28925 leader_election.cc:343] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.098320 28925 leader_election.cc:304] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.098758 30314 raft_consensus.cc:2749] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.098803 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adbc3219639748d9a0d71d45ae22ab36" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.098922 30314 consensus_queue.cc:1048] T fa123fc62a594dd19f20b520760fe6c4 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:05.099180 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219d85e4fd9b4ba3baf1e08d2b18a32c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.099298 30314 raft_consensus.cc:2749] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.099331 28988 raft_consensus.cc:2468] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:05.099604 30314 raft_consensus.cc:2749] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.099936 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cafcade995b407f84f56b8cd3ab6892" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.100067 28983 raft_consensus.cc:2468] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:05.102594 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet b4240e14b48f4a43b7ce9c6512fc7ff2 (table default.Table_d3c4a4f115524492993663ad7da2da7a [id=c35dbd440308443187b41417db2068f9]) successfully deleted
I20260617 20:17:05.105540 29383 tablet_bootstrap.cc:492] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:05.098932 28989 raft_consensus.cc:3060] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.105677 29383 ts_tablet_manager.cc:1403] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260617 20:17:05.106453 29383 raft_consensus.cc:359] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.106611 29383 raft_consensus.cc:385] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.106660 29383 raft_consensus.cc:740] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.106822 29383 consensus_queue.cc:260] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.108425 28989 raft_consensus.cc:2468] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:05.109066 29383 ts_tablet_manager.cc:1434] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:05.109968 29383 tablet_bootstrap.cc:492] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:05.110018 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_91ce1deb19d345e983397a67460cabcb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.110708 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91ce1deb19d345e983397a67460cabcb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.111116 30678 raft_consensus.cc:493] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.111240 30678 raft_consensus.cc:515] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.111874 30678 leader_election.cc:290] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:05.113330 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c20f436b9b4a8cb659215f9579af04" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:05.113962 29198 leader_election.cc:343] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.114656 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_619b4975021e4a94b2fb7e5affbe4cef" } new_table_name: "default.Table_a819c05e072c49eca6f58ced1b6f4887" modify_external_catalogs: true
I20260617 20:17:05.116539 30424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 525, Last appended: 1.525, Last appended by leader: 525, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:05.116843 29377 raft_consensus.cc:2243] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:05.120347 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6f05ae7d624efba571d059ce2f1c91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.121135 29377 pending_rounds.cc:70] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: Trying to abort 1 pending ops.
I20260617 20:17:05.121212 29377 pending_rounds.cc:77] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955524275572736 op_type: NO_OP noop_request { }
W20260617 20:17:05.121373 28925 leader_election.cc:343] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.121572 28925 leader_election.cc:304] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.121407 29377 raft_consensus.cc:2889] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:05.121994 29377 raft_consensus.cc:2272] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:05.122269 30314 raft_consensus.cc:2749] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:05.122642 28925 leader_election.cc:343] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.122788 28925 leader_election.cc:304] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.123008 30314 raft_consensus.cc:2749] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:05.123332 28925 leader_election.cc:343] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.123462 28925 leader_election.cc:304] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.123664 30314 raft_consensus.cc:2749] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:05.124469 28925 leader_election.cc:343] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.124614 28925 leader_election.cc:304] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.124863 30314 raft_consensus.cc:2749] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:05.125639 28925 leader_election.cc:343] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.125792 28925 leader_election.cc:304] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:05.126470 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 260b9cfb79684b168c20652392856808 consensus state has no leader
I20260617 20:17:05.125962 30314 raft_consensus.cc:493] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.126984 29375 ts_tablet_manager.cc:1916] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:05.126900 30314 raft_consensus.cc:515] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.127463 30314 leader_election.cc:290] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.126592 29377 ts_tablet_manager.cc:1916] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:05.128492 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 99a3d9ae347845dfa9357010819ebc58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.129184 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 5faea831376646c1bdfcaf8fbbc7ca6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.129988 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a5d9677bc184c30be1a11bfa85a97c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.130882 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 269d2bb9f1fd45f89ab765b33a502baf with delete_type TABLET_DATA_DELETED (replaced by tablet 9a4c040cfe4445bca51e302a98b40971) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.131366 29383 tablet_bootstrap.cc:654] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.131628 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet eb408723f7a346c3b5ea13cad237b44e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.132581 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 5df6af49cb484f59ad1f32235753e1db with delete_type TABLET_DATA_DELETED (replaced by tablet 663dbe73689d4849a85b68a79ea4062c) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.133179 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet e3897179e7724fdeb87a979ae4ef2091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.134042 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 26ebcfc80ca64129a7ab939bfd853998 with delete_type TABLET_DATA_DELETED (replaced by tablet a3013ecc095842f293f86f52f19510d0) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.134433 29377 ts_tablet_manager.cc:1929] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:05.134577 29377 log.cc:1199] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/b427ba6320be4f2a929eaf18a56b4309
I20260617 20:17:05.134730 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eaddd6519dc490c8358be629b21a2d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.135015 29377 ts_tablet_manager.cc:1950] T b427ba6320be4f2a929eaf18a56b4309 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:05.135320 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet cde88371f4454a4bb3053c6cd1afb801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.135344 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 791) took 2456 ms. Trace:
I20260617 20:17:05.135406 29377 rpcz_store.cc:276] 0617 20:17:02.678834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.678880 (+ 46us) service_pool.cc:224] Handling call
0617 20:17:05.056226 (+2377346us) ts_tablet_manager.cc:1151] Deleting tablet b427ba6320be4f2a929eaf18a56b4309
0617 20:17:05.056235 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.121053 (+ 64818us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x6160000c7054. stack: 00007ffae652a496 00007ffae652a250 00007ffae55553ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007ffaf25d07e0 00007ffaf391c933 00007ffaf64dfae7 00007ffaf6512bb4 00007ffaf64f35d0 00007ffaf64f335d 0000000000aa681c 00007ffae65709ff 00007ffae6573d1b 00007ffae6573b98
0617 20:17:05.131262 (+ 10209us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.134383 (+ 3121us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.135331 (+ 948us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136574720,"tablet-delete.queue_time_us":2359167}
I20260617 20:17:05.135968 30314 raft_consensus.cc:2749] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:05.136287 28925 leader_election.cc:343] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.136763 28925 leader_election.cc:304] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.137023 30314 raft_consensus.cc:2749] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.137015 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b04a91bebb6d429cbe4de27fdcd30bb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.137450 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 27c20f436b9b4a8cb659215f9579af04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.137631 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet cc547148aa124907a5e5def6941f734c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:17:05.137660 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b04a91bebb6d429cbe4de27fdcd30bb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.137889 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet ccd6f76a201e40f8be224a93c701fea9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:17:05.137974 28925 leader_election.cc:343] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.138118 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 89f7b878728a495f83b6584f8a6aca67 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.138162 28925 leader_election.cc:304] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.138392 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet dee426100bb645f391be123aeb52e412 with delete_type TABLET_DATA_DELETED (replaced by tablet c3496887f6a045e293698d09d9cc1c16) from {username='slave'} at 127.0.0.1:41028
W20260617 20:17:05.138494 28925 leader_election.cc:343] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.138731 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e0c5d20a4548cc8124302aa38bcb21 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:50 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.139093 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet cbeae97639fd4e6290768dae12f6a4ce with delete_type TABLET_DATA_DELETED (replaced by tablet cc547148aa124907a5e5def6941f734c) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.139369 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet adbc3219639748d9a0d71d45ae22ab36 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b00d3c0adcf48a48ba3d7a3de018b80) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.139649 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet f02529cd1e764a3886de27d86e9690e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.139941 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 211d0b0897f14ff4929ed55cd2f27b94 with delete_type TABLET_DATA_DELETED (replaced by tablet 0332617d0db44eda9166a88e75539d16) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.140210 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bc8b1dc268b455ea263b67077e0bf6d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.140933 28925 leader_election.cc:304] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.138672 30787 raft_consensus.cc:2749] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.141480 30314 raft_consensus.cc:2749] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.142365 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269d2bb9f1fd45f89ab765b33a502baf" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.142428 30787 raft_consensus.cc:493] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.142590 30787 raft_consensus.cc:515] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.143465 30787 leader_election.cc:290] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.144091 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14113dd9098456599d7b72626bedcd6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:05.144133 28925 leader_election.cc:343] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:05.144613 28925 leader_election.cc:343] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.155203 29118 raft_consensus.cc:3060] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.158000 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d09b732e1cc4126bf7b0b17e5396607 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.159811 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4facc39fb37f4b1e88d70be7148b6582"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.159915 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:17:05.160424 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4facc39fb37f4b1e88d70be7148b6582 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.160797 29383 tablet_bootstrap.cc:492] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:05.160938 29383 ts_tablet_manager.cc:1403] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.052s user 0.003s sys 0.000s
I20260617 20:17:05.161764 29383 raft_consensus.cc:359] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.162163 29383 raft_consensus.cc:385] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.162231 29383 raft_consensus.cc:740] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.162420 29383 consensus_queue.cc:260] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.162461 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_af1725ce632d44719ed0ce47881b4102" } new_table_name: "default.Table_a854cd6008ad44a0aa1e22bc32c4dcc3" modify_external_catalogs: true
I20260617 20:17:05.162946 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2a8f46e8ac4f4aa39544a9fe40b1fe" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.163044 29383 ts_tablet_manager.cc:1434] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:05.163278 29383 tablet_bootstrap.cc:492] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:05.164811 29383 tablet_bootstrap.cc:654] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.164893 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cee27611d8f547eca1c10f1e335f4a7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.165601 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cee27611d8f547eca1c10f1e335f4a7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.168362 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet adbc3219639748d9a0d71d45ae22ab36 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:05.174888 30641 tablet.cc:1724] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:05.175191 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet b427ba6320be4f2a929eaf18a56b4309 (table default.Table_62c85e3d42be4e9ca7183846e7d67145 [id=7563af483989440d91cf7f444a68d2ba]) successfully deleted
I20260617 20:17:05.175370 30766 tablet.cc:1724] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:05.176132 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 804) took 2478 ms. Trace:
I20260617 20:17:05.176216 29377 rpcz_store.cc:276] 0617 20:17:02.698014 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.698060 (+ 46us) service_pool.cc:224] Handling call
0617 20:17:05.176025 (+2477965us) ts_tablet_manager.cc:1151] Deleting tablet f8e0c5d20a4548cc8124302aa38bcb21
0617 20:17:05.176035 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.176112 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2477802}
I20260617 20:17:05.176519 29377 tablet_replica.cc:333] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:17:05.176689 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f8e0c5d20a4548cc8124302aa38bcb21 because the tablet was not found. No further retry: Not found: Tablet not found: f8e0c5d20a4548cc8124302aa38bcb21
I20260617 20:17:05.176702 29377 raft_consensus.cc:2243] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:05.176856 29377 raft_consensus.cc:2272] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:05.177366 29377 ts_tablet_manager.cc:1916] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:05.178947 28665 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet ead0291870a443d9b76ea919a45a4303 (table default.Table_d353f219381d4d17a2927a233465454c [id=0ef22e22306747b28d49d58d0fa45620]). Expected version 4 got 0
I20260617 20:17:05.179342 28665 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet e7eb77c619e04c448a084638668dbb6a (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]). Expected version 1 got 0
I20260617 20:17:05.180172 29383 tablet_bootstrap.cc:492] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:05.180305 29383 ts_tablet_manager.cc:1403] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
W20260617 20:17:05.181098 28665 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet e7eb77c619e04c448a084638668dbb6a (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e7eb77c619e04c448a084638668dbb6a consensus state has no leader
I20260617 20:17:05.181203 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet dd89c8452c444af99d8bce0c7cbf8ce1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.181095 29383 raft_consensus.cc:359] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.181666 29383 raft_consensus.cc:385] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.181766 29383 raft_consensus.cc:740] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.181807 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b427ba6320be4f2a929eaf18a56b4309" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.182009 29383 consensus_queue.cc:260] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.182519 29383 ts_tablet_manager.cc:1434] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:05.182761 29383 tablet_bootstrap.cc:492] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:05.184464 29383 tablet_bootstrap.cc:654] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.144781 30786 tablet.cc:1724] T 227d8a0d46294108a6b98a1a4b67fd6d P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:05.154536 29378 tablet_bootstrap.cc:492] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:05.187202 29378 ts_tablet_manager.cc:1403] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.161s user 0.006s sys 0.023s
I20260617 20:17:05.187247 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 488b06f05d9b4273a61bcb2d6e0ad796 (table default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca]) successfully deleted
I20260617 20:17:05.187917 29378 raft_consensus.cc:359] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.188081 29378 raft_consensus.cc:385] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.188138 29378 raft_consensus.cc:740] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.188320 29378 consensus_queue.cc:260] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.188822 29378 ts_tablet_manager.cc:1434] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:05.189090 29378 tablet_bootstrap.cc:492] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:05.190397 29378 tablet_bootstrap.cc:654] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.185041 30788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:17:05.197727 29379 tablet_bootstrap.cc:654] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:05.197917 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2f906eb1286493ab134c4b959cd1b6a consensus state has no leader
I20260617 20:17:05.196913 30788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: This master's current role is: FOLLOWER
W20260617 20:17:05.200546 29063 leader_election.cc:343] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: f24954093a45411a9cbe39415fb1adb7
I20260617 20:17:05.200748 29063 leader_election.cc:304] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.201045 30294 raft_consensus.cc:2749] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.201428 28979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c20f436b9b4a8cb659215f9579af04" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.201606 28979 raft_consensus.cc:2468] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:05.201977 29063 leader_election.cc:304] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.202567 30294 raft_consensus.cc:2749] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.203583 30424 sys_catalog.cc:565] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: configured and running, proceeding with master startup.
I20260617 20:17:05.203667 30380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 966 } } ignore_live_leader: false dest_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" is_pre_election: true
I20260617 20:17:05.204557 30380 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5ea3f9265d84474ab3bced8dd5aecc5 in term 1.
W20260617 20:17:05.204870 30380 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33474 (request call id 0) took 4445 ms (client timeout 739 ms). Trace:
W20260617 20:17:05.205084 30380 rpcz_store.cc:269] 0617 20:17:00.759614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.759668 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:05.204792 (+4445124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:17:05.206346 29375 ts_tablet_manager.cc:1929] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:05.208690 29376 ts_tablet_manager.cc:1929] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:05.209026 29376 log.cc:1199] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/7efe079091784d7e8035659edd442ba6
I20260617 20:17:05.209563 29376 ts_tablet_manager.cc:1950] T 7efe079091784d7e8035659edd442ba6 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:05.212317 30370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 966 } } ignore_live_leader: false dest_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" is_pre_election: true
W20260617 20:17:05.213378 30370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33474 (request call id 1) took 3732 ms (client timeout 739 ms). Trace:
I20260617 20:17:05.213600 29383 tablet_bootstrap.cc:492] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
W20260617 20:17:05.213551 30370 rpcz_store.cc:269] 0617 20:17:01.481199 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.481252 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:05.213341 (+3732089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:17:05.213726 29383 ts_tablet_manager.cc:1403] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.000s
I20260617 20:17:05.214594 29383 raft_consensus.cc:359] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:05.214803 29383 raft_consensus.cc:385] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.214874 29383 raft_consensus.cc:740] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.215101 29383 consensus_queue.cc:260] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:05.216322 29197 leader_election.cc:304] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.216547 30678 raft_consensus.cc:2804] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.216620 30678 raft_consensus.cc:493] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.216691 30678 raft_consensus.cc:3060] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.219168 30678 raft_consensus.cc:515] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.219728 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet f31bf7ed828f44b398f5bdac6b9b63e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.220456 30678 leader_election.cc:290] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:05.220752 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a3d9ae347845dfa9357010819ebc58" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.221801 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14113dd9098456599d7b72626bedcd6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.221975 29259 raft_consensus.cc:2468] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:05.222438 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269d2bb9f1fd45f89ab765b33a502baf" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.224756 30678 raft_consensus.cc:493] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.224872 30678 raft_consensus.cc:515] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.225414 30678 leader_election.cc:290] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:05.227259 29383 ts_tablet_manager.cc:1434] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20260617 20:17:05.227541 29383 tablet_bootstrap.cc:492] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:05.229431 29310 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:05.215287 29063 leader_election.cc:304] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.226456 29379 tablet_bootstrap.cc:492] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:05.229985 29379 ts_tablet_manager.cc:1403] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.153s user 0.005s sys 0.001s
I20260617 20:17:05.230566 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "593d9de6a2fb47e18d86649e45ba80b9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:05.230638 30294 raft_consensus.cc:2749] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.230861 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370db89a92a6455190edaf80e5a56205" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.231387 29379 raft_consensus.cc:359] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.231561 29379 raft_consensus.cc:385] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.231616 29379 raft_consensus.cc:740] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
W20260617 20:17:05.231833 29198 leader_election.cc:343] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.231909 29379 consensus_queue.cc:260] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:05.232023 29198 leader_election.cc:343] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.233355 29379 ts_tablet_manager.cc:1434] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:05.233597 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c25af0a4fa2f44b5b7680070d7f18a31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.234193 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c25af0a4fa2f44b5b7680070d7f18a31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.235448 29197 leader_election.cc:304] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.235677 30678 raft_consensus.cc:2804] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.235741 30678 raft_consensus.cc:493] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.235798 30678 raft_consensus.cc:3060] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.235839 29197 leader_election.cc:304] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.236012 30556 raft_consensus.cc:2804] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.236064 30556 raft_consensus.cc:493] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.236119 30556 raft_consensus.cc:3060] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.236950 29375 log.cc:1199] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/7f239f81c40743b2aaa70a361997db77
I20260617 20:17:05.237272 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_36ec6892bea94b65b641c5b752fd1fdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.237939 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36ec6892bea94b65b641c5b752fd1fdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.238010 29375 ts_tablet_manager.cc:1950] T 7f239f81c40743b2aaa70a361997db77 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:05.238713 30556 raft_consensus.cc:515] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.239261 30556 leader_election.cc:290] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:05.239795 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a17cfbbd20be4ffe99351c3b1ac11457"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.240159 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_b1e1ccfbd65149709f90def87a0de455"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.240955 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219d85e4fd9b4ba3baf1e08d2b18a32c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:05.241520 29198 leader_election.cc:343] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.241704 30678 raft_consensus.cc:515] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.242240 30678 leader_election.cc:290] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:05.242645 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee426100bb645f391be123aeb52e412" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:05.243129 29198 leader_election.cc:343] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.243320 29378 tablet_bootstrap.cc:492] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:05.243496 29378 ts_tablet_manager.cc:1403] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.054s user 0.007s sys 0.003s
I20260617 20:17:05.243516 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 783) took 3047 ms. Trace:
I20260617 20:17:05.244063 29376 rpcz_store.cc:276] 0617 20:17:02.196065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.203287 (+ 7222us) service_pool.cc:224] Handling call
0617 20:17:05.088241 (+2884954us) ts_tablet_manager.cc:1151] Deleting tablet 7efe079091784d7e8035659edd442ba6
0617 20:17:05.088250 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.124100 (+ 35850us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.208638 (+ 84538us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.243494 (+ 34856us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2884764}
I20260617 20:17:05.244252 29378 raft_consensus.cc:359] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.244506 29378 raft_consensus.cc:385] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.244616 29378 raft_consensus.cc:740] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.244868 29378 consensus_queue.cc:260] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.245582 29378 ts_tablet_manager.cc:1434] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:05.245889 29378 tablet_bootstrap.cc:492] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:05.247618 29378 tablet_bootstrap.cc:654] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:05.248253 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1e1ccfbd65149709f90def87a0de455 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:17:05.248328 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a17cfbbd20be4ffe99351c3b1ac11457 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.247462 29197 leader_election.cc:304] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.250844 29383 tablet_bootstrap.cc:654] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.251010 30678 raft_consensus.cc:2804] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.251082 30678 raft_consensus.cc:493] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.251173 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 788) took 2980 ms. Trace:
I20260617 20:17:05.251220 30678 raft_consensus.cc:3060] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.251497 30556 consensus_queue.cc:1048] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:05.252216 29379 tablet_bootstrap.cc:492] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:05.252063 29376 rpcz_store.cc:276] 0617 20:17:02.270384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.270453 (+ 69us) service_pool.cc:224] Handling call
0617 20:17:05.250593 (+2980140us) ts_tablet_manager.cc:1151] Deleting tablet 403095586c704ecaa2a9931295bd1330
0617 20:17:05.250604 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.251154 (+ 550us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2979936}
I20260617 20:17:05.253865 29379 tablet_bootstrap.cc:654] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.254163 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 807) took 2569 ms. Trace:
I20260617 20:17:05.255115 30678 raft_consensus.cc:515] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.255687 30678 leader_election.cc:290] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:05.251560 29197 leader_election.cc:304] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.256160 30556 raft_consensus.cc:2804] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.256283 30556 raft_consensus.cc:697] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.256493 30556 consensus_queue.cc:237] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.259173 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 739) took 5730 ms. Trace:
I20260617 20:17:05.259248 29375 rpcz_store.cc:276] 0617 20:16:59.528715 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.528776 (+ 61us) service_pool.cc:224] Handling call
0617 20:17:05.091410 (+5562634us) ts_tablet_manager.cc:1151] Deleting tablet 7f239f81c40743b2aaa70a361997db77
0617 20:17:05.091419 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.203497 (+112078us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.206283 (+ 2786us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.259154 (+ 52871us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5562330}
I20260617 20:17:05.259611 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 742) took 5709 ms. Trace:
I20260617 20:17:05.259676 29375 rpcz_store.cc:276] 0617 20:16:59.549778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.549833 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:05.259496 (+5709663us) ts_tablet_manager.cc:1151] Deleting tablet 5806949c371b41b0a162a4c8cbf6b435
0617 20:17:05.259504 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.259596 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5709484}
I20260617 20:17:05.259981 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 746) took 5629 ms. Trace:
I20260617 20:17:05.260043 29375 rpcz_store.cc:276] 0617 20:16:59.630131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:16:59.630193 (+ 62us) service_pool.cc:224] Handling call
0617 20:17:05.259879 (+5629686us) ts_tablet_manager.cc:1151] Deleting tablet 663dbe73689d4849a85b68a79ea4062c
0617 20:17:05.259886 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.259966 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5629465}
I20260617 20:17:05.260322 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 752) took 4301 ms. Trace:
I20260617 20:17:05.260396 29375 rpcz_store.cc:276] 0617 20:17:00.959261 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.959314 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:05.260218 (+4300904us) ts_tablet_manager.cc:1151] Deleting tablet 1ed860fa375848708beb31ff89056214
0617 20:17:05.260225 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.260307 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4300700}
I20260617 20:17:05.260622 29375 tablet_replica.cc:333] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:05.260788 29375 raft_consensus.cc:2243] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:05.260967 29375 raft_consensus.cc:2272] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:05.261528 29375 ts_tablet_manager.cc:1916] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:05.262562 30761 consensus_queue.cc:1048] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:05.263144 29197 consensus_peers.cc:597] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f02529cd1e764a3886de27d86e9690e3. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:05.263293 29197 leader_election.cc:304] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.265105 30761 raft_consensus.cc:2804] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.265182 30761 raft_consensus.cc:493] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.265239 30761 raft_consensus.cc:3060] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.266001 29379 tablet_bootstrap.cc:492] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:05.266105 29379 ts_tablet_manager.cc:1403] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260617 20:17:05.266808 29379 raft_consensus.cc:359] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.266949 29379 raft_consensus.cc:385] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.266993 29379 raft_consensus.cc:740] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.267161 29379 consensus_queue.cc:260] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.267606 29379 ts_tablet_manager.cc:1434] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:17:05.267832 29379 tablet_bootstrap.cc:492] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:05.267805 30761 raft_consensus.cc:515] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.268378 30761 leader_election.cc:290] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:05.270303 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3e14083b032f4f0aa58a5586a505644f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.270957 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8965f5e6c4ae469dac6a88b85b1bf4c8" } modify_external_catalogs: true
I20260617 20:17:05.271111 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8965f5e6c4ae469dac6a88b85b1bf4c8" } modify_external_catalogs: true
W20260617 20:17:05.274238 28925 leader_election.cc:343] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.274477 28925 leader_election.cc:304] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.274751 30787 raft_consensus.cc:2749] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.274498 28979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "593d9de6a2fb47e18d86649e45ba80b9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.274926 28979 raft_consensus.cc:3060] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.276837 28925 leader_election.cc:304] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.277045 30787 raft_consensus.cc:2804] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.277098 30787 raft_consensus.cc:493] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.277149 30787 raft_consensus.cc:3060] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.277426 30314 raft_consensus.cc:493] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.277529 30314 raft_consensus.cc:515] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.278043 30314 leader_election.cc:290] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.279117 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c20f436b9b4a8cb659215f9579af04" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:05.279549 29377 ts_tablet_manager.cc:1929] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:05.279511 30787 raft_consensus.cc:515] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.279645 29377 log.cc:1199] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/adbc3219639748d9a0d71d45ae22ab36
I20260617 20:17:05.279831 30294 raft_consensus.cc:493] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ca3d93189744132bbf55ac01f3a8254)
I20260617 20:17:05.279928 29377 ts_tablet_manager.cc:1950] T adbc3219639748d9a0d71d45ae22ab36 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:05.279963 30294 raft_consensus.cc:515] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.280030 30787 leader_election.cc:290] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.280504 30294 leader_election.cc:290] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.281368 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ebcfc80ca64129a7ab939bfd853998" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:05.281621 28925 leader_election.cc:343] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.281723 28925 leader_election.cc:304] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.282050 30787 raft_consensus.cc:2749] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:05.282269 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e14083b032f4f0aa58a5586a505644f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.285426 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370db89a92a6455190edaf80e5a56205" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.285621 28989 raft_consensus.cc:2468] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:05.286424 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee426100bb645f391be123aeb52e412" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.286597 28985 raft_consensus.cc:3060] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.287185 29383 tablet_bootstrap.cc:492] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:05.287334 29383 ts_tablet_manager.cc:1403] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260617 20:17:05.290292 29197 leader_election.cc:304] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.290298 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cafcade995b407f84f56b8cd3ab6892" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.290444 28983 raft_consensus.cc:3060] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.293402 30678 raft_consensus.cc:2804] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.293484 30678 raft_consensus.cc:493] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.293551 30678 raft_consensus.cc:3060] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.294101 28986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27c20f436b9b4a8cb659215f9579af04" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.294266 28986 raft_consensus.cc:3060] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.295991 30678 raft_consensus.cc:515] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.296530 30678 leader_election.cc:290] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:05.290242 29383 raft_consensus.cc:359] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.297187 29383 raft_consensus.cc:385] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.297268 29383 raft_consensus.cc:740] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.297477 29383 consensus_queue.cc:260] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.297865 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ebcfc80ca64129a7ab939bfd853998" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:05.298357 28925 leader_election.cc:343] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.298367 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14113dd9098456599d7b72626bedcd6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:05.298514 29259 raft_consensus.cc:3060] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.299456 29378 tablet_bootstrap.cc:492] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:05.299588 29378 ts_tablet_manager.cc:1403] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.001s
I20260617 20:17:05.300307 29378 raft_consensus.cc:359] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.300467 29378 raft_consensus.cc:385] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.300534 29378 raft_consensus.cc:740] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.300760 29378 consensus_queue.cc:260] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.301048 29259 raft_consensus.cc:2468] T f14113dd9098456599d7b72626bedcd6 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:05.301347 29378 ts_tablet_manager.cc:1434] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:05.301599 29378 tablet_bootstrap.cc:492] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:05.301910 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ea2ae51b9e004007a411b1ff05d274cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.302549 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea2ae51b9e004007a411b1ff05d274cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.302876 28925 leader_election.cc:304] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.303139 30787 raft_consensus.cc:2804] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.303244 30787 raft_consensus.cc:697] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:05.303452 30787 consensus_queue.cc:237] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.269265 29379 tablet_bootstrap.cc:654] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.304507 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6f140c50b6434bcebd5021f6519a66fb" } new_table_name: "default.Table_6ff97e18c72d48f69a219285a41f4d5d" modify_external_catalogs: true
I20260617 20:17:05.270200 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 7f239f81c40743b2aaa70a361997db77 (table default.Table_2880530e29494f939769447dfb05fd16 [id=0ea926c7d87a4670902ad04acbe1cfef]) successfully deleted
W20260617 20:17:05.307093 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5806949c371b41b0a162a4c8cbf6b435 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5806949c371b41b0a162a4c8cbf6b435 already in progress: creating tablet
W20260617 20:17:05.307283 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 663dbe73689d4849a85b68a79ea4062c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 663dbe73689d4849a85b68a79ea4062c already in progress: creating tablet
W20260617 20:17:05.307469 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 1ed860fa375848708beb31ff89056214 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1ed860fa375848708beb31ff89056214 already in progress: creating tablet
I20260617 20:17:05.307832 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 7efe079091784d7e8035659edd442ba6 (table default.Table_6bb71611d01f469a95325bc9bbcd5251 [id=f0df4d60a326473a8fc3d040ed7324d7]) successfully deleted
W20260617 20:17:05.308040 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 403095586c704ecaa2a9931295bd1330 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 403095586c704ecaa2a9931295bd1330 already in progress: creating tablet
I20260617 20:17:05.309243 29383 ts_tablet_manager.cc:1434] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20260617 20:17:05.309566 29383 tablet_bootstrap.cc:492] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:05.312300 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219d85e4fd9b4ba3baf1e08d2b18a32c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.312462 28981 raft_consensus.cc:3060] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.254449 29376 rpcz_store.cc:276] 0617 20:17:02.684724 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.684916 (+ 192us) service_pool.cc:224] Handling call
0617 20:17:05.253899 (+2568983us) ts_tablet_manager.cc:1151] Deleting tablet 0bbef4cc28ef46288cfc7d1933c71710
0617 20:17:05.253911 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.254141 (+ 230us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2568728}
I20260617 20:17:05.314188 29376 tablet_replica.cc:333] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:05.314422 29376 raft_consensus.cc:2243] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:05.314565 29376 raft_consensus.cc:2272] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:05.314929 28981 raft_consensus.cc:2468] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:05.315088 29376 ts_tablet_manager.cc:1916] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:05.315222 29378 tablet_bootstrap.cc:654] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:05.315280 29062 leader_election.cc:343] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 33a1c96212014333935ec7f7c92a306c
I20260617 20:17:05.317641 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_45681900e4bb466c8665d7200abc0eb1" } modify_external_catalogs: true
I20260617 20:17:05.317912 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_45681900e4bb466c8665d7200abc0eb1" } modify_external_catalogs: true
W20260617 20:17:05.318432 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a0462db75104cd6bdf54ba9777f792b consensus state has no leader
I20260617 20:17:05.318765 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_17f5f997158040c293ab63c2bd96216e" } modify_external_catalogs: true
I20260617 20:17:05.318909 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_17f5f997158040c293ab63c2bd96216e" } modify_external_catalogs: true
W20260617 20:17:05.320346 29197 consensus_peers.cc:597] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b427ba6320be4f2a929eaf18a56b4309. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:05.320547 29197 consensus_peers.cc:597] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5faea831376646c1bdfcaf8fbbc7ca6d. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:05.320859 29197 leader_election.cc:304] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.320940 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370db89a92a6455190edaf80e5a56205" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.321101 28990 raft_consensus.cc:3060] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.321336 30410 raft_consensus.cc:2804] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.321452 30410 raft_consensus.cc:697] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.321656 30410 consensus_queue.cc:237] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:05.322990 29198 leader_election.cc:343] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:05.323153 29198 consensus_peers.cc:597] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:05.323721 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f14113dd9098456599d7b72626bedcd6" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:05.324215 28925 leader_election.cc:343] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.324321 28925 leader_election.cc:304] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.324409 28990 raft_consensus.cc:2468] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:17:05.324692 28925 leader_election.cc:343] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.324963 30314 raft_consensus.cc:493] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.325075 30314 raft_consensus.cc:515] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.312309 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 805) took 2613 ms. Trace:
I20260617 20:17:05.325273 29377 rpcz_store.cc:276] 0617 20:17:02.698455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.698503 (+ 48us) service_pool.cc:224] Handling call
0617 20:17:05.176476 (+2477973us) ts_tablet_manager.cc:1151] Deleting tablet adbc3219639748d9a0d71d45ae22ab36
0617 20:17:05.176484 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.249754 (+ 73270us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.279498 (+ 29744us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.312297 (+ 32799us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2477819}
I20260617 20:17:05.325730 29377 tablet_replica.cc:333] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:05.325927 29377 raft_consensus.cc:2243] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:05.325964 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet adbc3219639748d9a0d71d45ae22ab36 (table default.Table_fb9bfca9839e45eab65f1350e50faa16 [id=b041ea39e57947919cb6744251af1ca7]) successfully deleted
I20260617 20:17:05.326073 29377 raft_consensus.cc:2272] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:05.325748 30314 leader_election.cc:290] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.326283 30314 raft_consensus.cc:2749] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.326368 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "370db89a92a6455190edaf80e5a56205" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:05.326534 29119 raft_consensus.cc:3060] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.327884 29379 tablet_bootstrap.cc:492] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:05.327993 29379 ts_tablet_manager.cc:1403] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.001s
I20260617 20:17:05.328562 29197 leader_election.cc:304] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.328785 30683 raft_consensus.cc:2804] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.328918 30683 raft_consensus.cc:697] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.329152 30683 consensus_queue.cc:237] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.330957 29119 raft_consensus.cc:2468] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:05.331480 29379 raft_consensus.cc:359] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.331624 29379 raft_consensus.cc:385] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.331674 29379 raft_consensus.cc:740] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.331851 29379 consensus_queue.cc:260] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:05.332113 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 0bbef4cc28ef46288cfc7d1933c71710 because the tablet was not found. No further retry: Not found: Tablet not found: 0bbef4cc28ef46288cfc7d1933c71710
I20260617 20:17:05.332319 29379 ts_tablet_manager.cc:1434] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:05.332607 29379 tablet_bootstrap.cc:492] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:05.332732 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6073576da0f64d37bae015524bd119de" } new_table_name: "default.Table_0bc4f3c08e5b47659b13d6eca2ae81e9" modify_external_catalogs: true
I20260617 20:17:05.334017 28985 raft_consensus.cc:2468] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:05.334409 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cafcade995b407f84f56b8cd3ab6892" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:05.334600 29197 leader_election.cc:304] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.334867 29377 ts_tablet_manager.cc:1916] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:05.335227 30410 raft_consensus.cc:2804] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.335325 30410 raft_consensus.cc:697] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.335539 30410 consensus_queue.cc:237] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.336730 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd89c8452c444af99d8bce0c7cbf8ce1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.335059 28983 raft_consensus.cc:2468] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:17:05.342707 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 078875241c324538ad6f93de1169aeb8 consensus state has no leader
I20260617 20:17:05.343137 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a9e8442cc84b4609b3c6c8d4dfd6d32a" } new_table_name: "default.Table_6f87ebb700cd4bcd8c9970ecae935a1a" modify_external_catalogs: true
I20260617 20:17:05.345432 29197 leader_election.cc:304] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.345724 30683 raft_consensus.cc:2804] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.345856 30683 raft_consensus.cc:697] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.336100 29378 tablet_bootstrap.cc:492] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:05.346069 30683 consensus_queue.cc:237] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.346163 29378 ts_tablet_manager.cc:1403] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260617 20:17:05.347083 29378 raft_consensus.cc:359] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.347277 29378 raft_consensus.cc:385] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.347852 29375 ts_tablet_manager.cc:1929] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:05.348206 29037 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:05.337023 28986 raft_consensus.cc:2468] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:05.349458 29197 leader_election.cc:304] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.349861 30678 raft_consensus.cc:2804] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.350121 30678 raft_consensus.cc:697] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.350385 30678 consensus_queue.cc:237] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.339607 28979 raft_consensus.cc:2468] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:17:05.340762 28925 leader_election.cc:343] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.354768 30314 raft_consensus.cc:493] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.354887 30314 raft_consensus.cc:515] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.355482 30314 leader_election.cc:290] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:05.353468 29063 leader_election.cc:343] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 33a1c96212014333935ec7f7c92a306c
I20260617 20:17:05.357450 29063 leader_election.cc:304] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.357863 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaa60028a1647e580a987c3a0836a24" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:05.358330 29198 leader_election.cc:343] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.358407 29259 raft_consensus.cc:2468] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:05.358615 30817 raft_consensus.cc:2749] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:05.358891 29375 log.cc:1199] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/64bb6d176a4845eca312848ae5104647
I20260617 20:17:05.357841 29197 leader_election.cc:304] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.359258 30683 raft_consensus.cc:2804] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.359318 28925 leader_election.cc:304] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.359500 30683 raft_consensus.cc:697] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.359591 30314 raft_consensus.cc:2804] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.359660 30314 raft_consensus.cc:493] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.359721 30314 raft_consensus.cc:3060] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.359719 30683 consensus_queue.cc:237] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.361580 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3d341472f7724dd8a87f7e18ea3f349d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.361711 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaa60028a1647e580a987c3a0836a24" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:05.362203 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d341472f7724dd8a87f7e18ea3f349d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.362838 30314 raft_consensus.cc:515] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:05.362949 28925 leader_election.cc:343] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.363314 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd89c8452c444af99d8bce0c7cbf8ce1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.363997 30314 leader_election.cc:290] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.364099 29375 ts_tablet_manager.cc:1950] T 64bb6d176a4845eca312848ae5104647 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:17:05.364440 28925 leader_election.cc:343] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.364549 28925 leader_election.cc:304] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.364996 30314 raft_consensus.cc:2749] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.347340 29378 raft_consensus.cc:740] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.368213 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaa60028a1647e580a987c3a0836a24" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:05.368358 29259 raft_consensus.cc:3060] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.368513 29378 consensus_queue.cc:260] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.369131 29378 ts_tablet_manager.cc:1434] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260617 20:17:05.371227 29259 raft_consensus.cc:2468] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:05.372933 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 753) took 4375 ms. Trace:
I20260617 20:17:05.373020 29375 rpcz_store.cc:276] 0617 20:17:00.997173 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.997453 (+ 280us) service_pool.cc:224] Handling call
0617 20:17:05.260583 (+4263130us) ts_tablet_manager.cc:1151] Deleting tablet 64bb6d176a4845eca312848ae5104647
0617 20:17:05.260593 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.306821 (+ 46228us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.347793 (+ 40972us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.372915 (+ 25122us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4262883}
I20260617 20:17:05.365473 29379 tablet_bootstrap.cc:654] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.375275 29378 tablet_bootstrap.cc:492] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:05.376880 29378 tablet_bootstrap.cc:654] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.377552 28965 tablet_service.cc:1511] Processing CreateTablet for tablet d4e0cb39b07d4549afe362b9e4fa97c5 (DEFAULT_TABLE table=default.Table_02d45e2cbb6a42f893c6227bbaa2a9f4 [id=cdb2e24324f546e5b21edbf9e6214aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.378010 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e0cb39b07d4549afe362b9e4fa97c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.379215 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]). Expected version 2 got 0
I20260617 20:17:05.379602 28663 catalog_manager.cc:5696] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:05.380098 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 87d0e2ecc16e4285a1d8337a5336caf2 (table default.Table_724f440ee4704ab9b73c964377608058 [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]). Expected version 1 got 0
I20260617 20:17:05.380808 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 64bb6d176a4845eca312848ae5104647 (table default.Table_12cb16608a854819a7e0834654f128bb [id=6e89910c5d7a4969a79960d34eff437c]) successfully deleted
I20260617 20:17:05.380877 29106 tablet_service.cc:1511] Processing CreateTablet for tablet d4e0cb39b07d4549afe362b9e4fa97c5 (DEFAULT_TABLE table=default.Table_02d45e2cbb6a42f893c6227bbaa2a9f4 [id=cdb2e24324f546e5b21edbf9e6214aed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.381709 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaa60028a1647e580a987c3a0836a24" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:05.382402 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31267063d24f4e89898349117a9a3031 has no consensus state
I20260617 20:17:05.382743 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_725310d538304427bfe704881702f3a2" } new_table_name: "default.Table_daa321ef525b447390f30edf50f160bc" modify_external_catalogs: true
W20260617 20:17:05.383926 28925 leader_election.cc:343] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.384729 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 754) took 4253 ms. Trace:
I20260617 20:17:05.384814 29375 rpcz_store.cc:276] 0617 20:17:01.131638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.137389 (+ 5751us) service_pool.cc:224] Handling call
0617 20:17:05.384614 (+4247225us) ts_tablet_manager.cc:1151] Deleting tablet 5a20867de1214c0fb4cb8504e8361c5b
0617 20:17:05.384626 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.384711 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4246986}
I20260617 20:17:05.385172 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 755) took 3542 ms. Trace:
I20260617 20:17:05.385243 29375 rpcz_store.cc:276] 0617 20:17:01.842841 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.842895 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:05.385058 (+3542163us) ts_tablet_manager.cc:1151] Deleting tablet 06680ddfee82464da4926e51dadd00a5
0617 20:17:05.385068 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.385156 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3541994}
I20260617 20:17:05.385850 28925 leader_election.cc:304] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.386229 29225 tablet_service.cc:1511] Processing CreateTablet for tablet d4e0cb39b07d4549afe362b9e4fa97c5 (DEFAULT_TABLE table=default.Table_02d45e2cbb6a42f893c6227bbaa2a9f4 [id=cdb2e24324f546e5b21edbf9e6214aed]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:05.386345 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5a20867de1214c0fb4cb8504e8361c5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a20867de1214c0fb4cb8504e8361c5b already in progress: creating tablet
W20260617 20:17:05.386576 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 06680ddfee82464da4926e51dadd00a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06680ddfee82464da4926e51dadd00a5 already in progress: creating tablet
I20260617 20:17:05.386615 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e0cb39b07d4549afe362b9e4fa97c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.388863 29376 ts_tablet_manager.cc:1929] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:05.388957 29376 log.cc:1199] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/8a5d9677bc184c30be1a11bfa85a97c8
I20260617 20:17:05.389511 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e0cb39b07d4549afe362b9e4fa97c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.380388 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet ead0291870a443d9b76ea919a45a4303 (table default.Table_d353f219381d4d17a2927a233465454c [id=0ef22e22306747b28d49d58d0fa45620]). Expected version 4 got 0
I20260617 20:17:05.394287 28663 catalog_manager.cc:5696] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:05.394688 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 0f3032155e4e4ea8a23984f547d78752 (table default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca]). Expected version 2 got 0
I20260617 20:17:05.395641 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 53d32672f44d4605b30237c0b1d72ff6
I20260617 20:17:05.396530 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4d81457d71a34657b43c8ebe7efb0a35
I20260617 20:17:05.396447 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_202d346de7a14d6f9cad64a5e8ea8391"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.396795 30314 raft_consensus.cc:2804] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.396926 30314 raft_consensus.cc:697] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
W20260617 20:17:05.396970 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_202d346de7a14d6f9cad64a5e8ea8391 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.397119 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7ab3e811b872450d856ef65057509c9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.397141 30314 consensus_queue.cc:237] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:05.397681 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ab3e811b872450d856ef65057509c9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.398869 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet d16bbe642edc43449d3b910ca5cf4d37
I20260617 20:17:05.401191 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d81457d71a34657b43c8ebe7efb0a35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.401603 28955 tablet_service.cc:1511] Processing CreateTablet for tablet ee9afd550a6d4d2e9edd84e4b49186c4 (DEFAULT_TABLE table=default.Table_1b6116659f754549b9c833b7b5f49b48 [id=2a75e08f58a74d18b2fead92b0c33183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.401955 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9afd550a6d4d2e9edd84e4b49186c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.405054 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 53d32672f44d4605b30237c0b1d72ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.405534 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0697e4379141238d1fa70297731187 (DEFAULT_TABLE table=default.Table_3f639bb9ece9443ea9d7f7cf5ec04be4 [id=80f77a5c1229411b9e3b5c0094eca5f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.405678 28667 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_87d2647a76934415a43629381e657e1e [id=de24e09cee8e4f28998625c2697769b3] alter complete (version 2)
I20260617 20:17:05.405889 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0697e4379141238d1fa70297731187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.405908 29104 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d81457d71a34657b43c8ebe7efb0a35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.406880 29104 tablet_service.cc:1511] Processing CreateTablet for tablet ee9afd550a6d4d2e9edd84e4b49186c4 (DEFAULT_TABLE table=default.Table_1b6116659f754549b9c833b7b5f49b48 [id=2a75e08f58a74d18b2fead92b0c33183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.407133 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet ce3e1aa04bca4425a907caadd5a736f9
I20260617 20:17:05.407210 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9afd550a6d4d2e9edd84e4b49186c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:05.408773 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6ba8b7d18af44b58800e588279e2e0b consensus state has no leader
I20260617 20:17:05.409345 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 380ccd1d167744248a1ccad80788d0a0
I20260617 20:17:05.409543 28954 tablet_service.cc:1511] Processing CreateTablet for tablet ce3e1aa04bca4425a907caadd5a736f9 (DEFAULT_TABLE table=default.Table_45681900e4bb466c8665d7200abc0eb1 [id=43bcf8cdd40b44f6b41da8802a0466b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.409925 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce3e1aa04bca4425a907caadd5a736f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.413411 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet d16bbe642edc43449d3b910ca5cf4d37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.413769 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 0385c347d2824b2dbb985b37cf8809b8 (DEFAULT_TABLE table=default.Table_e0d3bd7023894d139716d67bbe5357d4 [id=fb58b5a1d10847ef8221618e0fd77784]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.414090 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0385c347d2824b2dbb985b37cf8809b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.414760 29108 tablet_service.cc:1511] Processing CreateTablet for tablet ce3e1aa04bca4425a907caadd5a736f9 (DEFAULT_TABLE table=default.Table_45681900e4bb466c8665d7200abc0eb1 [id=43bcf8cdd40b44f6b41da8802a0466b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.415246 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet d16bbe642edc43449d3b910ca5cf4d37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.415832 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce3e1aa04bca4425a907caadd5a736f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.421366 28960 tablet_service.cc:1558] Processing DeleteTablet for tablet ce3e1aa04bca4425a907caadd5a736f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.421568 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 380ccd1d167744248a1ccad80788d0a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.421991 29104 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0697e4379141238d1fa70297731187 (DEFAULT_TABLE table=default.Table_3f639bb9ece9443ea9d7f7cf5ec04be4 [id=80f77a5c1229411b9e3b5c0094eca5f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.422370 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0697e4379141238d1fa70297731187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.424803 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb1277c83554dfbb541961c1e6c3617 (DEFAULT_TABLE table=default.Table_cdb98c9b862142e289f947e9d07a2a53 [id=4b77ac1b27aa415dbcb873621ee4ddd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.425171 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb1277c83554dfbb541961c1e6c3617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.425733 30819 raft_consensus.cc:493] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.425864 30819 raft_consensus.cc:515] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.426489 30819 leader_election.cc:290] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.427853 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_97ba340d89a0446caac56caf5b2cde59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.428414 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97ba340d89a0446caac56caf5b2cde59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.429602 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd75cc0dd244ee8b3c19a9597c8c7d3 (DEFAULT_TABLE table=default.Table_143ae9e7e1ec4c7abc9cd48b0623f7b7 [id=6fcc9d1bbca646d78518552e7930e293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.429862 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_bd0b72adbbe6450ea5af79b717033ff7" } new_table_name: "default.Table_409d138758b3428aabafcceb17e37cb1" modify_external_catalogs: true
I20260617 20:17:05.430022 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd75cc0dd244ee8b3c19a9597c8c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.432132 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab with delete_type TABLET_DATA_DELETED (replaced by tablet b4dbefbe5234458cb299410ddb2c73a3) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.432406 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet b427ba6320be4f2a929eaf18a56b4309 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.432638 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet 75519f97f1ce49ceb3a739ba7c7bc239 with delete_type TABLET_DATA_DELETED (replaced by tablet c73bdcc1cefd48f3b99e0c059c3a7467) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.432907 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet f24954093a45411a9cbe39415fb1adb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:57 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.433130 29091 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f239f81c40743b2aaa70a361997db77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:59 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.433512 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 0385c347d2824b2dbb985b37cf8809b8 (DEFAULT_TABLE table=default.Table_e0d3bd7023894d139716d67bbe5357d4 [id=fb58b5a1d10847ef8221618e0fd77784]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.433734 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet ce3e1aa04bca4425a907caadd5a736f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.433871 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0385c347d2824b2dbb985b37cf8809b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.434573 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 46dc6997caa74ccea3e5d4a7fb34a6f6 (DEFAULT_TABLE table=default.Table_c2d261c0ee9147409da728ff7de82e89 [id=850325382fbe4208aa36305354ab7044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.434923 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dc6997caa74ccea3e5d4a7fb34a6f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:05.441727 29062 leader_election.cc:343] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: fc36f62aa0bf46278cb84ec8cb7eef55
I20260617 20:17:05.444344 30787 raft_consensus.cc:493] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.444469 30787 raft_consensus.cc:515] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.445344 30787 leader_election.cc:290] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.445734 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8fa9f4c40b4ce9baa27a8837d3575c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.445961 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe with delete_type TABLET_DATA_DELETED (replaced by tablet 5a20867de1214c0fb4cb8504e8361c5b) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.446728 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 380ccd1d167744248a1ccad80788d0a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.447532 29106 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb1277c83554dfbb541961c1e6c3617 (DEFAULT_TABLE table=default.Table_cdb98c9b862142e289f947e9d07a2a53 [id=4b77ac1b27aa415dbcb873621ee4ddd9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:05.447834 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc48e61d2d3d4bca8051eafaa49c6534 consensus state has no leader
I20260617 20:17:05.447902 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb1277c83554dfbb541961c1e6c3617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.448314 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 604862f683984695b393cd9ca3500bdc (DEFAULT_TABLE table=default.Table_c67156b0dace4897967975f7f41f09fe [id=f48dcb0c33bd44f484cc4d1b0caadb88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.448695 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604862f683984695b393cd9ca3500bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.448868 28661 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_3198a4e3806449bc8871764c181d5ebf [id=cb568e8af2da4807b99a6d07c57afca9] alter complete (version 4)
I20260617 20:17:05.451166 30683 raft_consensus.cc:493] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.451361 30683 raft_consensus.cc:515] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.451421 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba86bae9e91404185d248dfd722a413" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:05.451993 28925 leader_election.cc:343] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.452279 30683 leader_election.cc:290] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:05.452418 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c59cf5f5e8486baf1e038a44657f33" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:05.453265 29198 leader_election.cc:343] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.453378 30786 tablet.cc:1724] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:05.458624 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd75cc0dd244ee8b3c19a9597c8c7d3 (DEFAULT_TABLE table=default.Table_143ae9e7e1ec4c7abc9cd48b0623f7b7 [id=6fcc9d1bbca646d78518552e7930e293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.459012 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd75cc0dd244ee8b3c19a9597c8c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.465518 29379 tablet_bootstrap.cc:492] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:05.465659 29379 ts_tablet_manager.cc:1403] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.133s user 0.000s sys 0.003s
I20260617 20:17:05.465643 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 53d32672f44d4605b30237c0b1d72ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.466045 28958 tablet_service.cc:1511] Processing CreateTablet for tablet d2d7a2a556e24e02a3f74d56c9bed78e (DEFAULT_TABLE table=default.Table_f47ba95e589c47759a3ca685e8e9a067 [id=b41299e9f3a84c2e91c6a082d8bba55d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.466125 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 58213ec0a9364a91a15fc0329f28605b with delete_type TABLET_DATA_DELETED (replaced by tablet 43462cf7003747d08e6b0e5db5999b3f) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.466387 29379 raft_consensus.cc:359] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.466554 29379 raft_consensus.cc:385] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.466611 29379 raft_consensus.cc:740] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.466770 29379 consensus_queue.cc:260] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.466881 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet cbeae97639fd4e6290768dae12f6a4ce with delete_type TABLET_DATA_DELETED (replaced by tablet cc547148aa124907a5e5def6941f734c) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.467008 28965 tablet_service.cc:1511] Processing CreateTablet for tablet ca4924e2825e4ec9b3302c1abb9c0bcf (DEFAULT_TABLE table=default.Table_f0db2ca25413465891e96ea21ba8f22a [id=c3f5396f04d840599b0fd38bd9bb6022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.467154 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 203666e6127b49ed92731bc87ce01798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.467278 29379 ts_tablet_manager.cc:1434] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:17:05.467495 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4924e2825e4ec9b3302c1abb9c0bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.467811 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 46dc6997caa74ccea3e5d4a7fb34a6f6 (DEFAULT_TABLE table=default.Table_c2d261c0ee9147409da728ff7de82e89 [id=850325382fbe4208aa36305354ab7044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.468160 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dc6997caa74ccea3e5d4a7fb34a6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.468238 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 756) took 3566 ms. Trace:
I20260617 20:17:05.468308 29375 rpcz_store.cc:276] 0617 20:17:01.901317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.901400 (+ 83us) service_pool.cc:224] Handling call
0617 20:17:05.468096 (+3566696us) ts_tablet_manager.cc:1151] Deleting tablet b002468734394d8181543368ac878c6f
0617 20:17:05.468103 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.468218 (+ 115us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3523931}
I20260617 20:17:05.468622 29375 tablet_replica.cc:333] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:05.468812 29375 raft_consensus.cc:2243] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:05.468783 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 8797ef75e5174c99bfae4de206eb1fda (DEFAULT_TABLE table=default.Table_6a488f8547fe46278096d8acc2c1753f [id=e0ac5a8ae5b34be48d2d85947f803ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.468967 29375 raft_consensus.cc:2272] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:05.469478 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8797ef75e5174c99bfae4de206eb1fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.470096 29106 tablet_service.cc:1558] Processing DeleteTablet for tablet 370db89a92a6455190edaf80e5a56205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.472843 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 513d335e9dfb4ab69ab0c455d7139905 (DEFAULT_TABLE table=default.Table_088c2b4ca59e4dd49f684c9f6648bc57 [id=47c6b29f6e284a1b9cd984f16d925103]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.473419 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513d335e9dfb4ab69ab0c455d7139905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.473732 29375 ts_tablet_manager.cc:1916] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:05.475838 29106 tablet_service.cc:1511] Processing CreateTablet for tablet d2d7a2a556e24e02a3f74d56c9bed78e (DEFAULT_TABLE table=default.Table_f47ba95e589c47759a3ca685e8e9a067 [id=b41299e9f3a84c2e91c6a082d8bba55d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.476230 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d7a2a556e24e02a3f74d56c9bed78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.477597 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 0822654770594804be2413296f6c94dc (DEFAULT_TABLE table=default.Table_7ba6c34c2fdb41c7a28dd9b7d555eeba [id=57f51996903e41d6bf32d9b398240a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.478085 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0822654770594804be2413296f6c94dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.479589 29377 ts_tablet_manager.cc:1929] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:05.479707 29377 log.cc:1199] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/cc8fa9f4c40b4ce9baa27a8837d3575c
I20260617 20:17:05.480103 29377 ts_tablet_manager.cc:1950] T cc8fa9f4c40b4ce9baa27a8837d3575c P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:05.480433 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 808) took 2781 ms. Trace:
I20260617 20:17:05.480518 29377 rpcz_store.cc:276] 0617 20:17:02.699034 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.699149 (+ 115us) service_pool.cc:224] Handling call
0617 20:17:05.325672 (+2626523us) ts_tablet_manager.cc:1151] Deleting tablet cc8fa9f4c40b4ce9baa27a8837d3575c
0617 20:17:05.325687 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.344555 (+ 18868us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.479537 (+134982us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.480417 (+ 880us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2626351}
I20260617 20:17:05.481182 28960 tablet_service.cc:1511] Processing CreateTablet for tablet 5da459a52667402aa7a94a88bdc6f4e6 (DEFAULT_TABLE table=default.Table_e1570318e62a4455991ccbddfea26e31 [id=bf708541e8b248beb550ef49994ed8d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.481635 28960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da459a52667402aa7a94a88bdc6f4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.481930 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet cc8fa9f4c40b4ce9baa27a8837d3575c (table default.Table_350b5e38df254cc69627edec8db5af45 [id=3463908997e94c288a7ac6ba26de9451]) successfully deleted
I20260617 20:17:05.484627 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d7a2a556e24e02a3f74d56c9bed78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.486330 28955 tablet_service.cc:1511] Processing CreateTablet for tablet 3413b0add2df453bb2839377af2e42cf (DEFAULT_TABLE table=default.Table_dc3d1baf230b4c32b23beb5d647a300d [id=642a5256a45b4ff3b1557a6c50d25d73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.486723 28955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3413b0add2df453bb2839377af2e42cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.486889 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 8797ef75e5174c99bfae4de206eb1fda (DEFAULT_TABLE table=default.Table_6a488f8547fe46278096d8acc2c1753f [id=e0ac5a8ae5b34be48d2d85947f803ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.489377 29104 tablet_service.cc:1511] Processing CreateTablet for tablet ca4924e2825e4ec9b3302c1abb9c0bcf (DEFAULT_TABLE table=default.Table_f0db2ca25413465891e96ea21ba8f22a [id=c3f5396f04d840599b0fd38bd9bb6022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.489743 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 604862f683984695b393cd9ca3500bdc (DEFAULT_TABLE table=default.Table_c67156b0dace4897967975f7f41f09fe [id=f48dcb0c33bd44f484cc4d1b0caadb88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.489743 28970 tablet_service.cc:1511] Processing CreateTablet for tablet 0b194772c9054192b7639cbab5f86ca8 (DEFAULT_TABLE table=default.Table_f168b2e932084d149c71a4b87f021c3d [id=e21edff75b2e411d80a8f97ab4ab7956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.490543 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 5da459a52667402aa7a94a88bdc6f4e6 (DEFAULT_TABLE table=default.Table_e1570318e62a4455991ccbddfea26e31 [id=bf708541e8b248beb550ef49994ed8d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.491211 29098 tablet_service.cc:1511] Processing CreateTablet for tablet 513d335e9dfb4ab69ab0c455d7139905 (DEFAULT_TABLE table=default.Table_088c2b4ca59e4dd49f684c9f6648bc57 [id=47c6b29f6e284a1b9cd984f16d925103]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.492336 29107 tablet_service.cc:1511] Processing CreateTablet for tablet e4ff51037a354457a0adc06020295ba9 (DEFAULT_TABLE table=default.Table_62b5e2225918452592675fc7e49ea2e0 [id=05a8eb4228f84b2b9eba7ee1c90dd385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.493475 29376 ts_tablet_manager.cc:1950] T 8a5d9677bc184c30be1a11bfa85a97c8 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:05.493441 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 0822654770594804be2413296f6c94dc (DEFAULT_TABLE table=default.Table_7ba6c34c2fdb41c7a28dd9b7d555eeba [id=57f51996903e41d6bf32d9b398240a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.494153 28952 tablet_service.cc:1511] Processing CreateTablet for tablet afbdb8d7562742e6903465afa71efa25 (DEFAULT_TABLE table=default.Table_d4ddf99bf0e44da4bd61741ec0ac2065 [id=cfcf57f5da064087ba790a7f348b4778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.494282 28968 tablet_service.cc:1511] Processing CreateTablet for tablet b3631e93c8684f02a2dd28a51080d006 (DEFAULT_TABLE table=default.Table_519cbb2c93394f968d1b274487015f44 [id=89f26a2cd90440a4948ae3718ee5cf3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.494153 28959 tablet_service.cc:1511] Processing CreateTablet for tablet e4ff51037a354457a0adc06020295ba9 (DEFAULT_TABLE table=default.Table_62b5e2225918452592675fc7e49ea2e0 [id=05a8eb4228f84b2b9eba7ee1c90dd385]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:05.497115 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet b002468734394d8181543368ac878c6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b002468734394d8181543368ac878c6f already in progress: creating tablet
I20260617 20:17:05.499874 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 3413b0add2df453bb2839377af2e42cf (DEFAULT_TABLE table=default.Table_dc3d1baf230b4c32b23beb5d647a300d [id=642a5256a45b4ff3b1557a6c50d25d73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.501427 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d4ee09ae0a4649cdb22c66655ef3b4e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.502224 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 0b194772c9054192b7639cbab5f86ca8 (DEFAULT_TABLE table=default.Table_f168b2e932084d149c71a4b87f021c3d [id=e21edff75b2e411d80a8f97ab4ab7956]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:05.502435 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4ee09ae0a4649cdb22c66655ef3b4e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.503240 29097 tablet_service.cc:1511] Processing CreateTablet for tablet afbdb8d7562742e6903465afa71efa25 (DEFAULT_TABLE table=default.Table_d4ddf99bf0e44da4bd61741ec0ac2065 [id=cfcf57f5da064087ba790a7f348b4778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.504376 29092 tablet_service.cc:1511] Processing CreateTablet for tablet b3631e93c8684f02a2dd28a51080d006 (DEFAULT_TABLE table=default.Table_519cbb2c93394f968d1b274487015f44 [id=89f26a2cd90440a4948ae3718ee5cf3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.504206 28670 catalog_manager.cc:5696] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:17:05.505046 28670 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 0f3032155e4e4ea8a23984f547d78752 (table default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca]). Expected version 2 got 0
I20260617 20:17:05.506368 28966 tablet_service.cc:1511] Processing CreateTablet for tablet a3205efad2b24178ba761606a25661ff (DEFAULT_TABLE table=default.Table_122065b5c3db4c0eae386133c84b7940 [id=d1350616b5dc41e98e4b1554a10ddafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.506865 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 835dd184c2fc4e109187ca30894b6cd2 (DEFAULT_TABLE table=default.Table_2a1a4568e12941bf8abda5bc5f6a3477 [id=7ff91d1db9e249efa3d80acfddc13a27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.507037 28967 tablet_service.cc:1511] Processing CreateTablet for tablet 53d32672f44d4605b30237c0b1d72ff6 (DEFAULT_TABLE table=default.Table_10083b9d580b48efac85dba92bf6c202 [id=ce55e9a4f19149029ef26b62fafad83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.507287 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb3d6e959e24fc2864f87984010493c (DEFAULT_TABLE table=default.Table_fc2cdea718fc4d83ab66e9c4d231a8f0 [id=791fd9c127eb4213b1f362d7ac1acf73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.507421 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 2860409277a0423cadadd79363713fd3 (DEFAULT_TABLE table=default.Table_b25f36c0ba1247f5a4b85a5b4add8420 [id=6a948594185b42128136770dbe3f0ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.507835 28953 tablet_service.cc:1511] Processing CreateTablet for tablet dfa3b652083d4112b69d305ba90730a9 (DEFAULT_TABLE table=default.Table_33cfc094d5004faab8f883e15663eac5 [id=8e179900a6774ea3877a6e4347aa9fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.506865 28961 tablet_service.cc:1511] Processing CreateTablet for tablet cb95c048212948dfb00baafbd0c691d9 (DEFAULT_TABLE table=default.Table_c816a44858d34b368a1e701cdbebd429 [id=d4618abed4d0489187b4d138ed28867a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.509913 29089 tablet_service.cc:1511] Processing CreateTablet for tablet a3205efad2b24178ba761606a25661ff (DEFAULT_TABLE table=default.Table_122065b5c3db4c0eae386133c84b7940 [id=d1350616b5dc41e98e4b1554a10ddafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.510030 29099 tablet_service.cc:1511] Processing CreateTablet for tablet cb95c048212948dfb00baafbd0c691d9 (DEFAULT_TABLE table=default.Table_c816a44858d34b368a1e701cdbebd429 [id=d4618abed4d0489187b4d138ed28867a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.511065 29105 tablet_service.cc:1511] Processing CreateTablet for tablet 53d32672f44d4605b30237c0b1d72ff6 (DEFAULT_TABLE table=default.Table_10083b9d580b48efac85dba92bf6c202 [id=ce55e9a4f19149029ef26b62fafad83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.511818 29093 tablet_service.cc:1511] Processing CreateTablet for tablet 2860409277a0423cadadd79363713fd3 (DEFAULT_TABLE table=default.Table_b25f36c0ba1247f5a4b85a5b4add8420 [id=6a948594185b42128136770dbe3f0ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.516700 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 835dd184c2fc4e109187ca30894b6cd2 (DEFAULT_TABLE table=default.Table_2a1a4568e12941bf8abda5bc5f6a3477 [id=7ff91d1db9e249efa3d80acfddc13a27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.517714 29100 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb3d6e959e24fc2864f87984010493c (DEFAULT_TABLE table=default.Table_fc2cdea718fc4d83ab66e9c4d231a8f0 [id=791fd9c127eb4213b1f362d7ac1acf73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.519300 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 331273aec09e4ec894dc28c2e4387dda (DEFAULT_TABLE table=default.Table_e449fc7e82964090996a0aa1e86bc42d [id=a7832fcf4d9c4b48a4670981229e49ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.521494 28964 tablet_service.cc:1511] Processing CreateTablet for tablet bfac7fefb3e54f18896703d01c0c7ee4 (DEFAULT_TABLE table=default.Table_87e22bfc578e47a49cb67beea659b86e [id=2844b3e6636d4e77bce1461fb477b36d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.522939 29103 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cafcade995b407f84f56b8cd3ab6892 with delete_type TABLET_DATA_DELETED (replaced by tablet fb2a0578122c421ab45bf56edb7cffdb) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.523401 29101 tablet_service.cc:1511] Processing CreateTablet for tablet dfa3b652083d4112b69d305ba90730a9 (DEFAULT_TABLE table=default.Table_33cfc094d5004faab8f883e15663eac5 [id=8e179900a6774ea3877a6e4347aa9fbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.524250 29103 tablet_service.cc:1511] Processing CreateTablet for tablet 331273aec09e4ec894dc28c2e4387dda (DEFAULT_TABLE table=default.Table_e449fc7e82964090996a0aa1e86bc42d [id=a7832fcf4d9c4b48a4670981229e49ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.525540 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f3b595ceaae84ca6a9460b180efc2e5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.526118 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3b595ceaae84ca6a9460b180efc2e5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.529127 28966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3205efad2b24178ba761606a25661ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.529345 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3631e93c8684f02a2dd28a51080d006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.529696 28967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53d32672f44d4605b30237c0b1d72ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.529899 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfac7fefb3e54f18896703d01c0c7ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.530067 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa3b652083d4112b69d305ba90730a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.530442 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb95c048212948dfb00baafbd0c691d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.530783 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2860409277a0423cadadd79363713fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.531209 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331273aec09e4ec894dc28c2e4387dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.531469 28970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b194772c9054192b7639cbab5f86ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.531823 28952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afbdb8d7562742e6903465afa71efa25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.531889 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet 53d32672f44d4605b30237c0b1d72ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.531939 29234 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d81457d71a34657b43c8ebe7efb0a35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.532110 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ff51037a354457a0adc06020295ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.532168 29225 tablet_service.cc:1511] Processing CreateTablet for tablet ee9afd550a6d4d2e9edd84e4b49186c4 (DEFAULT_TABLE table=default.Table_1b6116659f754549b9c833b7b5f49b48 [id=2a75e08f58a74d18b2fead92b0c33183]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.532313 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb3d6e959e24fc2864f87984010493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.532517 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9afd550a6d4d2e9edd84e4b49186c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.532763 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835dd184c2fc4e109187ca30894b6cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.533269 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 4f0697e4379141238d1fa70297731187 (DEFAULT_TABLE table=default.Table_3f639bb9ece9443ea9d7f7cf5ec04be4 [id=80f77a5c1229411b9e3b5c0094eca5f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.533608 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f0697e4379141238d1fa70297731187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.536321 30678 raft_consensus.cc:493] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.536466 30678 raft_consensus.cc:515] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.536798 29243 tablet_service.cc:1511] Processing CreateTablet for tablet 0822654770594804be2413296f6c94dc (DEFAULT_TABLE table=default.Table_7ba6c34c2fdb41c7a28dd9b7d555eeba [id=57f51996903e41d6bf32d9b398240a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.537024 30678 leader_election.cc:290] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:05.537130 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0822654770594804be2413296f6c94dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.537388 29233 tablet_service.cc:1558] Processing DeleteTablet for tablet d16bbe642edc43449d3b910ca5cf4d37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.537516 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb1277c83554dfbb541961c1e6c3617 (DEFAULT_TABLE table=default.Table_cdb98c9b862142e289f947e9d07a2a53 [id=4b77ac1b27aa415dbcb873621ee4ddd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.537635 30761 raft_consensus.cc:493] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.537688 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 3413b0add2df453bb2839377af2e42cf (DEFAULT_TABLE table=default.Table_dc3d1baf230b4c32b23beb5d647a300d [id=642a5256a45b4ff3b1557a6c50d25d73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.537786 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb1277c83554dfbb541961c1e6c3617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.537734 30761 raft_consensus.cc:515] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.537981 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3413b0add2df453bb2839377af2e42cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.538096 29238 tablet_service.cc:1558] Processing DeleteTablet for tablet ce3e1aa04bca4425a907caadd5a736f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.538201 30761 leader_election.cc:290] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:05.538365 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 0b194772c9054192b7639cbab5f86ca8 (DEFAULT_TABLE table=default.Table_f168b2e932084d149c71a4b87f021c3d [id=e21edff75b2e411d80a8f97ab4ab7956]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.538621 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b194772c9054192b7639cbab5f86ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.541350 28979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c59cf5f5e8486baf1e038a44657f33" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.541419 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d9de6a2fb47e18d86649e45ba80b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.541509 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 380ccd1d167744248a1ccad80788d0a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.541538 28979 raft_consensus.cc:2468] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:05.541705 29241 tablet_service.cc:1511] Processing CreateTablet for tablet afbdb8d7562742e6903465afa71efa25 (DEFAULT_TABLE table=default.Table_d4ddf99bf0e44da4bd61741ec0ac2065 [id=cfcf57f5da064087ba790a7f348b4778]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.541805 29229 tablet_service.cc:1511] Processing CreateTablet for tablet b3631e93c8684f02a2dd28a51080d006 (DEFAULT_TABLE table=default.Table_519cbb2c93394f968d1b274487015f44 [id=89f26a2cd90440a4948ae3718ee5cf3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.542001 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afbdb8d7562742e6903465afa71efa25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.542228 29240 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd75cc0dd244ee8b3c19a9597c8c7d3 (DEFAULT_TABLE table=default.Table_143ae9e7e1ec4c7abc9cd48b0623f7b7 [id=6fcc9d1bbca646d78518552e7930e293]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.542543 29240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd75cc0dd244ee8b3c19a9597c8c7d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.543097 28979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb0759ee9a34f3d96623bbe6dcc46d9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.543247 28979 raft_consensus.cc:2468] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:05.545512 29230 tablet_service.cc:1511] Processing CreateTablet for tablet 46dc6997caa74ccea3e5d4a7fb34a6f6 (DEFAULT_TABLE table=default.Table_c2d261c0ee9147409da728ff7de82e89 [id=850325382fbe4208aa36305354ab7044]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.545734 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 513d335e9dfb4ab69ab0c455d7139905 (DEFAULT_TABLE table=default.Table_088c2b4ca59e4dd49f684c9f6648bc57 [id=47c6b29f6e284a1b9cd984f16d925103]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.545876 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dc6997caa74ccea3e5d4a7fb34a6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.546036 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513d335e9dfb4ab69ab0c455d7139905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.547057 29243 tablet_service.cc:1511] Processing CreateTablet for tablet a3205efad2b24178ba761606a25661ff (DEFAULT_TABLE table=default.Table_122065b5c3db4c0eae386133c84b7940 [id=d1350616b5dc41e98e4b1554a10ddafb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.547516 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3205efad2b24178ba761606a25661ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.549551 29234 tablet_service.cc:1511] Processing CreateTablet for tablet ce3e1aa04bca4425a907caadd5a736f9 (DEFAULT_TABLE table=default.Table_45681900e4bb466c8665d7200abc0eb1 [id=43bcf8cdd40b44f6b41da8802a0466b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.549888 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce3e1aa04bca4425a907caadd5a736f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.550055 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 7cafcade995b407f84f56b8cd3ab6892 with delete_type TABLET_DATA_DELETED (replaced by tablet fb2a0578122c421ab45bf56edb7cffdb) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.550391 29228 tablet_service.cc:1511] Processing CreateTablet for tablet cb95c048212948dfb00baafbd0c691d9 (DEFAULT_TABLE table=default.Table_c816a44858d34b368a1e701cdbebd429 [id=d4618abed4d0489187b4d138ed28867a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.550570 29239 tablet_service.cc:1511] Processing CreateTablet for tablet d2d7a2a556e24e02a3f74d56c9bed78e (DEFAULT_TABLE table=default.Table_f47ba95e589c47759a3ca685e8e9a067 [id=b41299e9f3a84c2e91c6a082d8bba55d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.550685 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb95c048212948dfb00baafbd0c691d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.550863 29239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d7a2a556e24e02a3f74d56c9bed78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.550390 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba86bae9e91404185d248dfd722a413" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.553539 29237 tablet_service.cc:1511] Processing CreateTablet for tablet ca4924e2825e4ec9b3302c1abb9c0bcf (DEFAULT_TABLE table=default.Table_f0db2ca25413465891e96ea21ba8f22a [id=c3f5396f04d840599b0fd38bd9bb6022]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.553839 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4924e2825e4ec9b3302c1abb9c0bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.556141 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 2860409277a0423cadadd79363713fd3 (DEFAULT_TABLE table=default.Table_b25f36c0ba1247f5a4b85a5b4add8420 [id=6a948594185b42128136770dbe3f0ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.556416 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2860409277a0423cadadd79363713fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.556377 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 53d32672f44d4605b30237c0b1d72ff6 (DEFAULT_TABLE table=default.Table_10083b9d580b48efac85dba92bf6c202 [id=ce55e9a4f19149029ef26b62fafad83a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.556660 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53d32672f44d4605b30237c0b1d72ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.557595 29242 tablet_service.cc:1511] Processing CreateTablet for tablet 8797ef75e5174c99bfae4de206eb1fda (DEFAULT_TABLE table=default.Table_6a488f8547fe46278096d8acc2c1753f [id=e0ac5a8ae5b34be48d2d85947f803ead]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.557883 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8797ef75e5174c99bfae4de206eb1fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.561533 29236 tablet_service.cc:1511] Processing CreateTablet for tablet e4ff51037a354457a0adc06020295ba9 (DEFAULT_TABLE table=default.Table_62b5e2225918452592675fc7e49ea2e0 [id=05a8eb4228f84b2b9eba7ee1c90dd385]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.561825 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ff51037a354457a0adc06020295ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.562506 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet ebd98889d08f4683ba4b2ee98a74254d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.562651 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet cc8fa9f4c40b4ce9baa27a8837d3575c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.562923 28951 tablet_service.cc:1511] Processing CreateTablet for tablet a6372df669ca4fc4818243778d2186f5 (DEFAULT_TABLE table=default.Table_fcd950bebde64e8bafd0dae2ec3f7149 [id=8ca6a6b12902442fbff567cb44a4e03d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.563239 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6372df669ca4fc4818243778d2186f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.564030 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 835dd184c2fc4e109187ca30894b6cd2 (DEFAULT_TABLE table=default.Table_2a1a4568e12941bf8abda5bc5f6a3477 [id=7ff91d1db9e249efa3d80acfddc13a27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.564298 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835dd184c2fc4e109187ca30894b6cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.565858 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 0f3032155e4e4ea8a23984f547d78752 (table default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca]). Expected version 2 got 0
I20260617 20:17:05.566259 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]). Expected version 1 got 0
I20260617 20:17:05.566203 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 0385c347d2824b2dbb985b37cf8809b8 (DEFAULT_TABLE table=default.Table_e0d3bd7023894d139716d67bbe5357d4 [id=fb58b5a1d10847ef8221618e0fd77784]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.566464 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d673bc9892c94725b270ef3b9dc768f4 (table default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330]). Expected version 1 got 0
I20260617 20:17:05.566530 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0385c347d2824b2dbb985b37cf8809b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.566659 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet e7eb77c619e04c448a084638668dbb6a (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]). Expected version 1 got 0
I20260617 20:17:05.566864 28663 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 (table default.Table_9cd011070f8848eeb76b111f2e64f60f [id=475aa0d2f8044cd8b52cf31085dda15d]). Expected version 1 got 0
I20260617 20:17:05.567308 29233 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb3d6e959e24fc2864f87984010493c (DEFAULT_TABLE table=default.Table_fc2cdea718fc4d83ab66e9c4d231a8f0 [id=791fd9c127eb4213b1f362d7ac1acf73]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.567237 28663 catalog_manager.cc:5696] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:05.567592 29233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb3d6e959e24fc2864f87984010493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.545519 29231 tablet_service.cc:1511] Processing CreateTablet for tablet 5da459a52667402aa7a94a88bdc6f4e6 (DEFAULT_TABLE table=default.Table_e1570318e62a4455991ccbddfea26e31 [id=bf708541e8b248beb550ef49994ed8d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.570683 29231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da459a52667402aa7a94a88bdc6f4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.570698 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_35fc3c1b8a6c461087e80918d278d106"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.571625 29234 tablet_service.cc:1511] Processing CreateTablet for tablet dfa3b652083d4112b69d305ba90730a9 (DEFAULT_TABLE table=default.Table_33cfc094d5004faab8f883e15663eac5 [id=8e179900a6774ea3877a6e4347aa9fbe]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:05.571761 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35fc3c1b8a6c461087e80918d278d106 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.571925 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa3b652083d4112b69d305ba90730a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.549919 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 604862f683984695b393cd9ca3500bdc (DEFAULT_TABLE table=default.Table_c67156b0dace4897967975f7f41f09fe [id=f48dcb0c33bd44f484cc4d1b0caadb88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.573690 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3631e93c8684f02a2dd28a51080d006. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:05.573777 28925 leader_election.cc:343] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.573901 28925 leader_election.cc:304] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.574275 30756 raft_consensus.cc:2749] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.574465 29197 leader_election.cc:304] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.574716 30761 raft_consensus.cc:2804] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.574791 30761 raft_consensus.cc:493] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.574863 30761 raft_consensus.cc:3060] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.577245 30761 raft_consensus.cc:515] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.577948 30761 leader_election.cc:290] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:05.582135 29063 leader_election.cc:343] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: fc36f62aa0bf46278cb84ec8cb7eef55
I20260617 20:17:05.582253 29063 leader_election.cc:304] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:05.582739 30294 raft_consensus.cc:2749] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.583308 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c17aa7f99fc74838b9975c3e9289ccfd" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.583925 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb0759ee9a34f3d96623bbe6dcc46d9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.584983 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c59cf5f5e8486baf1e038a44657f33" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:05.585250 29197 leader_election.cc:304] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.585723 30678 raft_consensus.cc:2804] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260617 20:17:05.585755 29198 leader_election.cc:343] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: Tablet not RUNNING: STOPPED
I20260617 20:17:05.585799 30678 raft_consensus.cc:493] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.585880 30678 raft_consensus.cc:3060] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:05.586675 29198 leader_election.cc:343] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:05.587188 29198 leader_election.cc:343] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.588467 30678 raft_consensus.cc:515] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.589061 30678 leader_election.cc:290] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:05.589401 29197 leader_election.cc:343] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c17aa7f99fc74838b9975c3e9289ccfd
I20260617 20:17:05.589496 29197 leader_election.cc:304] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.594213 29378 tablet_bootstrap.cc:492] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:05.594357 29378 ts_tablet_manager.cc:1403] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.219s user 0.003s sys 0.000s
I20260617 20:17:05.595180 29378 raft_consensus.cc:359] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.595341 29378 raft_consensus.cc:385] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.595445 29378 raft_consensus.cc:740] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.595726 29378 consensus_queue.cc:260] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.596756 29378 ts_tablet_manager.cc:1434] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:05.598244 30819 raft_consensus.cc:493] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.598419 30819 raft_consensus.cc:515] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.599083 30819 leader_election.cc:290] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.601408 30556 raft_consensus.cc:2749] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:05.609874 28979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb0759ee9a34f3d96623bbe6dcc46d9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.610097 28979 raft_consensus.cc:3060] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.612545 28979 raft_consensus.cc:2468] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:05.612747 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet eba86bae9e91404185d248dfd722a413 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.612916 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c59cf5f5e8486baf1e038a44657f33" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.612540 29378 tablet_bootstrap.cc:492] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:05.613112 28981 raft_consensus.cc:3060] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.613032 28964 tablet_service.cc:1511] Processing CreateTablet for tablet bb6a2adbc5fb4c1e915dee1b524f3aa5 (DEFAULT_TABLE table=default.Table_a2980fa5162245c081e94675f6a1fd9e [id=8d19f88dfaeb45c088856dfb46408809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.614212 28964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6a2adbc5fb4c1e915dee1b524f3aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.615731 28981 raft_consensus.cc:2468] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:05.618572 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 0a1f2f87da1143d99668fe223201aa16 (DEFAULT_TABLE table=default.Table_e259b984fdf44bde85b3546242987b20 [id=3b2b81a363c74e6c9e602bf6fb5b0218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.618968 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a1f2f87da1143d99668fe223201aa16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.620638 29378 tablet_bootstrap.cc:654] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.621683 29197 leader_election.cc:304] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.621887 30678 raft_consensus.cc:493] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.621996 30678 raft_consensus.cc:515] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.613034 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 0307139a910c4850b717a36f22f80be1 (DEFAULT_TABLE table=default.Table_8c9ad175c7d645afb125d140eb250bfc [id=cf56b2890579404caad095aac8bcc4db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.622591 30678 leader_election.cc:290] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:05.622712 30678 raft_consensus.cc:2804] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.622886 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0307139a910c4850b717a36f22f80be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.622908 30678 raft_consensus.cc:697] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.623119 30678 consensus_queue.cc:237] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.624166 29197 leader_election.cc:304] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.624627 30761 raft_consensus.cc:2804] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.624797 30761 raft_consensus.cc:697] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.624997 30761 consensus_queue.cc:237] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.625566 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604862f683984695b393cd9ca3500bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.632691 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde88371f4454a4bb3053c6cd1afb801" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.632937 28981 raft_consensus.cc:2468] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:05.633239 30410 raft_consensus.cc:493] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.633386 30410 raft_consensus.cc:515] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.633538 29197 leader_election.cc:304] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.633766 30556 raft_consensus.cc:2804] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.633845 30556 raft_consensus.cc:493] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.633904 30556 raft_consensus.cc:3060] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.633955 30410 leader_election.cc:290] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:05.636045 29062 leader_election.cc:343] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 58213ec0a9364a91a15fc0329f28605b
I20260617 20:17:05.636300 30556 raft_consensus.cc:515] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.636886 30556 leader_election.cc:290] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:05.638126 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde88371f4454a4bb3053c6cd1afb801" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.638362 28981 raft_consensus.cc:3060] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.640841 28981 raft_consensus.cc:2468] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:05.641530 29197 leader_election.cc:304] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.641757 30556 raft_consensus.cc:2804] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.641737 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a5e5917a414c99b25ea2efeab4063d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.641887 30556 raft_consensus.cc:697] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.642066 28988 raft_consensus.cc:2468] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:05.642112 30556 consensus_queue.cc:237] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.643324 29197 leader_election.cc:304] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.644456 30410 raft_consensus.cc:2804] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.644531 30410 raft_consensus.cc:493] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.644584 30410 raft_consensus.cc:3060] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.648768 30410 raft_consensus.cc:515] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.649602 30410 leader_election.cc:290] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:05.653805 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a5e5917a414c99b25ea2efeab4063d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:05.654383 28988 raft_consensus.cc:3060] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.654584 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 331273aec09e4ec894dc28c2e4387dda (DEFAULT_TABLE table=default.Table_e449fc7e82964090996a0aa1e86bc42d [id=a7832fcf4d9c4b48a4670981229e49ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.654971 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331273aec09e4ec894dc28c2e4387dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.657464 28988 raft_consensus.cc:2468] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:05.657797 30756 raft_consensus.cc:493] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.657938 30756 raft_consensus.cc:515] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:05.658556 30756 leader_election.cc:290] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.658646 29197 leader_election.cc:304] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.658901 30556 raft_consensus.cc:2804] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:05.659011 30556 raft_consensus.cc:697] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:05.659222 30556 consensus_queue.cc:237] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.663264 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7eb77c619e04c448a084638668dbb6a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.663460 29257 raft_consensus.cc:2468] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:05.663914 28925 leader_election.cc:304] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:05.664556 30756 raft_consensus.cc:2804] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.664644 30756 raft_consensus.cc:493] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.664651 29235 tablet_service.cc:1511] Processing CreateTablet for tablet bfac7fefb3e54f18896703d01c0c7ee4 (DEFAULT_TABLE table=default.Table_87e22bfc578e47a49cb67beea659b86e [id=2844b3e6636d4e77bce1461fb477b36d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.664753 30756 raft_consensus.cc:3060] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.665024 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfac7fefb3e54f18896703d01c0c7ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.666843 29230 tablet_service.cc:1511] Processing CreateTablet for tablet a6372df669ca4fc4818243778d2186f5 (DEFAULT_TABLE table=default.Table_fcd950bebde64e8bafd0dae2ec3f7149 [id=8ca6a6b12902442fbff567cb44a4e03d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.667189 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6372df669ca4fc4818243778d2186f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.667268 30756 raft_consensus.cc:515] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:05.667982 30756 leader_election.cc:290] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.669708 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7eb77c619e04c448a084638668dbb6a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:05.669870 29257 raft_consensus.cc:3060] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.674963 29257 raft_consensus.cc:2468] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:05.675840 29383 tablet_bootstrap.cc:654] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.675978 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7eb77c619e04c448a084638668dbb6a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.676496 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7eb77c619e04c448a084638668dbb6a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:05.676925 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fb0759ee9a34f3d96623bbe6dcc46d9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:05.677809 29234 tablet_service.cc:1511] Processing CreateTablet for tablet 0307139a910c4850b717a36f22f80be1 (DEFAULT_TABLE table=default.Table_8c9ad175c7d645afb125d140eb250bfc [id=cf56b2890579404caad095aac8bcc4db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.678184 29234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0307139a910c4850b717a36f22f80be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.688270 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde88371f4454a4bb3053c6cd1afb801" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.689069 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a5e5917a414c99b25ea2efeab4063d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.689445 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a5e5917a414c99b25ea2efeab4063d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:05.690819 29198 leader_election.cc:343] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.691290 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde88371f4454a4bb3053c6cd1afb801" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:05.692955 29198 leader_election.cc:343] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.684651 29236 tablet_service.cc:1511] Processing CreateTablet for tablet bb6a2adbc5fb4c1e915dee1b524f3aa5 (DEFAULT_TABLE table=default.Table_a2980fa5162245c081e94675f6a1fd9e [id=8d19f88dfaeb45c088856dfb46408809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.693715 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6a2adbc5fb4c1e915dee1b524f3aa5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:05.693969 28925 leader_election.cc:343] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:05.694401 28925 leader_election.cc:343] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:05.711129 29198 consensus_peers.cc:597] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:05.711591 29198 leader_election.cc:343] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:05.712132 29198 leader_election.cc:343] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.712913 28925 leader_election.cc:304] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.713539 30787 raft_consensus.cc:2804] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
W20260617 20:17:05.713627 28636 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 181080us
I20260617 20:17:05.713732 30787 raft_consensus.cc:697] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:05.714026 30787 consensus_queue.cc:237] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:05.715023 29378 tablet_bootstrap.cc:492] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:05.716023 29378 ts_tablet_manager.cc:1403] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.104s user 0.009s sys 0.006s
I20260617 20:17:05.716948 29378 raft_consensus.cc:359] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.717188 29378 raft_consensus.cc:385] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.717276 29378 raft_consensus.cc:740] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.717569 29378 consensus_queue.cc:260] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.718170 29378 ts_tablet_manager.cc:1434] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:05.723037 29119 raft_consensus.cc:3060] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:05.712846 29198 leader_election.cc:343] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.732030 29379 tablet_bootstrap.cc:492] T f14113dd9098456599d7b72626bedcd6 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:05.493884 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 808) took 2807 ms. Trace:
I20260617 20:17:05.732246 29376 rpcz_store.cc:276] 0617 20:17:02.686464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.686513 (+ 49us) service_pool.cc:224] Handling call
0617 20:17:05.314139 (+2627626us) ts_tablet_manager.cc:1151] Deleting tablet 8a5d9677bc184c30be1a11bfa85a97c8
0617 20:17:05.314151 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.348965 (+ 34814us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.388811 (+ 39846us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.493863 (+105052us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2627414}
I20260617 20:17:05.733243 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 813) took 2867 ms. Trace:
I20260617 20:17:05.733693 29376 rpcz_store.cc:276] 0617 20:17:02.871690 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.872257 (+ 567us) service_pool.cc:224] Handling call
0617 20:17:05.733118 (+2860861us) ts_tablet_manager.cc:1151] Deleting tablet aad5d2ab3e7d4453b4e1aa27acf7683d
0617 20:17:05.733128 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.733225 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2860632}
I20260617 20:17:05.734215 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 814) took 2860 ms. Trace:
I20260617 20:17:05.734333 29376 rpcz_store.cc:276] 0617 20:17:02.874785 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.874840 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:05.733992 (+2859152us) ts_tablet_manager.cc:1151] Deleting tablet 64538fdf51f94e8e985fec6202baac22
0617 20:17:05.734000 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.734199 (+ 199us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2858946}
I20260617 20:17:05.734820 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 823) took 2783 ms. Trace:
I20260617 20:17:05.735165 29376 rpcz_store.cc:276] 0617 20:17:02.952058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.956717 (+ 4659us) service_pool.cc:224] Handling call
0617 20:17:05.734735 (+2778018us) ts_tablet_manager.cc:1151] Deleting tablet 33d9cafa9d7c4a3f91f738e4654058b4
0617 20:17:05.734743 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.734807 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2777858}
I20260617 20:17:05.735635 29376 tablet_replica.cc:333] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:05.736033 29376 raft_consensus.cc:2243] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:05.736625 29376 raft_consensus.cc:2272] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:05.738364 29378 tablet_bootstrap.cc:492] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:05.739653 29379 tablet_bootstrap.cc:654] T f14113dd9098456599d7b72626bedcd6 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.739850 29378 tablet_bootstrap.cc:654] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:05.742583 29379 tablet_bootstrap.cc:492] T f14113dd9098456599d7b72626bedcd6 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:05.743659 29379 ts_tablet_manager.cc:1403] T f14113dd9098456599d7b72626bedcd6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s
I20260617 20:17:05.745137 29379 raft_consensus.cc:359] T f14113dd9098456599d7b72626bedcd6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.745687 30410 consensus_queue.cc:1048] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:05.746964 28656 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 31267063d24f4e89898349117a9a3031 (table default.Table_6f87ebb700cd4bcd8c9970ecae935a1a [id=908d6aab19ee442a9d9246694407969e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 31267063d24f4e89898349117a9a3031 has no consensus state
I20260617 20:17:05.749029 29378 tablet_bootstrap.cc:492] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:05.749190 29378 ts_tablet_manager.cc:1403] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20260617 20:17:05.750602 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_02f58a9f82d14da8b747113572af3a4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.751260 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02f58a9f82d14da8b747113572af3a4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.752041 29377 tablet_replica.cc:333] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:05.752255 29377 raft_consensus.cc:2243] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:05.752494 29377 pending_rounds.cc:70] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: Trying to abort 1 pending ops.
I20260617 20:17:05.752562 29377 pending_rounds.cc:77] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955534429310976 op_type: NO_OP noop_request { }
I20260617 20:17:05.752664 29377 raft_consensus.cc:2889] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:05.752761 29377 raft_consensus.cc:2272] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:05.752959 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b04a91bebb6d429cbe4de27fdcd30bb5" } new_table_name: "default.Table_66d9873c0541455b9003127d8cd07f3d" modify_external_catalogs: true
I20260617 20:17:05.753947 30410 raft_consensus.cc:493] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.754096 30410 raft_consensus.cc:515] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.754683 30410 leader_election.cc:290] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:05.754787 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ac58b4b8071a43ea8e6c8839689b83dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.750646 29378 raft_consensus.cc:359] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.755764 29378 raft_consensus.cc:385] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.755888 29378 raft_consensus.cc:740] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.757524 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 0a1f2f87da1143d99668fe223201aa16 (DEFAULT_TABLE table=default.Table_e259b984fdf44bde85b3546242987b20 [id=3b2b81a363c74e6c9e602bf6fb5b0218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.759390 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a1f2f87da1143d99668fe223201aa16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.761569 30314 raft_consensus.cc:493] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.761920 30314 raft_consensus.cc:515] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.764142 30314 leader_election.cc:290] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.766295 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_409d138758b3428aabafcceb17e37cb1" } new_table_name: "default.Table_5ace1745da5345cfa1f9f0c9585cb25b" modify_external_catalogs: true
I20260617 20:17:05.775811 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5927f45d8048449fa563d499f1df55a7" } new_table_name: "default.Table_6997907f38d14a7aa42f81aae35fae5c" modify_external_catalogs: true
I20260617 20:17:05.773238 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4fe634ef4e354d92a6d2b711acee1d5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:05.780548 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5293e9d7c6ad4868b54d0aa5d41958b9" } modify_external_catalogs: true
I20260617 20:17:05.780725 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5293e9d7c6ad4868b54d0aa5d41958b9" } modify_external_catalogs: true
I20260617 20:17:05.782902 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_efec5fea83174407a7f646486d5f4269" } modify_external_catalogs: true
I20260617 20:17:05.783079 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_efec5fea83174407a7f646486d5f4269" } modify_external_catalogs: true
I20260617 20:17:05.785964 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet 370db89a92a6455190edaf80e5a56205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.806344 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_01fded33682b4e3f91e9f6e6e92031f6" } modify_external_catalogs: true
I20260617 20:17:05.806596 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_01fded33682b4e3f91e9f6e6e92031f6" } modify_external_catalogs: true
I20260617 20:17:05.807858 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fd65529645494ac38960b878c8dce40a" } modify_external_catalogs: true
I20260617 20:17:05.808043 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fd65529645494ac38960b878c8dce40a" } modify_external_catalogs: true
I20260617 20:17:05.831423 29377 ts_tablet_manager.cc:1916] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:05.849556 29378 consensus_queue.cc:260] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.850273 29378 ts_tablet_manager.cc:1434] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.101s user 0.002s sys 0.000s
I20260617 20:17:05.850826 29378 tablet_bootstrap.cc:492] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:17:05.852389 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d08a9b89bc4e4f66ab533a280a2499da has no consensus state
I20260617 20:17:05.852741 29378 tablet_bootstrap.cc:654] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:05.861487 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fe634ef4e354d92a6d2b711acee1d5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.864395 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4d054537f4144ed9bc9b35c7da51932d" } new_table_name: "default.Table_70b749ff7ffb4047b023ae8c67106dfb" modify_external_catalogs: true
W20260617 20:17:05.865798 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac58b4b8071a43ea8e6c8839689b83dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.868019 30787 raft_consensus.cc:493] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.868573 30787 raft_consensus.cc:515] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.755317 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f6dcc384154d41866cf8060cf05837" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.756479 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604862f683984695b393cd9ca3500bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.874847 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet cde88371f4454a4bb3053c6cd1afb801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.875094 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b194772c9054192b7639cbab5f86ca8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:05.875414 29198 leader_election.cc:343] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.874562 29379 raft_consensus.cc:385] T f14113dd9098456599d7b72626bedcd6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.775386 29106 tablet_service.cc:1511] Processing CreateTablet for tablet bfac7fefb3e54f18896703d01c0c7ee4 (DEFAULT_TABLE table=default.Table_87e22bfc578e47a49cb67beea659b86e [id=2844b3e6636d4e77bce1461fb477b36d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:05.788380 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ba8b7d18af44b58800e588279e2e0b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:05.862987 30819 raft_consensus.cc:493] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.872056 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd98889d08f4683ba4b2ee98a74254d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:05.880882 28925 leader_election.cc:343] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.877233 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0822654770594804be2413296f6c94dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:05.881112 28925 leader_election.cc:343] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:05.881520 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3413b0add2df453bb2839377af2e42cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.883747 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3205efad2b24178ba761606a25661ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.885002 29105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53d32672f44d4605b30237c0b1d72ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.887765 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb95c048212948dfb00baafbd0c691d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.889081 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afbdb8d7562742e6903465afa71efa25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.889950 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3631e93c8684f02a2dd28a51080d006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.908229 30787 leader_election.cc:290] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.919808 29376 ts_tablet_manager.cc:1916] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:05.931836 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d123638c3d384630b367ac3fd209caba consensus state has no leader
I20260617 20:17:05.934571 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a1db08a35ad14d90b6f54df2495fa076" } modify_external_catalogs: true
W20260617 20:17:05.939455 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc48e61d2d3d4bca8051eafaa49c6534 consensus state has no leader
I20260617 20:17:05.939845 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_89dd72be1c17431fb9eca41b33a12fc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:05.940372 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89dd72be1c17431fb9eca41b33a12fc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:05.943537 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c3014c93d6804f3896f452f041cbedc9
I20260617 20:17:05.944175 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d4a84bed29104bb3a86225b6af000f69" } new_table_name: "default.Table_a1253aa407ca4f668a179dd0a7b0f40e" modify_external_catalogs: true
I20260617 20:17:05.945345 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet c3014c93d6804f3896f452f041cbedc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:05.954079 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a5e5917a414c99b25ea2efeab4063d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.954174 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet 0eaa60028a1647e580a987c3a0836a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.955919 29230 tablet_service.cc:1558] Processing DeleteTablet for tablet c17aa7f99fc74838b9975c3e9289ccfd with delete_type TABLET_DATA_DELETED (replaced by tablet ae8574874a194473bb5891e604a25ce8) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.956030 29243 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f6dcc384154d41866cf8060cf05837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.956648 29378 tablet_bootstrap.cc:492] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:05.957217 29378 ts_tablet_manager.cc:1403] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.106s user 0.004s sys 0.015s
I20260617 20:17:05.958290 29378 raft_consensus.cc:359] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.960476 30787 raft_consensus.cc:493] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:05.960633 30787 raft_consensus.cc:515] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.961341 30787 leader_election.cc:290] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.962249 29378 raft_consensus.cc:385] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:05.962378 29378 raft_consensus.cc:740] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.962664 29378 consensus_queue.cc:260] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.965768 29378 ts_tablet_manager.cc:1434] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 20:17:05.969275 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet c3014c93d6804f3896f452f041cbedc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:05.972823 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 8a5d9677bc184c30be1a11bfa85a97c8 (table default.Table_2cc66b9f491541379d5bb95e9d64b6db [id=bc7497631072430ca5571972468880f7]) successfully deleted
W20260617 20:17:05.973104 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet aad5d2ab3e7d4453b4e1aa27acf7683d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aad5d2ab3e7d4453b4e1aa27acf7683d already in progress: creating tablet
W20260617 20:17:05.973335 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 64538fdf51f94e8e985fec6202baac22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64538fdf51f94e8e985fec6202baac22 already in progress: creating tablet
W20260617 20:17:05.973528 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 33d9cafa9d7c4a3f91f738e4654058b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33d9cafa9d7c4a3f91f738e4654058b4 already in progress: creating tablet
I20260617 20:17:05.974184 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f6dcc384154d41866cf8060cf05837" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:05.974442 28981 raft_consensus.cc:2468] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:05.977121 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ba8b7d18af44b58800e588279e2e0b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.978974 28988 raft_consensus.cc:1275] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Refusing update from remote peer a8c0aea0206f44d683ed3b6b18c719f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:17:05.971662 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58213ec0a9364a91a15fc0329f28605b" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.980875 29197 leader_election.cc:304] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:05.980916 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31bf7ed828f44b398f5bdac6b9b63e7" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.981376 30410 raft_consensus.cc:2804] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:05.981462 30410 raft_consensus.cc:493] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:05.981441 30683 consensus_queue.cc:1048] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:05.981639 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd98889d08f4683ba4b2ee98a74254d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:05.981523 30410 raft_consensus.cc:3060] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.984107 30678 consensus_queue.cc:1048] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:05.996165 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a1db08a35ad14d90b6f54df2495fa076" } modify_external_catalogs: true
I20260617 20:17:05.997586 30410 raft_consensus.cc:515] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:05.998299 29377 ts_tablet_manager.cc:1929] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:05.999572 29377 log.cc:1199] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/0eaa60028a1647e580a987c3a0836a24
I20260617 20:17:06.005100 29377 ts_tablet_manager.cc:1950] T 0eaa60028a1647e580a987c3a0836a24 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:06.007030 30410 leader_election.cc:290] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:06.011583 30787 raft_consensus.cc:493] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:06.011740 30787 raft_consensus.cc:515] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.012441 30787 leader_election.cc:290] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.031775 30858 tablet.cc:1724] T dd8a7096a09147789ac203c150a19419 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:06.037926 29383 tablet_bootstrap.cc:492] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:06.038075 29383 ts_tablet_manager.cc:1403] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.729s user 0.026s sys 0.004s
I20260617 20:17:06.038964 29383 raft_consensus.cc:359] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.039193 29383 raft_consensus.cc:385] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.039265 29383 raft_consensus.cc:740] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.879659 29375 ts_tablet_manager.cc:1929] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:06.047003 29375 log.cc:1199] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/c17aa7f99fc74838b9975c3e9289ccfd
I20260617 20:17:06.047392 29375 ts_tablet_manager.cc:1950] T c17aa7f99fc74838b9975c3e9289ccfd P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:06.047770 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 757) took 4118 ms. Trace:
I20260617 20:17:06.047857 29375 rpcz_store.cc:276] 0617 20:17:01.929541 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.929614 (+ 73us) service_pool.cc:224] Handling call
0617 20:17:05.468583 (+3538969us) ts_tablet_manager.cc:1151] Deleting tablet c17aa7f99fc74838b9975c3e9289ccfd
0617 20:17:05.468591 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.756326 (+287735us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.879617 (+123291us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.047750 (+168133us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3523139}
I20260617 20:17:06.048336 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 758) took 4101 ms. Trace:
I20260617 20:17:06.048394 29375 rpcz_store.cc:276] 0617 20:17:01.947035 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.947082 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:06.048219 (+4101137us) ts_tablet_manager.cc:1151] Deleting tablet c3496887f6a045e293698d09d9cc1c16
0617 20:17:06.048226 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.048322 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4100972}
I20260617 20:17:06.048657 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 759) took 4068 ms. Trace:
I20260617 20:17:06.048712 29375 rpcz_store.cc:276] 0617 20:17:01.979822 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:01.980131 (+ 309us) service_pool.cc:224] Handling call
0617 20:17:06.048568 (+4068437us) ts_tablet_manager.cc:1151] Deleting tablet 06680ddfee82464da4926e51dadd00a5
0617 20:17:06.048575 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.048645 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4068273}
I20260617 20:17:06.048949 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 762) took 3969 ms. Trace:
I20260617 20:17:06.048997 29375 rpcz_store.cc:276] 0617 20:17:02.079624 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.079671 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:06.048870 (+3969199us) ts_tablet_manager.cc:1151] Deleting tablet d44524b02e6f4c1291bca50e9261459b
0617 20:17:06.048877 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.048939 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3968967}
I20260617 20:17:06.049181 29375 tablet_replica.cc:333] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:05.880542 30819 raft_consensus.cc:515] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.050041 30819 leader_election.cc:290] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:05.893534 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfac7fefb3e54f18896703d01c0c7ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.050921 30857 tablet.cc:1724] T ead0291870a443d9b76ea919a45a4303 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:06.053440 29121 raft_consensus.cc:3060] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:05.897899 29092 tablet_service.cc:1511] Processing CreateTablet for tablet bb6a2adbc5fb4c1e915dee1b524f3aa5 (DEFAULT_TABLE table=default.Table_a2980fa5162245c081e94675f6a1fd9e [id=8d19f88dfaeb45c088856dfb46408809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.053800 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203666e6127b49ed92731bc87ce01798" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:06.054034 28988 raft_consensus.cc:2393] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:06.054107 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb6a2adbc5fb4c1e915dee1b524f3aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.056252 30858 tablet.cc:1724] T ead0291870a443d9b76ea919a45a4303 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:05.903525 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 0a1f2f87da1143d99668fe223201aa16 (DEFAULT_TABLE table=default.Table_e259b984fdf44bde85b3546242987b20 [id=3b2b81a363c74e6c9e602bf6fb5b0218]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.057605 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a1f2f87da1143d99668fe223201aa16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.904166 29091 tablet_service.cc:1511] Processing CreateTablet for tablet 0307139a910c4850b717a36f22f80be1 (DEFAULT_TABLE table=default.Table_8c9ad175c7d645afb125d140eb250bfc [id=cf56b2890579404caad095aac8bcc4db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.058919 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0307139a910c4850b717a36f22f80be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.938093 29118 raft_consensus.cc:3060] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.062590 30410 consensus_queue.cc:1048] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:05.946758 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet c3014c93d6804f3896f452f041cbedc9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:05.964267 30294 raft_consensus.cc:493] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ca3d93189744132bbf55ac01f3a8254)
I20260617 20:17:06.064451 30294 raft_consensus.cc:515] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.065043 30294 leader_election.cc:290] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.008047 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f6dcc384154d41866cf8060cf05837" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:06.013087 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71342100c8f746d384b4cef73086afd2" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:06.066362 29062 leader_election.cc:343] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 7efe079091784d7e8035659edd442ba6
W20260617 20:17:06.066725 28925 leader_election.cc:343] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:06.066939 29198 leader_election.cc:343] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.068365 29375 raft_consensus.cc:2243] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.068523 29375 raft_consensus.cc:2272] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.069020 29375 ts_tablet_manager.cc:1916] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.070945 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4924e2825e4ec9b3302c1abb9c0bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.072561 30294 raft_consensus.cc:493] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:06.072691 30294 raft_consensus.cc:515] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.073194 30294 leader_election.cc:290] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.073587 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet c17aa7f99fc74838b9975c3e9289ccfd (table default.Table_762c733e4f8445ad97f36fc9ee70147a [id=f62d71842e284523bbca857af62a367a]) successfully deleted
W20260617 20:17:06.073822 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet c3496887f6a045e293698d09d9cc1c16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c3496887f6a045e293698d09d9cc1c16 already in progress: creating tablet
I20260617 20:17:06.073827 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cafcade995b407f84f56b8cd3ab6892" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
W20260617 20:17:06.073993 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 06680ddfee82464da4926e51dadd00a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 06680ddfee82464da4926e51dadd00a5 already in progress: creating tablet
I20260617 20:17:06.074054 28988 raft_consensus.cc:2393] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
W20260617 20:17:06.074146 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d44524b02e6f4c1291bca50e9261459b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d44524b02e6f4c1291bca50e9261459b already in progress: creating tablet
W20260617 20:17:06.077380 29198 consensus_peers.cc:597] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.086125 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2860409277a0423cadadd79363713fd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:05.877653 29379 raft_consensus.cc:740] T f14113dd9098456599d7b72626bedcd6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:05.962211 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31bf7ed828f44b398f5bdac6b9b63e7" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:06.090668 29379 consensus_queue.cc:260] T f14113dd9098456599d7b72626bedcd6 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:06.090981 28925 leader_election.cc:343] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.091192 29379 ts_tablet_manager.cc:1434] T f14113dd9098456599d7b72626bedcd6 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.347s user 0.001s sys 0.001s
I20260617 20:17:06.031524 30859 tablet.cc:1724] T dd8a7096a09147789ac203c150a19419 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:06.092794 29379 tablet_bootstrap.cc:492] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:06.094808 29379 tablet_bootstrap.cc:654] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.116830 29100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb3d6e959e24fc2864f87984010493c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.120199 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfa3b652083d4112b69d305ba90730a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.123718 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ff51037a354457a0adc06020295ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.125689 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5da459a52667402aa7a94a88bdc6f4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.125972 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835dd184c2fc4e109187ca30894b6cd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.130445 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8797ef75e5174c99bfae4de206eb1fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.131556 29375 ts_tablet_manager.cc:1929] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:06.136487 29375 log.cc:1199] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/7efe079091784d7e8035659edd442ba6
I20260617 20:17:06.137566 29375 ts_tablet_manager.cc:1950] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:06.144985 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 764) took 3949 ms. Trace:
I20260617 20:17:06.155004 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 807) took 3456 ms. Trace:
I20260617 20:17:06.155124 29378 tablet_bootstrap.cc:492] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:06.155124 29377 rpcz_store.cc:276] 0617 20:17:02.698930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.698983 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:05.751993 (+3053010us) ts_tablet_manager.cc:1151] Deleting tablet 0eaa60028a1647e580a987c3a0836a24
0617 20:17:05.752003 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:05.960982 (+208979us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:05.997096 (+ 36114us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.154983 (+157887us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3052227}
I20260617 20:17:06.155563 29377 tablet_replica.cc:333] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:06.155696 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 0eaa60028a1647e580a987c3a0836a24 (table default.Table_8a1228ed97634cd7a2eecc5b659406c3 [id=65896b3e02a240159d5500963dde03e5]) successfully deleted
I20260617 20:17:06.155769 29377 raft_consensus.cc:2243] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.155920 29377 raft_consensus.cc:2272] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.156476 29377 ts_tablet_manager.cc:1916] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.156951 29378 tablet_bootstrap.cc:654] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.162201 29377 ts_tablet_manager.cc:1929] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:06.162302 29377 log.cc:1199] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/7cafcade995b407f84f56b8cd3ab6892
I20260617 20:17:06.162590 29377 ts_tablet_manager.cc:1950] T 7cafcade995b407f84f56b8cd3ab6892 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:06.163476 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 803) took 3465 ms. Trace:
I20260617 20:17:06.163587 29377 rpcz_store.cc:276] 0617 20:17:02.697833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.697876 (+ 43us) service_pool.cc:224] Handling call
0617 20:17:06.155484 (+3457608us) ts_tablet_manager.cc:1151] Deleting tablet 7cafcade995b407f84f56b8cd3ab6892
0617 20:17:06.155508 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.159522 (+ 4014us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.162158 (+ 2636us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.163445 (+ 1287us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3455695}
I20260617 20:17:06.163995 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 801) took 3466 ms. Trace:
I20260617 20:17:06.164070 29377 rpcz_store.cc:276] 0617 20:17:02.697566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.697618 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:06.163899 (+3466281us) ts_tablet_manager.cc:1151] Deleting tablet 7f239f81c40743b2aaa70a361997db77
0617 20:17:06.163908 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.163981 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3463993}
I20260617 20:17:06.164134 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 7cafcade995b407f84f56b8cd3ab6892 (table default.Table_eddd37adcac449fdafd97ff4e5f726ea [id=28482c1294b7476d96b490f73d8b9d28]) successfully deleted
I20260617 20:17:06.164382 29377 tablet_replica.cc:333] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:06.164583 29377 raft_consensus.cc:2243] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 20:17:06.164639 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 7f239f81c40743b2aaa70a361997db77 because the tablet was not found. No further retry: Not found: Tablet not found: 7f239f81c40743b2aaa70a361997db77
I20260617 20:17:06.164750 29377 raft_consensus.cc:2272] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.165197 29377 ts_tablet_manager.cc:1916] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:06.168011 29198 consensus_peers.cc:597] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.177906 29377 ts_tablet_manager.cc:1929] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:06.178210 29377 log.cc:1199] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/203666e6127b49ed92731bc87ce01798
I20260617 20:17:06.178579 29375 rpcz_store.cc:276] 0617 20:17:02.195596 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.195645 (+ 49us) service_pool.cc:224] Handling call
0617 20:17:06.049148 (+3853503us) ts_tablet_manager.cc:1151] Deleting tablet 7efe079091784d7e8035659edd442ba6
0617 20:17:06.049155 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.071731 (+ 22576us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.131508 (+ 59777us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.144964 (+ 13456us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3853332}
I20260617 20:17:06.178920 29377 ts_tablet_manager.cc:1950] T 203666e6127b49ed92731bc87ce01798 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:06.179131 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 7efe079091784d7e8035659edd442ba6 (table default.Table_6bb71611d01f469a95325bc9bbcd5251 [id=f0df4d60a326473a8fc3d040ed7324d7]) successfully deleted
I20260617 20:17:06.179381 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 767) took 3909 ms. Trace:
I20260617 20:17:06.179503 29375 rpcz_store.cc:276] 0617 20:17:02.269913 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.269973 (+ 60us) service_pool.cc:224] Handling call
0617 20:17:06.179165 (+3909192us) ts_tablet_manager.cc:1151] Deleting tablet 403095586c704ecaa2a9931295bd1330
0617 20:17:06.179176 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.179358 (+ 182us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3908992}
I20260617 20:17:06.179647 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 802) took 3481 ms. Trace:
I20260617 20:17:06.179801 29377 rpcz_store.cc:276] 0617 20:17:02.697741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.699373 (+ 1632us) service_pool.cc:224] Handling call
0617 20:17:06.164338 (+3464965us) ts_tablet_manager.cc:1151] Deleting tablet 203666e6127b49ed92731bc87ce01798
0617 20:17:06.164347 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.173405 (+ 9058us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.177795 (+ 4390us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.179602 (+ 1807us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3463829}
I20260617 20:17:06.180374 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 203666e6127b49ed92731bc87ce01798 (table default.Table_976e062ae33e43fc8ce7604f7bf3ad69 [id=37131dec7c6a44cb9c9aed3a27a5028a]) successfully deleted
I20260617 20:17:06.180884 29377 tablet_replica.cc:333] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:06.181391 29377 raft_consensus.cc:2243] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.181731 29377 raft_consensus.cc:2272] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.182691 29377 ts_tablet_manager.cc:1916] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.196458 29377 ts_tablet_manager.cc:1929] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:06.196816 29377 log.cc:1199] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/dee426100bb645f391be123aeb52e412
I20260617 20:17:06.197476 29377 ts_tablet_manager.cc:1950] T dee426100bb645f391be123aeb52e412 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:06.198096 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 806) took 3499 ms. Trace:
I20260617 20:17:06.198311 29377 rpcz_store.cc:276] 0617 20:17:02.698779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.698823 (+ 44us) service_pool.cc:224] Handling call
0617 20:17:06.180777 (+3481954us) ts_tablet_manager.cc:1151] Deleting tablet dee426100bb645f391be123aeb52e412
0617 20:17:06.180819 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.191031 (+ 10212us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.196378 (+ 5347us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.198074 (+ 1696us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3478858}
I20260617 20:17:06.199610 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet dee426100bb645f391be123aeb52e412 (table default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]) successfully deleted
I20260617 20:17:06.200109 29377 tablet_replica.cc:333] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:06.200450 29377 raft_consensus.cc:2243] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.200798 29377 raft_consensus.cc:2272] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.201813 29377 ts_tablet_manager.cc:1916] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:06.212823 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 228854us
I20260617 20:17:06.213255 30678 consensus_queue.cc:1048] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.216858 28990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30f6dcc384154d41866cf8060cf05837" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:06.217049 28990 raft_consensus.cc:3060] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:06.217797 28925 leader_election.cc:343] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.217911 28925 leader_election.cc:304] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.218616 30787 raft_consensus.cc:2749] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:06.219697 28990 raft_consensus.cc:2468] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:05.893277 29099 tablet_service.cc:1511] Processing CreateTablet for tablet a6372df669ca4fc4818243778d2186f5 (DEFAULT_TABLE table=default.Table_fcd950bebde64e8bafd0dae2ec3f7149 [id=8ca6a6b12902442fbff567cb44a4e03d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:06.222862 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 403095586c704ecaa2a9931295bd1330 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 403095586c704ecaa2a9931295bd1330 already in progress: creating tablet
I20260617 20:17:06.137816 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 331273aec09e4ec894dc28c2e4387dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.217505 29063 leader_election.cc:304] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.223544 30294 raft_consensus.cc:2749] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:06.223726 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513d335e9dfb4ab69ab0c455d7139905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.230520 29383 consensus_queue.cc:260] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:06.246333 28925 leader_election.cc:343] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.246568 28925 leader_election.cc:304] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.246845 30787 raft_consensus.cc:2749] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:06.247284 28925 leader_election.cc:343] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.247449 28925 leader_election.cc:304] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.247715 30787 raft_consensus.cc:2749] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:06.253379 30787 raft_consensus.cc:493] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:06.253496 30787 raft_consensus.cc:515] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.254002 29378 tablet_bootstrap.cc:492] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:06.254057 30787 leader_election.cc:290] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.254125 29378 ts_tablet_manager.cc:1403] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.099s user 0.004s sys 0.007s
I20260617 20:17:06.222378 29379 tablet_bootstrap.cc:492] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:06.254956 29378 raft_consensus.cc:359] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.255111 29378 raft_consensus.cc:385] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.255165 29378 raft_consensus.cc:740] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:06.255369 29379 ts_tablet_manager.cc:1403] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.163s user 0.002s sys 0.010s
I20260617 20:17:06.255355 29378 consensus_queue.cc:260] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.255849 29378 ts_tablet_manager.cc:1434] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:06.256110 29378 tablet_bootstrap.cc:492] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:06.256783 29379 raft_consensus.cc:359] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.258562 29378 tablet_bootstrap.cc:654] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.261348 29379 raft_consensus.cc:385] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.261479 29379 raft_consensus.cc:740] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:06.261794 29379 consensus_queue.cc:260] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.262583 29379 ts_tablet_manager.cc:1434] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20260617 20:17:06.267226 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 37214b955d63478088b9f723bcbc588a consensus state has no leader
I20260617 20:17:06.269378 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 592c58b06f8543feb1439044f1c5203c (DEFAULT_TABLE table=default.Table_d4ee09ae0a4649cdb22c66655ef3b4e6 [id=a0096dddd4124258915aa8acec69d3ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.269825 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592c58b06f8543feb1439044f1c5203c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.271167 29091 tablet_service.cc:1511] Processing CreateTablet for tablet fef5756f8960440eb6598246f300bc8a (DEFAULT_TABLE table=default.Table_7ab3e811b872450d856ef65057509c9e [id=062470abc0a44c6a847efb062ea85285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.271525 29097 tablet_service.cc:1511] Processing CreateTablet for tablet a05fd5cf1aa44d24a81bf1be178ad8b9 (DEFAULT_TABLE table=default.Table_202d346de7a14d6f9cad64a5e8ea8391 [id=6cef714c5570465286ae445cc7bb9109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.272310 29108 tablet_service.cc:1511] Processing CreateTablet for tablet 73d9202320ff4dcebe1897459f8d2238 (DEFAULT_TABLE table=default.Table_cee27611d8f547eca1c10f1e335f4a7c [id=6ffa00c2439b4485b9fd7cfcc84ad616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.272418 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]). Expected version 2 got 0
I20260617 20:17:06.272624 29092 tablet_service.cc:1511] Processing CreateTablet for tablet 76b5855e0e4149219a9b152ac1f9b958 (DEFAULT_TABLE table=default.Table_c25af0a4fa2f44b5b7680070d7f18a31 [id=fe89136dd04a45a18a88883eb05e12d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.272629 28670 catalog_manager.cc:5696] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:06.273036 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 (table default.Table_9cd011070f8848eeb76b111f2e64f60f [id=475aa0d2f8044cd8b52cf31085dda15d]). Expected version 1 got 0
I20260617 20:17:06.273569 28958 tablet_service.cc:1511] Processing CreateTablet for tablet fef5756f8960440eb6598246f300bc8a (DEFAULT_TABLE table=default.Table_7ab3e811b872450d856ef65057509c9e [id=062470abc0a44c6a847efb062ea85285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.273910 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef5756f8960440eb6598246f300bc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.274170 29104 tablet_service.cc:1511] Processing CreateTablet for tablet a2f917126dc34f27a70b26ad7daa3afe (DEFAULT_TABLE table=default.Table_aa47b2f6d9c446669f0a2ba8447cb83f [id=e57dad6d4c2e4149827ee1829842ae76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.275453 29106 tablet_service.cc:1511] Processing CreateTablet for tablet c41c83bb87a54c9487b64bbc345eb340 (DEFAULT_TABLE table=default.Table_143cff941bb14515ba8932f1263aedce [id=622a20953f3e4e9ab9469343794042c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.277092 29089 tablet_service.cc:1511] Processing CreateTablet for tablet b61162160ec248b7aa6c73c399be1842 (DEFAULT_TABLE table=default.Table_6d055567cac04381821aa61e52e1df04 [id=58c814af798f4e51a6d6d3e4700b865f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.278275 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 56584a4f576842a8b0f7315b7161cb68 (DEFAULT_TABLE table=default.Table_07e0f258ed6b45a7ad99bcf9bb2c3b75 [id=0a8eaaf090244a6c8d16398a62b5a2f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.278398 29376 ts_tablet_manager.cc:1929] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:06.278509 29376 log.cc:1199] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/18440a4a5c254a25b87f8632de9c92b9
I20260617 20:17:06.278864 29376 ts_tablet_manager.cc:1950] T 18440a4a5c254a25b87f8632de9c92b9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:06.282624 28951 tablet_service.cc:1511] Processing CreateTablet for tablet a2f917126dc34f27a70b26ad7daa3afe (DEFAULT_TABLE table=default.Table_aa47b2f6d9c446669f0a2ba8447cb83f [id=e57dad6d4c2e4149827ee1829842ae76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.282689 28953 tablet_service.cc:1511] Processing CreateTablet for tablet c41c83bb87a54c9487b64bbc345eb340 (DEFAULT_TABLE table=default.Table_143cff941bb14515ba8932f1263aedce [id=622a20953f3e4e9ab9469343794042c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.283015 28969 tablet_service.cc:1511] Processing CreateTablet for tablet b93bbcd1a2ae42409dbc9158aab0a9eb (DEFAULT_TABLE table=default.Table_e610c8b1186543a1ba5ab1899c8b672a [id=449b06b7f15e49dda75c4027f7f8e833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.282985 28954 tablet_service.cc:1511] Processing CreateTablet for tablet a05fd5cf1aa44d24a81bf1be178ad8b9 (DEFAULT_TABLE table=default.Table_202d346de7a14d6f9cad64a5e8ea8391 [id=6cef714c5570465286ae445cc7bb9109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.283259 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 76b5855e0e4149219a9b152ac1f9b958 (DEFAULT_TABLE table=default.Table_c25af0a4fa2f44b5b7680070d7f18a31 [id=fe89136dd04a45a18a88883eb05e12d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.283280 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 56584a4f576842a8b0f7315b7161cb68 (DEFAULT_TABLE table=default.Table_07e0f258ed6b45a7ad99bcf9bb2c3b75 [id=0a8eaaf090244a6c8d16398a62b5a2f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.283298 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 73d9202320ff4dcebe1897459f8d2238 (DEFAULT_TABLE table=default.Table_cee27611d8f547eca1c10f1e335f4a7c [id=6ffa00c2439b4485b9fd7cfcc84ad616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.283618 28968 tablet_service.cc:1511] Processing CreateTablet for tablet b61162160ec248b7aa6c73c399be1842 (DEFAULT_TABLE table=default.Table_6d055567cac04381821aa61e52e1df04 [id=58c814af798f4e51a6d6d3e4700b865f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.283638 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 401c2793bc6241c0aef1263597a3ef24 (DEFAULT_TABLE table=default.Table_8b8bdf1cd4e041fcb6260ee95e42b92b [id=954a691bcf674227964a49a2a73c91ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.283054 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f917126dc34f27a70b26ad7daa3afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.284126 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61162160ec248b7aa6c73c399be1842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.284267 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05fd5cf1aa44d24a81bf1be178ad8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.285799 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76b5855e0e4149219a9b152ac1f9b958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.286150 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43549813e294796baca2a1a64dbcfb9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:06.287706 29243 tablet_service.cc:1511] Processing CreateTablet for tablet 592c58b06f8543feb1439044f1c5203c (DEFAULT_TABLE table=default.Table_d4ee09ae0a4649cdb22c66655ef3b4e6 [id=a0096dddd4124258915aa8acec69d3ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.287971 29383 ts_tablet_manager.cc:1434] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.250s user 0.000s sys 0.003s
I20260617 20:17:06.288043 29243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592c58b06f8543feb1439044f1c5203c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:06.288256 28925 leader_election.cc:343] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.288434 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56584a4f576842a8b0f7315b7161cb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.288573 29383 tablet_bootstrap.cc:492] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:06.289949 29383 tablet_bootstrap.cc:654] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.293435 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "203666e6127b49ed92731bc87ce01798" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:06.293802 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93bbcd1a2ae42409dbc9158aab0a9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.293960 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cafcade995b407f84f56b8cd3ab6892" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:06.294723 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71342100c8f746d384b4cef73086afd2" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:06.297423 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d9202320ff4dcebe1897459f8d2238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.297397 29236 tablet_service.cc:1511] Processing CreateTablet for tablet fef5756f8960440eb6598246f300bc8a (DEFAULT_TABLE table=default.Table_7ab3e811b872450d856ef65057509c9e [id=062470abc0a44c6a847efb062ea85285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.297724 29236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef5756f8960440eb6598246f300bc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.301154 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43549813e294796baca2a1a64dbcfb9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:06.301429 28953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41c83bb87a54c9487b64bbc345eb340. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:06.301708 28925 leader_election.cc:343] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.301819 28925 leader_election.cc:304] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.302295 30787 raft_consensus.cc:2749] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:06.302663 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401c2793bc6241c0aef1263597a3ef24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.303071 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 401c2793bc6241c0aef1263597a3ef24 (DEFAULT_TABLE table=default.Table_8b8bdf1cd4e041fcb6260ee95e42b92b [id=954a691bcf674227964a49a2a73c91ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.305721 30788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 590225c8ea36448093b77385d238a34a. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:17:06.305984 30788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:17:06.306146 30843 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590225c8ea36448093b77385d238a34a)
I20260617 20:17:06.306324 30843 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:06.308717 29119 raft_consensus.cc:3060] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.309098 29091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef5756f8960440eb6598246f300bc8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.309991 30843 leader_election.cc:290] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059)
I20260617 20:17:06.310261 29378 tablet_bootstrap.cc:492] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:06.310401 29378 ts_tablet_manager.cc:1403] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.001s
I20260617 20:17:06.311067 29378 raft_consensus.cc:359] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.311344 29378 raft_consensus.cc:385] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.311467 29378 raft_consensus.cc:740] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:06.311797 29378 consensus_queue.cc:260] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.312664 29378 ts_tablet_manager.cc:1434] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:06.313033 29378 tablet_bootstrap.cc:492] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:06.316004 30852 consensus_queue.cc:1048] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.317147 29225 tablet_service.cc:1511] Processing CreateTablet for tablet a05fd5cf1aa44d24a81bf1be178ad8b9 (DEFAULT_TABLE table=default.Table_202d346de7a14d6f9cad64a5e8ea8391 [id=6cef714c5570465286ae445cc7bb9109]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.317633 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05fd5cf1aa44d24a81bf1be178ad8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.321604 30294 raft_consensus.cc:493] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:06.321741 30294 raft_consensus.cc:515] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.321867 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 76b5855e0e4149219a9b152ac1f9b958 (DEFAULT_TABLE table=default.Table_c25af0a4fa2f44b5b7680070d7f18a31 [id=fe89136dd04a45a18a88883eb05e12d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.322184 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76b5855e0e4149219a9b152ac1f9b958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.322365 30294 leader_election.cc:290] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:06.323069 29062 leader_election.cc:343] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 89f7b878728a495f83b6584f8a6aca67
I20260617 20:17:06.336329 29230 tablet_service.cc:1511] Processing CreateTablet for tablet c41c83bb87a54c9487b64bbc345eb340 (DEFAULT_TABLE table=default.Table_143cff941bb14515ba8932f1263aedce [id=622a20953f3e4e9ab9469343794042c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.336369 29228 tablet_service.cc:1511] Processing CreateTablet for tablet b61162160ec248b7aa6c73c399be1842 (DEFAULT_TABLE table=default.Table_6d055567cac04381821aa61e52e1df04 [id=58c814af798f4e51a6d6d3e4700b865f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.336462 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 401c2793bc6241c0aef1263597a3ef24 (DEFAULT_TABLE table=default.Table_8b8bdf1cd4e041fcb6260ee95e42b92b [id=954a691bcf674227964a49a2a73c91ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.336730 29238 tablet_service.cc:1511] Processing CreateTablet for tablet 56584a4f576842a8b0f7315b7161cb68 (DEFAULT_TABLE table=default.Table_07e0f258ed6b45a7ad99bcf9bb2c3b75 [id=0a8eaaf090244a6c8d16398a62b5a2f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.336903 29227 tablet_service.cc:1511] Processing CreateTablet for tablet 31267063d24f4e89898349117a9a3031 (DEFAULT_TABLE table=default.Table_6f87ebb700cd4bcd8c9970ecae935a1a [id=908d6aab19ee442a9d9246694407969e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.336974 29242 tablet_service.cc:1511] Processing CreateTablet for tablet ff6bd059a5f5406e9c7f0c46c25ddbbe (DEFAULT_TABLE table=default.Table_b1e1ccfbd65149709f90def87a0de455 [id=269eefef16a244c7b332a14c1e54c1c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.336763 29230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41c83bb87a54c9487b64bbc345eb340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.337281 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 2acfbcce4bbd403aa608f9b62d611723 (DEFAULT_TABLE table=default.Table_3d341472f7724dd8a87f7e18ea3f349d [id=5a8b12e534a84300b4feaedb62477673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.337417 29226 tablet_service.cc:1511] Processing CreateTablet for tablet d08a9b89bc4e4f66ab533a280a2499da (DEFAULT_TABLE table=default.Table_66d9873c0541455b9003127d8cd07f3d [id=d31cb66a2e974a00a957dd5e0ad579cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.336730 29229 tablet_service.cc:1511] Processing CreateTablet for tablet b93bbcd1a2ae42409dbc9158aab0a9eb (DEFAULT_TABLE table=default.Table_e610c8b1186543a1ba5ab1899c8b672a [id=449b06b7f15e49dda75c4027f7f8e833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.337594 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 8449a9905bbe4cdcbc211e437b1bd2b9 (DEFAULT_TABLE table=default.Table_3f075eeaca7944f5a62ec0392ebea2d6 [id=869901d606b0494db3b02b698908f9b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.337224 29237 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc6f47821064ebf869380dea06e965f (DEFAULT_TABLE table=default.Table_fdeeb511d87e4fcc8659b17d363c9834 [id=71f04739faee495782d0b18a7c3ab912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.337934 29238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56584a4f576842a8b0f7315b7161cb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.338099 29237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc6f47821064ebf869380dea06e965f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.338299 29227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31267063d24f4e89898349117a9a3031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.341477 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6bd059a5f5406e9c7f0c46c25ddbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.337213 29235 tablet_service.cc:1511] Processing CreateTablet for tablet a2f917126dc34f27a70b26ad7daa3afe (DEFAULT_TABLE table=default.Table_aa47b2f6d9c446669f0a2ba8447cb83f [id=e57dad6d4c2e4149827ee1829842ae76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.343016 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f917126dc34f27a70b26ad7daa3afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.345479 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acfbcce4bbd403aa608f9b62d611723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.345553 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 73d9202320ff4dcebe1897459f8d2238 (DEFAULT_TABLE table=default.Table_cee27611d8f547eca1c10f1e335f4a7c [id=6ffa00c2439b4485b9fd7cfcc84ad616]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.345819 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d9202320ff4dcebe1897459f8d2238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.349475 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08a9b89bc4e4f66ab533a280a2499da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.352866 29093 tablet_service.cc:1511] Processing CreateTablet for tablet b93bbcd1a2ae42409dbc9158aab0a9eb (DEFAULT_TABLE table=default.Table_e610c8b1186543a1ba5ab1899c8b672a [id=449b06b7f15e49dda75c4027f7f8e833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.353495 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93bbcd1a2ae42409dbc9158aab0a9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.354066 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6372df669ca4fc4818243778d2186f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.357556 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8449a9905bbe4cdcbc211e437b1bd2b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.359310 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 592c58b06f8543feb1439044f1c5203c (DEFAULT_TABLE table=default.Table_d4ee09ae0a4649cdb22c66655ef3b4e6 [id=a0096dddd4124258915aa8acec69d3ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.359637 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 592c58b06f8543feb1439044f1c5203c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.361820 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401c2793bc6241c0aef1263597a3ef24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.365497 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61162160ec248b7aa6c73c399be1842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.372490 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 824) took 3419 ms. Trace:
I20260617 20:17:06.372599 29376 rpcz_store.cc:276] 0617 20:17:02.953424 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.956901 (+ 3477us) service_pool.cc:224] Handling call
0617 20:17:05.735592 (+2778691us) ts_tablet_manager.cc:1151] Deleting tablet 18440a4a5c254a25b87f8632de9c92b9
0617 20:17:05.735601 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.172640 (+437039us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.278330 (+105690us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.372469 (+ 94139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92819,"tablet-delete.queue_time_us":2778584}
I20260617 20:17:06.372947 29376 tablet_replica.cc:333] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:06.373116 29376 raft_consensus.cc:2243] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:06.373401 29376 raft_consensus.cc:2272] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.373929 29376 ts_tablet_manager.cc:1916] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:06.375300 29197 consensus_peers.cc:597] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 203666e6127b49ed92731bc87ce01798. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.375470 29197 leader_election.cc:304] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:06.375721 30852 raft_consensus.cc:2804] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:06.375821 30852 raft_consensus.cc:697] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:06.376076 30852 consensus_queue.cc:237] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.378829 29383 tablet_bootstrap.cc:492] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:06.378968 29383 ts_tablet_manager.cc:1403] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.090s user 0.000s sys 0.002s
I20260617 20:17:06.379634 29383 raft_consensus.cc:359] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.379798 29383 raft_consensus.cc:385] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.379859 29383 raft_consensus.cc:740] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:06.380052 29383 consensus_queue.cc:260] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.380571 29383 ts_tablet_manager.cc:1434] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:17:06.380803 29383 tablet_bootstrap.cc:492] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:06.381664 29098 tablet_service.cc:1511] Processing CreateTablet for tablet ff6bd059a5f5406e9c7f0c46c25ddbbe (DEFAULT_TABLE table=default.Table_b1e1ccfbd65149709f90def87a0de455 [id=269eefef16a244c7b332a14c1e54c1c0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:06.382257 29198 consensus_peers.cc:597] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.382323 29098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6bd059a5f5406e9c7f0c46c25ddbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.381649 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc6f47821064ebf869380dea06e965f (DEFAULT_TABLE table=default.Table_fdeeb511d87e4fcc8659b17d363c9834 [id=71f04739faee495782d0b18a7c3ab912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.383107 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc6f47821064ebf869380dea06e965f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.384012 29101 tablet_service.cc:1511] Processing CreateTablet for tablet 31267063d24f4e89898349117a9a3031 (DEFAULT_TABLE table=default.Table_6f87ebb700cd4bcd8c9970ecae935a1a [id=908d6aab19ee442a9d9246694407969e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:06.389510 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 841664f40c02423095bb9e63b85006a6 consensus state has no leader
W20260617 20:17:06.390568 29197 consensus_peers.cc:597] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adbc3219639748d9a0d71d45ae22ab36. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.390609 29099 tablet_service.cc:1511] Processing CreateTablet for tablet 2acfbcce4bbd403aa608f9b62d611723 (DEFAULT_TABLE table=default.Table_3d341472f7724dd8a87f7e18ea3f349d [id=5a8b12e534a84300b4feaedb62477673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.391593 29379 tablet_bootstrap.cc:492] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:06.392848 29379 tablet_bootstrap.cc:654] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.394764 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_84c1d2b01f524da3917249139afe19b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.395480 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84c1d2b01f524da3917249139afe19b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.396803 29095 tablet_service.cc:1511] Processing CreateTablet for tablet d08a9b89bc4e4f66ab533a280a2499da (DEFAULT_TABLE table=default.Table_66d9873c0541455b9003127d8cd07f3d [id=d31cb66a2e974a00a957dd5e0ad579cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.397135 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08a9b89bc4e4f66ab533a280a2499da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.398669 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_5a7af34a137e4cd5bc14d4166ea07903"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:06.399106 29101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31267063d24f4e89898349117a9a3031. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:06.399170 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a7af34a137e4cd5bc14d4166ea07903 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.400462 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_25485c53fc824593aebd48840afae10e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.401014 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25485c53fc824593aebd48840afae10e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.401211 29104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f917126dc34f27a70b26ad7daa3afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.316848 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 31267063d24f4e89898349117a9a3031 (DEFAULT_TABLE table=default.Table_6f87ebb700cd4bcd8c9970ecae935a1a [id=908d6aab19ee442a9d9246694407969e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.316910 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 5cc6f47821064ebf869380dea06e965f (DEFAULT_TABLE table=default.Table_fdeeb511d87e4fcc8659b17d363c9834 [id=71f04739faee495782d0b18a7c3ab912]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.346050 30314 raft_consensus.cc:493] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:06.401762 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31267063d24f4e89898349117a9a3031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.401798 30314 raft_consensus.cc:515] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.401952 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cc6f47821064ebf869380dea06e965f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.402457 30314 leader_election.cc:290] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.404264 29378 tablet_bootstrap.cc:654] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.346299 28956 tablet_service.cc:1511] Processing CreateTablet for tablet d08a9b89bc4e4f66ab533a280a2499da (DEFAULT_TABLE table=default.Table_66d9873c0541455b9003127d8cd07f3d [id=d31cb66a2e974a00a957dd5e0ad579cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.407737 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08a9b89bc4e4f66ab533a280a2499da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.412271 29383 tablet_bootstrap.cc:654] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.346652 28951 tablet_service.cc:1511] Processing CreateTablet for tablet ff6bd059a5f5406e9c7f0c46c25ddbbe (DEFAULT_TABLE table=default.Table_b1e1ccfbd65149709f90def87a0de455 [id=269eefef16a244c7b332a14c1e54c1c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.413666 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6bd059a5f5406e9c7f0c46c25ddbbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.413803 30378 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33468 (request call id 0) took 5451 ms. Trace:
I20260617 20:17:06.348403 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 2acfbcce4bbd403aa608f9b62d611723 (DEFAULT_TABLE table=default.Table_3d341472f7724dd8a87f7e18ea3f349d [id=5a8b12e534a84300b4feaedb62477673]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.418249 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acfbcce4bbd403aa608f9b62d611723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.419914 30878 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260617 20:17:06.349545 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 8449a9905bbe4cdcbc211e437b1bd2b9 (DEFAULT_TABLE table=default.Table_3f075eeaca7944f5a62ec0392ebea2d6 [id=869901d606b0494db3b02b698908f9b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.421645 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8449a9905bbe4cdcbc211e437b1bd2b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.351970 29377 ts_tablet_manager.cc:1929] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:06.422194 29377 log.cc:1199] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/e59430dd630b4ca6b573ea4230212abf
I20260617 20:17:06.422654 29377 ts_tablet_manager.cc:1950] T e59430dd630b4ca6b573ea4230212abf P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:17:06.422711 28925 leader_election.cc:343] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.422828 28925 leader_election.cc:304] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.423419 30787 raft_consensus.cc:2749] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:06.424461 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 18440a4a5c254a25b87f8632de9c92b9 (table default.Table_c7b9c867be6c4fa3b58557f0b4d1876b [id=4ed00f8c66674fc99d8742599241bb77]) successfully deleted
I20260617 20:17:06.430270 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4281bbef1efb4986a23c6fb24e62e49c
I20260617 20:17:06.431013 28665 master_service.cc:960] ReplaceTablet: received request to replace tablet 269d2bb9f1fd45f89ab765b33a502baf from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:06.431393 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet edf884e801d74362ad05435a76efcc1f
I20260617 20:17:06.433156 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 809) took 3732 ms. Trace:
I20260617 20:17:06.433243 29377 rpcz_store.cc:276] 0617 20:17:02.702403 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.702453 (+ 50us) service_pool.cc:224] Handling call
0617 20:17:06.200029 (+3497576us) ts_tablet_manager.cc:1151] Deleting tablet e59430dd630b4ca6b573ea4230212abf
0617 20:17:06.200042 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.206921 (+ 6879us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.351911 (+144990us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.433136 (+ 81225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9591,"tablet-delete.queue_time_us":3497393}
I20260617 20:17:06.433737 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet e59430dd630b4ca6b573ea4230212abf (table default.Table_f09fba1c81844e81a218171de6721f68 [id=e9b35265c9c245e5a2d81e9f8b81a92c]) successfully deleted
I20260617 20:17:06.434159 29377 tablet_replica.cc:333] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:06.434360 29377 raft_consensus.cc:2243] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.434513 29377 raft_consensus.cc:2272] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.435072 29377 ts_tablet_manager.cc:1916] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.435211 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2b5d45aad044441c84c126666d3c05d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.435765 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b5d45aad044441c84c126666d3c05d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.437175 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cb082a7a5a9a4bc2a3bbec80980daecd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.437711 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb082a7a5a9a4bc2a3bbec80980daecd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.439510 29376 ts_tablet_manager.cc:1929] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:06.439633 29376 log.cc:1199] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/3726e55ed36f420ab63bcfb5a81c5aab
I20260617 20:17:06.440071 29376 ts_tablet_manager.cc:1950] T 3726e55ed36f420ab63bcfb5a81c5aab P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:06.443905 28951 tablet_service.cc:1558] Processing DeleteTablet for tablet 4281bbef1efb4986a23c6fb24e62e49c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:06.444375 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet edf884e801d74362ad05435a76efcc1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:06.447944 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 266ff05cc91b43dfbb30ce9e961eeb54
I20260617 20:17:06.448355 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet cdd24a60a91b43cd9e31ecca3d21ec60
I20260617 20:17:06.448746 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet 266ff05cc91b43dfbb30ce9e961eeb54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:06.449463 28958 tablet_service.cc:1558] Processing DeleteTablet for tablet cdd24a60a91b43cd9e31ecca3d21ec60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:06.450124 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_411f66b9447a436d8d71bc99a62285fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.450663 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_411f66b9447a436d8d71bc99a62285fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.451259 29099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acfbcce4bbd403aa608f9b62d611723. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.451632 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 4281bbef1efb4986a23c6fb24e62e49c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.451784 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet edf884e801d74362ad05435a76efcc1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.451922 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet 266ff05cc91b43dfbb30ce9e961eeb54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.452021 29105 tablet_service.cc:1558] Processing DeleteTablet for tablet cdd24a60a91b43cd9e31ecca3d21ec60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.452001 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a7a5ea2c387e417aae386b585127cb0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.452556 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7a5ea2c387e417aae386b585127cb0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.453473 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56584a4f576842a8b0f7315b7161cb68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.455112 29375 tablet_replica.cc:333] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:06.455315 29375 raft_consensus.cc:2243] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.455453 29375 raft_consensus.cc:2272] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.455958 29375 ts_tablet_manager.cc:1916] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.457787 29125 raft_consensus.cc:3060] T f14113dd9098456599d7b72626bedcd6 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.458107 29063 leader_election.cc:304] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:06.458491 29063 leader_election.cc:343] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 7efe079091784d7e8035659edd442ba6
I20260617 20:17:06.458575 29063 leader_election.cc:304] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:06.458719 29063 raft_consensus.cc:2686] T 7efe079091784d7e8035659edd442ba6 P 6d4ce30e1fce4591b64c398747f8d37a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:17:06.459301 29063 leader_election.cc:304] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.460031 30294 raft_consensus.cc:2749] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:06.460178 30294 raft_consensus.cc:2749] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:06.460206 29377 ts_tablet_manager.cc:1929] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:06.460300 29377 log.cc:1199] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/fed593a3fa7742a18ccc2124c3ee0fb9
I20260617 20:17:06.460608 29377 ts_tablet_manager.cc:1950] T fed593a3fa7742a18ccc2124c3ee0fb9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:06.460750 29108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73d9202320ff4dcebe1897459f8d2238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.464494 29375 ts_tablet_manager.cc:1929] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:06.464674 29375 log.cc:1199] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/fc36f62aa0bf46278cb84ec8cb7eef55
I20260617 20:17:06.464988 29375 ts_tablet_manager.cc:1950] T fc36f62aa0bf46278cb84ec8cb7eef55 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:06.465668 29106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41c83bb87a54c9487b64bbc345eb340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.466537 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b61162160ec248b7aa6c73c399be1842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.466675 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 8449a9905bbe4cdcbc211e437b1bd2b9 (DEFAULT_TABLE table=default.Table_3f075eeaca7944f5a62ec0392ebea2d6 [id=869901d606b0494db3b02b698908f9b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.466990 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8449a9905bbe4cdcbc211e437b1bd2b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.467343 30314 consensus_queue.cc:1048] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.467470 29103 tablet_service.cc:1511] Processing CreateTablet for tablet a7b20564ac93482b84672c09e5489cfd (DEFAULT_TABLE table=default.Table_b16811c4e5c6448194a1adf7df3d96a2 [id=cc3218b558cf46c8ad88fb1ec7fa82b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.468439 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 810) took 3765 ms. Trace:
I20260617 20:17:06.468559 29377 rpcz_store.cc:276] 0617 20:17:02.702737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.702782 (+ 45us) service_pool.cc:224] Handling call
0617 20:17:06.434106 (+3731324us) ts_tablet_manager.cc:1151] Deleting tablet fed593a3fa7742a18ccc2124c3ee0fb9
0617 20:17:06.434116 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.449666 (+ 15550us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.460148 (+ 10482us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.468416 (+ 8268us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3731173}
I20260617 20:17:06.469050 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet fed593a3fa7742a18ccc2124c3ee0fb9 (table default.Table_726c0ba5eb5442e68a5c029d25fb209c [id=dcdfecb6a9634f42b1b11a02b9dd7ec2]) successfully deleted
I20260617 20:17:06.469785 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 811) took 3759 ms. Trace:
I20260617 20:17:06.469960 29377 rpcz_store.cc:276] 0617 20:17:02.710209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.710285 (+ 76us) service_pool.cc:224] Handling call
0617 20:17:06.469691 (+3759406us) ts_tablet_manager.cc:1151] Deleting tablet f24954093a45411a9cbe39415fb1adb7
0617 20:17:06.469701 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.469768 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3759198}
W20260617 20:17:06.470415 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet f24954093a45411a9cbe39415fb1adb7 because the tablet was not found. No further retry: Not found: Tablet not found: f24954093a45411a9cbe39415fb1adb7
I20260617 20:17:06.470786 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bc2304de37441bb78cd12cab5ca3c3" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:06.471149 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 812) took 3753 ms. Trace:
I20260617 20:17:06.471220 29377 rpcz_store.cc:276] 0617 20:17:02.717726 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.717781 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:06.471043 (+3753262us) ts_tablet_manager.cc:1151] Deleting tablet fc36f62aa0bf46278cb84ec8cb7eef55
0617 20:17:06.471073 (+ 30us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.471134 (+ 61us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3753067}
W20260617 20:17:06.471591 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet fc36f62aa0bf46278cb84ec8cb7eef55 because the tablet was not found. No further retry: Not found: Tablet not found: fc36f62aa0bf46278cb84ec8cb7eef55
I20260617 20:17:06.472178 29377 tablet_replica.cc:333] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:06.472451 29377 raft_consensus.cc:2243] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.472642 29377 raft_consensus.cc:2272] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.473232 29377 ts_tablet_manager.cc:1916] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.474148 29383 tablet_bootstrap.cc:492] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:06.474296 29383 ts_tablet_manager.cc:1403] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.094s user 0.003s sys 0.000s
I20260617 20:17:06.477715 28666 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet b6ba8b7d18af44b58800e588279e2e0b (table default.Table_daa321ef525b447390f30edf50f160bc [id=489b6871a12b4a68b7f600556cfc5b8e]). Expected version 1 got 0
I20260617 20:17:06.477919 28666 catalog_manager.cc:5696] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:06.478273 28666 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet e7eb77c619e04c448a084638668dbb6a (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]). Expected version 1 got 0
I20260617 20:17:06.481844 29378 tablet_bootstrap.cc:492] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:06.481971 29378 ts_tablet_manager.cc:1403] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.169s user 0.001s sys 0.001s
I20260617 20:17:06.481997 29377 ts_tablet_manager.cc:1929] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:06.482085 29377 log.cc:1199] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/64538fdf51f94e8e985fec6202baac22
I20260617 20:17:06.482362 29377 ts_tablet_manager.cc:1950] T 64538fdf51f94e8e985fec6202baac22 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:06.482649 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 816) took 3663 ms. Trace:
I20260617 20:17:06.482751 29378 raft_consensus.cc:359] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.483002 29378 raft_consensus.cc:385] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.483059 29378 raft_consensus.cc:740] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:06.484294 28958 tablet_service.cc:1511] Processing CreateTablet for tablet a7b20564ac93482b84672c09e5489cfd (DEFAULT_TABLE table=default.Table_b16811c4e5c6448194a1adf7df3d96a2 [id=cc3218b558cf46c8ad88fb1ec7fa82b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.484669 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b20564ac93482b84672c09e5489cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.487231 28663 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_d353f219381d4d17a2927a233465454c [id=0ef22e22306747b28d49d58d0fa45620] alter complete (version 4)
I20260617 20:17:06.489001 28664 master_service.cc:960] ReplaceTablet: received request to replace tablet 086bd3079e8f4a6d85ccc681a38a47b0 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:06.489754 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 966 } } ignore_live_leader: false dest_uuid: "590225c8ea36448093b77385d238a34a" is_pre_election: true
I20260617 20:17:06.491329 29383 raft_consensus.cc:359] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.491506 29383 raft_consensus.cc:385] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.491557 29383 raft_consensus.cc:740] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:06.491763 29383 consensus_queue.cc:260] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.492153 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a854cd6008ad44a0aa1e22bc32c4dcc3" } new_table_name: "default.Table_828a81e6756742db828d8880981f1021" modify_external_catalogs: true
I20260617 20:17:06.493649 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4f1e9321b3c548eeb322bd50ae32a077" } new_table_name: "default.Table_6084cccbc3fe415eb83ba19e8c8edb9c" modify_external_catalogs: true
I20260617 20:17:06.493729 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bc2304de37441bb78cd12cab5ca3c3" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:06.493886 29261 raft_consensus.cc:2468] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:06.504349 30358 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" instance_seqno: 1781727402242368) as {username='slave'} at 127.27.245.193:42269; Asking this server to re-register.
I20260617 20:17:06.504532 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 790) took 3839 ms. Trace:
I20260617 20:17:06.504626 29375 rpcz_store.cc:276] 0617 20:17:02.664665 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.664738 (+ 73us) service_pool.cc:224] Handling call
0617 20:17:06.222856 (+3558118us) ts_tablet_manager.cc:1151] Deleting tablet fc36f62aa0bf46278cb84ec8cb7eef55
0617 20:17:06.455067 (+232211us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.461908 (+ 6841us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.464456 (+ 2548us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.504504 (+ 40048us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3557941}
I20260617 20:17:06.482717 29377 rpcz_store.cc:276] 0617 20:17:02.818881 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.818949 (+ 68us) service_pool.cc:224] Handling call
0617 20:17:06.472117 (+3653168us) ts_tablet_manager.cc:1151] Deleting tablet 64538fdf51f94e8e985fec6202baac22
0617 20:17:06.472130 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.478424 (+ 6294us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.481949 (+ 3525us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.482634 (+ 685us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3652949}
I20260617 20:17:06.507133 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 64538fdf51f94e8e985fec6202baac22 (table default.Table_429e918201e84c0ab85d77c4cef3f02a [id=6cc7087e31da411db5d0ef5f7b376ade]) successfully deleted
I20260617 20:17:06.508581 29375 tablet_replica.cc:333] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:06.508838 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 815) took 3690 ms. Trace:
I20260617 20:17:06.508893 29375 raft_consensus.cc:2243] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.508957 29377 rpcz_store.cc:276] 0617 20:17:02.818217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.818617 (+ 400us) service_pool.cc:224] Handling call
0617 20:17:06.508651 (+3690034us) ts_tablet_manager.cc:1151] Deleting tablet aad5d2ab3e7d4453b4e1aa27acf7683d
0617 20:17:06.508668 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.508813 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3682483}
I20260617 20:17:06.509224 29375 raft_consensus.cc:2272] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:06.509493 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet aad5d2ab3e7d4453b4e1aa27acf7683d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aad5d2ab3e7d4453b4e1aa27acf7683d already in progress: creating tablet
I20260617 20:17:06.510134 29375 ts_tablet_manager.cc:1916] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.510901 30314 raft_consensus.cc:493] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:06.511062 30314 raft_consensus.cc:515] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.511734 30314 leader_election.cc:290] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.512353 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 825) took 3549 ms. Trace:
I20260617 20:17:06.512883 29377 rpcz_store.cc:276] 0617 20:17:02.962536 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.963151 (+ 615us) service_pool.cc:224] Handling call
0617 20:17:06.512221 (+3549070us) ts_tablet_manager.cc:1151] Deleting tablet 33d9cafa9d7c4a3f91f738e4654058b4
0617 20:17:06.512235 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.512333 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3548901}
I20260617 20:17:06.513980 29118 raft_consensus.cc:3060] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.514670 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2089215acdf478ca725c9d26b94d692" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:06.515425 29198 consensus_peers.cc:597] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:06.516077 28925 leader_election.cc:343] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:06.516345 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 33d9cafa9d7c4a3f91f738e4654058b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33d9cafa9d7c4a3f91f738e4654058b4 already in progress: creating tablet
I20260617 20:17:06.516528 29037 heartbeater.cc:461] Registering TS with master...
I20260617 20:17:06.516656 29377 tablet_replica.cc:333] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:06.516830 29377 raft_consensus.cc:2243] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 20:17:06.516907 28925 leader_election.cc:343] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.516959 29377 raft_consensus.cc:2272] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.518401 29377 ts_tablet_manager.cc:1916] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.518862 30294 raft_consensus.cc:493] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:06.519040 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76b5855e0e4149219a9b152ac1f9b958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.518977 30294 raft_consensus.cc:515] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.519529 30294 leader_election.cc:290] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.519929 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05fd5cf1aa44d24a81bf1be178ad8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.520562 29093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93bbcd1a2ae42409dbc9158aab0a9eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.520854 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet fc36f62aa0bf46278cb84ec8cb7eef55 (table default.Table_486a2491b91d4d4899c49ae5065acbcd [id=fe4c16ade5a04cc5b67a89de3e4ec53d]) successfully deleted
I20260617 20:17:06.520944 29103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b20564ac93482b84672c09e5489cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.521085 29090 tablet_service.cc:1511] Processing CreateTablet for tablet 3992cf5fd268481297c29515416d47e5 (DEFAULT_TABLE table=default.Table_36ec6892bea94b65b641c5b752fd1fdf [id=dacea1c7ac4243d8acd20757eaa05249]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:06.524451 29062 leader_election.cc:343] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c12ea6cac8d44b4b8d41e3e33e0fd6cb
I20260617 20:17:06.525521 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet 4281bbef1efb4986a23c6fb24e62e49c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.526209 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 266ff05cc91b43dfbb30ce9e961eeb54 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.526419 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet cdd24a60a91b43cd9e31ecca3d21ec60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.526441 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet edf884e801d74362ad05435a76efcc1f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:05 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.526990 29225 tablet_service.cc:1511] Processing CreateTablet for tablet a7b20564ac93482b84672c09e5489cfd (DEFAULT_TABLE table=default.Table_b16811c4e5c6448194a1adf7df3d96a2 [id=cc3218b558cf46c8ad88fb1ec7fa82b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.527498 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b20564ac93482b84672c09e5489cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.528034 30358 ts_manager.cc:194] Registered new tserver with Master: 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:06.531106 29383 ts_tablet_manager.cc:1434] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.057s user 0.001s sys 0.001s
I20260617 20:17:06.540611 29175 heartbeater.cc:344] Connected to a master server at 127.27.245.253:38361
I20260617 20:17:06.540717 30761 consensus_queue.cc:1048] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.542023 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401c2793bc6241c0aef1263597a3ef24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.542037 29377 ts_tablet_manager.cc:1929] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:06.542135 29377 log.cc:1199] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/cbeae97639fd4e6290768dae12f6a4ce
I20260617 20:17:06.543282 29377 ts_tablet_manager.cc:1950] T cbeae97639fd4e6290768dae12f6a4ce P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:06.544278 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 828) took 3528 ms. Trace:
I20260617 20:17:06.544378 29377 rpcz_store.cc:276] 0617 20:17:03.015854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.017013 (+ 1159us) service_pool.cc:224] Handling call
0617 20:17:06.516613 (+3499600us) ts_tablet_manager.cc:1151] Deleting tablet cbeae97639fd4e6290768dae12f6a4ce
0617 20:17:06.516622 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.530676 (+ 14054us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.541981 (+ 11305us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.544252 (+ 2271us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3499380}
I20260617 20:17:06.551745 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 18440a4a5c254a25b87f8632de9c92b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.552070 29235 tablet_service.cc:1511] Processing CreateTablet for tablet 3992cf5fd268481297c29515416d47e5 (DEFAULT_TABLE table=default.Table_36ec6892bea94b65b641c5b752fd1fdf [id=dacea1c7ac4243d8acd20757eaa05249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.560158 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet b1064bce50b64aa9afe8bb249545c5ab from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:06.562624 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3992cf5fd268481297c29515416d47e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.562703 28958 tablet_service.cc:1511] Processing CreateTablet for tablet 3992cf5fd268481297c29515416d47e5 (DEFAULT_TABLE table=default.Table_36ec6892bea94b65b641c5b752fd1fdf [id=dacea1c7ac4243d8acd20757eaa05249]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.563122 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3992cf5fd268481297c29515416d47e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.563723 30358 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" instance_seqno: 1781727403200426) as {username='slave'} at 127.27.245.195:53317; Asking this server to re-register.
I20260617 20:17:06.564199 29379 tablet_bootstrap.cc:492] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:06.564328 29379 ts_tablet_manager.cc:1403] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.173s user 0.002s sys 0.006s
I20260617 20:17:06.564987 29379 raft_consensus.cc:359] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.565140 29379 raft_consensus.cc:385] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.565194 29379 raft_consensus.cc:740] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:06.565412 29379 consensus_queue.cc:260] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.565884 29379 ts_tablet_manager.cc:1434] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260617 20:17:06.567248 29125 raft_consensus.cc:3060] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.568575 29090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3992cf5fd268481297c29515416d47e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.570217 30761 consensus_queue.cc:1048] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.576128 30865 raft_consensus.cc:493] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:06.576263 30865 raft_consensus.cc:515] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.576481 28958 tablet_service.cc:1511] Processing CreateTablet for tablet e401eea0717d4cbb8319e4d4b1ada410 (DEFAULT_TABLE table=default.Table_91ce1deb19d345e983397a67460cabcb [id=ee557d3a99a5471398131086daf8412f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.576795 30865 leader_election.cc:290] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.576922 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e401eea0717d4cbb8319e4d4b1ada410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.577381 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00c493a5624569b8f47242fc55b6fb" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:06.577827 28925 leader_election.cc:343] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.580488 29378 consensus_queue.cc:260] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.580797 29107 tablet_service.cc:1511] Processing CreateTablet for tablet e401eea0717d4cbb8319e4d4b1ada410 (DEFAULT_TABLE table=default.Table_91ce1deb19d345e983397a67460cabcb [id=ee557d3a99a5471398131086daf8412f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.581228 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e401eea0717d4cbb8319e4d4b1ada410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.590075 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 5272e7bed48247d99cb6a86a11156b8e (DEFAULT_TABLE table=default.Table_4facc39fb37f4b1e88d70be7148b6582 [id=98fc6157ed4d4c618c7b9dba872d0ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.590550 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5272e7bed48247d99cb6a86a11156b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.592469 29377 tablet_replica.cc:333] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:06.593997 29377 raft_consensus.cc:2243] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.594157 29377 raft_consensus.cc:2272] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.594342 29378 ts_tablet_manager.cc:1434] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.112s user 0.002s sys 0.000s
W20260617 20:17:06.595970 29063 leader_election.cc:343] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 89f7b878728a495f83b6584f8a6aca67
I20260617 20:17:06.596089 29063 leader_election.cc:304] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.596426 30294 raft_consensus.cc:2749] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:06.596560 29379 tablet_bootstrap.cc:492] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:06.597100 29094 tablet_service.cc:1511] Processing CreateTablet for tablet c2c7e5b1a28e4ce1943df3cab1f3ee97 (DEFAULT_TABLE table=default.Table_a17cfbbd20be4ffe99351c3b1ac11457 [id=39cd55a8cab4400db925a6c2d7e7da82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.597492 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c7e5b1a28e4ce1943df3cab1f3ee97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.598191 29379 tablet_bootstrap.cc:654] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.599671 29092 tablet_service.cc:1511] Processing CreateTablet for tablet dc717bac916140afa61a463435cc1e7c (DEFAULT_TABLE table=default.Table_3e14083b032f4f0aa58a5586a505644f [id=d8748c2388784fad857370a86fb9fc4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.600106 29092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc717bac916140afa61a463435cc1e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.594681 29377 ts_tablet_manager.cc:1916] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.594728 28925 leader_election.cc:304] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:06.602438 30787 raft_consensus.cc:2804] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:06.602519 30787 raft_consensus.cc:493] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:06.602571 30787 raft_consensus.cc:3060] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.604897 30787 raft_consensus.cc:515] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.595958 28951 tablet_service.cc:1511] Processing CreateTablet for tablet c2c7e5b1a28e4ce1943df3cab1f3ee97 (DEFAULT_TABLE table=default.Table_a17cfbbd20be4ffe99351c3b1ac11457 [id=39cd55a8cab4400db925a6c2d7e7da82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.605342 28958 tablet_service.cc:1511] Processing CreateTablet for tablet dc717bac916140afa61a463435cc1e7c (DEFAULT_TABLE table=default.Table_3e14083b032f4f0aa58a5586a505644f [id=d8748c2388784fad857370a86fb9fc4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.605444 30865 consensus_queue.cc:1048] T f14113dd9098456599d7b72626bedcd6 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.605824 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 5272e7bed48247d99cb6a86a11156b8e (DEFAULT_TABLE table=default.Table_4facc39fb37f4b1e88d70be7148b6582 [id=98fc6157ed4d4c618c7b9dba872d0ecb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.606196 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5272e7bed48247d99cb6a86a11156b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.606268 30787 leader_election.cc:290] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.606822 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bc2304de37441bb78cd12cab5ca3c3" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:06.607295 28925 leader_election.cc:343] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.607894 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c7e5b1a28e4ce1943df3cab1f3ee97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.609576 29096 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce393d563a446f08aa7dfb896d3e32c (DEFAULT_TABLE table=default.Table_97ba340d89a0446caac56caf5b2cde59 [id=2f5114c6a06f42cd8742c62168dd5032]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.610095 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce393d563a446f08aa7dfb896d3e32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.610661 28956 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce393d563a446f08aa7dfb896d3e32c (DEFAULT_TABLE table=default.Table_97ba340d89a0446caac56caf5b2cde59 [id=2f5114c6a06f42cd8742c62168dd5032]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.610975 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce393d563a446f08aa7dfb896d3e32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.613422 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad81ce1ab114fc395f8efb930f4d949 (DEFAULT_TABLE table=default.Table_ea2ae51b9e004007a411b1ff05d274cc [id=62f09839187f4bc5a6eab610514fb676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.613443 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 0332617d0db44eda9166a88e75539d16 (DEFAULT_TABLE table=default.Table_cc1b1d5f363341f89757851580c7be12 [id=56c7ef0d2f9b4f6f9265a1f64d01dc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.613785 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad81ce1ab114fc395f8efb930f4d949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.613977 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0332617d0db44eda9166a88e75539d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.614576 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad81ce1ab114fc395f8efb930f4d949 (DEFAULT_TABLE table=default.Table_ea2ae51b9e004007a411b1ff05d274cc [id=62f09839187f4bc5a6eab610514fb676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.614910 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad81ce1ab114fc395f8efb930f4d949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.615525 28951 tablet_service.cc:1511] Processing CreateTablet for tablet 0332617d0db44eda9166a88e75539d16 (DEFAULT_TABLE table=default.Table_cc1b1d5f363341f89757851580c7be12 [id=56c7ef0d2f9b4f6f9265a1f64d01dc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.615820 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0332617d0db44eda9166a88e75539d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.621487 29378 tablet_bootstrap.cc:492] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:06.623070 29378 tablet_bootstrap.cc:654] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.624500 30852 raft_consensus.cc:493] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:06.624676 30852 raft_consensus.cc:515] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.625279 30852 leader_election.cc:290] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:06.625986 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c73ae1007d44ce958ad02fa5787651" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:06.626598 29198 leader_election.cc:343] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:06.629467 29197 consensus_peers.cc:597] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dee426100bb645f391be123aeb52e412. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.632915 29375 ts_tablet_manager.cc:1929] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:06.635221 30678 consensus_queue.cc:1048] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.635133 30852 consensus_queue.cc:1048] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260617 20:17:06.636559 30852 raft_consensus.cc:493] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:06.636736 30852 raft_consensus.cc:515] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.637913 30852 leader_election.cc:290] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:06.638253 29197 consensus_peers.cc:597] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc8fa9f4c40b4ce9baa27a8837d3575c. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.640023 29618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 966 } } ignore_live_leader: false dest_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" is_pre_election: true
I20260617 20:17:06.640906 30313 leader_election.cc:304] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87437cd320a4470fa0dedd43aa7ea3eb; no voters: 590225c8ea36448093b77385d238a34a, f5ea3f9265d84474ab3bced8dd5aecc5
W20260617 20:17:06.641112 29198 consensus_peers.cc:597] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.641791 30843 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260617 20:17:06.642655 29198 consensus_peers.cc:597] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.650300 30761 consensus_queue.cc:1048] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.655473 30856 tablet.cc:1724] T d673bc9892c94725b270ef3b9dc768f4 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:06.656204 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ea2ae51b9e004007a411b1ff05d274cc" } modify_external_catalogs: true
I20260617 20:17:06.656459 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ea2ae51b9e004007a411b1ff05d274cc" } modify_external_catalogs: true
I20260617 20:17:06.659956 28665 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_041e671cc057444e808fc948556269c2" } new_table_name: "default.Table_32efdf31b50248e5ada2c2b690ff5aba" modify_external_catalogs: true
I20260617 20:17:06.664479 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet a350456a8eb143838de58a05c76c9056 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:06.664968 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet 1bf654918dc148cdbca0e420e337478b from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:06.669929 30856 tablet.cc:1724] T 87d0e2ecc16e4285a1d8337a5336caf2 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:06.673864 30856 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:41028 (request call id 949) took 1138 ms. Trace:
I20260617 20:17:06.674058 30856 rpcz_store.cc:276] 0617 20:17:05.535812 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.681680 (+145868us) service_pool.cc:224] Handling call
0617 20:17:06.673847 (+992167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:05.728292 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0617 20:17:05.728413 (+ 121us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0617 20:17:05.728423 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
0617 20:17:05.728433 (+ 10us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0617 20:17:05.728482 (+ 49us) alter_schema_op.cc:128] START. Timestamp: 1781727425728418
0617 20:17:05.728487 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 20:17:05.728703 (+ 216us) log.cc:844] Serialized 173 byte log entry
0617 20:17:06.669826 (+941123us) op_driver.cc:464] REPLICATION: finished
0617 20:17:06.669906 (+ 80us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0617 20:17:06.670294 (+ 388us) log.cc:844] Serialized 5 byte log entry
0617 20:17:06.673549 (+ 3255us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.673757 (+ 208us) log.cc:844] Serialized 14 byte log entry
0617 20:17:06.673809 (+ 52us) alter_schema_op.cc:73] Released schema lock
0617 20:17:06.673814 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":37,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":546,"prepare.run_wall_time_us":547,"raft.queue_time_us":283,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":168,"replication_time_us":941307}]]}
I20260617 20:17:06.675853 29377 ts_tablet_manager.cc:1929] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:06.675987 29377 log.cc:1199] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/593d9de6a2fb47e18d86649e45ba80b9
I20260617 20:17:06.676265 29377 ts_tablet_manager.cc:1950] T 593d9de6a2fb47e18d86649e45ba80b9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:06.678194 30852 consensus_queue.cc:1048] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:06.678774 29197 consensus_peers.cc:597] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.679061 30852 consensus_queue.cc:1048] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.680365 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2089215acdf478ca725c9d26b94d692" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:06.680802 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00c493a5624569b8f47242fc55b6fb" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:06.681267 29241 tablet_service.cc:1511] Processing CreateTablet for tablet e401eea0717d4cbb8319e4d4b1ada410 (DEFAULT_TABLE table=default.Table_91ce1deb19d345e983397a67460cabcb [id=ee557d3a99a5471398131086daf8412f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.681671 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e401eea0717d4cbb8319e4d4b1ada410. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.681828 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bc2304de37441bb78cd12cab5ca3c3" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:06.682008 29256 raft_consensus.cc:3060] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.682890 29375 log.cc:1199] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/b19bce310bd24294b063b3b4f76b9f99
I20260617 20:17:06.683180 29375 ts_tablet_manager.cc:1950] T b19bce310bd24294b063b3b4f76b9f99 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:06.683450 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 788) took 4019 ms. Trace:
I20260617 20:17:06.683497 28982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c73ae1007d44ce958ad02fa5787651" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:06.683517 29375 rpcz_store.cc:276] 0617 20:17:02.664448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.664774 (+ 326us) service_pool.cc:224] Handling call
0617 20:17:06.505186 (+3840412us) ts_tablet_manager.cc:1151] Deleting tablet b19bce310bd24294b063b3b4f76b9f99
0617 20:17:06.508516 (+ 3330us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.543433 (+ 34917us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.632863 (+ 89430us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.683437 (+ 50574us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3840192}
I20260617 20:17:06.683674 28982 raft_consensus.cc:2468] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:06.683828 29375 tablet_replica.cc:333] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:06.683991 29375 raft_consensus.cc:2243] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:06.641711 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb408723f7a346c3b5ea13cad237b44e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:06.684280 29375 raft_consensus.cc:2272] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.684463 29256 raft_consensus.cc:2468] T b6bc2304de37441bb78cd12cab5ca3c3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:06.684825 29375 ts_tablet_manager.cc:1916] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:06.684901 29198 leader_election.cc:343] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.685596 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 5272e7bed48247d99cb6a86a11156b8e (DEFAULT_TABLE table=default.Table_4facc39fb37f4b1e88d70be7148b6582 [id=98fc6157ed4d4c618c7b9dba872d0ecb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:06.685708 28925 leader_election.cc:343] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.685818 28925 leader_election.cc:304] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.685925 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5272e7bed48247d99cb6a86a11156b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.686252 30787 raft_consensus.cc:2749] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:06.686969 28986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb408723f7a346c3b5ea13cad237b44e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:06.687120 28986 raft_consensus.cc:2468] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:06.689014 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet b19bce310bd24294b063b3b4f76b9f99 (table default.Table_5716b279b26c4d29a3259333d3661d7d [id=e0633fd70c974a2d8ec482e122a7cd55]) successfully deleted
I20260617 20:17:06.689219 30852 raft_consensus.cc:493] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ca3d93189744132bbf55ac01f3a8254)
I20260617 20:17:06.689349 30852 raft_consensus.cc:515] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.689536 29228 tablet_service.cc:1511] Processing CreateTablet for tablet c2c7e5b1a28e4ce1943df3cab1f3ee97 (DEFAULT_TABLE table=default.Table_a17cfbbd20be4ffe99351c3b1ac11457 [id=39cd55a8cab4400db925a6c2d7e7da82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.689837 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c7e5b1a28e4ce1943df3cab1f3ee97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.689909 30852 leader_election.cc:290] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:06.690270 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2a8f46e8ac4f4aa39544a9fe40b1fe" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:06.690452 29121 raft_consensus.cc:2468] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:06.690903 29198 leader_election.cc:304] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:06.691355 30852 raft_consensus.cc:2804] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 20:17:06.691422 30852 raft_consensus.cc:493] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ca3d93189744132bbf55ac01f3a8254)
I20260617 20:17:06.691480 30852 raft_consensus.cc:3060] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Advancing to term 2
I20260617 20:17:06.693536 29242 tablet_service.cc:1511] Processing CreateTablet for tablet dc717bac916140afa61a463435cc1e7c (DEFAULT_TABLE table=default.Table_3e14083b032f4f0aa58a5586a505644f [id=d8748c2388784fad857370a86fb9fc4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.693881 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc717bac916140afa61a463435cc1e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.693795 30852 raft_consensus.cc:515] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.694350 30852 leader_election.cc:290] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:06.695046 30901 tablet.cc:1724] T d673bc9892c94725b270ef3b9dc768f4 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:06.697522 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce393d563a446f08aa7dfb896d3e32c (DEFAULT_TABLE table=default.Table_97ba340d89a0446caac56caf5b2cde59 [id=2f5114c6a06f42cd8742c62168dd5032]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.697825 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce393d563a446f08aa7dfb896d3e32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.699803 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2a8f46e8ac4f4aa39544a9fe40b1fe" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:06.699954 29125 raft_consensus.cc:3060] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 2
I20260617 20:17:06.701536 29232 tablet_service.cc:1511] Processing CreateTablet for tablet 0332617d0db44eda9166a88e75539d16 (DEFAULT_TABLE table=default.Table_cc1b1d5f363341f89757851580c7be12 [id=56c7ef0d2f9b4f6f9265a1f64d01dc76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.701853 29232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0332617d0db44eda9166a88e75539d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.702484 29125 raft_consensus.cc:2468] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 2.
I20260617 20:17:06.702885 29198 leader_election.cc:304] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:06.703138 30678 raft_consensus.cc:2804] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260617 20:17:06.703250 30678 raft_consensus.cc:697] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:06.703456 30678 consensus_queue.cc:237] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.704833 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad81ce1ab114fc395f8efb930f4d949 (DEFAULT_TABLE table=default.Table_ea2ae51b9e004007a411b1ff05d274cc [id=62f09839187f4bc5a6eab610514fb676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:06.705184 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad81ce1ab114fc395f8efb930f4d949. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:06.715157 28925 leader_election.cc:343] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.715302 28925 leader_election.cc:304] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.715806 30314 raft_consensus.cc:2749] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:06.719252 28925 leader_election.cc:304] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:06.719728 30314 raft_consensus.cc:2804] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:06.719858 30314 raft_consensus.cc:697] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:06.725895 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 830) took 3707 ms. Trace:
I20260617 20:17:06.726023 29377 rpcz_store.cc:276] 0617 20:17:03.018518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.022477 (+ 3959us) service_pool.cc:224] Handling call
0617 20:17:06.592421 (+3569944us) ts_tablet_manager.cc:1151] Deleting tablet 593d9de6a2fb47e18d86649e45ba80b9
0617 20:17:06.592432 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.618410 (+ 25978us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.675782 (+ 57372us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.725866 (+ 50084us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3569705}
I20260617 20:17:06.726672 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 593d9de6a2fb47e18d86649e45ba80b9 (table default.Table_8cd5575879f54274afa3ecac3cc58ea7 [id=a7cecb2081fb4a37a1814fa7324f24a3]) successfully deleted
I20260617 20:17:06.730181 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 831) took 3707 ms. Trace:
I20260617 20:17:06.730353 29377 rpcz_store.cc:276] 0617 20:17:03.022892 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.023115 (+ 223us) service_pool.cc:224] Handling call
0617 20:17:06.730069 (+3706954us) ts_tablet_manager.cc:1151] Deleting tablet 33a1c96212014333935ec7f7c92a306c
0617 20:17:06.730082 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.730162 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3706754}
W20260617 20:17:06.731345 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 33a1c96212014333935ec7f7c92a306c because the tablet was not found. No further retry: Not found: Tablet not found: 33a1c96212014333935ec7f7c92a306c
W20260617 20:17:06.733089 29063 leader_election.cc:343] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: c12ea6cac8d44b4b8d41e3e33e0fd6cb
I20260617 20:17:06.733210 29063 leader_election.cc:304] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.733448 30294 raft_consensus.cc:2749] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:06.733763 29377 tablet_replica.cc:333] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:06.734306 29377 raft_consensus.cc:2243] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.735195 29377 raft_consensus.cc:2272] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.736732 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc717bac916140afa61a463435cc1e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:06.738131 29377 ts_tablet_manager.cc:1916] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:06.738830 29197 consensus_peers.cc:597] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fed593a3fa7742a18ccc2124c3ee0fb9. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:06.739013 29197 consensus_peers.cc:597] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7cafcade995b407f84f56b8cd3ab6892. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.739148 29197 leader_election.cc:304] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:06.745154 29377 ts_tablet_manager.cc:1929] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260617 20:17:06.746308 28925 consensus_peers.cc:597] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.749643 30678 raft_consensus.cc:2804] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:06.749745 30678 raft_consensus.cc:493] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:06.749828 30678 raft_consensus.cc:3060] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.752223 30678 raft_consensus.cc:515] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.752837 30678 leader_election.cc:290] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:06.752977 30678 consensus_queue.cc:1048] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.753427 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c73ae1007d44ce958ad02fa5787651" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:06.753737 29197 leader_election.cc:304] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:17:06.753914 29198 leader_election.cc:343] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:06.754308 30678 raft_consensus.cc:2804] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:06.754390 30678 raft_consensus.cc:493] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:06.754410 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 825) took 3800 ms. Trace:
I20260617 20:17:06.754467 30678 raft_consensus.cc:3060] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.754483 29376 rpcz_store.cc:276] 0617 20:17:02.954674 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.957028 (+ 2354us) service_pool.cc:224] Handling call
0617 20:17:06.372906 (+3415878us) ts_tablet_manager.cc:1151] Deleting tablet 3726e55ed36f420ab63bcfb5a81c5aab
0617 20:17:06.372916 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.436518 (+ 63602us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.439454 (+ 2936us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.754392 (+314938us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12448,"tablet-delete.queue_time_us":3415768}
I20260617 20:17:06.754827 29376 tablet_replica.cc:333] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:06.754998 29376 raft_consensus.cc:2243] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:06.755257 29376 raft_consensus.cc:2272] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.755789 29376 ts_tablet_manager.cc:1916] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.756759 30678 raft_consensus.cc:515] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.757833 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb408723f7a346c3b5ea13cad237b44e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:06.758177 29197 leader_election.cc:343] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: ea2a8f46e8ac4f4aa39544a9fe40b1fe
W20260617 20:17:06.758296 29198 leader_election.cc:343] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:06.758448 29197 leader_election.cc:343] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: ea2a8f46e8ac4f4aa39544a9fe40b1fe
I20260617 20:17:06.759303 30761 consensus_queue.cc:1048] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.760354 28979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c73ae1007d44ce958ad02fa5787651" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:06.760517 28979 raft_consensus.cc:3060] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.760799 28982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb408723f7a346c3b5ea13cad237b44e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:06.760946 28982 raft_consensus.cc:3060] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:06.763657 28979 raft_consensus.cc:2468] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:06.764001 28982 raft_consensus.cc:2468] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:06.765591 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 3726e55ed36f420ab63bcfb5a81c5aab (table default.Table_fbaeb71321364cca9f5c971ee3419519 [id=cd2fab71637e4b968e9957070c30c936]) successfully deleted
I20260617 20:17:06.774024 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 086bd3079e8f4a6d85ccc681a38a47b0
I20260617 20:17:06.774663 28664 catalog_manager.cc:6784] ReplaceTablet: tablet 086bd3079e8f4a6d85ccc681a38a47b0 deleted and replaced by tablet e164ead74ef44bbbb33f65f7ede5a8e2
W20260617 20:17:06.775090 28666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.193:34505 (request call id 124) took 973 ms (client timeout 1000 ms). Trace:
I20260617 20:17:06.775061 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7b002b69063948828e757ca68368920c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.775192 28666 rpcz_store.cc:269] 0617 20:17:05.801565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.811162 (+ 9597us) service_pool.cc:224] Handling call
0617 20:17:06.775028 (+963866us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:06.479028 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:06.479147 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:06.479152 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:06.479154 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:06.479247 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:06.479257 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:06.479261 (+ 4us) tablet.cc:685] Acquiring locks for 1 operations
0617 20:17:06.479320 (+ 59us) tablet.cc:701] Row locks acquired
0617 20:17:06.479322 (+ 2us) write_op.cc:260] PREPARE: finished
0617 20:17:06.479356 (+ 34us) write_op.cc:270] Start()
0617 20:17:06.479384 (+ 28us) write_op.cc:276] Timestamp: P: 1781727426479328 usec, L: 0
0617 20:17:06.479389 (+ 5us) op_driver.cc:348] REPLICATION: starting
0617 20:17:06.490087 (+ 10698us) log.cc:844] Serialized 536 byte log entry
0617 20:17:06.490298 (+ 211us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x616000043354. stack: 00007fa110c2f496 00007fa110c2f250 00007fa10fc5a3ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007fa11ccaaf22 00007fa11e08c305 00007fa11e08ae29 00007fa11e093250 00007fa11e09305d 0000000000aa681c 00007fa110c759ff 00007fa110c78d1b 00007fa110c78b98 0000000000aa681c
0617 20:17:06.772951 (+282653us) op_driver.cc:464] REPLICATION: finished
0617 20:17:06.773065 (+ 114us) write_op.cc:301] APPLY: starting
0617 20:17:06.773084 (+ 19us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:06.773119 (+ 35us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:06.773121 (+ 2us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:06.773381 (+ 260us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:06.773416 (+ 35us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0617 20:17:06.773424 (+ 8us) write_op.cc:312] APPLY: finished
0617 20:17:06.773503 (+ 79us) log.cc:844] Serialized 23 byte log entry
0617 20:17:06.773564 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:06.773582 (+ 18us) write_op.cc:454] Released schema lock
0617 20:17:06.773589 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:06.773659 (+ 70us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:06.773663 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":39,"apply.run_cpu_time_us":386,"apply.run_wall_time_us":592,"num_ops":1,"prepare.queue_time_us":52,"prepare.run_cpu_time_us":1158,"prepare.run_wall_time_us":11302,"replication_time_us":293523,"spinlock_wait_cycles":24207744}]]}
W20260617 20:17:06.775710 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b002b69063948828e757ca68368920c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.775991 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3d341472f7724dd8a87f7e18ea3f349d" } new_table_name: "default.Table_cba2415155904e39af29aadcd63568b1" modify_external_catalogs: true
I20260617 20:17:06.753921 29310 heartbeater.cc:461] Registering TS with master...
W20260617 20:17:06.777093 28670 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3656e8549ea543e3b7a7cc1490aad71c consensus state has no leader
I20260617 20:17:06.777530 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f72a129643494deabc2a8c6f86129b46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.778036 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f72a129643494deabc2a8c6f86129b46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:17:06.780315 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2f906eb1286493ab134c4b959cd1b6a consensus state has no leader
I20260617 20:17:06.780649 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1dcb619bfb304bcc890afe629b9e4694"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.781111 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1dcb619bfb304bcc890afe629b9e4694 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.782771 29375 ts_tablet_manager.cc:1929] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:06.782917 29375 log.cc:1199] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/d2db0467c5e64e38961d3b0e66375544
I20260617 20:17:06.783319 29375 ts_tablet_manager.cc:1950] T d2db0467c5e64e38961d3b0e66375544 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:06.783658 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 787) took 4119 ms. Trace:
I20260617 20:17:06.783738 29375 rpcz_store.cc:276] 0617 20:17:02.664343 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.664948 (+ 605us) service_pool.cc:224] Handling call
0617 20:17:06.683774 (+4018826us) ts_tablet_manager.cc:1151] Deleting tablet d2db0467c5e64e38961d3b0e66375544
0617 20:17:06.683795 (+ 21us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.746175 (+ 62380us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.782697 (+ 36522us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.783638 (+ 941us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4018713}
I20260617 20:17:06.784113 29375 tablet_replica.cc:333] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:06.784339 29375 raft_consensus.cc:2243] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.784510 29375 raft_consensus.cc:2272] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.785158 29375 ts_tablet_manager.cc:1916] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.757254 30678 leader_election.cc:290] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:06.786453 30358 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" instance_seqno: 1781727402721499) as {username='slave'} at 127.27.245.194:41851; Asking this server to re-register.
I20260617 20:17:06.790400 29197 leader_election.cc:304] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:06.790802 29197 leader_election.cc:304] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:06.791020 30761 raft_consensus.cc:2804] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:06.791126 30761 raft_consensus.cc:697] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:06.791347 30761 consensus_queue.cc:237] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:06.791781 28656 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 31267063d24f4e89898349117a9a3031 (table default.Table_6f87ebb700cd4bcd8c9970ecae935a1a [id=908d6aab19ee442a9d9246694407969e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 31267063d24f4e89898349117a9a3031 consensus state has no leader
I20260617 20:17:06.791957 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet d2db0467c5e64e38961d3b0e66375544 (table default.Table_3a768181eca84e2f9d6eb43239795801 [id=d18d30df8d4644899355b7c8c2f387e6]) successfully deleted
I20260617 20:17:06.792801 30852 raft_consensus.cc:2804] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:06.792920 30852 raft_consensus.cc:697] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:06.793071 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 086bd3079e8f4a6d85ccc681a38a47b0 with delete_type TABLET_DATA_DELETED (replaced by tablet e164ead74ef44bbbb33f65f7ede5a8e2) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.793146 30852 consensus_queue.cc:237] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.798374 29175 heartbeater.cc:461] Registering TS with master...
I20260617 20:17:06.677861 29379 tablet_bootstrap.cc:492] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:06.802983 29379 ts_tablet_manager.cc:1403] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.206s user 0.003s sys 0.009s
I20260617 20:17:06.806094 28664 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_8b8bdf1cd4e041fcb6260ee95e42b92b" } new_table_name: "default.Table_1b82da87fd3545618d32eb43a350f6ef" modify_external_catalogs: true
I20260617 20:17:06.806555 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b1064bce50b64aa9afe8bb249545c5ab
I20260617 20:17:06.807055 28662 catalog_manager.cc:6784] ReplaceTablet: tablet b1064bce50b64aa9afe8bb249545c5ab deleted and replaced by tablet c10b96bee83b419dbfc2a8e26f88e719
I20260617 20:17:06.807338 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c9f56913d2c44e0ab075f05ddeb35442" } modify_external_catalogs: true
I20260617 20:17:06.807484 29378 tablet_bootstrap.cc:492] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:06.807503 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c9f56913d2c44e0ab075f05ddeb35442" } modify_external_catalogs: true
I20260617 20:17:06.807633 29378 ts_tablet_manager.cc:1403] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.186s user 0.003s sys 0.001s
I20260617 20:17:06.808314 29378 raft_consensus.cc:359] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.808481 29378 raft_consensus.cc:385] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.808534 29378 raft_consensus.cc:740] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:06.808615 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fd7a383258db4d0387bbef3727e3e319" } modify_external_catalogs: true
W20260617 20:17:06.808710 28665 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5a6d25d728654de68061884976356d42 consensus state has no leader
I20260617 20:17:06.808725 29378 consensus_queue.cc:260] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.809016 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0db02a7ec7e94e95826a6132d5527a3a" } modify_external_catalogs: true
I20260617 20:17:06.808784 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fd7a383258db4d0387bbef3727e3e319" } modify_external_catalogs: true
I20260617 20:17:06.809182 29378 ts_tablet_manager.cc:1434] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:17:06.809178 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0db02a7ec7e94e95826a6132d5527a3a" } modify_external_catalogs: true
I20260617 20:17:06.809687 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet b1064bce50b64aa9afe8bb249545c5ab with delete_type TABLET_DATA_DELETED (replaced by tablet c10b96bee83b419dbfc2a8e26f88e719) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:06.810001 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5ad81ce1ab114fc395f8efb930f4d949
I20260617 20:17:06.810585 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a2f0e4601acf41bcb6c1eb2b630891d0" } modify_external_catalogs: true
I20260617 20:17:06.810721 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a2f0e4601acf41bcb6c1eb2b630891d0" } modify_external_catalogs: true
I20260617 20:17:06.811030 29227 tablet_service.cc:1558] Processing DeleteTablet for tablet 086bd3079e8f4a6d85ccc681a38a47b0 with delete_type TABLET_DATA_DELETED (replaced by tablet e164ead74ef44bbbb33f65f7ede5a8e2) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.803735 29379 raft_consensus.cc:359] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.811467 29379 raft_consensus.cc:385] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.811507 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ad81ce1ab114fc395f8efb930f4d949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:06.811532 29379 raft_consensus.cc:740] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:06.811726 29379 consensus_queue.cc:260] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.811829 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 1bf654918dc148cdbca0e420e337478b
I20260617 20:17:06.812230 29379 ts_tablet_manager.cc:1434] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260617 20:17:06.812328 28668 catalog_manager.cc:6784] ReplaceTablet: tablet 1bf654918dc148cdbca0e420e337478b deleted and replaced by tablet 209a90eea5ef4061a1b935d7aa5dd1ed
I20260617 20:17:06.812515 29379 tablet_bootstrap.cc:492] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:06.812664 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_77e7189ea1ef4f3c9af44f3374988908"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.813210 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77e7189ea1ef4f3c9af44f3374988908 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.814275 29379 tablet_bootstrap.cc:654] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.814729 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ad81ce1ab114fc395f8efb930f4d949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.816980 30314 consensus_queue.cc:237] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.818082 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_4b555cc3fa1e4dd5b51da47450054b76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.818635 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b555cc3fa1e4dd5b51da47450054b76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.820353 28663 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a] alter complete (version 1)
I20260617 20:17:06.821780 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ad81ce1ab114fc395f8efb930f4d949 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.821874 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet b1064bce50b64aa9afe8bb249545c5ab with delete_type TABLET_DATA_DELETED (replaced by tablet c10b96bee83b419dbfc2a8e26f88e719) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.821990 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bf654918dc148cdbca0e420e337478b with delete_type TABLET_DATA_DELETED (replaced by tablet 209a90eea5ef4061a1b935d7aa5dd1ed) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.822135 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a6272b48651941ac98fb21a3f6de6679"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.822616 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6272b48651941ac98fb21a3f6de6679 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:17:06.825470 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2acfbcce4bbd403aa608f9b62d611723 consensus state has no leader
I20260617 20:17:06.825878 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ea6a8570fafd4a2f979827a3711b2de4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.826359 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea6a8570fafd4a2f979827a3711b2de4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.826897 30678 consensus_queue.cc:1048] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:06.829272 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_270cf0c20609474eaf9e30d5b9a8ecf8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.829728 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_270cf0c20609474eaf9e30d5b9a8ecf8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.831208 29383 tablet_bootstrap.cc:492] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:06.831266 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bf654918dc148cdbca0e420e337478b with delete_type TABLET_DATA_DELETED (replaced by tablet 209a90eea5ef4061a1b935d7aa5dd1ed) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.832170 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet b1064bce50b64aa9afe8bb249545c5ab with delete_type TABLET_DATA_DELETED (replaced by tablet c10b96bee83b419dbfc2a8e26f88e719) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.832454 29383 tablet_bootstrap.cc:654] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:06.834434 29198 consensus_peers.cc:597] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.820161 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 1bf654918dc148cdbca0e420e337478b with delete_type TABLET_DATA_DELETED (replaced by tablet 209a90eea5ef4061a1b935d7aa5dd1ed) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:06.839723 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet d2db0467c5e64e38961d3b0e66375544 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:49 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.839982 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 593d9de6a2fb47e18d86649e45ba80b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.827806 29378 tablet_bootstrap.cc:492] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:06.842778 29378 tablet_bootstrap.cc:654] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.843519 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet eb408723f7a346c3b5ea13cad237b44e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.844082 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 3726e55ed36f420ab63bcfb5a81c5aab with delete_type TABLET_DATA_DELETED (replaced by tablet b4dbefbe5234458cb299410ddb2c73a3) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.848701 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 086bd3079e8f4a6d85ccc681a38a47b0 with delete_type TABLET_DATA_DELETED (replaced by tablet e164ead74ef44bbbb33f65f7ede5a8e2) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:06.855069 29376 ts_tablet_manager.cc:1929] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:06.858026 30909 tablet.cc:1724] T dd8a7096a09147789ac203c150a19419 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:06.858309 30358 ts_manager.cc:194] Registered new tserver with Master: 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:06.861857 30910 tablet.cc:1724] T ead0291870a443d9b76ea919a45a4303 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:06.863952 30912 tablet.cc:1724] T 87d0e2ecc16e4285a1d8337a5336caf2 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:06.865458 29379 tablet_bootstrap.cc:492] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:06.865604 29379 ts_tablet_manager.cc:1403] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.053s user 0.003s sys 0.000s
I20260617 20:17:06.866328 29379 raft_consensus.cc:359] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.866494 29379 raft_consensus.cc:385] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:06.866539 29379 raft_consensus.cc:740] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:06.866737 29379 consensus_queue.cc:260] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.867190 29379 ts_tablet_manager.cc:1434] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:17:06.867447 29379 tablet_bootstrap.cc:492] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:06.876550 30356 ts_manager.cc:194] Registered new tserver with Master: a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.881086 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet e9ea2f6574d44d1a80fd4787fb6ca0e1
I20260617 20:17:06.881604 30294 raft_consensus.cc:493] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:06.881736 30294 raft_consensus.cc:515] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.882562 30294 leader_election.cc:290] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.883929 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet fc7cb1160fe94c2baf9775a193ef4c77
I20260617 20:17:06.885742 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet fc7cb1160fe94c2baf9775a193ef4c77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:06.883756 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3032155e4e4ea8a23984f547d78752" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:06.887989 29376 log.cc:1199] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/e59430dd630b4ca6b573ea4230212abf
I20260617 20:17:06.888439 29376 ts_tablet_manager.cc:1950] T e59430dd630b4ca6b573ea4230212abf P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
W20260617 20:17:06.888512 28664 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 401c2793bc6241c0aef1263597a3ef24 consensus state has no leader
I20260617 20:17:06.888896 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8c1e2652a5d745fda18a0e7512b22ecd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:06.889137 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 826) took 3933 ms. Trace:
I20260617 20:17:06.889226 29376 rpcz_store.cc:276] 0617 20:17:02.956210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.957699 (+ 1489us) service_pool.cc:224] Handling call
0617 20:17:06.754784 (+3797085us) ts_tablet_manager.cc:1151] Deleting tablet e59430dd630b4ca6b573ea4230212abf
0617 20:17:06.754794 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.818739 (+ 63945us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.855005 (+ 36266us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.889117 (+ 34112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3796907}
I20260617 20:17:06.889374 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet e9ea2f6574d44d1a80fd4787fb6ca0e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:06.889575 29376 tablet_replica.cc:333] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:06.889729 29376 raft_consensus.cc:2243] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 LEADER]: Raft consensus shutting down.
I20260617 20:17:06.889904 29376 pending_rounds.cc:70] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:17:06.889937 29376 pending_rounds.cc:77] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7297955539779571712 op_type: NO_OP noop_request { }
I20260617 20:17:06.890870 29376 raft_consensus.cc:2889] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260617 20:17:06.890895 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c1e2652a5d745fda18a0e7512b22ecd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.890962 29376 raft_consensus.cc:2272] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.888857 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2d90fd265e634bb9b76e516660488059"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:06.894613 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d90fd265e634bb9b76e516660488059 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:06.909834 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet e9ea2f6574d44d1a80fd4787fb6ca0e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.909834 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet fc7cb1160fe94c2baf9775a193ef4c77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:06.910555 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet e59430dd630b4ca6b573ea4230212abf (table default.Table_f09fba1c81844e81a218171de6721f68 [id=e9b35265c9c245e5a2d81e9f8b81a92c]) successfully deleted
I20260617 20:17:06.911383 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet fc7cb1160fe94c2baf9775a193ef4c77 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.911712 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet e9ea2f6574d44d1a80fd4787fb6ca0e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:06.915802 30918 consensus_queue.cc:1048] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:06.916877 29197 consensus_peers.cc:597] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbeae97639fd4e6290768dae12f6a4ce. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:06.925115 28984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3032155e4e4ea8a23984f547d78752" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:06.927620 29062 leader_election.cc:304] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:06.928139 30294 raft_consensus.cc:2749] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:06.933662 29376 ts_tablet_manager.cc:1916] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.935300 30294 raft_consensus.cc:493] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:06.935503 30294 raft_consensus.cc:515] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.936219 30294 leader_election.cc:290] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:06.937745 29062 leader_election.cc:343] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f4de5dafb1474de1911148bb3b4527cf
I20260617 20:17:06.940497 29376 ts_tablet_manager.cc:1929] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260617 20:17:06.944644 30901 tablet.cc:1724] T c73bdcc1cefd48f3b99e0c059c3a7467 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:06.947517 30294 raft_consensus.cc:493] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:06.947664 30294 raft_consensus.cc:515] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.948297 30294 leader_election.cc:290] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.953387 30917 tablet.cc:1724] T d673bc9892c94725b270ef3b9dc768f4 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 20:17:06.955101 29062 leader_election.cc:343] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f8e0c5d20a4548cc8124302aa38bcb21
I20260617 20:17:06.970082 29377 log.cc:1199] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/e79c6804fbb34f5baebdb366f2e0b1bf
I20260617 20:17:06.970538 29377 ts_tablet_manager.cc:1950] T e79c6804fbb34f5baebdb366f2e0b1bf P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:06.971041 29379 tablet_bootstrap.cc:654] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:06.974568 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 836) took 3812 ms. Trace:
I20260617 20:17:06.974671 29377 rpcz_store.cc:276] 0617 20:17:03.162037 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.173505 (+ 11468us) service_pool.cc:224] Handling call
0617 20:17:06.733705 (+3560200us) ts_tablet_manager.cc:1151] Deleting tablet e79c6804fbb34f5baebdb366f2e0b1bf
0617 20:17:06.733714 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.741757 (+ 8043us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.745098 (+ 3341us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.974546 (+229448us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3162,"tablet-delete.queue_time_us":3559945}
I20260617 20:17:06.975162 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet e79c6804fbb34f5baebdb366f2e0b1bf (table default.Table_c31a6d3cec584680a4f793abe57f6d24 [id=dccd13aa95b94b70882f6a59e71d2bf4]) successfully deleted
I20260617 20:17:06.975175 29377 tablet_replica.cc:333] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:06.975528 29377 raft_consensus.cc:2243] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.975714 29377 raft_consensus.cc:2272] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.976226 29377 ts_tablet_manager.cc:1916] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.982508 30910 tablet.cc:1724] T c73bdcc1cefd48f3b99e0c059c3a7467 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:06.984148 29375 ts_tablet_manager.cc:1929] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:06.984273 29375 log.cc:1199] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/89f7b878728a495f83b6584f8a6aca67
I20260617 20:17:06.984678 29375 ts_tablet_manager.cc:1950] T 89f7b878728a495f83b6584f8a6aca67 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:06.985010 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 789) took 4320 ms. Trace:
I20260617 20:17:06.985086 29375 rpcz_store.cc:276] 0617 20:17:02.664529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.665029 (+ 500us) service_pool.cc:224] Handling call
0617 20:17:06.784066 (+4119037us) ts_tablet_manager.cc:1151] Deleting tablet 89f7b878728a495f83b6584f8a6aca67
0617 20:17:06.784077 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.830420 (+ 46343us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.984086 (+153666us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.984994 (+ 908us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4118905}
I20260617 20:17:06.985601 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 786) took 4321 ms. Trace:
I20260617 20:17:06.985673 29375 rpcz_store.cc:276] 0617 20:17:02.664209 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.665186 (+ 977us) service_pool.cc:224] Handling call
0617 20:17:06.985515 (+4320329us) ts_tablet_manager.cc:1151] Deleting tablet 5e53946c85ab4a8286a6e174cc411c5e
0617 20:17:06.985524 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.985586 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4320166}
I20260617 20:17:06.986061 29375 tablet_replica.cc:333] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:06.986254 29375 raft_consensus.cc:2243] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:06.986398 29375 raft_consensus.cc:2272] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:06.986963 29375 ts_tablet_manager.cc:1916] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:06.989574 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 89f7b878728a495f83b6584f8a6aca67 (table default.Table_bb7f63dd419f420bb7bed4cf3bd9042e [id=6fb9858b817a4575abd3b84a32027d90]) successfully deleted
W20260617 20:17:06.989890 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5e53946c85ab4a8286a6e174cc411c5e because the tablet was not found. No further retry: Not found: Tablet not found: 5e53946c85ab4a8286a6e174cc411c5e
I20260617 20:17:06.990273 30294 raft_consensus.cc:493] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:06.990401 30294 raft_consensus.cc:515] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:06.991022 30294 leader_election.cc:290] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:06.993247 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3099db3fe67f428d9b61e60303d756f2" } new_table_name: "default.Table_a856b87de7f949c4b0afa2cfc3a8489e" modify_external_catalogs: true
I20260617 20:17:06.994474 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_59e33a772ea84e4286330690b0973bf4" } new_table_name: "default.Table_5c3dfa3702bc41ad99c1ae8bb53dce13" modify_external_catalogs: true
W20260617 20:17:06.999589 29062 leader_election.cc:343] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: cf8d04ef8acd4fcaa69df9253cd89462
W20260617 20:17:07.004920 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48caf549502b4493b73ba33aeccc1a5a consensus state has no leader
W20260617 20:17:07.008996 29063 leader_election.cc:343] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: f4de5dafb1474de1911148bb3b4527cf
I20260617 20:17:07.009128 29063 leader_election.cc:304] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:07.010178 29063 leader_election.cc:343] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: f8e0c5d20a4548cc8124302aa38bcb21
I20260617 20:17:07.010278 29063 leader_election.cc:304] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:07.010492 30817 raft_consensus.cc:2749] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:07.010582 30294 raft_consensus.cc:2749] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:07.015254 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3b25a09b7fe74e00a568504737da0c8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:07.015687 29378 tablet_bootstrap.cc:492] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:07.015825 29378 ts_tablet_manager.cc:1403] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.188s user 0.002s sys 0.004s
W20260617 20:17:07.015869 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b25a09b7fe74e00a568504737da0c8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.020094 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_eb559c64ad6046518eb0cf7a52ae1b35"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.020641 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb559c64ad6046518eb0cf7a52ae1b35 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.021580 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0969f0a128834168ad1fde29b32e32d0" } new_table_name: "default.Table_db3cad8ad5504503992f09f4cbfa7246" modify_external_catalogs: true
I20260617 20:17:07.023039 28668 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9125c594bb904c249d84dd3b53caa011" } modify_external_catalogs: true
I20260617 20:17:07.023226 28668 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9125c594bb904c249d84dd3b53caa011" } modify_external_catalogs: true
I20260617 20:17:07.024013 30910 tablet.cc:1724] T 0f3032155e4e4ea8a23984f547d78752 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260617 20:17:07.026171 29063 leader_election.cc:343] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: cf8d04ef8acd4fcaa69df9253cd89462
I20260617 20:17:07.026343 29063 leader_election.cc:304] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:07.028875 30294 raft_consensus.cc:2749] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:07.007364 29377 ts_tablet_manager.cc:1929] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:07.030608 29377 log.cc:1199] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/91c99389d24d4a8d8c934f0a9b9c2825
I20260617 20:17:07.031010 29377 ts_tablet_manager.cc:1950] T 91c99389d24d4a8d8c934f0a9b9c2825 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:17:07.038204 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d62885cedcc4821ac430f1d6df3bded consensus state has no leader
I20260617 20:17:07.040185 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1b82da87fd3545618d32eb43a350f6ef" } new_table_name: "default.Table_49d176333f04466aa2554d7107e748f7" modify_external_catalogs: true
I20260617 20:17:07.041252 29379 tablet_bootstrap.cc:492] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:07.041406 29379 ts_tablet_manager.cc:1403] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.174s user 0.004s sys 0.000s
I20260617 20:17:07.042248 29379 raft_consensus.cc:359] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.042407 29379 raft_consensus.cc:385] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.042456 29379 raft_consensus.cc:740] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.044797 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c6b928749f3c47948dc6d24894ac5e25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.046931 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6b928749f3c47948dc6d24894ac5e25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.052934 29379 consensus_queue.cc:260] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.053529 29379 ts_tablet_manager.cc:1434] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
W20260617 20:17:07.053664 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 401c2793bc6241c0aef1263597a3ef24 consensus state has no leader
I20260617 20:17:07.053824 29379 tablet_bootstrap.cc:492] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:07.078193 29378 raft_consensus.cc:359] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.078553 29378 raft_consensus.cc:385] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.078562 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 839) took 3826 ms. Trace:
I20260617 20:17:07.078684 29378 raft_consensus.cc:740] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.078703 29377 rpcz_store.cc:276] 0617 20:17:03.252513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.252569 (+ 56us) service_pool.cc:224] Handling call
0617 20:17:06.975125 (+3722556us) ts_tablet_manager.cc:1151] Deleting tablet 91c99389d24d4a8d8c934f0a9b9c2825
0617 20:17:06.975135 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.979276 (+ 4141us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.007303 (+ 28027us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.078537 (+ 71234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46771,"tablet-delete.queue_time_us":3722363}
I20260617 20:17:07.079145 29378 consensus_queue.cc:260] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.079322 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_b25f36c0ba1247f5a4b85a5b4add8420 [id=6a948594185b42128136770dbe3f0ffb]) successfully deleted
I20260617 20:17:07.079807 29378 ts_tablet_manager.cc:1434] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.064s user 0.001s sys 0.001s
I20260617 20:17:07.080538 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 840) took 3817 ms. Trace:
I20260617 20:17:07.080626 29377 rpcz_store.cc:276] 0617 20:17:03.262885 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.262957 (+ 72us) service_pool.cc:224] Handling call
0617 20:17:07.079052 (+3816095us) ts_tablet_manager.cc:1151] Deleting tablet add6e21cef3b4c02910486841e36ce4a
0617 20:17:07.080382 (+ 1330us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.080520 (+ 138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3815875}
W20260617 20:17:07.081182 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet add6e21cef3b4c02910486841e36ce4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet add6e21cef3b4c02910486841e36ce4a already in progress: creating tablet
I20260617 20:17:07.081579 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 841) took 3652 ms. Trace:
I20260617 20:17:07.081650 29377 rpcz_store.cc:276] 0617 20:17:03.429262 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.429359 (+ 97us) service_pool.cc:224] Handling call
0617 20:17:07.080872 (+3651513us) ts_tablet_manager.cc:1151] Deleting tablet d192d11683dc4b558cd3c3f965e657f9
0617 20:17:07.081449 (+ 577us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.081562 (+ 113us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3651296}
W20260617 20:17:07.082095 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d192d11683dc4b558cd3c3f965e657f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d192d11683dc4b558cd3c3f965e657f9 already in progress: creating tablet
I20260617 20:17:07.082446 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 842) took 3653 ms. Trace:
I20260617 20:17:07.082530 29377 rpcz_store.cc:276] 0617 20:17:03.429449 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.429631 (+ 182us) service_pool.cc:224] Handling call
0617 20:17:07.081857 (+3652226us) ts_tablet_manager.cc:1151] Deleting tablet c141dde259d44f4c88db5236190259a7
0617 20:17:07.082355 (+ 498us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.082431 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3652083}
I20260617 20:17:07.082796 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 843) took 3612 ms. Trace:
I20260617 20:17:07.082854 29377 rpcz_store.cc:276] 0617 20:17:03.470677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.470745 (+ 68us) service_pool.cc:224] Handling call
0617 20:17:07.082712 (+3611967us) ts_tablet_manager.cc:1151] Deleting tablet 5a09fbb3e8eb4b66acba0d6b572713ef
0617 20:17:07.082719 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.082783 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3604572}
I20260617 20:17:07.083112 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 844) took 3517 ms. Trace:
I20260617 20:17:07.083169 29377 rpcz_store.cc:276] 0617 20:17:03.565683 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.565767 (+ 84us) service_pool.cc:224] Handling call
0617 20:17:07.083026 (+3517259us) ts_tablet_manager.cc:1151] Deleting tablet d5e5d246ea0e474e81edfc7e88001321
0617 20:17:07.083038 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.083100 (+ 62us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3517038}
I20260617 20:17:07.083410 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 848) took 3239 ms. Trace:
I20260617 20:17:07.083475 29377 rpcz_store.cc:276] 0617 20:17:03.844072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.844129 (+ 57us) service_pool.cc:224] Handling call
0617 20:17:07.083331 (+3239202us) ts_tablet_manager.cc:1151] Deleting tablet 3e11c8b69b704e959e4463f565bf89ab
0617 20:17:07.083339 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.083397 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3238987}
I20260617 20:17:07.083714 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 849) took 3227 ms. Trace:
I20260617 20:17:07.083770 29377 rpcz_store.cc:276] 0617 20:17:03.856258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.856327 (+ 69us) service_pool.cc:224] Handling call
0617 20:17:07.083635 (+3227308us) ts_tablet_manager.cc:1151] Deleting tablet 519719a748f441c58689172dffb54394
0617 20:17:07.083643 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.083703 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3227064}
I20260617 20:17:07.084022 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 850) took 3144 ms. Trace:
I20260617 20:17:07.084076 29377 rpcz_store.cc:276] 0617 20:17:03.939123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.939181 (+ 58us) service_pool.cc:224] Handling call
0617 20:17:07.083943 (+3144762us) ts_tablet_manager.cc:1151] Deleting tablet 6ea0168fa86547f68c7fec880b8d8f1e
0617 20:17:07.083951 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.084011 (+ 60us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3144566}
W20260617 20:17:07.085218 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet c141dde259d44f4c88db5236190259a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c141dde259d44f4c88db5236190259a7 already in progress: creating tablet
W20260617 20:17:07.085461 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5a09fbb3e8eb4b66acba0d6b572713ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a09fbb3e8eb4b66acba0d6b572713ef already in progress: creating tablet
W20260617 20:17:07.085655 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet d5e5d246ea0e474e81edfc7e88001321 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5e5d246ea0e474e81edfc7e88001321 already in progress: creating tablet
W20260617 20:17:07.085820 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3e11c8b69b704e959e4463f565bf89ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e11c8b69b704e959e4463f565bf89ab already in progress: creating tablet
W20260617 20:17:07.086019 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 519719a748f441c58689172dffb54394 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 519719a748f441c58689172dffb54394 already in progress: creating tablet
W20260617 20:17:07.086217 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 6ea0168fa86547f68c7fec880b8d8f1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ea0168fa86547f68c7fec880b8d8f1e already in progress: creating tablet
I20260617 20:17:07.087715 29377 tablet_replica.cc:333] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:07.087983 29377 raft_consensus.cc:2243] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.088145 29377 raft_consensus.cc:2272] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.090338 29377 ts_tablet_manager.cc:1916] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.093609 29119 raft_consensus.cc:3060] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:07.094285 29379 tablet_bootstrap.cc:654] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.099509 29375 ts_tablet_manager.cc:1929] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.100427 30787 raft_consensus.cc:493] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.100626 30787 raft_consensus.cc:515] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.101536 30787 leader_election.cc:290] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:07.103286 29378 tablet_bootstrap.cc:492] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:06.943939 30856 tablet.cc:1724] T c73bdcc1cefd48f3b99e0c059c3a7467 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:07.050091 29383 tablet_bootstrap.cc:492] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.105872 29383 ts_tablet_manager.cc:1403] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.275s user 0.002s sys 0.002s
I20260617 20:17:07.106609 29383 raft_consensus.cc:359] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.106788 29383 raft_consensus.cc:385] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.106853 29383 raft_consensus.cc:740] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.107070 29383 consensus_queue.cc:260] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.107573 29383 ts_tablet_manager.cc:1434] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:07.111344 29378 tablet_bootstrap.cc:654] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.112411 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ec93db29796046d78927ecf1d33c63da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.113176 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec93db29796046d78927ecf1d33c63da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.115607 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_390902ffe43c4f1483476e5da984b628" } modify_external_catalogs: true
I20260617 20:17:07.115799 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_390902ffe43c4f1483476e5da984b628" } modify_external_catalogs: true
I20260617 20:17:07.118836 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4fe634ef4e354d92a6d2b711acee1d5b" } modify_external_catalogs: true
I20260617 20:17:07.119122 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4fe634ef4e354d92a6d2b711acee1d5b" } modify_external_catalogs: true
I20260617 20:17:07.123453 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_83dad09bc9d6404d8bb9f0cbcf719f08" } new_table_name: "default.Table_5c6561f5414e4882a5dda6848359c27b" modify_external_catalogs: true
I20260617 20:17:07.127919 29383 tablet_bootstrap.cc:492] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.129549 29383 tablet_bootstrap.cc:654] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:07.131973 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f5636950d5d445c297b7e3286645d013 consensus state has no leader
I20260617 20:17:07.133035 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_006cb367b3ec46459d97e77c25bc67ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.134495 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_006cb367b3ec46459d97e77c25bc67ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.051946 30944 tablet.cc:1724] T 0f3032155e4e4ea8a23984f547d78752 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:07.102814 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d81457d71a34657b43c8ebe7efb0a35" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:07.137391 29377 ts_tablet_manager.cc:1929] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.137545 29377 log.cc:1199] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/370db89a92a6455190edaf80e5a56205
I20260617 20:17:07.138242 29377 ts_tablet_manager.cc:1950] T 370db89a92a6455190edaf80e5a56205 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:07.139153 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 852) took 3193 ms. Trace:
I20260617 20:17:07.139256 29377 rpcz_store.cc:276] 0617 20:17:03.945849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.946490 (+ 641us) service_pool.cc:224] Handling call
0617 20:17:07.084924 (+3138434us) ts_tablet_manager.cc:1151] Deleting tablet 370db89a92a6455190edaf80e5a56205
0617 20:17:07.087669 (+ 2745us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.108246 (+ 20577us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.122648 (+ 14402us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.139128 (+ 16480us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3138210}
I20260617 20:17:07.139787 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 370db89a92a6455190edaf80e5a56205 (table default.Table_a53260b7e2f34a0f9eadcfc43812a67c [id=1b48b6816fff4837bb9acf6a14bcd898]) successfully deleted
I20260617 20:17:07.140192 29377 tablet_replica.cc:333] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:07.140443 29377 raft_consensus.cc:2243] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.140846 29377 raft_consensus.cc:2272] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:07.140846 28925 leader_election.cc:343] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.144999 29377 ts_tablet_manager.cc:1916] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.145799 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8acde758a415485fa7e9aaa929121769"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:07.146596 29378 tablet_bootstrap.cc:492] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
W20260617 20:17:07.146620 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8acde758a415485fa7e9aaa929121769 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.146847 29378 ts_tablet_manager.cc:1403] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.044s user 0.003s sys 0.003s
I20260617 20:17:07.147640 29378 raft_consensus.cc:359] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.147899 29378 raft_consensus.cc:385] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.148007 29378 raft_consensus.cc:740] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.148291 29378 consensus_queue.cc:260] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.148897 29378 ts_tablet_manager.cc:1434] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:07.149410 29378 tablet_bootstrap.cc:492] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:07.149998 29376 log.cc:1199] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/ea2a8f46e8ac4f4aa39544a9fe40b1fe
I20260617 20:17:07.150465 29376 ts_tablet_manager.cc:1950] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:07.151533 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 827) took 4194 ms. Trace:
I20260617 20:17:07.151676 29376 rpcz_store.cc:276] 0617 20:17:02.957563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.958077 (+ 514us) service_pool.cc:224] Handling call
0617 20:17:06.889534 (+3931457us) ts_tablet_manager.cc:1151] Deleting tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe
0617 20:17:06.889543 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:06.937720 (+ 48177us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:06.940448 (+ 2728us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.151351 (+210903us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3931335}
I20260617 20:17:07.152181 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe (table default.Table_a6787e5dc20a42b6812d3cd0acc6112c [id=c0e83fb2a91448d7937ba0ba68a48fba]) successfully deleted
I20260617 20:17:07.153550 30787 raft_consensus.cc:493] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.153682 30787 raft_consensus.cc:515] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.154320 30787 leader_election.cc:290] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:07.158890 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb29f2e56c4838b0efd0171229088a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:07.159379 28925 leader_election.cc:343] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.162616 29378 tablet_bootstrap.cc:654] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.173095 29377 ts_tablet_manager.cc:1929] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.173249 29377 log.cc:1199] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/14a5e5917a414c99b25ea2efeab4063d
I20260617 20:17:07.178687 29383 tablet_bootstrap.cc:492] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.178845 29383 ts_tablet_manager.cc:1403] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.051s user 0.000s sys 0.003s
I20260617 20:17:07.179486 29383 raft_consensus.cc:359] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.179656 29383 raft_consensus.cc:385] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.179706 29383 raft_consensus.cc:740] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.179893 29383 consensus_queue.cc:260] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.180423 29383 ts_tablet_manager.cc:1434] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260617 20:17:07.180673 29383 tablet_bootstrap.cc:492] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.180927 29377 ts_tablet_manager.cc:1950] T 14a5e5917a414c99b25ea2efeab4063d P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:07.181993 29383 tablet_bootstrap.cc:654] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.185799 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7df03098d8c34f058bcae824c33dd2a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:07.182577 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 851) took 3236 ms. Trace:
I20260617 20:17:07.186086 29377 rpcz_store.cc:276] 0617 20:17:03.945726 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.946700 (+ 974us) service_pool.cc:224] Handling call
0617 20:17:07.140138 (+3193438us) ts_tablet_manager.cc:1151] Deleting tablet 14a5e5917a414c99b25ea2efeab4063d
0617 20:17:07.140149 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.160724 (+ 20575us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.173009 (+ 12285us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.182556 (+ 9547us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3193147}
I20260617 20:17:07.186554 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 14a5e5917a414c99b25ea2efeab4063d (table default.Table_6039bf8f7372476bb786690cad75b43c [id=d714bd16d06041a2a930d45e8409ab88]) successfully deleted
I20260617 20:17:07.187291 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 853) took 3206 ms. Trace:
I20260617 20:17:07.187732 29377 rpcz_store.cc:276] 0617 20:17:03.981192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.981254 (+ 62us) service_pool.cc:224] Handling call
0617 20:17:07.187164 (+3205910us) ts_tablet_manager.cc:1151] Deleting tablet b7e3bb8cd7df47aea4746f74f1ca2dc1
0617 20:17:07.187175 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.187276 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3205623}
W20260617 20:17:07.188443 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 already in progress: creating tablet
I20260617 20:17:07.188985 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 828) took 4230 ms. Trace:
I20260617 20:17:07.189248 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 854) took 3205 ms. Trace:
I20260617 20:17:07.189167 29376 rpcz_store.cc:276] 0617 20:17:02.958777 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.959073 (+ 296us) service_pool.cc:224] Handling call
0617 20:17:07.188861 (+4229788us) ts_tablet_manager.cc:1151] Deleting tablet 9f9844fab126448895c4c9d4c3c78d76
0617 20:17:07.188872 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.188960 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4229646}
I20260617 20:17:07.189378 29377 rpcz_store.cc:276] 0617 20:17:03.983661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.983726 (+ 65us) service_pool.cc:224] Handling call
0617 20:17:07.189135 (+3205409us) ts_tablet_manager.cc:1151] Deleting tablet c83fa97268f045d6aa60413dfa96ebbd
0617 20:17:07.189145 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.189231 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3205220}
I20260617 20:17:07.189742 29376 tablet_replica.cc:333] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:17:07.189765 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet c83fa97268f045d6aa60413dfa96ebbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c83fa97268f045d6aa60413dfa96ebbd already in progress: creating tablet
I20260617 20:17:07.189991 29376 raft_consensus.cc:2243] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:07.190343 29376 raft_consensus.cc:2272] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.190692 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 855) took 3203 ms. Trace:
I20260617 20:17:07.190883 29376 ts_tablet_manager.cc:1916] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.191205 29377 rpcz_store.cc:276] 0617 20:17:03.986782 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.986848 (+ 66us) service_pool.cc:224] Handling call
0617 20:17:07.190596 (+3203748us) ts_tablet_manager.cc:1151] Deleting tablet 8f058c309b87431d9517338c7484bbbd
0617 20:17:07.190604 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.190677 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3203586}
W20260617 20:17:07.191939 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 8f058c309b87431d9517338c7484bbbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f058c309b87431d9517338c7484bbbd already in progress: creating tablet
I20260617 20:17:07.192343 29377 tablet_replica.cc:333] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:17:07.197088 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7df03098d8c34f058bcae824c33dd2a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.199523 29377 raft_consensus.cc:2243] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.199707 29377 raft_consensus.cc:2272] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.199261 29378 tablet_bootstrap.cc:492] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:07.199954 29378 ts_tablet_manager.cc:1403] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.005s
I20260617 20:17:07.200860 29378 raft_consensus.cc:359] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.201045 29378 raft_consensus.cc:385] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.201105 29378 raft_consensus.cc:740] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.203440 29378 consensus_queue.cc:260] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.204097 29378 ts_tablet_manager.cc:1434] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:07.204377 29378 tablet_bootstrap.cc:492] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:07.102610 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d81457d71a34657b43c8ebe7efb0a35" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:07.152254 30901 tablet.cc:1724] T 0f3032155e4e4ea8a23984f547d78752 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:07.157933 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb29f2e56c4838b0efd0171229088a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:07.205878 28925 leader_election.cc:343] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.206032 28925 leader_election.cc:304] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:07.203955 29379 tablet_bootstrap.cc:492] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:07.206333 29379 ts_tablet_manager.cc:1403] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.153s user 0.002s sys 0.001s
W20260617 20:17:07.206450 28925 leader_election.cc:343] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.206537 28925 leader_election.cc:304] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:07.206874 29378 tablet_bootstrap.cc:654] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.207221 30787 raft_consensus.cc:2749] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:07.207397 30787 raft_consensus.cc:2749] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:07.208319 29377 ts_tablet_manager.cc:1916] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.208461 29375 log.cc:1199] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/33a1c96212014333935ec7f7c92a306c
I20260617 20:17:07.207412 29379 raft_consensus.cc:359] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.209038 29119 raft_consensus.cc:3060] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:07.212673 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a9feae94e42c4ffc87ff57c32a580c64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:07.216912 30314 raft_consensus.cc:493] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.217051 30314 raft_consensus.cc:515] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.217640 30314 leader_election.cc:290] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:07.218384 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c65bb7c45e40a081de91d4c1c5cf56" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:07.218924 28925 leader_election.cc:343] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.219189 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c65bb7c45e40a081de91d4c1c5cf56" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:07.219872 28925 leader_election.cc:343] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.219969 28925 leader_election.cc:304] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:07.220304 30314 raft_consensus.cc:2749] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:07.223253 29383 tablet_bootstrap.cc:492] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.223404 29383 ts_tablet_manager.cc:1403] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.000s
I20260617 20:17:07.228247 29377 ts_tablet_manager.cc:1929] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.228370 29377 log.cc:1199] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/75c59cf5f5e8486baf1e038a44657f33
I20260617 20:17:07.228714 29377 ts_tablet_manager.cc:1950] T 75c59cf5f5e8486baf1e038a44657f33 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:07.224728 29379 raft_consensus.cc:385] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.229743 29379 raft_consensus.cc:740] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.230163 29378 tablet_bootstrap.cc:492] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:07.230365 29378 ts_tablet_manager.cc:1403] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.002s
I20260617 20:17:07.230454 29379 consensus_queue.cc:260] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.231042 30952 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590225c8ea36448093b77385d238a34a)
I20260617 20:17:07.231107 29378 raft_consensus.cc:359] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.231351 29378 raft_consensus.cc:385] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.231498 29378 raft_consensus.cc:740] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.231470 29383 raft_consensus.cc:359] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.231660 29383 raft_consensus.cc:385] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.231750 29383 raft_consensus.cc:740] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.231966 29383 consensus_queue.cc:260] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.232213 29378 consensus_queue.cc:260] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.234331 29378 ts_tablet_manager.cc:1434] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:07.235391 29378 tablet_bootstrap.cc:492] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:07.236994 29383 ts_tablet_manager.cc:1434] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 20:17:07.237283 29383 tablet_bootstrap.cc:492] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.238754 29383 tablet_bootstrap.cc:654] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.239773 29378 tablet_bootstrap.cc:654] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.229585 29375 ts_tablet_manager.cc:1950] T 33a1c96212014333935ec7f7c92a306c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:07.246265 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 791) took 4580 ms. Trace:
W20260617 20:17:07.253473 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9feae94e42c4ffc87ff57c32a580c64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.254793 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 856) took 3239 ms. Trace:
I20260617 20:17:07.254890 29377 rpcz_store.cc:276] 0617 20:17:04.015212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.015277 (+ 65us) service_pool.cc:224] Handling call
0617 20:17:07.192286 (+3177009us) ts_tablet_manager.cc:1151] Deleting tablet 75c59cf5f5e8486baf1e038a44657f33
0617 20:17:07.192294 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.225443 (+ 33149us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.228197 (+ 2754us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.254771 (+ 26574us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3173949}
I20260617 20:17:07.256554 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 885) took 2777 ms. Trace:
I20260617 20:17:07.256631 29377 rpcz_store.cc:276] 0617 20:17:04.478968 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.479024 (+ 56us) service_pool.cc:224] Handling call
0617 20:17:07.256427 (+2777403us) ts_tablet_manager.cc:1151] Deleting tablet ee5b41c446444389821a2ebb85c1bf8b
0617 20:17:07.256436 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.256537 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2777223}
I20260617 20:17:07.256716 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 75c59cf5f5e8486baf1e038a44657f33 (table default.Table_0f470f9601d84ae29158e563c73bce2d [id=eb66a2f606534252b7a20de365947ee4]) successfully deleted
I20260617 20:17:07.256950 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 886) took 2775 ms. Trace:
I20260617 20:17:07.257032 29377 rpcz_store.cc:276] 0617 20:17:04.481952 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.482004 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:07.256845 (+2774841us) ts_tablet_manager.cc:1151] Deleting tablet 8ca84d3c8b8f43978692bcc61956d2b5
0617 20:17:07.256853 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.256935 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2774670}
W20260617 20:17:07.257277 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet ee5b41c446444389821a2ebb85c1bf8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee5b41c446444389821a2ebb85c1bf8b already in progress: creating tablet
I20260617 20:17:07.257388 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 890) took 2411 ms. Trace:
I20260617 20:17:07.257444 29377 rpcz_store.cc:276] 0617 20:17:04.845451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.845500 (+ 49us) service_pool.cc:224] Handling call
0617 20:17:07.257243 (+2411743us) ts_tablet_manager.cc:1151] Deleting tablet cc547148aa124907a5e5def6941f734c
0617 20:17:07.257254 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.257373 (+ 119us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2344892}
I20260617 20:17:07.257730 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 891) took 2412 ms. Trace:
I20260617 20:17:07.257790 29377 rpcz_store.cc:276] 0617 20:17:04.845567 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.845674 (+ 107us) service_pool.cc:224] Handling call
0617 20:17:07.257639 (+2411965us) ts_tablet_manager.cc:1151] Deleting tablet ccd6f76a201e40f8be224a93c701fea9
0617 20:17:07.257647 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.257718 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2345236}
I20260617 20:17:07.258025 29377 tablet_replica.cc:333] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:07.258208 29377 raft_consensus.cc:2243] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.258363 29377 raft_consensus.cc:2272] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.261058 30952 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:07.262281 29377 ts_tablet_manager.cc:1916] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:07.262650 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 8ca84d3c8b8f43978692bcc61956d2b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ca84d3c8b8f43978692bcc61956d2b5 already in progress: creating tablet
W20260617 20:17:07.262873 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet cc547148aa124907a5e5def6941f734c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc547148aa124907a5e5def6941f734c already in progress: creating tablet
W20260617 20:17:07.263092 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet ccd6f76a201e40f8be224a93c701fea9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccd6f76a201e40f8be224a93c701fea9 already in progress: creating tablet
I20260617 20:17:07.237854 29119 raft_consensus.cc:3060] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:07.261776 29379 ts_tablet_manager.cc:1434] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.055s user 0.001s sys 0.001s
I20260617 20:17:07.273566 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c365798fc83d4befad2195f6b2ac7fca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.274725 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c365798fc83d4befad2195f6b2ac7fca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.275617 29378 tablet_bootstrap.cc:492] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:07.276772 29378 ts_tablet_manager.cc:1403] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.002s
I20260617 20:17:07.278357 29377 ts_tablet_manager.cc:1929] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.278460 29377 log.cc:1199] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/27c20f436b9b4a8cb659215f9579af04
I20260617 20:17:07.278941 29377 ts_tablet_manager.cc:1950] T 27c20f436b9b4a8cb659215f9579af04 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:07.279606 29378 raft_consensus.cc:359] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.279816 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 889) took 2434 ms. Trace:
I20260617 20:17:07.279911 29377 rpcz_store.cc:276] 0617 20:17:04.845290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.846158 (+ 868us) service_pool.cc:224] Handling call
0617 20:17:07.257986 (+2411828us) ts_tablet_manager.cc:1151] Deleting tablet 27c20f436b9b4a8cb659215f9579af04
0617 20:17:07.257994 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.275149 (+ 17155us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.278309 (+ 3160us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.279798 (+ 1489us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2345529}
I20260617 20:17:07.280344 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 27c20f436b9b4a8cb659215f9579af04 (table default.Table_3d19c23664c34aff8fce1a199ca71ac9 [id=f8657da5fd504f17aa1f82c1dba56187]) successfully deleted
I20260617 20:17:07.279829 29378 raft_consensus.cc:385] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.269656 29375 rpcz_store.cc:276] 0617 20:17:02.666027 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.666090 (+ 63us) service_pool.cc:224] Handling call
0617 20:17:06.986016 (+4319926us) ts_tablet_manager.cc:1151] Deleting tablet 33a1c96212014333935ec7f7c92a306c
0617 20:17:06.986024 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.096585 (+110561us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.099442 (+ 2857us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.246244 (+146802us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4319756}
I20260617 20:17:07.280941 29378 raft_consensus.cc:740] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.281443 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 33a1c96212014333935ec7f7c92a306c (table default.Table_f73d839e67c548629526669e7310da0c [id=cdf84135aed8448bafc93456dd9cdfc2]) successfully deleted
I20260617 20:17:07.282208 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 794) took 4469 ms. Trace:
I20260617 20:17:07.282490 30314 raft_consensus.cc:493] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.282589 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 892) took 2352 ms. Trace:
I20260617 20:17:07.282663 29377 rpcz_store.cc:276] 0617 20:17:04.930117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.930159 (+ 42us) service_pool.cc:224] Handling call
0617 20:17:07.280624 (+2350465us) ts_tablet_manager.cc:1151] Deleting tablet 3726e55ed36f420ab63bcfb5a81c5aab
0617 20:17:07.282494 (+ 1870us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.282575 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2350285}
W20260617 20:17:07.283069 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 3726e55ed36f420ab63bcfb5a81c5aab because the tablet was not found. No further retry: Not found: Tablet not found: 3726e55ed36f420ab63bcfb5a81c5aab
I20260617 20:17:07.282604 30314 raft_consensus.cc:515] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.283684 30314 leader_election.cc:290] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:07.284567 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ae9c63c8c541bc91ecedd798a7d60f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:07.285084 28925 leader_election.cc:343] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.285638 29377 tablet_replica.cc:333] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:07.285840 29377 raft_consensus.cc:2243] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.284256 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ae9c63c8c541bc91ecedd798a7d60f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:07.285871 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 966 } } ignore_live_leader: false dest_uuid: "590225c8ea36448093b77385d238a34a" is_pre_election: true
I20260617 20:17:07.285972 29377 raft_consensus.cc:2272] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.284567 29379 tablet_bootstrap.cc:492] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:07.286449 29377 ts_tablet_manager.cc:1916] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:07.286578 28925 leader_election.cc:343] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.286659 28925 leader_election.cc:304] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:07.286823 29375 rpcz_store.cc:276] 0617 20:17:02.813116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.813186 (+ 70us) service_pool.cc:224] Handling call
0617 20:17:07.282079 (+4468893us) ts_tablet_manager.cc:1151] Deleting tablet aad5d2ab3e7d4453b4e1aa27acf7683d
0617 20:17:07.282088 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.282189 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4468632}
I20260617 20:17:07.287068 30314 raft_consensus.cc:2749] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:07.287323 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet aad5d2ab3e7d4453b4e1aa27acf7683d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet aad5d2ab3e7d4453b4e1aa27acf7683d already in progress: creating tablet
I20260617 20:17:07.291882 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 966 } } ignore_live_leader: false dest_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" is_pre_election: true
I20260617 20:17:07.292081 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 795) took 4477 ms. Trace:
I20260617 20:17:07.292519 30313 leader_election.cc:304] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87437cd320a4470fa0dedd43aa7ea3eb; no voters: 590225c8ea36448093b77385d238a34a, f5ea3f9265d84474ab3bced8dd5aecc5
I20260617 20:17:07.294611 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_3d7d626f6bae4e3cbfc7bd41f1cdc5f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:07.295137 29378 consensus_queue.cc:260] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:07.297899 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d7d626f6bae4e3cbfc7bd41f1cdc5f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.299804 29378 ts_tablet_manager.cc:1434] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.023s user 0.001s sys 0.000s
I20260617 20:17:07.302597 29378 tablet_bootstrap.cc:492] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:07.304384 29378 tablet_bootstrap.cc:654] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.296495 29377 ts_tablet_manager.cc:1929] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:07.305377 29377 log.cc:1199] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/f823290351d542179b8bcc683d7acf6a
I20260617 20:17:07.305698 29377 ts_tablet_manager.cc:1950] T f823290351d542179b8bcc683d7acf6a P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:07.306458 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 893) took 2376 ms. Trace:
I20260617 20:17:07.306541 29377 rpcz_store.cc:276] 0617 20:17:04.930207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.930372 (+ 165us) service_pool.cc:224] Handling call
0617 20:17:07.283326 (+2352954us) ts_tablet_manager.cc:1151] Deleting tablet f823290351d542179b8bcc683d7acf6a
0617 20:17:07.285582 (+ 2256us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.289510 (+ 3928us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.296444 (+ 6934us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.306441 (+ 9997us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2352759}
I20260617 20:17:07.307575 30952 leader_election.cc:290] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059)
I20260617 20:17:07.308000 30952 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:07.308353 30410 consensus_queue.cc:1048] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:07.308866 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 05494b097ba0480e91d338cf6b50ddc8
I20260617 20:17:07.309465 28667 master_service.cc:960] ReplaceTablet: received request to replace tablet 5f7534d57f1740af8b211d646488c90f from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:07.311595 28670 catalog_manager.cc:5696] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:07.315063 28670 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 74c73ae1007d44ce958ad02fa5787651 (table default.Table_59e33a772ea84e4286330690b0973bf4 [id=0586dbd68a634d83ab9b00d2ba7f38af]). Expected version 2 got 0
W20260617 20:17:07.316481 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74c73ae1007d44ce958ad02fa5787651 consensus state has no leader
I20260617 20:17:07.317154 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a2798a47a5a746238dd22a3f89641417" } new_table_name: "default.Table_9620456571e44a95930dec879ff4ad69" modify_external_catalogs: true
I20260617 20:17:07.292155 29375 rpcz_store.cc:276] 0617 20:17:02.814735 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.814786 (+ 51us) service_pool.cc:224] Handling call
0617 20:17:07.291951 (+4477165us) ts_tablet_manager.cc:1151] Deleting tablet 64538fdf51f94e8e985fec6202baac22
0617 20:17:07.291960 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.292062 (+ 102us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4477004}
I20260617 20:17:07.317977 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 805) took 4402 ms. Trace:
I20260617 20:17:07.318076 29375 rpcz_store.cc:276] 0617 20:17:02.915230 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.915425 (+ 195us) service_pool.cc:224] Handling call
0617 20:17:07.317812 (+4402387us) ts_tablet_manager.cc:1151] Deleting tablet 33d9cafa9d7c4a3f91f738e4654058b4
0617 20:17:07.317828 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.317954 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4402146}
I20260617 20:17:07.319314 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5559b78afa0d4043971bb433500a21e4
I20260617 20:17:07.319964 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 814) took 4178 ms. Trace:
I20260617 20:17:07.320057 29375 rpcz_store.cc:276] 0617 20:17:03.141788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.141838 (+ 50us) service_pool.cc:224] Handling call
0617 20:17:07.319824 (+4177986us) ts_tablet_manager.cc:1151] Deleting tablet e79c6804fbb34f5baebdb366f2e0b1bf
0617 20:17:07.319838 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.319943 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4177796}
I20260617 20:17:07.320751 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_9b1f182b3d5c42ac986fdc3989d04e85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.321283 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b1f182b3d5c42ac986fdc3989d04e85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.322417 28662 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330] alter complete (version 1)
I20260617 20:17:07.323426 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1447e53a07e04f0aad77f02ce6c222e7" } new_table_name: "default.Table_2b5031b4d42c4d51b39279536a2c19d9" modify_external_catalogs: true
I20260617 20:17:07.324774 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 08290c23fff5449481789b29d15c4781
I20260617 20:17:07.324887 29116 raft_consensus.cc:3060] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:07.324967 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet f823290351d542179b8bcc683d7acf6a (table default.Table_40053ed1f4264c3993f829af0bea9f13 [id=a5d095adc0744ee49bba7dca6126d33f]) successfully deleted
I20260617 20:17:07.325778 28957 tablet_service.cc:1558] Processing DeleteTablet for tablet 5559b78afa0d4043971bb433500a21e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.325778 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 05494b097ba0480e91d338cf6b50ddc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.326563 29377 tablet_replica.cc:333] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:07.326740 29377 raft_consensus.cc:2243] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.326889 29377 raft_consensus.cc:2272] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.327415 29377 ts_tablet_manager.cc:1916] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.327749 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 08290c23fff5449481789b29d15c4781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.327948 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 4b94d8148cf74a899c3d025f22541bd9
I20260617 20:17:07.328572 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_fd36630af298479ea72ee90aac680893" } new_table_name: "default.Table_0abef9ea18ea4a1ab736d589813de366" modify_external_catalogs: true
I20260617 20:17:07.329993 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b94d8148cf74a899c3d025f22541bd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.330129 30901 tablet.cc:1724] T 87d0e2ecc16e4285a1d8337a5336caf2 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:07.330498 30410 consensus_queue.cc:1048] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:07.337725 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fa31011cf98e493ab6cbc8a5a4a9e05a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.338299 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa31011cf98e493ab6cbc8a5a4a9e05a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:17:07.342455 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 64538fdf51f94e8e985fec6202baac22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64538fdf51f94e8e985fec6202baac22 already in progress: creating tablet
W20260617 20:17:07.342741 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 33d9cafa9d7c4a3f91f738e4654058b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33d9cafa9d7c4a3f91f738e4654058b4 already in progress: creating tablet
I20260617 20:17:07.342772 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet 5559b78afa0d4043971bb433500a21e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:43332
W20260617 20:17:07.342957 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet e79c6804fbb34f5baebdb366f2e0b1bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e79c6804fbb34f5baebdb366f2e0b1bf already in progress: creating tablet
I20260617 20:17:07.342965 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet f02529cd1e764a3886de27d86e9690e3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.343130 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 05494b097ba0480e91d338cf6b50ddc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.343190 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b94d8148cf74a899c3d025f22541bd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.343114 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 08290c23fff5449481789b29d15c4781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.305006 29379 tablet_bootstrap.cc:654] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.347092 29375 tablet_replica.cc:333] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:07.347186 28881 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5559b78afa0d4043971bb433500a21e4
I20260617 20:17:07.347720 29375 raft_consensus.cc:2243] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.348032 28968 tablet_service.cc:1558] Processing DeleteTablet for tablet 5559b78afa0d4043971bb433500a21e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.348105 29375 raft_consensus.cc:2272] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.349529 28968 tablet_service.cc:1511] Processing CreateTablet for tablet 7592de494f9c428fb062ccc94766b784 (DEFAULT_TABLE table=default.Table_cb082a7a5a9a4bc2a3bbec80980daecd [id=92cf868f819444efa0bbc6b0bb233b8e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:07.349920 30313 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.252:46059, user_credentials={real_user=slave}} blocked reactor thread for 57424.5us
I20260617 20:17:07.350263 28957 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0cce8795d34d64a702fc2b92dbfd9a (DEFAULT_TABLE table=default.Table_84c1d2b01f524da3917249139afe19b4 [id=07b0ad409eb74e75bd9d78b40faee1b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.350811 29375 ts_tablet_manager.cc:1916] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.352352 28958 tablet_service.cc:1511] Processing CreateTablet for tablet bcface890a254023b283e28a1770f3f1 (DEFAULT_TABLE table=default.Table_89dd72be1c17431fb9eca41b33a12fc7 [id=77f8609e9cfc4c9ca0ba955bbb7b088b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.353168 28951 tablet_service.cc:1511] Processing CreateTablet for tablet b1b743909bed449f9cacba14d2d93ab8 (DEFAULT_TABLE table=default.Table_ac58b4b8071a43ea8e6c8839689b83dd [id=9a98514409064f4bbfd6c2d962b0d03c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.354096 29383 tablet_bootstrap.cc:492] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.354288 29383 ts_tablet_manager.cc:1403] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.117s user 0.005s sys 0.009s
I20260617 20:17:07.358194 28956 tablet_service.cc:1511] Processing CreateTablet for tablet bb0a3e7952fe421596baf563a3891292 (DEFAULT_TABLE table=default.Table_35fc3c1b8a6c461087e80918d278d106 [id=2822a1c1a34341019a5380cec3062f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.358573 29378 tablet_bootstrap.cc:492] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:07.358758 29378 ts_tablet_manager.cc:1403] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.001s
I20260617 20:17:07.358695 29383 raft_consensus.cc:359] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.358878 29383 raft_consensus.cc:385] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.358948 29383 raft_consensus.cc:740] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.359166 29383 consensus_queue.cc:260] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.359545 28962 tablet_service.cc:1511] Processing CreateTablet for tablet dbc2e5ecad0c41d5a24e0dad708b1a5c (DEFAULT_TABLE table=default.Table_02f58a9f82d14da8b747113572af3a4e [id=21c7cd86b93641e98dacef328e4e5954]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.359808 29378 raft_consensus.cc:359] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.360033 29378 raft_consensus.cc:385] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.360136 29378 raft_consensus.cc:740] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.360421 29378 consensus_queue.cc:260] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.360916 29378 ts_tablet_manager.cc:1434] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:07.359622 29383 ts_tablet_manager.cc:1434] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.000s sys 0.000s
I20260617 20:17:07.361279 29383 tablet_bootstrap.cc:492] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.361224 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1f912a45a64dfab6affbc972d27e6b (DEFAULT_TABLE table=default.Table_411f66b9447a436d8d71bc99a62285fc [id=732a974bd6a84f428014fcc980ed9390]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.362593 29383 tablet_bootstrap.cc:654] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.363965 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 5559b78afa0d4043971bb433500a21e4 (DEFAULT_TABLE table=default.Table_4fe634ef4e354d92a6d2b711acee1d5b [id=c8b745341d0c472e8ef5b78cd3e7742a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.365041 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet f13c7d600d334e549a5abfe0040b3296
I20260617 20:17:07.367405 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1a3d321b3ffa4bc6b94fe6ca3068cda5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.367878 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd7d5f6b8bce44fa8e4065613989bda7 consensus state has no leader
W20260617 20:17:07.367970 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a3d321b3ffa4bc6b94fe6ca3068cda5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.368245 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_24b0bdcfb9354683bf9478d54ffdf945"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.368669 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24b0bdcfb9354683bf9478d54ffdf945 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.371251 29376 ts_tablet_manager.cc:1929] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.371361 29376 log.cc:1199] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/58213ec0a9364a91a15fc0329f28605b
I20260617 20:17:07.371703 29376 ts_tablet_manager.cc:1950] T 58213ec0a9364a91a15fc0329f28605b P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:07.372663 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet d2089215acdf478ca725c9d26b94d692 (table default.Table_1447e53a07e04f0aad77f02ce6c222e7 [id=395d6bc9360549c69d616b8ccf8d01cd]). Expected version 1 got 0
I20260617 20:17:07.372937 28664 catalog_manager.cc:5696] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193). New cstate: current_term: 1 leader_uuid: "5ca3d93189744132bbf55ac01f3a8254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: UNKNOWN } } }
I20260617 20:17:07.373543 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 (table default.Table_9cd011070f8848eeb76b111f2e64f60f [id=475aa0d2f8044cd8b52cf31085dda15d]). Expected version 1 got 0
I20260617 20:17:07.373761 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet f43549813e294796baca2a1a64dbcfb9 (table default.Table_07b69bc96042426b925d4a1072ec0d08 [id=8015a245e8574c7580068edea8104f06]). Expected version 2 got 0
I20260617 20:17:07.374002 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 6efb29f2e56c4838b0efd0171229088a (table default.Table_1e06b58a614b4e83af282cace8749f39 [id=bf54a099a679476485430b505a037ea3]). Expected version 1 got 0
I20260617 20:17:07.375813 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 5559b78afa0d4043971bb433500a21e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.375931 29097 tablet_service.cc:1511] Processing CreateTablet for tablet dbc2e5ecad0c41d5a24e0dad708b1a5c (DEFAULT_TABLE table=default.Table_02f58a9f82d14da8b747113572af3a4e [id=21c7cd86b93641e98dacef328e4e5954]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.376078 29102 tablet_service.cc:1511] Processing CreateTablet for tablet bb0a3e7952fe421596baf563a3891292 (DEFAULT_TABLE table=default.Table_35fc3c1b8a6c461087e80918d278d106 [id=2822a1c1a34341019a5380cec3062f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.376133 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 7592de494f9c428fb062ccc94766b784 (DEFAULT_TABLE table=default.Table_cb082a7a5a9a4bc2a3bbec80980daecd [id=92cf868f819444efa0bbc6b0bb233b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.376261 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc2e5ecad0c41d5a24e0dad708b1a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.376406 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0a3e7952fe421596baf563a3891292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.378244 29096 tablet_service.cc:1511] Processing CreateTablet for tablet bcface890a254023b283e28a1770f3f1 (DEFAULT_TABLE table=default.Table_89dd72be1c17431fb9eca41b33a12fc7 [id=77f8609e9cfc4c9ca0ba955bbb7b088b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.378573 29094 tablet_service.cc:1511] Processing CreateTablet for tablet b1b743909bed449f9cacba14d2d93ab8 (DEFAULT_TABLE table=default.Table_ac58b4b8071a43ea8e6c8839689b83dd [id=9a98514409064f4bbfd6c2d962b0d03c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.379195 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcface890a254023b283e28a1770f3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.380724 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1f912a45a64dfab6affbc972d27e6b (DEFAULT_TABLE table=default.Table_411f66b9447a436d8d71bc99a62285fc [id=732a974bd6a84f428014fcc980ed9390]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.381002 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1f912a45a64dfab6affbc972d27e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.381500 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0cce8795d34d64a702fc2b92dbfd9a (DEFAULT_TABLE table=default.Table_84c1d2b01f524da3917249139afe19b4 [id=07b0ad409eb74e75bd9d78b40faee1b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.381774 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0cce8795d34d64a702fc2b92dbfd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.383770 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b743909bed449f9cacba14d2d93ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.388114 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7592de494f9c428fb062ccc94766b784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.389056 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5f7534d57f1740af8b211d646488c90f
I20260617 20:17:07.389067 28969 tablet_service.cc:1511] Processing CreateTablet for tablet aa626e3cdc7240deaf399b50b0258c50 (DEFAULT_TABLE table=default.Table_f3b595ceaae84ca6a9460b180efc2e5d [id=49945129a97e4fefa0704eeadcaec436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.389282 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet f13c7d600d334e549a5abfe0040b3296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.389542 28667 catalog_manager.cc:6784] ReplaceTablet: tablet 5f7534d57f1740af8b211d646488c90f deleted and replaced by tablet 08062d7b815b49558bbb3811420d5ce5
I20260617 20:17:07.389889 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6c5c337c61df411ba27ebb1e7a4e8ec9" } new_table_name: "default.Table_9cbb96ec056a4e329cf862c7bd244585" modify_external_catalogs: true
I20260617 20:17:07.393388 28959 tablet_service.cc:1511] Processing CreateTablet for tablet 6f256936080443dbae1b538f0fbbd7d4 (DEFAULT_TABLE table=default.Table_5a7af34a137e4cd5bc14d4166ea07903 [id=b4ce945ce47043d68218ebf69c580d3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.397389 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f7534d57f1740af8b211d646488c90f with delete_type TABLET_DATA_DELETED (replaced by tablet 08062d7b815b49558bbb3811420d5ce5) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.397871 28961 tablet_service.cc:1511] Processing CreateTablet for tablet eae5935a4adc4c8dbfa6888c02b2dced (DEFAULT_TABLE table=default.Table_2b5d45aad044441c84c126666d3c05d5 [id=bf23e5dfb99040f2987306a3d260e92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.406801 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_eb9f201319f9403fb808594dd9583fe8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.407596 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb9f201319f9403fb808594dd9583fe8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260617 20:17:07.410113 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2089215acdf478ca725c9d26b94d692 consensus state has no leader
I20260617 20:17:07.410358 28662 master_service.cc:960] ReplaceTablet: received request to replace tablet cb95c048212948dfb00baafbd0c691d9 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:07.415879 29092 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f7534d57f1740af8b211d646488c90f with delete_type TABLET_DATA_DELETED (replaced by tablet 08062d7b815b49558bbb3811420d5ce5) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.416411 29096 tablet_service.cc:1511] Processing CreateTablet for tablet aa626e3cdc7240deaf399b50b0258c50 (DEFAULT_TABLE table=default.Table_f3b595ceaae84ca6a9460b180efc2e5d [id=49945129a97e4fefa0704eeadcaec436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.417129 29096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa626e3cdc7240deaf399b50b0258c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.417526 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 6f256936080443dbae1b538f0fbbd7d4 (DEFAULT_TABLE table=default.Table_5a7af34a137e4cd5bc14d4166ea07903 [id=b4ce945ce47043d68218ebf69c580d3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.417774 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 5559b78afa0d4043971bb433500a21e4 (DEFAULT_TABLE table=default.Table_4fe634ef4e354d92a6d2b711acee1d5b [id=c8b745341d0c472e8ef5b78cd3e7742a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.418074 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f256936080443dbae1b538f0fbbd7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.418418 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet f13c7d600d334e549a5abfe0040b3296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.418613 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5559b78afa0d4043971bb433500a21e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.416776 29102 tablet_service.cc:1511] Processing CreateTablet for tablet ea82d485fe0e4f7fac5c6374f51d7bb4 (DEFAULT_TABLE table=default.Table_25485c53fc824593aebd48840afae10e [id=4f66039ab9ea457fa2bc42d45a087826]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.420389 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea82d485fe0e4f7fac5c6374f51d7bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.429900 28954 tablet_service.cc:1511] Processing CreateTablet for tablet ea82d485fe0e4f7fac5c6374f51d7bb4 (DEFAULT_TABLE table=default.Table_25485c53fc824593aebd48840afae10e [id=4f66039ab9ea457fa2bc42d45a087826]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:07.431722 29197 consensus_peers.cc:597] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:07.432402 29089 tablet_service.cc:1511] Processing CreateTablet for tablet eae5935a4adc4c8dbfa6888c02b2dced (DEFAULT_TABLE table=default.Table_2b5d45aad044441c84c126666d3c05d5 [id=bf23e5dfb99040f2987306a3d260e92a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.432972 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae5935a4adc4c8dbfa6888c02b2dced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.436254 28968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7592de494f9c428fb062ccc94766b784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.436553 28951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b743909bed449f9cacba14d2d93ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.436839 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0a3e7952fe421596baf563a3891292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.437032 28958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcface890a254023b283e28a1770f3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.441442 28957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0cce8795d34d64a702fc2b92dbfd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.442667 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc2e5ecad0c41d5a24e0dad708b1a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.443516 28959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f256936080443dbae1b538f0fbbd7d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.443653 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae5935a4adc4c8dbfa6888c02b2dced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.445513 29378 tablet_bootstrap.cc:492] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:07.447451 29378 tablet_bootstrap.cc:654] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.454591 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 05494b097ba0480e91d338cf6b50ddc8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.454668 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 5559b78afa0d4043971bb433500a21e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.455062 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 08290c23fff5449481789b29d15c4781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:06 UTC) from {username='slave'} at 127.0.0.1:41028
W20260617 20:17:07.456899 28666 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc0081e8742248a0ba088006a905ce85 consensus state has no leader
I20260617 20:17:07.449663 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea82d485fe0e4f7fac5c6374f51d7bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.460678 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1ba25cf94e2c4be8a766c5e248de7a85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.461251 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ba25cf94e2c4be8a766c5e248de7a85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.461434 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa626e3cdc7240deaf399b50b0258c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.462762 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f81311971e2a4b36a7bf5ac219b8ab58"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.463451 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f81311971e2a4b36a7bf5ac219b8ab58 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.463943 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 829) took 4504 ms. Trace:
I20260617 20:17:07.464043 29376 rpcz_store.cc:276] 0617 20:17:02.960093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.960442 (+ 349us) service_pool.cc:224] Handling call
0617 20:17:07.189693 (+4229251us) ts_tablet_manager.cc:1151] Deleting tablet 58213ec0a9364a91a15fc0329f28605b
0617 20:17:07.189704 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.322668 (+132964us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.371194 (+ 48526us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.463920 (+ 92726us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4229063}
I20260617 20:17:07.464385 29376 tablet_replica.cc:333] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:07.464563 29376 raft_consensus.cc:2243] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:07.464862 29376 raft_consensus.cc:2272] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.465487 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1f912a45a64dfab6affbc972d27e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.466854 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b94d8148cf74a899c3d025f22541bd9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.468700 29225 tablet_service.cc:1558] Processing DeleteTablet for tablet 5559b78afa0d4043971bb433500a21e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.468770 29375 ts_tablet_manager.cc:1929] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.468868 29375 log.cc:1199] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/b4240e14b48f4a43b7ce9c6512fc7ff2
I20260617 20:17:07.469183 29375 ts_tablet_manager.cc:1950] T b4240e14b48f4a43b7ce9c6512fc7ff2 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:07.469810 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5559b78afa0d4043971bb433500a21e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.469892 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 7592de494f9c428fb062ccc94766b784 (DEFAULT_TABLE table=default.Table_cb082a7a5a9a4bc2a3bbec80980daecd [id=92cf868f819444efa0bbc6b0bb233b8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.470041 29383 tablet_bootstrap.cc:492] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.470155 29383 ts_tablet_manager.cc:1403] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.109s user 0.001s sys 0.009s
I20260617 20:17:07.470249 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7592de494f9c428fb062ccc94766b784. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.470800 29383 raft_consensus.cc:359] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.470952 29383 raft_consensus.cc:385] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.470997 29383 raft_consensus.cc:740] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.471174 29383 consensus_queue.cc:260] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.471998 29383 ts_tablet_manager.cc:1434] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:07.472234 29383 tablet_bootstrap.cc:492] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.473564 29383 tablet_bootstrap.cc:654] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.473848 30294 raft_consensus.cc:493] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ca3d93189744132bbf55ac01f3a8254)
I20260617 20:17:07.473989 30294 raft_consensus.cc:515] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.474645 30294 leader_election.cc:290] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:07.475975 29062 leader_election.cc:343] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 8a5d9677bc184c30be1a11bfa85a97c8
I20260617 20:17:07.482307 29241 tablet_service.cc:1511] Processing CreateTablet for tablet bcface890a254023b283e28a1770f3f1 (DEFAULT_TABLE table=default.Table_89dd72be1c17431fb9eca41b33a12fc7 [id=77f8609e9cfc4c9ca0ba955bbb7b088b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.482654 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcface890a254023b283e28a1770f3f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.482758 29225 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0cce8795d34d64a702fc2b92dbfd9a (DEFAULT_TABLE table=default.Table_84c1d2b01f524da3917249139afe19b4 [id=07b0ad409eb74e75bd9d78b40faee1b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.483160 29225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0cce8795d34d64a702fc2b92dbfd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.483428 30878 catalog_manager.cc:1294] Loaded cluster ID: 46a5ac7d37d748d69d2d5bbcb74d8c61
I20260617 20:17:07.483528 30878 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: loading cluster ID for follower catalog manager: success
I20260617 20:17:07.484961 29376 ts_tablet_manager.cc:1916] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.485503 29224 tablet_service.cc:1511] Processing CreateTablet for tablet b1b743909bed449f9cacba14d2d93ab8 (DEFAULT_TABLE table=default.Table_ac58b4b8071a43ea8e6c8839689b83dd [id=9a98514409064f4bbfd6c2d962b0d03c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.485808 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b743909bed449f9cacba14d2d93ab8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:07.485837 28636 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 53567.3us
I20260617 20:17:07.489377 29379 tablet_bootstrap.cc:492] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:07.489507 29379 ts_tablet_manager.cc:1403] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.205s user 0.006s sys 0.002s
I20260617 20:17:07.489511 29226 tablet_service.cc:1511] Processing CreateTablet for tablet bb0a3e7952fe421596baf563a3891292 (DEFAULT_TABLE table=default.Table_35fc3c1b8a6c461087e80918d278d106 [id=2822a1c1a34341019a5380cec3062f69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.489809 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb0a3e7952fe421596baf563a3891292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.490803 29379 raft_consensus.cc:359] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.490969 29379 raft_consensus.cc:385] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.491021 29379 raft_consensus.cc:740] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.491205 29379 consensus_queue.cc:260] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.493777 29242 tablet_service.cc:1511] Processing CreateTablet for tablet dbc2e5ecad0c41d5a24e0dad708b1a5c (DEFAULT_TABLE table=default.Table_02f58a9f82d14da8b747113572af3a4e [id=21c7cd86b93641e98dacef328e4e5954]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.494055 29242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc2e5ecad0c41d5a24e0dad708b1a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.497459 29379 ts_tablet_manager.cc:1434] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260617 20:17:07.501965 28668 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 87d0e2ecc16e4285a1d8337a5336caf2 (table default.Table_724f440ee4704ab9b73c964377608058 [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]). Expected version 1 got 0
I20260617 20:17:07.503165 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 815) took 4318 ms. Trace:
I20260617 20:17:07.503340 29375 rpcz_store.cc:276] 0617 20:17:03.184738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.184794 (+ 56us) service_pool.cc:224] Handling call
0617 20:17:07.347045 (+4162251us) ts_tablet_manager.cc:1151] Deleting tablet b4240e14b48f4a43b7ce9c6512fc7ff2
0617 20:17:07.347054 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.441529 (+ 94475us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.468713 (+ 27184us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.503145 (+ 34432us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4162024}
I20260617 20:17:07.503953 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 816) took 4315 ms. Trace:
I20260617 20:17:07.504081 29375 rpcz_store.cc:276] 0617 20:17:03.188819 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.188873 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:07.503860 (+4314987us) ts_tablet_manager.cc:1151] Deleting tablet 46ea43994a0a42fe9e16d7bc6a2118e6
0617 20:17:07.503869 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.503938 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4314821}
I20260617 20:17:07.504582 29379 tablet_bootstrap.cc:492] T fa123fc62a594dd19f20b520760fe6c4 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:07.504724 29375 tablet_replica.cc:333] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:07.504953 29375 raft_consensus.cc:2243] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.505174 29375 raft_consensus.cc:2272] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:07.508576 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7381c348acbd462b8e04587b2eb948b6 consensus state has no leader
I20260617 20:17:07.514460 29375 ts_tablet_manager.cc:1916] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.514665 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 6f256936080443dbae1b538f0fbbd7d4 (DEFAULT_TABLE table=default.Table_5a7af34a137e4cd5bc14d4166ea07903 [id=b4ce945ce47043d68218ebf69c580d3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.515051 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_24dde6dc70d64bee8c127475dac477af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:07.515358 29229 tablet_service.cc:1511] Processing CreateTablet for tablet eae5935a4adc4c8dbfa6888c02b2dced (DEFAULT_TABLE table=default.Table_2b5d45aad044441c84c126666d3c05d5 [id=bf23e5dfb99040f2987306a3d260e92a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:07.515640 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24dde6dc70d64bee8c127475dac477af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.515986 29235 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f7534d57f1740af8b211d646488c90f with delete_type TABLET_DATA_DELETED (replaced by tablet 08062d7b815b49558bbb3811420d5ce5) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.516947 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 5559b78afa0d4043971bb433500a21e4 (DEFAULT_TABLE table=default.Table_4fe634ef4e354d92a6d2b711acee1d5b [id=c8b745341d0c472e8ef5b78cd3e7742a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.517230 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet f13c7d600d334e549a5abfe0040b3296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.517632 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f256936080443dbae1b538f0fbbd7d4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:07.518172 29198 consensus_peers.cc:597] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:07.518517 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet b4240e14b48f4a43b7ce9c6512fc7ff2 (table default.Table_d3c4a4f115524492993663ad7da2da7a [id=c35dbd440308443187b41417db2068f9]) successfully deleted
W20260617 20:17:07.518764 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 46ea43994a0a42fe9e16d7bc6a2118e6 because the tablet was not found. No further retry: Not found: Tablet not found: 46ea43994a0a42fe9e16d7bc6a2118e6
I20260617 20:17:07.521968 29235 tablet_service.cc:1511] Processing CreateTablet for tablet ea82d485fe0e4f7fac5c6374f51d7bb4 (DEFAULT_TABLE table=default.Table_25485c53fc824593aebd48840afae10e [id=4f66039ab9ea457fa2bc42d45a087826]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.522238 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 58213ec0a9364a91a15fc0329f28605b (table default.Table_d4f8ff9bb47c440b96251b7d063e73f6 [id=b267380ca82144ebbc909227070c204e]) successfully deleted
I20260617 20:17:07.522302 29235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea82d485fe0e4f7fac5c6374f51d7bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.523294 29376 ts_tablet_manager.cc:1929] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.523377 29376 log.cc:1199] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/5faea831376646c1bdfcaf8fbbc7ca6d
I20260617 20:17:07.523779 29376 ts_tablet_manager.cc:1950] T 5faea831376646c1bdfcaf8fbbc7ca6d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:07.524499 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 830) took 4563 ms. Trace:
I20260617 20:17:07.524570 29376 rpcz_store.cc:276] 0617 20:17:02.961072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.961117 (+ 45us) service_pool.cc:224] Handling call
0617 20:17:07.464339 (+4503222us) ts_tablet_manager.cc:1151] Deleting tablet 5faea831376646c1bdfcaf8fbbc7ca6d
0617 20:17:07.464347 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.487629 (+ 23282us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.523244 (+ 35615us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.524480 (+ 1236us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4503101}
I20260617 20:17:07.524825 29376 tablet_replica.cc:333] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:07.525017 29376 raft_consensus.cc:2243] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:07.511282 29379 tablet_bootstrap.cc:654] T fa123fc62a594dd19f20b520760fe6c4 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.525434 30910 tablet.cc:1724] T e7eb77c619e04c448a084638668dbb6a P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:07.525537 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_367156c006bc4543b26e6c3c6cb494a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.526067 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_367156c006bc4543b26e6c3c6cb494a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.526149 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eae5935a4adc4c8dbfa6888c02b2dced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.531340 29375 ts_tablet_manager.cc:1929] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.532145 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 8d1f912a45a64dfab6affbc972d27e6b (DEFAULT_TABLE table=default.Table_411f66b9447a436d8d71bc99a62285fc [id=732a974bd6a84f428014fcc980ed9390]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.532507 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d1f912a45a64dfab6affbc972d27e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.533238 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 5faea831376646c1bdfcaf8fbbc7ca6d (table default.Table_230ee4baedc44720869f17501e15a05e [id=aa54066da9fc4f3db61a51b59db1afb6]) successfully deleted
I20260617 20:17:07.539310 28663 master_service.cc:960] ReplaceTablet: received request to replace tablet fc0081e8742248a0ba088006a905ce85 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:07.544459 30787 raft_consensus.cc:493] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.544605 30787 raft_consensus.cc:515] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:07.533015 29063 leader_election.cc:343] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 8a5d9677bc184c30be1a11bfa85a97c8
I20260617 20:17:07.544867 29375 log.cc:1199] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/18440a4a5c254a25b87f8632de9c92b9
I20260617 20:17:07.544904 29063 leader_election.cc:304] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:07.545245 29375 ts_tablet_manager.cc:1950] T 18440a4a5c254a25b87f8632de9c92b9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:07.545382 30294 raft_consensus.cc:2749] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:07.525266 29376 raft_consensus.cc:2272] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.546413 29376 ts_tablet_manager.cc:1916] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.549409 28670 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_724f440ee4704ab9b73c964377608058 [id=bcc2e0ae5e6b4ab9b36f37350872c6f8] alter complete (version 1)
I20260617 20:17:07.550508 28670 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6d8d8942e21d4268b530c31639fc4d09" } modify_external_catalogs: true
I20260617 20:17:07.550689 28670 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6d8d8942e21d4268b530c31639fc4d09" } modify_external_catalogs: true
I20260617 20:17:07.551023 29241 tablet_service.cc:1511] Processing CreateTablet for tablet aa626e3cdc7240deaf399b50b0258c50 (DEFAULT_TABLE table=default.Table_f3b595ceaae84ca6a9460b180efc2e5d [id=49945129a97e4fefa0704eeadcaec436]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:07.551362 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa626e3cdc7240deaf399b50b0258c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.552193 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_02f58a9f82d14da8b747113572af3a4e" } modify_external_catalogs: true
I20260617 20:17:07.552353 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_02f58a9f82d14da8b747113572af3a4e" } modify_external_catalogs: true
I20260617 20:17:07.553503 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5559b78afa0d4043971bb433500a21e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:07.553661 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet cb95c048212948dfb00baafbd0c691d9
I20260617 20:17:07.554100 28662 catalog_manager.cc:6784] ReplaceTablet: tablet cb95c048212948dfb00baafbd0c691d9 deleted and replaced by tablet b6b783ff58d643fda6ba016173200063
I20260617 20:17:07.554440 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a1253aa407ca4f668a179dd0a7b0f40e" } modify_external_catalogs: true
I20260617 20:17:07.554582 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a1253aa407ca4f668a179dd0a7b0f40e" } modify_external_catalogs: true
I20260617 20:17:07.555725 29376 ts_tablet_manager.cc:1929] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.555809 29376 log.cc:1199] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/fed593a3fa7742a18ccc2124c3ee0fb9
I20260617 20:17:07.556124 29376 ts_tablet_manager.cc:1950] T fed593a3fa7742a18ccc2124c3ee0fb9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:07.556831 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 831) took 4592 ms. Trace:
I20260617 20:17:07.556901 29376 rpcz_store.cc:276] 0617 20:17:02.964921 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.965032 (+ 111us) service_pool.cc:224] Handling call
0617 20:17:07.524788 (+4559756us) ts_tablet_manager.cc:1151] Deleting tablet fed593a3fa7742a18ccc2124c3ee0fb9
0617 20:17:07.524797 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.552934 (+ 28137us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.555681 (+ 2747us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.556813 (+ 1132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4559615}
I20260617 20:17:07.557641 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5d147a20f3c047e2b5a9c4d61739120a" } modify_external_catalogs: true
I20260617 20:17:07.557803 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_5d147a20f3c047e2b5a9c4d61739120a" } modify_external_catalogs: true
I20260617 20:17:07.561978 29377 ts_tablet_manager.cc:1929] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:07.562100 29377 log.cc:1199] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/30f6dcc384154d41866cf8060cf05837
I20260617 20:17:07.565251 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95c048212948dfb00baafbd0c691d9 with delete_type TABLET_DATA_DELETED (replaced by tablet b6b783ff58d643fda6ba016173200063) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.565403 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet e79c6804fbb34f5baebdb366f2e0b1bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.566075 29383 tablet_bootstrap.cc:492] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.566211 28669 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c6b928749f3c47948dc6d24894ac5e25" } new_table_name: "default.Table_20640097ea6e4184ac6fb53704a54d25" modify_external_catalogs: true
I20260617 20:17:07.566430 29383 ts_tablet_manager.cc:1403] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.094s user 0.003s sys 0.000s
I20260617 20:17:07.567292 29383 raft_consensus.cc:359] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.567433 29383 raft_consensus.cc:385] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.567579 29383 raft_consensus.cc:740] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.567802 29383 consensus_queue.cc:260] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.568542 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 370db89a92a6455190edaf80e5a56205 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.572382 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 817) took 4380 ms. Trace:
I20260617 20:17:07.572535 29375 rpcz_store.cc:276] 0617 20:17:03.192291 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.192336 (+ 45us) service_pool.cc:224] Handling call
0617 20:17:07.504619 (+4312283us) ts_tablet_manager.cc:1151] Deleting tablet 18440a4a5c254a25b87f8632de9c92b9
0617 20:17:07.504627 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.528634 (+ 24007us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.531292 (+ 2658us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.572353 (+ 41061us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4312135}
I20260617 20:17:07.574687 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet fed593a3fa7742a18ccc2124c3ee0fb9 (table default.Table_726c0ba5eb5442e68a5c029d25fb209c [id=dcdfecb6a9634f42b1b11a02b9dd7ec2]) successfully deleted
I20260617 20:17:07.575179 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 27c20f436b9b4a8cb659215f9579af04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:04 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.575300 29378 tablet_bootstrap.cc:492] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:07.575235 29375 tablet_replica.cc:333] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:07.575433 29378 ts_tablet_manager.cc:1403] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.130s user 0.002s sys 0.006s
I20260617 20:17:07.575420 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe with delete_type TABLET_DATA_DELETED (replaced by tablet 5a20867de1214c0fb4cb8504e8361c5b) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.575525 29375 raft_consensus.cc:2243] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.575616 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95c048212948dfb00baafbd0c691d9 with delete_type TABLET_DATA_DELETED (replaced by tablet b6b783ff58d643fda6ba016173200063) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.575174 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c59cf5f5e8486baf1e038a44657f33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:03 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.575680 29375 raft_consensus.cc:2272] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.576622 29377 ts_tablet_manager.cc:1950] T 30f6dcc384154d41866cf8060cf05837 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:07.576944 29375 ts_tablet_manager.cc:1916] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.578395 30787 leader_election.cc:290] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:07.590312 30878 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: acquiring CA information for follower catalog manager: success
I20260617 20:17:07.593137 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 18440a4a5c254a25b87f8632de9c92b9 (table default.Table_c7b9c867be6c4fa3b58557f0b4d1876b [id=4ed00f8c66674fc99d8742599241bb77]) successfully deleted
I20260617 20:17:07.594039 29383 ts_tablet_manager.cc:1434] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.027s user 0.001s sys 0.000s
I20260617 20:17:07.594393 29383 tablet_bootstrap.cc:492] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.598567 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet cb95c048212948dfb00baafbd0c691d9 with delete_type TABLET_DATA_DELETED (replaced by tablet b6b783ff58d643fda6ba016173200063) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.601449 28666 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet a3e20a1092b746a8b8ddd4386a682229 (table default.Table_8b3f418465f142c784a9c20784e64477 [id=a3772e01cb314c7e88e85833d727617d]). Expected version 2 got 0
I20260617 20:17:07.602322 28666 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet e7eb77c619e04c448a084638668dbb6a (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]). Expected version 1 got 0
I20260617 20:17:07.602708 28666 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 (table default.Table_9cd011070f8848eeb76b111f2e64f60f [id=475aa0d2f8044cd8b52cf31085dda15d]). Expected version 1 got 0
I20260617 20:17:07.603121 28668 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca] alter complete (version 2)
I20260617 20:17:07.613520 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 832) took 4648 ms. Trace:
I20260617 20:17:07.613643 29376 rpcz_store.cc:276] 0617 20:17:02.965345 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:02.965429 (+ 84us) service_pool.cc:224] Handling call
0617 20:17:07.613383 (+4647954us) ts_tablet_manager.cc:1151] Deleting tablet f24954093a45411a9cbe39415fb1adb7
0617 20:17:07.613396 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.613489 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4647773}
W20260617 20:17:07.614727 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f24954093a45411a9cbe39415fb1adb7 because the tablet was not found. No further retry: Not found: Tablet not found: f24954093a45411a9cbe39415fb1adb7
I20260617 20:17:07.616001 29379 tablet_bootstrap.cc:492] T fa123fc62a594dd19f20b520760fe6c4 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:07.616147 29379 ts_tablet_manager.cc:1403] T fa123fc62a594dd19f20b520760fe6c4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.112s user 0.004s sys 0.003s
I20260617 20:17:07.616200 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f786ef7bfe62418fac5124168a78cac1" } modify_external_catalogs: true
I20260617 20:17:07.616406 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f786ef7bfe62418fac5124168a78cac1" } modify_external_catalogs: true
I20260617 20:17:07.616971 29379 raft_consensus.cc:359] T fa123fc62a594dd19f20b520760fe6c4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.617121 29379 raft_consensus.cc:385] T fa123fc62a594dd19f20b520760fe6c4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.617168 29379 raft_consensus.cc:740] T fa123fc62a594dd19f20b520760fe6c4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.617283 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 840) took 4430 ms. Trace:
I20260617 20:17:07.617389 29379 consensus_queue.cc:260] T fa123fc62a594dd19f20b520760fe6c4 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.617395 29376 rpcz_store.cc:276] 0617 20:17:03.187804 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.188053 (+ 249us) service_pool.cc:224] Handling call
0617 20:17:07.617130 (+4429077us) ts_tablet_manager.cc:1151] Deleting tablet e79c6804fbb34f5baebdb366f2e0b1bf
0617 20:17:07.617143 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.617261 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4428911}
I20260617 20:17:07.617870 29379 ts_tablet_manager.cc:1434] T fa123fc62a594dd19f20b520760fe6c4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:07.617939 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 844) took 4277 ms. Trace:
I20260617 20:17:07.618014 29376 rpcz_store.cc:276] 0617 20:17:03.341002 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.341051 (+ 49us) service_pool.cc:224] Handling call
0617 20:17:07.617829 (+4276778us) ts_tablet_manager.cc:1151] Deleting tablet add6e21cef3b4c02910486841e36ce4a
0617 20:17:07.617840 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.617923 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4276562}
I20260617 20:17:07.618772 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_8d05c7ebda0b4513a30b51d3248efb1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.619304 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d05c7ebda0b4513a30b51d3248efb1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.620512 29375 ts_tablet_manager.cc:1929] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.620764 29376 tablet_replica.cc:333] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:07.621016 29376 raft_consensus.cc:2243] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
W20260617 20:17:07.621049 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet e79c6804fbb34f5baebdb366f2e0b1bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e79c6804fbb34f5baebdb366f2e0b1bf already in progress: creating tablet
W20260617 20:17:07.621379 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet add6e21cef3b4c02910486841e36ce4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet add6e21cef3b4c02910486841e36ce4a already in progress: creating tablet
I20260617 20:17:07.622737 29376 raft_consensus.cc:2272] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.623634 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 894) took 2693 ms. Trace:
I20260617 20:17:07.623893 29376 ts_tablet_manager.cc:1916] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.623737 29377 rpcz_store.cc:276] 0617 20:17:04.930300 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.930611 (+ 311us) service_pool.cc:224] Handling call
0617 20:17:07.307360 (+2376749us) ts_tablet_manager.cc:1151] Deleting tablet 30f6dcc384154d41866cf8060cf05837
0617 20:17:07.326507 (+ 19147us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.354506 (+ 27999us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.561918 (+207412us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.623612 (+ 61694us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2376621}
I20260617 20:17:07.627521 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 30f6dcc384154d41866cf8060cf05837 (table default.Table_ffa0c6d530ee478f9cd5bc64e8d1ed83 [id=9c7d75a5ae9147a2850f090b0c67ea33]) successfully deleted
I20260617 20:17:07.631481 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet fc0081e8742248a0ba088006a905ce85
I20260617 20:17:07.632056 28663 catalog_manager.cc:6784] ReplaceTablet: tablet fc0081e8742248a0ba088006a905ce85 deleted and replaced by tablet af7d6e3fbaa141b9ab2970d1ae02d989
I20260617 20:17:07.632414 28663 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d98a23fa3bd844be97030f42b77ce612" } new_table_name: "default.Table_dff75187402b408b81d75a7c7619d2d5" modify_external_catalogs: true
I20260617 20:17:07.633550 28670 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 29c65bb7c45e40a081de91d4c1c5cf56
I20260617 20:17:07.634272 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 58213ec0a9364a91a15fc0329f28605b with delete_type TABLET_DATA_DELETED (replaced by tablet 43462cf7003747d08e6b0e5db5999b3f) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.634290 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c77f056453554773a2687ccba8bb4056"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.634822 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c77f056453554773a2687ccba8bb4056 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.637413 29375 log.cc:1199] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/cf8d04ef8acd4fcaa69df9253cd89462
I20260617 20:17:07.638000 29375 ts_tablet_manager.cc:1950] T cf8d04ef8acd4fcaa69df9253cd89462 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:07.640847 29377 tablet_replica.cc:333] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:07.641835 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet fc0081e8742248a0ba088006a905ce85 with delete_type TABLET_DATA_DELETED (replaced by tablet af7d6e3fbaa141b9ab2970d1ae02d989) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.642051 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 818) took 4446 ms. Trace:
I20260617 20:17:07.643551 29377 raft_consensus.cc:2243] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.643726 29377 raft_consensus.cc:2272] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.643721 29375 rpcz_store.cc:276] 0617 20:17:03.195939 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.195990 (+ 51us) service_pool.cc:224] Handling call
0617 20:17:07.575181 (+4379191us) ts_tablet_manager.cc:1151] Deleting tablet cf8d04ef8acd4fcaa69df9253cd89462
0617 20:17:07.575192 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.580519 (+ 5327us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.620454 (+ 39935us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.642027 (+ 21573us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4379013}
I20260617 20:17:07.644263 29377 ts_tablet_manager.cc:1916] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.644346 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet fc0081e8742248a0ba088006a905ce85 with delete_type TABLET_DATA_DELETED (replaced by tablet af7d6e3fbaa141b9ab2970d1ae02d989) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.643298 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet fc0081e8742248a0ba088006a905ce85 with delete_type TABLET_DATA_DELETED (replaced by tablet af7d6e3fbaa141b9ab2970d1ae02d989) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.644572 29375 tablet_replica.cc:333] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:07.645241 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet 29c65bb7c45e40a081de91d4c1c5cf56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.645342 29375 raft_consensus.cc:2243] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.645504 29375 raft_consensus.cc:2272] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.645820 29383 tablet_bootstrap.cc:654] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.646760 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 29c65bb7c45e40a081de91d4c1c5cf56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.646919 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet cf8d04ef8acd4fcaa69df9253cd89462 (table default.Table_4de9b511b49b48cca1674d8532df65cd [id=7ba43f49c1924ed0acfb4c453dc8d0f9]) successfully deleted
I20260617 20:17:07.647554 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet 29c65bb7c45e40a081de91d4c1c5cf56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.650578 29376 ts_tablet_manager.cc:1929] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:07.647532 29375 ts_tablet_manager.cc:1916] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.651602 29378 raft_consensus.cc:359] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.651798 29378 raft_consensus.cc:385] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.651854 29378 raft_consensus.cc:740] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.652051 29378 consensus_queue.cc:260] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.664239 29375 ts_tablet_manager.cc:1929] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.667793 29376 log.cc:1199] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/91c99389d24d4a8d8c934f0a9b9c2825
I20260617 20:17:07.668309 29376 ts_tablet_manager.cc:1950] T 91c99389d24d4a8d8c934f0a9b9c2825 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:07.669045 29378 ts_tablet_manager.cc:1434] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.094s user 0.001s sys 0.005s
I20260617 20:17:07.669166 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 843) took 4328 ms. Trace:
I20260617 20:17:07.669260 29376 rpcz_store.cc:276] 0617 20:17:03.340663 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.340755 (+ 92us) service_pool.cc:224] Handling call
0617 20:17:07.620714 (+4279959us) ts_tablet_manager.cc:1151] Deleting tablet 91c99389d24d4a8d8c934f0a9b9c2825
0617 20:17:07.620724 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.640127 (+ 19403us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.650513 (+ 10386us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.669143 (+ 18630us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4267682}
I20260617 20:17:07.661931 29383 tablet_bootstrap.cc:492] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.669588 29378 tablet_bootstrap.cc:492] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:07.669715 29383 ts_tablet_manager.cc:1403] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.075s user 0.002s sys 0.002s
I20260617 20:17:07.669801 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet dbc2e5ecad0c41d5a24e0dad708b1a5c
I20260617 20:17:07.670398 29383 raft_consensus.cc:359] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.670578 29383 raft_consensus.cc:385] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.670578 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_39641ab506b845759f012df286383321" } new_table_name: "default.Table_ab1320db24234450830394363e3d77d8" modify_external_catalogs: true
I20260617 20:17:07.670629 29383 raft_consensus.cc:740] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.671291 29383 consensus_queue.cc:260] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.671736 29383 ts_tablet_manager.cc:1434] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:07.671845 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 841664f40c02423095bb9e63b85006a6
I20260617 20:17:07.671983 29383 tablet_bootstrap.cc:492] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.672490 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b7a26cb68df548f9b716c72e36b11647
W20260617 20:17:07.673132 28669 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a5aca2e76c34c17b17a5593dc5eefe9 has no consensus state
I20260617 20:17:07.673421 28668 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855] alter complete (version 2)
I20260617 20:17:07.673563 29383 tablet_bootstrap.cc:654] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.674893 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 75e3e15cade7403fa70096516d83c3c0
I20260617 20:17:07.674057 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 846) took 4177 ms. Trace:
I20260617 20:17:07.675891 29376 rpcz_store.cc:276] 0617 20:17:03.497102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.504872 (+ 7770us) service_pool.cc:224] Handling call
0617 20:17:07.673933 (+4169061us) ts_tablet_manager.cc:1151] Deleting tablet 5a09fbb3e8eb4b66acba0d6b572713ef
0617 20:17:07.673943 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.674041 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4168516}
I20260617 20:17:07.676764 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 847) took 4179 ms. Trace:
I20260617 20:17:07.676839 29376 rpcz_store.cc:276] 0617 20:17:03.497402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.505472 (+ 8070us) service_pool.cc:224] Handling call
0617 20:17:07.676646 (+4171174us) ts_tablet_manager.cc:1151] Deleting tablet c141dde259d44f4c88db5236190259a7
0617 20:17:07.676656 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.676747 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4170858}
I20260617 20:17:07.677956 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 848) took 4180 ms. Trace:
I20260617 20:17:07.678025 29376 rpcz_store.cc:276] 0617 20:17:03.497630 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.505900 (+ 8270us) service_pool.cc:224] Handling call
0617 20:17:07.677839 (+4171939us) ts_tablet_manager.cc:1151] Deleting tablet d192d11683dc4b558cd3c3f965e657f9
0617 20:17:07.677847 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.677928 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4171702}
I20260617 20:17:07.687134 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_b25f36c0ba1247f5a4b85a5b4add8420 [id=6a948594185b42128136770dbe3f0ffb]) successfully deleted
W20260617 20:17:07.687412 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 5a09fbb3e8eb4b66acba0d6b572713ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a09fbb3e8eb4b66acba0d6b572713ef already in progress: creating tablet
W20260617 20:17:07.687615 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet c141dde259d44f4c88db5236190259a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c141dde259d44f4c88db5236190259a7 already in progress: creating tablet
I20260617 20:17:07.688628 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet dbc2e5ecad0c41d5a24e0dad708b1a5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.688840 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 841664f40c02423095bb9e63b85006a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.689322 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet f823290351d542179b8bcc683d7acf6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.689366 29226 tablet_service.cc:1558] Processing DeleteTablet for tablet b7a26cb68df548f9b716c72e36b11647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.689440 30878 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260617 20:17:07.689522 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 99a3d9ae347845dfa9357010819ebc58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.689534 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 75e3e15cade7403fa70096516d83c3c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.689796 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 5df6af49cb484f59ad1f32235753e1db with delete_type TABLET_DATA_DELETED (replaced by tablet 663dbe73689d4849a85b68a79ea4062c) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.689998 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 39ca961cfea54a7187cc7ea8d16a627f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.690987 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 849) took 3986 ms. Trace:
I20260617 20:17:07.691061 29376 rpcz_store.cc:276] 0617 20:17:03.704284 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.704332 (+ 48us) service_pool.cc:224] Handling call
0617 20:17:07.690865 (+3986533us) ts_tablet_manager.cc:1151] Deleting tablet d5e5d246ea0e474e81edfc7e88001321
0617 20:17:07.690875 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.690970 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3986347}
I20260617 20:17:07.692416 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 850) took 3766 ms. Trace:
I20260617 20:17:07.692407 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet b7a26cb68df548f9b716c72e36b11647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.692503 29376 rpcz_store.cc:276] 0617 20:17:03.925625 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.925742 (+ 117us) service_pool.cc:224] Handling call
0617 20:17:07.692311 (+3766569us) ts_tablet_manager.cc:1151] Deleting tablet 3e11c8b69b704e959e4463f565bf89ab
0617 20:17:07.692321 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.692400 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3750135}
I20260617 20:17:07.692724 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 841664f40c02423095bb9e63b85006a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.692885 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet 75e3e15cade7403fa70096516d83c3c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:07.692997 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet dbc2e5ecad0c41d5a24e0dad708b1a5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:55834
W20260617 20:17:07.693248 28925 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 146244us
I20260617 20:17:07.690239 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 841664f40c02423095bb9e63b85006a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.690385 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet b7a26cb68df548f9b716c72e36b11647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.694571 29375 log.cc:1199] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/488b06f05d9b4273a61bcb2d6e0ad796
I20260617 20:17:07.694784 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ec778da4c9467d90c7151f36ffaa79" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:07.695919 29375 ts_tablet_manager.cc:1950] T 488b06f05d9b4273a61bcb2d6e0ad796 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:17:07.696022 28925 leader_election.cc:343] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.693802 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 851) took 3573 ms. Trace:
I20260617 20:17:07.696411 29376 rpcz_store.cc:276] 0617 20:17:04.120155 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.120214 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:07.693698 (+3573484us) ts_tablet_manager.cc:1151] Deleting tablet 519719a748f441c58689172dffb54394
0617 20:17:07.693707 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.693785 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3573264}
I20260617 20:17:07.697422 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 861) took 3191 ms. Trace:
I20260617 20:17:07.696098 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ec778da4c9467d90c7151f36ffaa79" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:07.697495 29376 rpcz_store.cc:276] 0617 20:17:04.506335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.506401 (+ 66us) service_pool.cc:224] Handling call
0617 20:17:07.697339 (+3190938us) ts_tablet_manager.cc:1151] Deleting tablet dcd999d88d954e50810cc01b297a27a9
0617 20:17:07.697348 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.697405 (+ 57us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3190690}
I20260617 20:17:07.690529 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet dbc2e5ecad0c41d5a24e0dad708b1a5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.690594 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet 30f6dcc384154d41866cf8060cf05837 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:53 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.690725 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 75e3e15cade7403fa70096516d83c3c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.698082 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ff10865b6d2c4c6d9ab53cc4154f7340"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:07.698484 29379 tablet_bootstrap.cc:492] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:17:07.698697 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff10865b6d2c4c6d9ab53cc4154f7340 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.698971 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 852) took 3193 ms. Trace:
I20260617 20:17:07.699041 29376 rpcz_store.cc:276] 0617 20:17:04.505494 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.506939 (+ 1445us) service_pool.cc:224] Handling call
0617 20:17:07.698842 (+3191903us) ts_tablet_manager.cc:1151] Deleting tablet 6ea0168fa86547f68c7fec880b8d8f1e
0617 20:17:07.698852 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.698953 (+ 101us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3191709}
I20260617 20:17:07.700930 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 855) took 3195 ms. Trace:
I20260617 20:17:07.701013 29376 rpcz_store.cc:276] 0617 20:17:04.505756 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.507490 (+ 1734us) service_pool.cc:224] Handling call
0617 20:17:07.700823 (+3193333us) ts_tablet_manager.cc:1151] Deleting tablet c83fa97268f045d6aa60413dfa96ebbd
0617 20:17:07.700831 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.700914 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3193152}
I20260617 20:17:07.703896 29379 tablet_bootstrap.cc:654] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.704358 29376 tablet_replica.cc:333] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:07.704548 29376 raft_consensus.cc:2243] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
W20260617 20:17:07.705739 28663 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be96f417f6614e569555f37c2838369d consensus state has no leader
I20260617 20:17:07.707448 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_873f0c1e037f45099135433d2b96f732"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.707988 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_873f0c1e037f45099135433d2b96f732 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.709635 29377 ts_tablet_manager.cc:1929] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:07.709766 29377 log.cc:1199] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/5b2797384f7845969ee9744b444f1acc
I20260617 20:17:07.710071 29377 ts_tablet_manager.cc:1950] T 5b2797384f7845969ee9744b444f1acc P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:07.711503 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 820) took 4513 ms. Trace:
I20260617 20:17:07.711643 29375 rpcz_store.cc:276] 0617 20:17:03.198400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.203242 (+ 4842us) service_pool.cc:224] Handling call
0617 20:17:07.644500 (+4441258us) ts_tablet_manager.cc:1151] Deleting tablet 488b06f05d9b4273a61bcb2d6e0ad796
0617 20:17:07.644514 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.661425 (+ 16911us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.664178 (+ 2753us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.711427 (+ 47249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14736,"tablet-delete.queue_time_us":4441030}
I20260617 20:17:07.712060 29375 tablet_replica.cc:333] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:07.712289 29375 raft_consensus.cc:2243] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.712554 29375 raft_consensus.cc:2272] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.713088 29375 ts_tablet_manager.cc:1916] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.714955 29383 tablet_bootstrap.cc:492] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.715091 29383 ts_tablet_manager.cc:1403] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.000s
I20260617 20:17:07.715830 29383 raft_consensus.cc:359] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.716019 29383 raft_consensus.cc:385] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.716086 29383 raft_consensus.cc:740] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.716286 29383 consensus_queue.cc:260] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.718140 29378 tablet_bootstrap.cc:654] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.721158 29119 raft_consensus.cc:3060] T fa123fc62a594dd19f20b520760fe6c4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:07.725132 29383 ts_tablet_manager.cc:1434] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260617 20:17:07.725440 29383 tablet_bootstrap.cc:492] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.726949 29383 tablet_bootstrap.cc:654] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:07.731510 28925 consensus_peers.cc:597] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:07.733186 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 488b06f05d9b4273a61bcb2d6e0ad796 (table default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca]) successfully deleted
W20260617 20:17:07.733521 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d192d11683dc4b558cd3c3f965e657f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d192d11683dc4b558cd3c3f965e657f9 already in progress: creating tablet
W20260617 20:17:07.733809 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d5e5d246ea0e474e81edfc7e88001321 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5e5d246ea0e474e81edfc7e88001321 already in progress: creating tablet
W20260617 20:17:07.734047 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 3e11c8b69b704e959e4463f565bf89ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e11c8b69b704e959e4463f565bf89ab already in progress: creating tablet
W20260617 20:17:07.734233 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 519719a748f441c58689172dffb54394 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 519719a748f441c58689172dffb54394 already in progress: creating tablet
W20260617 20:17:07.734447 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet dcd999d88d954e50810cc01b297a27a9 because the tablet was not found. No further retry: Not found: Tablet not found: dcd999d88d954e50810cc01b297a27a9
W20260617 20:17:07.734634 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 6ea0168fa86547f68c7fec880b8d8f1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ea0168fa86547f68c7fec880b8d8f1e already in progress: creating tablet
W20260617 20:17:07.734860 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet c83fa97268f045d6aa60413dfa96ebbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c83fa97268f045d6aa60413dfa96ebbd already in progress: creating tablet
I20260617 20:17:07.735955 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 0eaa60028a1647e580a987c3a0836a24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:58 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:07.732399 30910 tablet.cc:1724] T 24e4b91def8642b7a8a063c06f43e060 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:07.737462 29375 ts_tablet_manager.cc:1929] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 20:17:07.736841 28925 leader_election.cc:343] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.737792 28925 leader_election.cc:304] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:07.741834 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_192444e7b6dc4e918c77df128cae877a" } new_table_name: "default.Table_47860f92f62f4376b2396e6936d2969a" modify_external_catalogs: true
I20260617 20:17:07.749492 29375 log.cc:1199] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/f8e0c5d20a4548cc8124302aa38bcb21
I20260617 20:17:07.749958 29375 ts_tablet_manager.cc:1950] T f8e0c5d20a4548cc8124302aa38bcb21 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:07.753543 28668 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_eb559c64ad6046518eb0cf7a52ae1b35" } new_table_name: "default.Table_9e2110e4c0414947ac06773cfa319bd9" modify_external_catalogs: true
W20260617 20:17:07.757630 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 672aba4228fc44ef9cea80dd6f07c3c9 consensus state has no leader
I20260617 20:17:07.759140 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 821) took 4559 ms. Trace:
I20260617 20:17:07.759238 29375 rpcz_store.cc:276] 0617 20:17:03.200016 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.203510 (+ 3494us) service_pool.cc:224] Handling call
0617 20:17:07.712008 (+4508498us) ts_tablet_manager.cc:1151] Deleting tablet f8e0c5d20a4548cc8124302aa38bcb21
0617 20:17:07.712019 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.734634 (+ 22615us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.737390 (+ 2756us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.759120 (+ 21730us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4508373}
I20260617 20:17:07.759672 29375 tablet_replica.cc:333] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:07.759925 29375 raft_consensus.cc:2243] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.760110 29375 raft_consensus.cc:2272] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.755107 28981 raft_consensus.cc:1275] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Refusing update from remote peer a8c0aea0206f44d683ed3b6b18c719f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260617 20:17:07.761539 30314 raft_consensus.cc:2749] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:07.762220 30901 tablet.cc:1724] T 24e4b91def8642b7a8a063c06f43e060 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:07.763574 29375 ts_tablet_manager.cc:1916] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.763645 29383 tablet_bootstrap.cc:492] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.763772 29383 ts_tablet_manager.cc:1403] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20260617 20:17:07.764436 29383 raft_consensus.cc:359] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.764602 29383 raft_consensus.cc:385] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.764655 29383 raft_consensus.cc:740] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.764879 29383 consensus_queue.cc:260] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.767685 29383 ts_tablet_manager.cc:1434] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:07.767985 29383 tablet_bootstrap.cc:492] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.768718 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eaddd6519dc490c8358be629b21a2d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.769398 29383 tablet_bootstrap.cc:654] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.769758 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6f05ae7d624efba571d059ce2f1c91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.770471 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet f8e0c5d20a4548cc8124302aa38bcb21 (table default.Table_56731cc7022548f8a230b1f50b31109f [id=8b180a732c2a49c8a6dfd4218af43abf]) successfully deleted
I20260617 20:17:07.772711 29375 ts_tablet_manager.cc:1929] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.772862 29375 log.cc:1199] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/c12ea6cac8d44b4b8d41e3e33e0fd6cb
I20260617 20:17:07.773133 29383 tablet_bootstrap.cc:492] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.773260 29383 ts_tablet_manager.cc:1403] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260617 20:17:07.773506 29375 ts_tablet_manager.cc:1950] T c12ea6cac8d44b4b8d41e3e33e0fd6cb P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:07.773927 29383 raft_consensus.cc:359] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.774096 29383 raft_consensus.cc:385] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.774155 29383 raft_consensus.cc:740] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.774868 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 822) took 4555 ms. Trace:
I20260617 20:17:07.779321 29375 rpcz_store.cc:276] 0617 20:17:03.219509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.219596 (+ 87us) service_pool.cc:224] Handling call
0617 20:17:07.759620 (+4540024us) ts_tablet_manager.cc:1151] Deleting tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb
0617 20:17:07.759630 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.766522 (+ 6892us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.772655 (+ 6133us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.774848 (+ 2193us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4539805}
I20260617 20:17:07.779852 29375 tablet_replica.cc:333] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:07.780073 29375 raft_consensus.cc:2243] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.780256 29375 raft_consensus.cc:2272] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.780826 29375 ts_tablet_manager.cc:1916] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.787765 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet c12ea6cac8d44b4b8d41e3e33e0fd6cb (table default.Table_fe54346acedc4aee9fe8151c12a389fc [id=32c61aa9610e428fa8d5c794b078e0a1]) successfully deleted
I20260617 20:17:07.790233 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_fc956f2e299343cd846ec9a9272c1440"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.790889 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc956f2e299343cd846ec9a9272c1440 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.791857 29375 ts_tablet_manager.cc:1929] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:07.791965 29375 log.cc:1199] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/f4de5dafb1474de1911148bb3b4527cf
I20260617 20:17:07.792255 29375 ts_tablet_manager.cc:1950] T f4de5dafb1474de1911148bb3b4527cf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:07.792405 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2831ca4ebfea4801b37ec6e9d3c0dca2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.792915 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2831ca4ebfea4801b37ec6e9d3c0dca2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.794039 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_7ad9b9d0a81a4059917a01a2dbea08ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.794494 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ad9b9d0a81a4059917a01a2dbea08ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.798623 30973 raft_consensus.cc:493] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.798872 30973 raft_consensus.cc:515] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.799706 30973 leader_election.cc:290] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:07.798632 29376 raft_consensus.cc:2272] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.802811 29383 consensus_queue.cc:260] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.804649 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 823) took 4579 ms. Trace:
I20260617 20:17:07.806366 29376 ts_tablet_manager.cc:1916] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.804795 29375 rpcz_store.cc:276] 0617 20:17:03.224833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.225386 (+ 553us) service_pool.cc:224] Handling call
0617 20:17:07.779806 (+4554420us) ts_tablet_manager.cc:1151] Deleting tablet f4de5dafb1474de1911148bb3b4527cf
0617 20:17:07.779816 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.789012 (+ 9196us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.791803 (+ 2791us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.804628 (+ 12825us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4554223}
I20260617 20:17:07.808393 29375 tablet_replica.cc:333] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:07.808632 29375 raft_consensus.cc:2243] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.808879 29375 raft_consensus.cc:2272] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.809528 29375 ts_tablet_manager.cc:1916] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.809564 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ae2f924494679a1389ad61be65259" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:07.809624 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ae2f924494679a1389ad61be65259" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:07.810433 29383 ts_tablet_manager.cc:1434] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20260617 20:17:07.810767 29383 tablet_bootstrap.cc:492] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.800982 29379 tablet_bootstrap.cc:492] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:07.814061 29379 ts_tablet_manager.cc:1403] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.116s user 0.002s sys 0.001s
I20260617 20:17:07.814724 29379 raft_consensus.cc:359] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.814894 29379 raft_consensus.cc:385] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.814941 29379 raft_consensus.cc:740] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.815472 29379 consensus_queue.cc:260] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.815989 29379 ts_tablet_manager.cc:1434] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260617 20:17:07.816767 28655 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet f43549813e294796baca2a1a64dbcfb9 (table default.Table_07b69bc96042426b925d4a1072ec0d08 [id=8015a245e8574c7580068edea8104f06], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f43549813e294796baca2a1a64dbcfb9 consensus state has no leader
I20260617 20:17:07.818341 30852 consensus_queue.cc:1048] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:07.818828 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 895) took 2888 ms. Trace:
I20260617 20:17:07.818957 29377 rpcz_store.cc:276] 0617 20:17:04.930382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.936105 (+ 5723us) service_pool.cc:224] Handling call
0617 20:17:07.627323 (+2691218us) ts_tablet_manager.cc:1151] Deleting tablet 5b2797384f7845969ee9744b444f1acc
0617 20:17:07.640773 (+ 13450us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.706604 (+ 65831us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.709572 (+ 2968us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.818807 (+109235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2424,"tablet-delete.queue_time_us":2691048}
I20260617 20:17:07.819319 29375 ts_tablet_manager.cc:1929] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260617 20:17:07.819519 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 5b2797384f7845969ee9744b444f1acc (table default.Table_b5d227c61e734225b76fd057b7ad9b96 [id=4cb0ef24b723455aacc2dc61526886d1]) successfully deleted
I20260617 20:17:07.822896 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 896) took 2889 ms. Trace:
I20260617 20:17:07.823056 29377 rpcz_store.cc:276] 0617 20:17:04.933267 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.936308 (+ 3041us) service_pool.cc:224] Handling call
0617 20:17:07.822795 (+2886487us) ts_tablet_manager.cc:1151] Deleting tablet 18440a4a5c254a25b87f8632de9c92b9
0617 20:17:07.822806 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.822876 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2886354}
W20260617 20:17:07.823592 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 18440a4a5c254a25b87f8632de9c92b9 because the tablet was not found. No further retry: Not found: Tablet not found: 18440a4a5c254a25b87f8632de9c92b9
I20260617 20:17:07.819753 29379 tablet_bootstrap.cc:492] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:07.824043 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 897) took 2890 ms. Trace:
I20260617 20:17:07.824158 29377 rpcz_store.cc:276] 0617 20:17:04.933383 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.936469 (+ 3086us) service_pool.cc:224] Handling call
0617 20:17:07.823899 (+2887430us) ts_tablet_manager.cc:1151] Deleting tablet 58213ec0a9364a91a15fc0329f28605b
0617 20:17:07.823921 (+ 22us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.824026 (+ 105us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2887307}
I20260617 20:17:07.824301 30852 consensus_queue.cc:1048] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:07.824661 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 58213ec0a9364a91a15fc0329f28605b because the tablet was not found. No further retry: Not found: Tablet not found: 58213ec0a9364a91a15fc0329f28605b
I20260617 20:17:07.824968 29377 tablet_replica.cc:333] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
W20260617 20:17:07.825017 29197 consensus_peers.cc:597] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27c20f436b9b4a8cb659215f9579af04. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:07.825623 29379 tablet_bootstrap.cc:654] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.826603 30852 raft_consensus.cc:493] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.826719 30852 raft_consensus.cc:515] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.826861 29375 log.cc:1199] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/91c99389d24d4a8d8c934f0a9b9c2825
I20260617 20:17:07.827216 29375 ts_tablet_manager.cc:1950] T 91c99389d24d4a8d8c934f0a9b9c2825 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:07.827310 30852 leader_election.cc:290] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:07.827966 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 824) took 4560 ms. Trace:
I20260617 20:17:07.828027 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaddd6519dc490c8358be629b21a2d9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:07.828843 29375 rpcz_store.cc:276] 0617 20:17:03.267192 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.267252 (+ 60us) service_pool.cc:224] Handling call
0617 20:17:07.808333 (+4541081us) ts_tablet_manager.cc:1151] Deleting tablet 91c99389d24d4a8d8c934f0a9b9c2825
0617 20:17:07.808343 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.816344 (+ 8001us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.819253 (+ 2909us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.827949 (+ 8696us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4540876}
W20260617 20:17:07.829437 29198 leader_election.cc:343] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.812134 29383 tablet_bootstrap.cc:654] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.830914 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 825) took 4563 ms. Trace:
I20260617 20:17:07.831321 29375 rpcz_store.cc:276] 0617 20:17:03.267297 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.267379 (+ 82us) service_pool.cc:224] Handling call
0617 20:17:07.830788 (+4563409us) ts_tablet_manager.cc:1151] Deleting tablet add6e21cef3b4c02910486841e36ce4a
0617 20:17:07.830797 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.830895 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4563185}
I20260617 20:17:07.832026 29375 tablet_replica.cc:333] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:07.832451 29375 raft_consensus.cc:2243] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.832969 29375 raft_consensus.cc:2272] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.833716 29375 ts_tablet_manager.cc:1916] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.834789 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet f4de5dafb1474de1911148bb3b4527cf (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]) successfully deleted
I20260617 20:17:07.835037 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 91c99389d24d4a8d8c934f0a9b9c2825 (table default.Table_b25f36c0ba1247f5a4b85a5b4add8420 [id=6a948594185b42128136770dbe3f0ffb]) successfully deleted
W20260617 20:17:07.835261 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet add6e21cef3b4c02910486841e36ce4a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet add6e21cef3b4c02910486841e36ce4a already in progress: creating tablet
I20260617 20:17:06.414162 30378 rpcz_store.cc:276] 0617 20:17:00.961656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:00.961708 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:05.207166 (+4245458us) raft_consensus.cc:1471] Updating replica for 441 ops
0617 20:17:05.259166 (+ 52000us) raft_consensus.cc:1534] Early marking committed up to index 0
0617 20:17:05.259180 (+ 14us) raft_consensus.cc:1539] Triggering prepare for 441 ops
0617 20:17:05.261876 (+ 2696us) write_op.cc:270] Start()
0617 20:17:05.261938 (+ 62us) write_op.cc:276] Timestamp: P: 1781727412387339 usec, L: 0
0617 20:17:05.293752 (+ 31814us) write_op.cc:270] Start()
0617 20:17:05.293786 (+ 34us) write_op.cc:276] Timestamp: P: 1781727412419770 usec, L: 0
0617 20:17:05.294155 (+ 369us) write_op.cc:270] Start()
0617 20:17:05.296752 (+ 2597us) write_op.cc:276] Timestamp: P: 1781727412421615 usec, L: 0
0617 20:17:05.296962 (+ 210us) write_op.cc:270] Start()
0617 20:17:05.296992 (+ 30us) write_op.cc:276] Timestamp: P: 1781727412422456 usec, L: 0
0617 20:17:05.297166 (+ 174us) write_op.cc:270] Start()
0617 20:17:05.297188 (+ 22us) write_op.cc:276] Timestamp: P: 1781727412437493 usec, L: 0
0617 20:17:05.297372 (+ 184us) write_op.cc:270] Start()
0617 20:17:05.297402 (+ 30us) write_op.cc:276] Timestamp: P: 1781727412460616 usec, L: 0
0617 20:17:05.297591 (+ 189us) write_op.cc:270] Start()
0617 20:17:05.297644 (+ 53us) write_op.cc:276] Timestamp: P: 1781727412462345 usec, L: 0
0617 20:17:05.297832 (+ 188us) write_op.cc:270] Start()
0617 20:17:05.297852 (+ 20us) write_op.cc:276] Timestamp: P: 1781727412463396 usec, L: 0
0617 20:17:05.298001 (+ 149us) write_op.cc:270] Start()
0617 20:17:05.298021 (+ 20us) write_op.cc:276] Timestamp: P: 1781727412485927 usec, L: 0
0617 20:17:05.298158 (+ 137us) write_op.cc:270] Start()
0617 20:17:05.298179 (+ 21us) write_op.cc:276] Timestamp: P: 1781727412522225 usec, L: 0
0617 20:17:05.298337 (+ 158us) write_op.cc:270] Start()
0617 20:17:05.298357 (+ 20us) write_op.cc:276] Timestamp: P: 1781727412527823 usec, L: 0
0617 20:17:05.298554 (+ 197us) write_op.cc:270] Start()
0617 20:17:05.298575 (+ 21us) write_op.cc:276] Timestamp: P: 1781727412528818 usec, L: 0
0617 20:17:05.298741 (+ 166us) write_op.cc:270] Start()
0617 20:17:05.298761 (+ 20us) write_op.cc:276] Timestamp: P: 1781727412531479 usec, L: 0
0617 20:17:05.298915 (+ 154us) write_op.cc:270] Start()
0617 20:17:05.298938 (+ 23us) write_op.cc:276] Timestamp: P: 1781727412561785 usec, L: 0
0617 20:17:05.299080 (+ 142us) write_op.cc:270] Start()
0617 20:17:05.299103 (+ 23us) write_op.cc:276] Timestamp: P: 1781727412569230 usec, L: 0
0617 20:17:05.299234 (+ 131us) write_op.cc:270] Start()
0617 20:17:05.299254 (+ 20us) write_op.cc:276] Timestamp: P: 1781727412577497 usec, L: 0
0617 20:17:05.299406 (+ 152us) write_op.cc:270] Start()
0617 20:17:05.299432 (+ 26us) write_op.cc:276] Timestamp: P: 1781727412580176 usec, L: 0
0617 20:17:05.299576 (+ 144us) write_op.cc:270] Start()
0617 20:17:05.299597 (+ 21us) write_op.cc:276] Timestamp: P: 1781727412591994 usec, L: 0
0617 20:17:05.299726 (+ 129us) write_op.cc:270] Start()
0617 20:17:05.299746 (+ 20us) write_op.cc:276] Timestamp: P: 1781727412601205 usec, L: 0
0617 20:17:05.299889 (+ 143us) write_op.cc:270] Start()
0617 20:17:05.299908 (+ 19us) write_op.cc:276] Timestamp: P: 1781727412636828 usec, L: 0
0617 20:17:05.300048 (+ 140us) write_op.cc:270] Start()
0617 20:17:05.300066 (+ 18us) write_op.cc:276] Timestamp: P: 1781727412697563 usec, L: 0
0617 20:17:05.300199 (+ 133us) write_op.cc:270] Start()
0617 20:17:05.300218 (+ 19us) write_op.cc:276] Timestamp: P: 1781727412786713 usec, L: 0
0617 20:17:05.300349 (+ 131us) write_op.cc:270] Start()
0617 20:17:05.300368 (+ 19us) write_op.cc:276] Timestamp: P: 1781727412787351 usec, L: 0
0617 20:17:05.300522 (+ 154us) write_op.cc:270] Start()
0617 20:17:05.300546 (+ 24us) write_op.cc:276] Timestamp: P: 1781727412787892 usec, L: 0
0617 20:17:05.300723 (+ 177us) write_op.cc:270] Start()
0617 20:17:05.300744 (+ 21us) write_op.cc:276] Timestamp: P: 1781727412788407 usec, L: 0
0617 20:17:05.300912 (+ 168us) write_op.cc:270] Start()
0617 20:17:05.300932 (+ 20us) write_op.cc:276] Timestamp: P: 1781727412820275 usec, L: 0
0617 20:17:05.301080 (+ 148us) write_op.cc:270] Start()
0617 20:17:05.301098 (+ 18us) write_op.cc:276] Timestamp: P: 1781727412968287 usec, L: 0
0617 20:17:05.301241 (+ 143us) write_op.cc:270] Start()
0617 20:17:05.336911 (+ 35670us) write_op.cc:276] Timestamp: P: 1781727412971699 usec, L: 0
0617 20:17:05.337116 (+ 205us) write_op.cc:270] Start()
0617 20:17:05.337139 (+ 23us) write_op.cc:276] Timestamp: P: 1781727412972519 usec, L: 0
0617 20:17:05.337252 (+ 113us) write_op.cc:270] Start()
0617 20:17:05.337268 (+ 16us) write_op.cc:276] Timestamp: P: 1781727412989229 usec, L: 0
0617 20:17:05.337452 (+ 184us) write_op.cc:270] Start()
0617 20:17:05.337471 (+ 19us) write_op.cc:276] Timestamp: P: 1781727412991260 usec, L: 0
0617 20:17:05.337579 (+ 108us) write_op.cc:270] Start()
0617 20:17:05.337595 (+ 16us) write_op.cc:276] Timestamp: P: 1781727413049161 usec, L: 0
0617 20:17:05.337698 (+ 103us) write_op.cc:270] Start()
0617 20:17:05.337713 (+ 15us) write_op.cc:276] Timestamp: P: 1781727413052690 usec, L: 0
0617 20:17:05.337821 (+ 108us) write_op.cc:270] Start()
0617 20:17:05.337836 (+ 15us) write_op.cc:276] Timestamp: P: 1781727413081905 usec, L: 0
0617 20:17:05.337938 (+ 102us) write_op.cc:270] Start()
0617 20:17:05.337953 (+ 15us) write_op.cc:276] Timestamp: P: 1781727413082915 usec, L: 0
0617 20:17:05.338054 (+ 101us) write_op.cc:270] Start()
0617 20:17:05.338069 (+ 15us) write_op.cc:276] Timestamp: P: 1781727413084426 usec, L: 0
0617 20:17:05.338174 (+ 105us) write_op.cc:270] Start()
0617 20:17:05.338199 (+ 25us) write_op.cc:276] Timestamp: P: 1781727413367205 usec, L: 0
0617 20:17:05.338301 (+ 102us) write_op.cc:270] Start()
0617 20:17:05.338315 (+ 14us) write_op.cc:276] Timestamp: P: 1781727413368434 usec, L: 0
0617 20:17:05.338426 (+ 111us) write_op.cc:270] Start()
0617 20:17:05.338441 (+ 15us) write_op.cc:276] Timestamp: P: 1781727413408585 usec, L: 0
0617 20:17:05.338549 (+ 108us) write_op.cc:270] Start()
0617 20:17:05.338564 (+ 15us) write_op.cc:276] Timestamp: P: 1781727413409875 usec, L: 0
0617 20:17:05.338658 (+ 94us) write_op.cc:270] Start()
0617 20:17:05.338673 (+ 15us) write_op.cc:276] Timestamp: P: 1781727413467229 usec, L: 0
0617 20:17:05.338777 (+ 104us) write_op.cc:270] Start()
0617 20:17:05.338792 (+ 15us) write_op.cc:276] Timestamp: P: 1781727413468266 usec, L: 0
0617 20:17:05.338884 (+ 92us) write_op.cc:270] Start()
0617 20:17:05.338898 (+ 14us) write_op.cc:276] Timestamp: P: 1781727413468836 usec, L: 0
0617 20:17:05.345180 (+ 6282us) write_op.cc:270] Start()
0617 20:17:05.345208 (+ 28us) write_op.cc:276] Timestamp: P: 1781727413469450 usec, L: 0
0617 20:17:05.345408 (+ 200us) write_op.cc:270] Start()
0617 20:17:05.345431 (+ 23us) write_op.cc:276] Timestamp: P: 1781727413470192 usec, L: 0
0617 20:17:05.345578 (+ 147us) write_op.cc:270] Start()
0617 20:17:05.345597 (+ 19us) write_op.cc:276] Timestamp: P: 1781727413602200 usec, L: 0
0617 20:17:05.345735 (+ 138us) write_op.cc:270] Start()
0617 20:17:05.345758 (+ 23us) write_op.cc:276] Timestamp: P: 1781727413603347 usec, L: 0
0617 20:17:05.349445 (+ 3687us) write_op.cc:270] Start()
0617 20:17:05.349475 (+ 30us) write_op.cc:276] Timestamp: P: 1781727413630636 usec, L: 0
0617 20:17:05.349653 (+ 178us) write_op.cc:270] Start()
0617 20:17:05.349689 (+ 36us) write_op.cc:276] Timestamp: P: 1781727413650940 usec, L: 0
0617 20:17:05.349818 (+ 129us) write_op.cc:270] Start()
0617 20:17:05.349838 (+ 20us) write_op.cc:276] Timestamp: P: 1781727413663191 usec, L: 0
0617 20:17:05.350117 (+ 279us) write_op.cc:270] Start()
0617 20:17:05.350142 (+ 25us) write_op.cc:276] Timestamp: P: 1781727413663869 usec, L: 0
0617 20:17:05.350284 (+ 142us) write_op.cc:270] Start()
0617 20:17:05.350303 (+ 19us) write_op.cc:276] Timestamp: P: 1781727413664403 usec, L: 0
0617 20:17:05.351094 (+ 791us) write_op.cc:270] Start()
0617 20:17:05.351118 (+ 24us) write_op.cc:276] Timestamp: P: 1781727413665237 usec, L: 0
0617 20:17:05.351296 (+ 178us) write_op.cc:270] Start()
0617 20:17:05.351325 (+ 29us) write_op.cc:276] Timestamp: P: 1781727413666057 usec, L: 0
0617 20:17:05.351503 (+ 178us) write_op.cc:270] Start()
0617 20:17:05.351528 (+ 25us) write_op.cc:276] Timestamp: P: 1781727413760111 usec, L: 0
0617 20:17:05.351685 (+ 157us) write_op.cc:270] Start()
0617 20:17:05.351709 (+ 24us) write_op.cc:276] Timestamp: P: 1781727413821819 usec, L: 0
0617 20:17:05.351859 (+ 150us) write_op.cc:270] Start()
0617 20:17:05.351877 (+ 18us) write_op.cc:276] Timestamp: P: 1781727413823063 usec, L: 0
0617 20:17:05.352044 (+ 167us) write_op.cc:270] Start()
0617 20:17:05.352068 (+ 24us) write_op.cc:276] Timestamp: P: 1781727413824469 usec, L: 0
0617 20:17:05.352248 (+ 180us) write_op.cc:270] Start()
0617 20:17:05.352264 (+ 16us) write_op.cc:276] Timestamp: P: 1781727413825543 usec, L: 0
0617 20:17:05.352407 (+ 143us) write_op.cc:270] Start()
0617 20:17:05.352457 (+ 50us) write_op.cc:276] Timestamp: P: 1781727413840865 usec, L: 0
0617 20:17:05.352630 (+ 173us) write_op.cc:270] Start()
0617 20:17:05.352659 (+ 29us) write_op.cc:276] Timestamp: P: 1781727413841544 usec, L: 0
0617 20:17:05.352801 (+ 142us) write_op.cc:270] Start()
0617 20:17:05.352822 (+ 21us) write_op.cc:276] Timestamp: P: 1781727413842127 usec, L: 0
0617 20:17:05.352957 (+ 135us) write_op.cc:270] Start()
0617 20:17:05.352973 (+ 16us) write_op.cc:276] Timestamp: P: 1781727413843032 usec, L: 0
0617 20:17:05.353127 (+ 154us) write_op.cc:270] Start()
0617 20:17:05.353161 (+ 34us) write_op.cc:276] Timestamp: P: 1781727413843661 usec, L: 0
0617 20:17:05.353360 (+ 199us) write_op.cc:270] Start()
0617 20:17:05.353385 (+ 25us) write_op.cc:276] Timestamp: P: 1781727413867111 usec, L: 0
0617 20:17:05.353595 (+ 210us) write_op.cc:270] Start()
0617 20:17:05.353619 (+ 24us) write_op.cc:276] Timestamp: P: 1781727413871118 usec, L: 0
0617 20:17:05.353777 (+ 158us) write_op.cc:270] Start()
0617 20:17:05.353798 (+ 21us) write_op.cc:276] Timestamp: P: 1781727413879562 usec, L: 0
0617 20:17:05.353941 (+ 143us) write_op.cc:270] Start()
0617 20:17:05.353964 (+ 23us) write_op.cc:276] Timestamp: P: 1781727413880911 usec, L: 0
0617 20:17:05.354117 (+ 153us) write_op.cc:270] Start()
0617 20:17:05.354138 (+ 21us) write_op.cc:276] Timestamp: P: 1781727413881538 usec, L: 0
0617 20:17:05.354278 (+ 140us) write_op.cc:270] Start()
0617 20:17:05.354299 (+ 21us) write_op.cc:276] Timestamp: P: 1781727413888912 usec, L: 0
0617 20:17:05.354450 (+ 151us) write_op.cc:270] Start()
0617 20:17:05.354472 (+ 22us) write_op.cc:276] Timestamp: P: 1781727413895548 usec, L: 0
0617 20:17:05.354653 (+ 181us) write_op.cc:270] Start()
0617 20:17:05.354671 (+ 18us) write_op.cc:276] Timestamp: P: 1781727413935816 usec, L: 0
0617 20:17:05.354804 (+ 133us) write_op.cc:270] Start()
0617 20:17:05.354824 (+ 20us) write_op.cc:276] Timestamp: P: 1781727413951755 usec, L: 0
0617 20:17:05.354964 (+ 140us) write_op.cc:270] Start()
0617 20:17:05.354984 (+ 20us) write_op.cc:276] Timestamp: P: 1781727414020147 usec, L: 0
0617 20:17:05.355113 (+ 129us) write_op.cc:270] Start()
0617 20:17:05.355131 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414021958 usec, L: 0
0617 20:17:05.355257 (+ 126us) write_op.cc:270] Start()
0617 20:17:05.355275 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414027248 usec, L: 0
0617 20:17:05.355442 (+ 167us) write_op.cc:270] Start()
0617 20:17:05.355462 (+ 20us) write_op.cc:276] Timestamp: P: 1781727414030200 usec, L: 0
0617 20:17:05.355644 (+ 182us) write_op.cc:270] Start()
0617 20:17:05.355666 (+ 22us) write_op.cc:276] Timestamp: P: 1781727414034269 usec, L: 0
0617 20:17:05.355808 (+ 142us) write_op.cc:270] Start()
0617 20:17:05.355880 (+ 72us) write_op.cc:276] Timestamp: P: 1781727414039692 usec, L: 0
0617 20:17:05.356036 (+ 156us) write_op.cc:270] Start()
0617 20:17:05.356058 (+ 22us) write_op.cc:276] Timestamp: P: 1781727414061374 usec, L: 0
0617 20:17:05.356187 (+ 129us) write_op.cc:270] Start()
0617 20:17:05.356207 (+ 20us) write_op.cc:276] Timestamp: P: 1781727414068646 usec, L: 0
0617 20:17:05.356351 (+ 144us) write_op.cc:270] Start()
0617 20:17:05.356369 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414076697 usec, L: 0
0617 20:17:05.356556 (+ 187us) write_op.cc:270] Start()
0617 20:17:05.356579 (+ 23us) write_op.cc:276] Timestamp: P: 1781727414085781 usec, L: 0
0617 20:17:05.356715 (+ 136us) write_op.cc:270] Start()
0617 20:17:05.356737 (+ 22us) write_op.cc:276] Timestamp: P: 1781727414094379 usec, L: 0
0617 20:17:05.356881 (+ 144us) write_op.cc:270] Start()
0617 20:17:05.356899 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414107333 usec, L: 0
0617 20:17:05.357041 (+ 142us) write_op.cc:270] Start()
0617 20:17:05.357063 (+ 22us) write_op.cc:276] Timestamp: P: 1781727414117707 usec, L: 0
0617 20:17:05.357194 (+ 131us) write_op.cc:270] Start()
0617 20:17:05.357209 (+ 15us) write_op.cc:276] Timestamp: P: 1781727414144463 usec, L: 0
0617 20:17:05.371530 (+ 14321us) write_op.cc:270] Start()
0617 20:17:05.371570 (+ 40us) write_op.cc:276] Timestamp: P: 1781727414145552 usec, L: 0
0617 20:17:05.371774 (+ 204us) write_op.cc:270] Start()
0617 20:17:05.371797 (+ 23us) write_op.cc:276] Timestamp: P: 1781727414146438 usec, L: 0
0617 20:17:05.371946 (+ 149us) write_op.cc:270] Start()
0617 20:17:05.371966 (+ 20us) write_op.cc:276] Timestamp: P: 1781727414147228 usec, L: 0
0617 20:17:05.372109 (+ 143us) write_op.cc:270] Start()
0617 20:17:05.372126 (+ 17us) write_op.cc:276] Timestamp: P: 1781727414147970 usec, L: 0
0617 20:17:05.372255 (+ 129us) write_op.cc:270] Start()
0617 20:17:05.372276 (+ 21us) write_op.cc:276] Timestamp: P: 1781727414202934 usec, L: 0
0617 20:17:05.372434 (+ 158us) write_op.cc:270] Start()
0617 20:17:05.372462 (+ 28us) write_op.cc:276] Timestamp: P: 1781727414218540 usec, L: 0
0617 20:17:05.372648 (+ 186us) write_op.cc:270] Start()
0617 20:17:05.372674 (+ 26us) write_op.cc:276] Timestamp: P: 1781727414219549 usec, L: 0
0617 20:17:05.372821 (+ 147us) write_op.cc:270] Start()
0617 20:17:05.372842 (+ 21us) write_op.cc:276] Timestamp: P: 1781727414318624 usec, L: 0
0617 20:17:05.373009 (+ 167us) write_op.cc:270] Start()
0617 20:17:05.373030 (+ 21us) write_op.cc:276] Timestamp: P: 1781727414332797 usec, L: 0
0617 20:17:05.373163 (+ 133us) write_op.cc:270] Start()
0617 20:17:05.373185 (+ 22us) write_op.cc:276] Timestamp: P: 1781727414355593 usec, L: 0
0617 20:17:05.373375 (+ 190us) write_op.cc:270] Start()
0617 20:17:05.373405 (+ 30us) write_op.cc:276] Timestamp: P: 1781727414392435 usec, L: 0
0617 20:17:05.373575 (+ 170us) write_op.cc:270] Start()
0617 20:17:05.373598 (+ 23us) write_op.cc:276] Timestamp: P: 1781727414412239 usec, L: 0
0617 20:17:05.440481 (+ 66883us) write_op.cc:270] Start()
0617 20:17:05.440533 (+ 52us) write_op.cc:276] Timestamp: P: 1781727414427268 usec, L: 0
0617 20:17:05.440844 (+ 311us) write_op.cc:270] Start()
0617 20:17:05.440873 (+ 29us) write_op.cc:276] Timestamp: P: 1781727414485581 usec, L: 0
0617 20:17:05.441072 (+ 199us) write_op.cc:270] Start()
0617 20:17:05.441096 (+ 24us) write_op.cc:276] Timestamp: P: 1781727414486353 usec, L: 0
0617 20:17:05.441233 (+ 137us) write_op.cc:270] Start()
0617 20:17:05.441254 (+ 21us) write_op.cc:276] Timestamp: P: 1781727414486938 usec, L: 0
0617 20:17:05.454532 (+ 13278us) write_op.cc:270] Start()
0617 20:17:05.454565 (+ 33us) write_op.cc:276] Timestamp: P: 1781727414532488 usec, L: 0
0617 20:17:05.454715 (+ 150us) write_op.cc:270] Start()
0617 20:17:05.454734 (+ 19us) write_op.cc:276] Timestamp: P: 1781727414534716 usec, L: 0
0617 20:17:05.454870 (+ 136us) write_op.cc:270] Start()
0617 20:17:05.454888 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414535392 usec, L: 0
0617 20:17:05.455060 (+ 172us) write_op.cc:270] Start()
0617 20:17:05.455080 (+ 20us) write_op.cc:276] Timestamp: P: 1781727414535996 usec, L: 0
0617 20:17:05.455235 (+ 155us) write_op.cc:270] Start()
0617 20:17:05.455257 (+ 22us) write_op.cc:276] Timestamp: P: 1781727414536612 usec, L: 0
0617 20:17:05.455416 (+ 159us) write_op.cc:270] Start()
0617 20:17:05.455440 (+ 24us) write_op.cc:276] Timestamp: P: 1781727414537200 usec, L: 0
0617 20:17:05.455621 (+ 181us) write_op.cc:270] Start()
0617 20:17:05.455646 (+ 25us) write_op.cc:276] Timestamp: P: 1781727414538532 usec, L: 0
0617 20:17:05.455786 (+ 140us) write_op.cc:270] Start()
0617 20:17:05.455804 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414552872 usec, L: 0
0617 20:17:05.455928 (+ 124us) write_op.cc:270] Start()
0617 20:17:05.455946 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414553491 usec, L: 0
0617 20:17:05.456054 (+ 108us) write_op.cc:270] Start()
0617 20:17:05.456071 (+ 17us) write_op.cc:276] Timestamp: P: 1781727414554321 usec, L: 0
0617 20:17:05.456187 (+ 116us) write_op.cc:270] Start()
0617 20:17:05.456203 (+ 16us) write_op.cc:276] Timestamp: P: 1781727414554920 usec, L: 0
0617 20:17:05.456311 (+ 108us) write_op.cc:270] Start()
0617 20:17:05.456329 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414565836 usec, L: 0
0617 20:17:05.456451 (+ 122us) write_op.cc:270] Start()
0617 20:17:05.456469 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414612565 usec, L: 0
0617 20:17:05.456579 (+ 110us) write_op.cc:270] Start()
0617 20:17:05.456595 (+ 16us) write_op.cc:276] Timestamp: P: 1781727414615557 usec, L: 0
0617 20:17:05.456717 (+ 122us) write_op.cc:270] Start()
0617 20:17:05.456733 (+ 16us) write_op.cc:276] Timestamp: P: 1781727414626060 usec, L: 0
0617 20:17:05.456861 (+ 128us) write_op.cc:270] Start()
0617 20:17:05.456879 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414627049 usec, L: 0
0617 20:17:05.457014 (+ 135us) write_op.cc:270] Start()
0617 20:17:05.457032 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414628710 usec, L: 0
0617 20:17:05.457137 (+ 105us) write_op.cc:270] Start()
0617 20:17:05.457153 (+ 16us) write_op.cc:276] Timestamp: P: 1781727414634377 usec, L: 0
0617 20:17:05.457265 (+ 112us) write_op.cc:270] Start()
0617 20:17:05.457281 (+ 16us) write_op.cc:276] Timestamp: P: 1781727414635042 usec, L: 0
0617 20:17:05.457474 (+ 193us) write_op.cc:270] Start()
0617 20:17:05.457492 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414636794 usec, L: 0
0617 20:17:05.457632 (+ 140us) write_op.cc:270] Start()
0617 20:17:05.457654 (+ 22us) write_op.cc:276] Timestamp: P: 1781727414665186 usec, L: 0
0617 20:17:05.457792 (+ 138us) write_op.cc:270] Start()
0617 20:17:05.457810 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414685953 usec, L: 0
0617 20:17:05.457964 (+ 154us) write_op.cc:270] Start()
0617 20:17:05.457989 (+ 25us) write_op.cc:276] Timestamp: P: 1781727414701534 usec, L: 0
0617 20:17:05.458137 (+ 148us) write_op.cc:270] Start()
0617 20:17:05.458159 (+ 22us) write_op.cc:276] Timestamp: P: 1781727414702246 usec, L: 0
0617 20:17:05.458322 (+ 163us) write_op.cc:270] Start()
0617 20:17:05.458341 (+ 19us) write_op.cc:276] Timestamp: P: 1781727414702807 usec, L: 0
0617 20:17:05.458522 (+ 181us) write_op.cc:270] Start()
0617 20:17:05.458542 (+ 20us) write_op.cc:276] Timestamp: P: 1781727414789560 usec, L: 0
0617 20:17:05.458668 (+ 126us) write_op.cc:270] Start()
0617 20:17:05.458683 (+ 15us) write_op.cc:276] Timestamp: P: 1781727414790263 usec, L: 0
0617 20:17:05.472555 (+ 13872us) write_op.cc:270] Start()
0617 20:17:05.472631 (+ 76us) write_op.cc:276] Timestamp: P: 1781727414791221 usec, L: 0
0617 20:17:05.472875 (+ 244us) write_op.cc:270] Start()
0617 20:17:05.472903 (+ 28us) write_op.cc:276] Timestamp: P: 1781727414791733 usec, L: 0
0617 20:17:05.473066 (+ 163us) write_op.cc:270] Start()
0617 20:17:05.473085 (+ 19us) write_op.cc:276] Timestamp: P: 1781727414792224 usec, L: 0
0617 20:17:05.473237 (+ 152us) write_op.cc:270] Start()
0617 20:17:05.473256 (+ 19us) write_op.cc:276] Timestamp: P: 1781727414792737 usec, L: 0
0617 20:17:05.473440 (+ 184us) write_op.cc:270] Start()
0617 20:17:05.473463 (+ 23us) write_op.cc:276] Timestamp: P: 1781727414793254 usec, L: 0
0617 20:17:05.473629 (+ 166us) write_op.cc:270] Start()
0617 20:17:05.473648 (+ 19us) write_op.cc:276] Timestamp: P: 1781727414793812 usec, L: 0
0617 20:17:05.473770 (+ 122us) write_op.cc:270] Start()
0617 20:17:05.473791 (+ 21us) write_op.cc:276] Timestamp: P: 1781727414794365 usec, L: 0
0617 20:17:05.473937 (+ 146us) write_op.cc:270] Start()
0617 20:17:05.473963 (+ 26us) write_op.cc:276] Timestamp: P: 1781727414813505 usec, L: 0
0617 20:17:05.474112 (+ 149us) write_op.cc:270] Start()
0617 20:17:05.474131 (+ 19us) write_op.cc:276] Timestamp: P: 1781727414908176 usec, L: 0
0617 20:17:05.474271 (+ 140us) write_op.cc:270] Start()
0617 20:17:05.474288 (+ 17us) write_op.cc:276] Timestamp: P: 1781727414910889 usec, L: 0
0617 20:17:05.474422 (+ 134us) write_op.cc:270] Start()
0617 20:17:05.474442 (+ 20us) write_op.cc:276] Timestamp: P: 1781727414929885 usec, L: 0
0617 20:17:05.486970 (+ 12528us) write_op.cc:270] Start()
0617 20:17:05.487012 (+ 42us) write_op.cc:276] Timestamp: P: 1781727414930533 usec, L: 0
0617 20:17:05.487214 (+ 202us) write_op.cc:270] Start()
0617 20:17:05.487236 (+ 22us) write_op.cc:276] Timestamp: P: 1781727414934788 usec, L: 0
0617 20:17:05.487363 (+ 127us) write_op.cc:270] Start()
0617 20:17:05.487382 (+ 19us) write_op.cc:276] Timestamp: P: 1781727414935390 usec, L: 0
0617 20:17:05.487518 (+ 136us) write_op.cc:270] Start()
0617 20:17:05.487535 (+ 17us) write_op.cc:276] Timestamp: P: 1781727414935964 usec, L: 0
0617 20:17:05.487645 (+ 110us) write_op.cc:270] Start()
0617 20:17:05.487669 (+ 24us) write_op.cc:276] Timestamp: P: 1781727414976166 usec, L: 0
0617 20:17:05.487783 (+ 114us) write_op.cc:270] Start()
0617 20:17:05.487801 (+ 18us) write_op.cc:276] Timestamp: P: 1781727414978554 usec, L: 0
0617 20:17:05.487919 (+ 118us) write_op.cc:270] Start()
0617 20:17:05.487936 (+ 17us) write_op.cc:276] Timestamp: P: 1781727414979227 usec, L: 0
0617 20:17:05.488043 (+ 107us) write_op.cc:270] Start()
0617 20:17:05.488059 (+ 16us) write_op.cc:276] Timestamp: P: 1781727414980941 usec, L: 0
0617 20:17:05.488182 (+ 123us) write_op.cc:270] Start()
0617 20:17:05.488198 (+ 16us) write_op.cc:276] Timestamp: P: 1781727414991566 usec, L: 0
0617 20:17:05.488300 (+ 102us) write_op.cc:270] Start()
0617 20:17:05.488314 (+ 14us) write_op.cc:276] Timestamp: P: 1781727415013084 usec, L: 0
0617 20:17:05.488440 (+ 126us) write_op.cc:270] Start()
0617 20:17:05.488459 (+ 19us) write_op.cc:276] Timestamp: P: 1781727415185949 usec, L: 0
0617 20:17:05.488625 (+ 166us) write_op.cc:270] Start()
0617 20:17:05.488643 (+ 18us) write_op.cc:276] Timestamp: P: 1781727415186638 usec, L: 0
0617 20:17:05.488757 (+ 114us) write_op.cc:270] Start()
0617 20:17:05.488773 (+ 16us) write_op.cc:276] Timestamp: P: 1781727415187193 usec, L: 0
0617 20:17:05.488884 (+ 111us) write_op.cc:270] Start()
0617 20:17:05.488901 (+ 17us) write_op.cc:276] Timestamp: P: 1781727415187693 usec, L: 0
0617 20:17:05.489008 (+ 107us) write_op.cc:270] Start()
0617 20:17:05.489024 (+ 16us) write_op.cc:276] Timestamp: P: 1781727415227324 usec, L: 0
0617 20:17:05.489124 (+ 100us) write_op.cc:270] Start()
0617 20:17:05.489138 (+ 14us) write_op.cc:276] Timestamp: P: 1781727415239641 usec, L: 0
0617 20:17:05.489251 (+ 113us) write_op.cc:270] Start()
0617 20:17:05.489280 (+ 29us) write_op.cc:276] Timestamp: P: 1781727415245986 usec, L: 0
0617 20:17:05.489498 (+ 218us) write_op.cc:270] Start()
0617 20:17:05.489522 (+ 24us) write_op.cc:276] Timestamp: P: 1781727415254225 usec, L: 0
0617 20:17:05.489655 (+ 133us) write_op.cc:270] Start()
0617 20:17:05.489674 (+ 19us) write_op.cc:276] Timestamp: P: 1781727415260326 usec, L: 0
0617 20:17:05.489817 (+ 143us) write_op.cc:270] Start()
0617 20:17:05.489837 (+ 20us) write_op.cc:276] Timestamp: P: 1781727415279253 usec, L: 0
0617 20:17:05.490004 (+ 167us) write_op.cc:270] Start()
0617 20:17:05.490026 (+ 22us) write_op.cc:276] Timestamp: P: 1781727415287203 usec, L: 0
0617 20:17:05.490168 (+ 142us) write_op.cc:270] Start()
0617 20:17:05.490188 (+ 20us) write_op.cc:276] Timestamp: P: 1781727415295049 usec, L: 0
0617 20:17:05.490321 (+ 133us) write_op.cc:270] Start()
0617 20:17:05.490342 (+ 21us) write_op.cc:276] Timestamp: P: 1781727415322301 usec, L: 0
0617 20:17:05.490496 (+ 154us) write_op.cc:270] Start()
0617 20:17:05.490517 (+ 21us) write_op.cc:276] Timestamp: P: 1781727415340834 usec, L: 0
0617 20:17:05.490650 (+ 133us) write_op.cc:270] Start()
0617 20:17:05.490671 (+ 21us) write_op.cc:276] Timestamp: P: 1781727415361120 usec, L: 0
0617 20:17:05.490844 (+ 173us) write_op.cc:270] Start()
0617 20:17:05.490907 (+ 63us) write_op.cc:276] Timestamp: P: 1781727415391268 usec, L: 0
0617 20:17:05.491091 (+ 184us) write_op.cc:270] Start()
0617 20:17:05.491112 (+ 21us) write_op.cc:276] Timestamp: P: 1781727415414972 usec, L: 0
0617 20:17:05.491250 (+ 138us) write_op.cc:270] Start()
0617 20:17:05.491270 (+ 20us) write_op.cc:276] Timestamp: P: 1781727415428244 usec, L: 0
0617 20:17:05.491408 (+ 138us) write_op.cc:270] Start()
0617 20:17:05.491439 (+ 31us) write_op.cc:276] Timestamp: P: 1781727415446330 usec, L: 0
0617 20:17:05.498740 (+ 7301us) write_op.cc:270] Start()
0617 20:17:05.498784 (+ 44us) write_op.cc:276] Timestamp: P: 1781727415455828 usec, L: 0
0617 20:17:05.498991 (+ 207us) write_op.cc:270] Start()
0617 20:17:05.499012 (+ 21us) write_op.cc:276] Timestamp: P: 1781727415465401 usec, L: 0
0617 20:17:05.499136 (+ 124us) write_op.cc:270] Start()
0617 20:17:05.499157 (+ 21us) write_op.cc:276] Timestamp: P: 1781727415489356 usec, L: 0
0617 20:17:05.499273 (+ 116us) write_op.cc:270] Start()
0617 20:17:05.499289 (+ 16us) write_op.cc:276] Timestamp: P: 1781727415506518 usec, L: 0
0617 20:17:05.499417 (+ 128us) write_op.cc:270] Start()
0617 20:17:05.499435 (+ 18us) write_op.cc:276] Timestamp: P: 1781727415522159 usec, L: 0
0617 20:17:05.499556 (+ 121us) write_op.cc:270] Start()
0617 20:17:05.499574 (+ 18us) write_op.cc:276] Timestamp: P: 1781727415533113 usec, L: 0
0617 20:17:05.499715 (+ 141us) write_op.cc:270] Start()
0617 20:17:05.499736 (+ 21us) write_op.cc:276] Timestamp: P: 1781727415548090 usec, L: 0
0617 20:17:05.499890 (+ 154us) write_op.cc:270] Start()
0617 20:17:05.499913 (+ 23us) write_op.cc:276] Timestamp: P: 1781727415562140 usec, L: 0
0617 20:17:05.500086 (+ 173us) write_op.cc:270] Start()
0617 20:17:05.500109 (+ 23us) write_op.cc:276] Timestamp: P: 1781727415569963 usec, L: 0
0617 20:17:05.500248 (+ 139us) write_op.cc:270] Start()
0617 20:17:05.500271 (+ 23us) write_op.cc:276] Timestamp: P: 1781727415577902 usec, L: 0
0617 20:17:05.500389 (+ 118us) write_op.cc:270] Start()
0617 20:17:05.500422 (+ 33us) write_op.cc:276] Timestamp: P: 1781727415587702 usec, L: 0
0617 20:17:05.500563 (+ 141us) write_op.cc:270] Start()
0617 20:17:05.500582 (+ 19us) write_op.cc:276] Timestamp: P: 1781727415595430 usec, L: 0
0617 20:17:05.500710 (+ 128us) write_op.cc:270] Start()
0617 20:17:05.500728 (+ 18us) write_op.cc:276] Timestamp: P: 1781727415603534 usec, L: 0
0617 20:17:05.500837 (+ 109us) write_op.cc:270] Start()
0617 20:17:05.500855 (+ 18us) write_op.cc:276] Timestamp: P: 1781727415618887 usec, L: 0
0617 20:17:05.501008 (+ 153us) write_op.cc:270] Start()
0617 20:17:05.501028 (+ 20us) write_op.cc:276] Timestamp: P: 1781727415633108 usec, L: 0
0617 20:17:05.501159 (+ 131us) write_op.cc:270] Start()
0617 20:17:05.501177 (+ 18us) write_op.cc:276] Timestamp: P: 1781727415643378 usec, L: 0
0617 20:17:05.501335 (+ 158us) write_op.cc:270] Start()
0617 20:17:05.501357 (+ 22us) write_op.cc:276] Timestamp: P: 1781727415678375 usec, L: 0
0617 20:17:05.501511 (+ 154us) write_op.cc:270] Start()
0617 20:17:05.501531 (+ 20us) write_op.cc:276] Timestamp: P: 1781727415697454 usec, L: 0
0617 20:17:05.501649 (+ 118us) write_op.cc:270] Start()
0617 20:17:05.501667 (+ 18us) write_op.cc:276] Timestamp: P: 1781727415719386 usec, L: 0
0617 20:17:05.501787 (+ 120us) write_op.cc:270] Start()
0617 20:17:05.501803 (+ 16us) write_op.cc:276] Timestamp: P: 1781727415733612 usec, L: 0
0617 20:17:05.501928 (+ 125us) write_op.cc:270] Start()
0617 20:17:05.501947 (+ 19us) write_op.cc:276] Timestamp: P: 1781727415751305 usec, L: 0
0617 20:17:05.502058 (+ 111us) write_op.cc:270] Start()
0617 20:17:05.502074 (+ 16us) write_op.cc:276] Timestamp: P: 1781727415759648 usec, L: 0
0617 20:17:05.502229 (+ 155us) write_op.cc:270] Start()
0617 20:17:05.502247 (+ 18us) write_op.cc:276] Timestamp: P: 1781727415785100 usec, L: 0
0617 20:17:05.502352 (+ 105us) write_op.cc:270] Start()
0617 20:17:05.502370 (+ 18us) write_op.cc:276] Timestamp: P: 1781727415822271 usec, L: 0
0617 20:17:05.502510 (+ 140us) write_op.cc:270] Start()
0617 20:17:05.502533 (+ 23us) write_op.cc:276] Timestamp: P: 1781727415823453 usec, L: 0
0617 20:17:05.502681 (+ 148us) write_op.cc:270] Start()
0617 20:17:05.502706 (+ 25us) write_op.cc:276] Timestamp: P: 1781727415824910 usec, L: 0
0617 20:17:05.502838 (+ 132us) write_op.cc:270] Start()
0617 20:17:05.502857 (+ 19us) write_op.cc:276] Timestamp: P: 1781727
I20260617 20:17:07.837971 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 26ebcfc80ca64129a7ab939bfd853998 with delete_type TABLET_DATA_DELETED (replaced by tablet a3013ecc095842f293f86f52f19510d0) from {username='slave'} at 127.0.0.1:41028
W20260617 20:17:07.839407 28636 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 57239.5us
I20260617 20:17:07.839558 29383 tablet_bootstrap.cc:492] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.839674 29383 ts_tablet_manager.cc:1403] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.001s
I20260617 20:17:07.840286 29383 raft_consensus.cc:359] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.840514 29383 raft_consensus.cc:385] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.840564 29383 raft_consensus.cc:740] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.840837 29383 consensus_queue.cc:260] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.857666 29377 raft_consensus.cc:2243] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:07.857884 29377 raft_consensus.cc:2272] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.858414 29377 ts_tablet_manager.cc:1916] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.858544 29383 ts_tablet_manager.cc:1434] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
W20260617 20:17:07.825657 28925 leader_election.cc:343] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:07.860662 29198 consensus_peers.cc:597] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:07.860982 28925 leader_election.cc:343] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.861150 28925 leader_election.cc:304] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:07.841655 29378 tablet_bootstrap.cc:492] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:07.842767 30910 tablet.cc:1724] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:07.865556 29378 ts_tablet_manager.cc:1403] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.196s user 0.002s sys 0.003s
I20260617 20:17:07.866942 29378 raft_consensus.cc:359] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.867098 29376 ts_tablet_manager.cc:1929] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.867250 29376 log.cc:1199] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/75c59cf5f5e8486baf1e038a44657f33
I20260617 20:17:07.867247 29378 raft_consensus.cc:385] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.867405 29378 raft_consensus.cc:740] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.867698 29376 ts_tablet_manager.cc:1950] T 75c59cf5f5e8486baf1e038a44657f33 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:07.867974 29378 consensus_queue.cc:260] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.868647 29378 ts_tablet_manager.cc:1434] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:17:07.868993 29378 tablet_bootstrap.cc:492] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:07.871098 29375 ts_tablet_manager.cc:1929] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.873332 30967 raft_consensus.cc:2749] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:07.877583 29383 tablet_bootstrap.cc:492] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.878120 30967 consensus_queue.cc:1048] T b6bc2304de37441bb78cd12cab5ca3c3 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:07.879205 29383 tablet_bootstrap.cc:654] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.881093 29378 tablet_bootstrap.cc:654] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.882088 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 857) took 3376 ms. Trace:
I20260617 20:17:07.882215 29376 rpcz_store.cc:276] 0617 20:17:04.505931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.507789 (+ 1858us) service_pool.cc:224] Handling call
0617 20:17:07.704315 (+3196526us) ts_tablet_manager.cc:1151] Deleting tablet 75c59cf5f5e8486baf1e038a44657f33
0617 20:17:07.704325 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.842168 (+137843us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.867031 (+ 24863us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.882068 (+ 15037us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3196407}
I20260617 20:17:07.882690 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 858) took 3376 ms. Trace:
I20260617 20:17:07.882706 28667 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_99df9464c22045a1ac1834514adf1ade"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:07.882822 29376 rpcz_store.cc:276] 0617 20:17:04.506068 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.507940 (+ 1872us) service_pool.cc:224] Handling call
0617 20:17:07.882578 (+3374638us) ts_tablet_manager.cc:1151] Deleting tablet d2db0467c5e64e38961d3b0e66375544
0617 20:17:07.882591 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.882672 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3374516}
I20260617 20:17:07.883121 29376 tablet_replica.cc:333] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:07.883345 29376 raft_consensus.cc:2243] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
W20260617 20:17:07.883505 28667 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99df9464c22045a1ac1834514adf1ade in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.883747 29376 raft_consensus.cc:2272] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.884395 29376 ts_tablet_manager.cc:1916] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.889279 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0b8e0aa46bda414b9cd909ead421e411"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:07.889947 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b8e0aa46bda414b9cd909ead421e411 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.890403 29383 tablet_bootstrap.cc:492] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.890534 29383 ts_tablet_manager.cc:1403] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20260617 20:17:07.891260 29383 raft_consensus.cc:359] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.891422 29383 raft_consensus.cc:385] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.891479 29383 raft_consensus.cc:740] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.891664 29383 consensus_queue.cc:260] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.884896 29379 tablet_bootstrap.cc:492] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:07.893479 29375 log.cc:1199] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/8a5d9677bc184c30be1a11bfa85a97c8
I20260617 20:17:07.893541 29379 ts_tablet_manager.cc:1403] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.074s user 0.024s sys 0.016s
I20260617 20:17:07.894207 29383 ts_tablet_manager.cc:1434] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 20:17:07.895375 30884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "590225c8ea36448093b77385d238a34a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:17:07.895581 30884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a [sys.catalog]: This master's current role is: LEADER
I20260617 20:17:07.897936 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_f168e10b93404a79b1d7a16f09857071"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:07.898509 29379 raft_consensus.cc:359] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.898677 29379 raft_consensus.cc:385] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.898738 29379 raft_consensus.cc:740] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.898942 29379 consensus_queue.cc:260] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:07.899024 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f168e10b93404a79b1d7a16f09857071 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:07.899470 29379 ts_tablet_manager.cc:1434] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.000s sys 0.000s
I20260617 20:17:07.899891 29375 ts_tablet_manager.cc:1950] T 8a5d9677bc184c30be1a11bfa85a97c8 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:07.900559 29383 tablet_bootstrap.cc:492] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.901031 29379 tablet_bootstrap.cc:492] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:07.902544 30988 raft_consensus.cc:493] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.902658 30988 raft_consensus.cc:515] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.902765 29379 tablet_bootstrap.cc:654] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.903208 30988 leader_election.cc:290] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:07.903853 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ca961cfea54a7187cc7ea8d16a627f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:07.904461 29198 leader_election.cc:343] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.905834 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 826) took 4525 ms. Trace:
I20260617 20:17:07.905927 29375 rpcz_store.cc:276] 0617 20:17:03.380251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.381833 (+ 1582us) service_pool.cc:224] Handling call
0617 20:17:07.831979 (+4450146us) ts_tablet_manager.cc:1151] Deleting tablet 8a5d9677bc184c30be1a11bfa85a97c8
0617 20:17:07.831989 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.859541 (+ 27552us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.871025 (+ 11484us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.905816 (+ 34791us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4449947}
W20260617 20:17:07.906277 29197 consensus_peers.cc:597] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 370db89a92a6455190edaf80e5a56205. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:07.906314 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 828) took 4434 ms. Trace:
W20260617 20:17:07.906445 29197 consensus_peers.cc:597] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14a5e5917a414c99b25ea2efeab4063d. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:07.906394 29375 rpcz_store.cc:276] 0617 20:17:03.471565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.471629 (+ 64us) service_pool.cc:224] Handling call
0617 20:17:07.906205 (+4434576us) ts_tablet_manager.cc:1151] Deleting tablet 5a09fbb3e8eb4b66acba0d6b572713ef
0617 20:17:07.906215 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.906300 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4425333}
I20260617 20:17:07.906673 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 827) took 4435 ms. Trace:
I20260617 20:17:07.906745 29375 rpcz_store.cc:276] 0617 20:17:03.471416 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.473502 (+ 2086us) service_pool.cc:224] Handling call
0617 20:17:07.906581 (+4433079us) ts_tablet_manager.cc:1151] Deleting tablet c141dde259d44f4c88db5236190259a7
0617 20:17:07.906589 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.906660 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4425617}
I20260617 20:17:07.907008 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 75c59cf5f5e8486baf1e038a44657f33 (table default.Table_0f470f9601d84ae29158e563c73bce2d [id=eb66a2f606534252b7a20de365947ee4]) successfully deleted
I20260617 20:17:07.907038 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 829) took 4427 ms. Trace:
I20260617 20:17:07.907104 29375 rpcz_store.cc:276] 0617 20:17:03.479241 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.479297 (+ 56us) service_pool.cc:224] Handling call
0617 20:17:07.906935 (+4427638us) ts_tablet_manager.cc:1151] Deleting tablet d192d11683dc4b558cd3c3f965e657f9
0617 20:17:07.906943 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.907025 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4425894}
I20260617 20:17:07.907397 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 830) took 4345 ms. Trace:
I20260617 20:17:07.907477 29375 rpcz_store.cc:276] 0617 20:17:03.562157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.562228 (+ 71us) service_pool.cc:224] Handling call
0617 20:17:07.907295 (+4345067us) ts_tablet_manager.cc:1151] Deleting tablet d5e5d246ea0e474e81edfc7e88001321
0617 20:17:07.907302 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.907370 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4344851}
I20260617 20:17:07.907754 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 831) took 4063 ms. Trace:
I20260617 20:17:07.907828 30683 raft_consensus.cc:493] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.907821 29375 rpcz_store.cc:276] 0617 20:17:03.844635 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.844977 (+ 342us) service_pool.cc:224] Handling call
0617 20:17:07.907662 (+4062685us) ts_tablet_manager.cc:1151] Deleting tablet 3e11c8b69b704e959e4463f565bf89ab
0617 20:17:07.907670 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.907743 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4014695}
I20260617 20:17:07.907933 30683 raft_consensus.cc:515] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.908066 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 832) took 4051 ms. Trace:
I20260617 20:17:07.908124 29375 rpcz_store.cc:276] 0617 20:17:03.857048 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.857123 (+ 75us) service_pool.cc:224] Handling call
0617 20:17:07.907987 (+4050864us) ts_tablet_manager.cc:1151] Deleting tablet 519719a748f441c58689172dffb54394
0617 20:17:07.907995 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.908054 (+ 59us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4014651}
I20260617 20:17:07.908416 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 834) took 3989 ms. Trace:
I20260617 20:17:07.908478 30683 leader_election.cc:290] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:07.908473 29375 rpcz_store.cc:276] 0617 20:17:03.919334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:03.919576 (+ 242us) service_pool.cc:224] Handling call
0617 20:17:07.908328 (+3988752us) ts_tablet_manager.cc:1151] Deleting tablet 6ea0168fa86547f68c7fec880b8d8f1e
0617 20:17:07.908335 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.908404 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3988512}
I20260617 20:17:07.908703 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 835) took 3911 ms. Trace:
I20260617 20:17:07.908763 29375 rpcz_store.cc:276] 0617 20:17:03.997698 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.001463 (+ 3765us) service_pool.cc:224] Handling call
0617 20:17:07.908632 (+3907169us) ts_tablet_manager.cc:1151] Deleting tablet b7e3bb8cd7df47aea4746f74f1ca2dc1
0617 20:17:07.908639 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.908693 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3906908}
I20260617 20:17:07.909009 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 836) took 3906 ms. Trace:
I20260617 20:17:07.909065 29375 rpcz_store.cc:276] 0617 20:17:04.002565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.002624 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:07.908924 (+3906300us) ts_tablet_manager.cc:1151] Deleting tablet c83fa97268f045d6aa60413dfa96ebbd
0617 20:17:07.908931 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.908999 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3906131}
W20260617 20:17:07.907675 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet d2db0467c5e64e38961d3b0e66375544 because the tablet was not found. No further retry: Not found: Tablet not found: d2db0467c5e64e38961d3b0e66375544
I20260617 20:17:07.909811 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 8a5d9677bc184c30be1a11bfa85a97c8 (table default.Table_2cc66b9f491541379d5bb95e9d64b6db [id=bc7497631072430ca5571972468880f7]) successfully deleted
W20260617 20:17:07.910167 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5a09fbb3e8eb4b66acba0d6b572713ef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5a09fbb3e8eb4b66acba0d6b572713ef already in progress: creating tablet
I20260617 20:17:07.910141 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e20a1092b746a8b8ddd4386a682229" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:07.910698 29198 leader_election.cc:343] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:07.911286 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet c141dde259d44f4c88db5236190259a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c141dde259d44f4c88db5236190259a7 already in progress: creating tablet
W20260617 20:17:07.911592 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d192d11683dc4b558cd3c3f965e657f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d192d11683dc4b558cd3c3f965e657f9 already in progress: creating tablet
W20260617 20:17:07.911897 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d5e5d246ea0e474e81edfc7e88001321 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5e5d246ea0e474e81edfc7e88001321 already in progress: creating tablet
W20260617 20:17:07.918761 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 3e11c8b69b704e959e4463f565bf89ab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3e11c8b69b704e959e4463f565bf89ab already in progress: creating tablet
W20260617 20:17:07.919061 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 519719a748f441c58689172dffb54394 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 519719a748f441c58689172dffb54394 already in progress: creating tablet
W20260617 20:17:07.919301 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 6ea0168fa86547f68c7fec880b8d8f1e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ea0168fa86547f68c7fec880b8d8f1e already in progress: creating tablet
W20260617 20:17:07.919531 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 already in progress: creating tablet
W20260617 20:17:07.919754 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet c83fa97268f045d6aa60413dfa96ebbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c83fa97268f045d6aa60413dfa96ebbd already in progress: creating tablet
I20260617 20:17:07.881629 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaddd6519dc490c8358be629b21a2d9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:07.920033 28985 raft_consensus.cc:2468] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:07.920378 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 837) took 3915 ms. Trace:
I20260617 20:17:07.899447 30967 raft_consensus.cc:493] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.920670 30967 raft_consensus.cc:515] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.920940 29375 rpcz_store.cc:276] 0617 20:17:04.004991 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.005056 (+ 65us) service_pool.cc:224] Handling call
0617 20:17:07.909228 (+3904172us) ts_tablet_manager.cc:1151] Deleting tablet 8f058c309b87431d9517338c7484bbbd
0617 20:17:07.909235 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.909289 (+ 54us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3903974}
I20260617 20:17:07.921411 30967 leader_election.cc:290] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:07.912454 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ca961cfea54a7187cc7ea8d16a627f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
W20260617 20:17:07.922048 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 8f058c309b87431d9517338c7484bbbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f058c309b87431d9517338c7484bbbd already in progress: creating tablet
I20260617 20:17:07.922500 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 838) took 3903 ms. Trace:
I20260617 20:17:07.922776 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 938b61a0f6dc4d178971034fd18c1674 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.923005 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b2797384f7845969ee9744b444f1acc with delete_type TABLET_DATA_DELETED (replaced by tablet 9dad85a23c0a45218fcd6ac04c12831a) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:07.928228 29383 tablet_bootstrap.cc:654] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.939597 30967 raft_consensus.cc:493] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.939797 30967 raft_consensus.cc:515] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.940563 30967 leader_election.cc:290] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:07.944022 29377 ts_tablet_manager.cc:1929] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:07.944157 29377 log.cc:1199] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/39ca961cfea54a7187cc7ea8d16a627f
I20260617 20:17:07.944489 29377 ts_tablet_manager.cc:1950] T 39ca961cfea54a7187cc7ea8d16a627f P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:07.944692 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08290c23fff5449481789b29d15c4781" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:07.945252 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938b61a0f6dc4d178971034fd18c1674" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:07.945441 29257 raft_consensus.cc:2468] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:07.925446 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08290c23fff5449481789b29d15c4781" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:07.945750 29375 rpcz_store.cc:276] 0617 20:17:04.019314 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.019367 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:07.922376 (+3903009us) ts_tablet_manager.cc:1151] Deleting tablet 75c59cf5f5e8486baf1e038a44657f33
0617 20:17:07.922396 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.922483 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3899704}
I20260617 20:17:07.941198 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938b61a0f6dc4d178971034fd18c1674" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:07.946122 28925 leader_election.cc:343] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:07.946194 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 75c59cf5f5e8486baf1e038a44657f33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 75c59cf5f5e8486baf1e038a44657f33 already in progress: creating tablet
W20260617 20:17:07.946389 28925 leader_election.cc:343] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.946542 28925 leader_election.cc:304] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:07.946614 29383 tablet_bootstrap.cc:492] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.946748 29383 ts_tablet_manager.cc:1403] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.002s
I20260617 20:17:07.947252 28925 leader_election.cc:304] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:07.947506 30967 raft_consensus.cc:2749] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:07.947474 29383 raft_consensus.cc:359] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.947616 29383 raft_consensus.cc:385] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.947672 29383 raft_consensus.cc:740] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.947872 29383 consensus_queue.cc:260] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.948086 30967 raft_consensus.cc:2804] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:07.948190 30967 raft_consensus.cc:493] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:07.948319 30967 raft_consensus.cc:3060] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:07.948457 29383 ts_tablet_manager.cc:1434] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:07.948725 29383 tablet_bootstrap.cc:492] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.949582 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 869) took 3356 ms. Trace:
I20260617 20:17:07.950555 29383 tablet_bootstrap.cc:654] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.950667 29375 rpcz_store.cc:276] 0617 20:17:04.593135 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.593200 (+ 65us) service_pool.cc:224] Handling call
0617 20:17:07.949441 (+3356241us) ts_tablet_manager.cc:1151] Deleting tablet ee5b41c446444389821a2ebb85c1bf8b
0617 20:17:07.949455 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.949561 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3355924}
W20260617 20:17:07.951308 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet ee5b41c446444389821a2ebb85c1bf8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee5b41c446444389821a2ebb85c1bf8b already in progress: creating tablet
I20260617 20:17:07.951833 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 870) took 3354 ms. Trace:
I20260617 20:17:07.951864 30967 raft_consensus.cc:515] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.951987 29375 rpcz_store.cc:276] 0617 20:17:04.597523 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.607295 (+ 9772us) service_pool.cc:224] Handling call
0617 20:17:07.951673 (+3344378us) ts_tablet_manager.cc:1151] Deleting tablet 8ca84d3c8b8f43978692bcc61956d2b5
0617 20:17:07.951687 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.951810 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3344139}
I20260617 20:17:07.952646 30967 leader_election.cc:290] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:07.953289 29376 ts_tablet_manager.cc:1929] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:07.953598 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938b61a0f6dc4d178971034fd18c1674" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:07.953775 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 8ca84d3c8b8f43978692bcc61956d2b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ca84d3c8b8f43978692bcc61956d2b5 already in progress: creating tablet
I20260617 20:17:07.954084 29375 tablet_replica.cc:333] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:07.954432 29375 raft_consensus.cc:2243] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
W20260617 20:17:07.954818 28925 leader_election.cc:343] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.955020 29375 raft_consensus.cc:2272] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:07.955291 28925 leader_election.cc:343] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.956158 29375 ts_tablet_manager.cc:1916] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:07.956574 29376 log.cc:1199] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/cc8fa9f4c40b4ce9baa27a8837d3575c
I20260617 20:17:07.957188 29376 ts_tablet_manager.cc:1950] T cc8fa9f4c40b4ce9baa27a8837d3575c P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:07.959722 29383 tablet_bootstrap.cc:492] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.965170 29383 ts_tablet_manager.cc:1403] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.003s
I20260617 20:17:07.966082 29383 raft_consensus.cc:359] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.966271 29383 raft_consensus.cc:385] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.966329 29383 raft_consensus.cc:740] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.966545 29383 consensus_queue.cc:260] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.966614 29378 tablet_bootstrap.cc:492] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:07.966789 29378 ts_tablet_manager.cc:1403] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.098s user 0.001s sys 0.002s
I20260617 20:17:07.967185 29383 ts_tablet_manager.cc:1434] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:07.967470 29383 tablet_bootstrap.cc:492] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:07.968000 29378 raft_consensus.cc:359] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.968297 29378 raft_consensus.cc:385] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:07.968411 29378 raft_consensus.cc:740] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:07.968823 31006 tablet.cc:1724] T e7eb77c619e04c448a084638668dbb6a P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:07.969192 29378 consensus_queue.cc:260] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.969780 29378 ts_tablet_manager.cc:1434] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:07.970471 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 860) took 3464 ms. Trace:
I20260617 20:17:07.973641 30294 raft_consensus.cc:493] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.973408 29376 rpcz_store.cc:276] 0617 20:17:04.506244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.508147 (+ 1903us) service_pool.cc:224] Handling call
0617 20:17:07.883085 (+3374938us) ts_tablet_manager.cc:1151] Deleting tablet cc8fa9f4c40b4ce9baa27a8837d3575c
0617 20:17:07.883092 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.916053 (+ 32961us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.953230 (+ 37177us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.970450 (+ 17220us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3374805}
I20260617 20:17:07.973800 30294 raft_consensus.cc:515] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.969240 29383 tablet_bootstrap.cc:654] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:07.974006 29376 tablet_replica.cc:333] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:07.974176 29376 raft_consensus.cc:2243] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:07.974529 30294 leader_election.cc:290] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:07.975584 28668 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 491aa3630ee44380aaf7c6f2d18c2eb1 has no consensus state
I20260617 20:17:07.975857 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet 5d93449f5d5d41fb9883db3bce10f969 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:07.976230 28666 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d02f66937c674c3598da361d82db321f" } modify_external_catalogs: true
I20260617 20:17:07.976405 28666 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_d02f66937c674c3598da361d82db321f" } modify_external_catalogs: true
I20260617 20:17:07.971346 30981 tablet.cc:1724] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:07.972848 30989 tablet.cc:1724] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:07.986919 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e20a1092b746a8b8ddd4386a682229" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:07.987146 28985 raft_consensus.cc:2468] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:17:07.988040 29062 leader_election.cc:343] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 0eaa60028a1647e580a987c3a0836a24
I20260617 20:17:07.969467 29197 leader_election.cc:304] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:17:07.989255 29197 leader_election.cc:343] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Illegal state: Tablet not RUNNING: STOPPED
I20260617 20:17:07.989398 29197 leader_election.cc:304] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:07.989615 30852 raft_consensus.cc:2804] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:07.989687 30852 raft_consensus.cc:493] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:07.989751 30852 raft_consensus.cc:3060] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:07.992331 30852 raft_consensus.cc:515] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.992962 30988 raft_consensus.cc:2749] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:07.993677 30852 leader_election.cc:290] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:07.994007 29383 tablet_bootstrap.cc:492] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:07.994189 29383 ts_tablet_manager.cc:1403] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.001s
I20260617 20:17:07.994134 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaddd6519dc490c8358be629b21a2d9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:07.994776 29198 leader_election.cc:343] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:07.995005 29376 raft_consensus.cc:2272] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:07.997468 30967 raft_consensus.cc:493] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:07.997654 30967 raft_consensus.cc:515] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:07.998389 30967 leader_election.cc:290] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:07.999085 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326eb1cffb9a47078320e6fcba0743ce" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:07.999773 28925 leader_election.cc:343] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:08.001368 29383 raft_consensus.cc:359] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.001596 29383 raft_consensus.cc:385] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.001657 29383 raft_consensus.cc:740] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.001889 29383 consensus_queue.cc:260] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.002363 29376 ts_tablet_manager.cc:1916] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.002375 29383 ts_tablet_manager.cc:1434] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.008s user 0.000s sys 0.000s
I20260617 20:17:08.003901 29383 tablet_bootstrap.cc:492] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:08.005949 29375 ts_tablet_manager.cc:1929] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:08.006151 29383 tablet_bootstrap.cc:654] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.008049 29378 tablet_bootstrap.cc:492] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:08.008507 29197 leader_election.cc:304] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:08.009032 29375 log.cc:1199] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/27c20f436b9b4a8cb659215f9579af04
I20260617 20:17:08.009074 30683 raft_consensus.cc:2804] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:08.009159 30683 raft_consensus.cc:493] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:08.009231 30683 raft_consensus.cc:3060] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.009891 29378 tablet_bootstrap.cc:654] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.011343 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 898) took 3077 ms. Trace:
I20260617 20:17:08.011475 29377 rpcz_store.cc:276] 0617 20:17:04.933481 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.936614 (+ 3133us) service_pool.cc:224] Handling call
0617 20:17:07.824921 (+2888307us) ts_tablet_manager.cc:1151] Deleting tablet 39ca961cfea54a7187cc7ea8d16a627f
0617 20:17:07.824930 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.917375 (+ 92445us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:07.943968 (+ 26593us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.011321 (+ 67353us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2888164}
I20260617 20:17:08.011782 30683 raft_consensus.cc:515] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.012101 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 39ca961cfea54a7187cc7ea8d16a627f (table default.Table_6e3a4cd286c74acca399a55d5202d4ac [id=9eceb2e355c940f1854894b7fc8a92dc]) successfully deleted
I20260617 20:17:08.012262 29375 ts_tablet_manager.cc:1950] T 27c20f436b9b4a8cb659215f9579af04 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:08.012444 29377 tablet_replica.cc:333] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:08.012656 29377 raft_consensus.cc:2243] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.012888 29377 raft_consensus.cc:2272] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.013437 29377 ts_tablet_manager.cc:1916] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.018626 28664 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f0db2ca25413465891e96ea21ba8f22a" } modify_external_catalogs: true
I20260617 20:17:08.018842 28664 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f0db2ca25413465891e96ea21ba8f22a" } modify_external_catalogs: true
I20260617 20:17:08.015269 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 871) took 3201 ms. Trace:
I20260617 20:17:08.028151 29379 tablet_bootstrap.cc:492] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.032205 29379 ts_tablet_manager.cc:1403] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.131s user 0.004s sys 0.000s
I20260617 20:17:08.033070 29379 raft_consensus.cc:359] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.033407 29379 raft_consensus.cc:385] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.033552 29379 raft_consensus.cc:740] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.033875 29379 consensus_queue.cc:260] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.031739 29375 rpcz_store.cc:276] 0617 20:17:04.813651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.813714 (+ 63us) service_pool.cc:224] Handling call
0617 20:17:07.954024 (+3140310us) ts_tablet_manager.cc:1151] Deleting tablet 27c20f436b9b4a8cb659215f9579af04
0617 20:17:07.954037 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:07.963563 (+ 9526us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.005872 (+ 42309us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.015246 (+ 9374us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3107592}
I20260617 20:17:08.034662 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 27c20f436b9b4a8cb659215f9579af04 (table default.Table_3d19c23664c34aff8fce1a199ca71ac9 [id=f8657da5fd504f17aa1f82c1dba56187]) successfully deleted
I20260617 20:17:08.035130 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 872) took 3216 ms. Trace:
I20260617 20:17:08.035267 29375 rpcz_store.cc:276] 0617 20:17:04.818522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.818569 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:08.034991 (+3216422us) ts_tablet_manager.cc:1151] Deleting tablet cc547148aa124907a5e5def6941f734c
0617 20:17:08.035002 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.035112 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3173541}
I20260617 20:17:08.035424 29378 tablet_bootstrap.cc:492] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:08.035674 29378 ts_tablet_manager.cc:1403] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.000s
W20260617 20:17:08.035846 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet cc547148aa124907a5e5def6941f734c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc547148aa124907a5e5def6941f734c already in progress: creating tablet
I20260617 20:17:08.036242 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 873) took 3205 ms. Trace:
I20260617 20:17:08.036361 29375 rpcz_store.cc:276] 0617 20:17:04.830689 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.830752 (+ 63us) service_pool.cc:224] Handling call
0617 20:17:08.036136 (+3205384us) ts_tablet_manager.cc:1151] Deleting tablet ccd6f76a201e40f8be224a93c701fea9
0617 20:17:08.036145 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.036224 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3174633}
W20260617 20:17:08.036870 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet ccd6f76a201e40f8be224a93c701fea9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccd6f76a201e40f8be224a93c701fea9 already in progress: creating tablet
I20260617 20:17:08.037225 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 874) took 3137 ms. Trace:
I20260617 20:17:08.037690 29378 raft_consensus.cc:359] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.037925 29378 raft_consensus.cc:385] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.038028 29378 raft_consensus.cc:740] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.038142 29375 rpcz_store.cc:276] 0617 20:17:04.899585 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.899646 (+ 61us) service_pool.cc:224] Handling call
0617 20:17:08.037149 (+3137503us) ts_tablet_manager.cc:1151] Deleting tablet 67a3124306094c72ad78e5473aa35bdb
0617 20:17:08.037157 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.037207 (+ 50us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3137277}
I20260617 20:17:08.038300 29378 consensus_queue.cc:260] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:08.038645 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 67a3124306094c72ad78e5473aa35bdb because the tablet was not found. No further retry: Not found: Tablet not found: 67a3124306094c72ad78e5473aa35bdb
I20260617 20:17:08.038993 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 876) took 3139 ms. Trace:
I20260617 20:17:08.040462 28669 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a39fd5d8d0904a738db01e4866ba504f" } modify_external_catalogs: true
I20260617 20:17:08.040630 28669 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a39fd5d8d0904a738db01e4866ba504f" } modify_external_catalogs: true
I20260617 20:17:08.042428 30683 leader_election.cc:290] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.044672 29378 ts_tablet_manager.cc:1434] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260617 20:17:08.045027 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_a6272b48651941ac98fb21a3f6de6679" } new_table_name: "default.Table_4a1320838a1a477cabc0d69fbe93cc5e" modify_external_catalogs: true
I20260617 20:17:08.048609 29378 tablet_bootstrap.cc:492] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:08.048913 30683 raft_consensus.cc:493] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.049050 30683 raft_consensus.cc:515] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.049714 30683 leader_election.cc:290] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.051148 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet cc8fa9f4c40b4ce9baa27a8837d3575c (table default.Table_350b5e38df254cc69627edec8db5af45 [id=3463908997e94c288a7ac6ba26de9451]) successfully deleted
I20260617 20:17:08.052002 30910 tablet.cc:1724] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:08.053031 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaddd6519dc490c8358be629b21a2d9" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:08.053181 28981 raft_consensus.cc:3060] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.056142 28981 raft_consensus.cc:2468] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:08.056890 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938b61a0f6dc4d178971034fd18c1674" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:08.057044 29261 raft_consensus.cc:3060] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.058226 29378 tablet_bootstrap.cc:654] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.060683 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e20a1092b746a8b8ddd4386a682229" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:08.060881 28978 raft_consensus.cc:3060] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.065706 28978 raft_consensus.cc:2468] T a3e20a1092b746a8b8ddd4386a682229 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:08.073257 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f3b595ceaae84ca6a9460b180efc2e5d" } modify_external_catalogs: true
I20260617 20:17:08.073489 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_f3b595ceaae84ca6a9460b180efc2e5d" } modify_external_catalogs: true
W20260617 20:17:08.074093 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0d95e957008b451993e327a7acb4671a has no consensus state
I20260617 20:17:08.074402 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c924b0d8446c4a9a98e9f94a926c3fc9" } modify_external_catalogs: true
I20260617 20:17:08.074573 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c924b0d8446c4a9a98e9f94a926c3fc9" } modify_external_catalogs: true
I20260617 20:17:08.076717 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_d4d37c5379c9419c8b12c966da753137"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.077313 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4d37c5379c9419c8b12c966da753137 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.078292 30910 tablet.cc:1724] T b162a0ef91d1447b838331ba6ef93bf4 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:08.081203 29377 ts_tablet_manager.cc:1929] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:08.081382 29377 log.cc:1199] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/938b61a0f6dc4d178971034fd18c1674
I20260617 20:17:08.081710 29377 ts_tablet_manager.cc:1950] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:08.082299 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 899) took 3148 ms. Trace:
I20260617 20:17:08.082405 29377 rpcz_store.cc:276] 0617 20:17:04.933569 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.936773 (+ 3204us) service_pool.cc:224] Handling call
0617 20:17:08.012384 (+3075611us) ts_tablet_manager.cc:1151] Deleting tablet 938b61a0f6dc4d178971034fd18c1674
0617 20:17:08.012397 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.054703 (+ 42306us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.081152 (+ 26449us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.082241 (+ 1089us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3075496}
I20260617 20:17:08.082852 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 938b61a0f6dc4d178971034fd18c1674 (table default.Table_cdbdfa69a2ce497ea08811de10403d4a [id=a2424a096b1c4a8fa97b06acfdd7f1b0]) successfully deleted
I20260617 20:17:08.092324 29378 tablet_bootstrap.cc:492] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:08.093873 29378 ts_tablet_manager.cc:1403] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.000s
I20260617 20:17:08.094838 29378 raft_consensus.cc:359] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.094923 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_9cd011070f8848eeb76b111f2e64f60f" } new_table_name: "default.Table_a1c77cc368fb44969f11416cb083598b" modify_external_catalogs: true
I20260617 20:17:08.095228 29378 raft_consensus.cc:385] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.095392 29378 raft_consensus.cc:740] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.095722 29378 consensus_queue.cc:260] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.096357 30852 raft_consensus.cc:493] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.096453 29378 ts_tablet_manager.cc:1434] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:08.096531 30852 raft_consensus.cc:515] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.043066 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e20a1092b746a8b8ddd4386a682229" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:08.096920 29378 tablet_bootstrap.cc:492] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:08.050325 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f823290351d542179b8bcc683d7acf6a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:08.059300 30901 tablet.cc:1724] T b162a0ef91d1447b838331ba6ef93bf4 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:08.097219 30852 leader_election.cc:290] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.098628 29378 tablet_bootstrap.cc:654] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.099231 29197 leader_election.cc:304] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:17:08.099637 29197 leader_election.cc:343] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f823290351d542179b8bcc683d7acf6a
I20260617 20:17:08.099774 29197 leader_election.cc:304] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.100041 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326eb1cffb9a47078320e6fcba0743ce" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:08.100312 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaa60028a1647e580a987c3a0836a24" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:08.100484 29259 raft_consensus.cc:2393] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate 5ca3d93189744132bbf55ac01f3a8254 in this term.
I20260617 20:17:08.100935 30683 raft_consensus.cc:2804] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:08.101046 30683 raft_consensus.cc:697] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:08.101454 30761 raft_consensus.cc:2804] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:08.101534 30761 raft_consensus.cc:697] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:08.101704 30761 consensus_queue.cc:237] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.102005 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17684c0e6b545d1a22801071b6a72ac" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:08.102258 28988 raft_consensus.cc:2468] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:08.102902 30410 raft_consensus.cc:493] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.103026 30410 raft_consensus.cc:515] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.103567 30410 leader_election.cc:290] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.104482 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 900) took 3167 ms. Trace:
I20260617 20:17:08.104586 29377 rpcz_store.cc:276] 0617 20:17:04.936633 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.936921 (+ 288us) service_pool.cc:224] Handling call
0617 20:17:08.104328 (+3167407us) ts_tablet_manager.cc:1151] Deleting tablet 211d0b0897f14ff4929ed55cd2f27b94
0617 20:17:08.104337 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.104426 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3167291}
W20260617 20:17:08.105090 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 211d0b0897f14ff4929ed55cd2f27b94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 211d0b0897f14ff4929ed55cd2f27b94 already in progress: creating tablet
I20260617 20:17:08.106408 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 901) took 3037 ms. Trace:
I20260617 20:17:08.118427 29375 rpcz_store.cc:276] 0617 20:17:04.899835 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.899880 (+ 45us) service_pool.cc:224] Handling call
0617 20:17:08.038910 (+3139030us) ts_tablet_manager.cc:1151] Deleting tablet 4e27c5834baa48ed953fccef54e6c52b
0617 20:17:08.038918 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.038976 (+ 58us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3138806}
I20260617 20:17:08.101256 30683 consensus_queue.cc:237] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:08.122453 28925 leader_election.cc:343] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:08.122618 28925 leader_election.cc:304] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:08.122789 29197 leader_election.cc:304] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.122850 30967 raft_consensus.cc:2749] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:08.123013 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet e3897179e7724fdeb87a979ae4ef2091 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.124064 30988 raft_consensus.cc:2804] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:08.124148 30988 raft_consensus.cc:493] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:08.124213 30988 raft_consensus.cc:3060] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.124927 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6af49cb484f59ad1f32235753e1db" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:08.125175 28981 raft_consensus.cc:2468] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:08.126807 30988 raft_consensus.cc:515] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.127342 30988 leader_election.cc:290] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.128819 30981 tablet.cc:1724] T 24e4b91def8642b7a8a063c06f43e060 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 20:17:08.129271 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4e27c5834baa48ed953fccef54e6c52b because the tablet was not found. No further retry: Not found: Tablet not found: 4e27c5834baa48ed953fccef54e6c52b
I20260617 20:17:08.129882 29375 tablet_replica.cc:333] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:08.131197 29375 raft_consensus.cc:2243] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.132272 29375 raft_consensus.cc:2272] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.141953 29197 leader_election.cc:304] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.142593 30852 raft_consensus.cc:2804] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:08.142673 30852 raft_consensus.cc:493] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:08.142730 30852 raft_consensus.cc:3060] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.143611 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17684c0e6b545d1a22801071b6a72ac" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:08.143788 28978 raft_consensus.cc:3060] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.145447 30852 raft_consensus.cc:515] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.146390 28978 raft_consensus.cc:2468] T a17684c0e6b545d1a22801071b6a72ac P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:08.146899 30981 tablet.cc:1719] T 74c73ae1007d44ce958ad02fa5787651 P a8c0aea0206f44d683ed3b6b18c719f6: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:08.147935 29375 ts_tablet_manager.cc:1916] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.149863 29376 ts_tablet_manager.cc:1929] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:08.150218 29376 log.cc:1199] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/203666e6127b49ed92731bc87ce01798
I20260617 20:17:08.150207 30910 tablet.cc:1719] T 74c73ae1007d44ce958ad02fa5787651 P 5ca3d93189744132bbf55ac01f3a8254: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:08.150727 29376 ts_tablet_manager.cc:1950] T 203666e6127b49ed92731bc87ce01798 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:08.151095 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 862) took 3644 ms. Trace:
I20260617 20:17:08.151211 29376 rpcz_store.cc:276] 0617 20:17:04.506421 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.508322 (+ 1901us) service_pool.cc:224] Handling call
0617 20:17:07.973951 (+3465629us) ts_tablet_manager.cc:1151] Deleting tablet 203666e6127b49ed92731bc87ce01798
0617 20:17:07.973960 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.120126 (+146166us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.149807 (+ 29681us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.151083 (+ 1276us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3465504}
I20260617 20:17:08.132030 29379 ts_tablet_manager.cc:1434] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.100s user 0.001s sys 0.001s
I20260617 20:17:08.151579 29376 tablet_replica.cc:333] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:08.151746 29376 raft_consensus.cc:2243] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:08.152102 29376 raft_consensus.cc:2272] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.152755 29376 ts_tablet_manager.cc:1916] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.154279 29197 leader_election.cc:304] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.155092 30410 raft_consensus.cc:2804] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:08.155208 30410 raft_consensus.cc:697] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:08.155155 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 203666e6127b49ed92731bc87ce01798 (table default.Table_976e062ae33e43fc8ce7604f7bf3ad69 [id=37131dec7c6a44cb9c9aed3a27a5028a]) successfully deleted
I20260617 20:17:08.155408 30410 consensus_queue.cc:237] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.156222 29379 tablet_bootstrap.cc:492] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.158043 29379 tablet_bootstrap.cc:654] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.160806 30852 leader_election.cc:290] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.165001 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6af49cb484f59ad1f32235753e1db" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:08.165457 28978 raft_consensus.cc:3060] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.168042 28978 raft_consensus.cc:2468] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:08.168673 29197 leader_election.cc:304] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.169869 30988 raft_consensus.cc:2804] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:08.170015 30988 raft_consensus.cc:697] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:08.170423 30988 consensus_queue.cc:237] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.175436 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_a108c0a8edf2412b8c8bf5decbc848b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.176088 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a108c0a8edf2412b8c8bf5decbc848b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.179322 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 6f08bdd9c769403db89c20aabdc58d59
I20260617 20:17:08.180539 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f08bdd9c769403db89c20aabdc58d59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.180549 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f08bdd9c769403db89c20aabdc58d59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.180815 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 5d93449f5d5d41fb9883db3bce10f969
I20260617 20:17:08.181420 28668 catalog_manager.cc:6784] ReplaceTablet: tablet 5d93449f5d5d41fb9883db3bce10f969 deleted and replaced by tablet b9008e7ea8f54896b5d4e51a2512f85b
I20260617 20:17:08.181679 28668 master_service.cc:960] ReplaceTablet: received request to replace tablet 078875241c324538ad6f93de1169aeb8 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:08.181705 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d93449f5d5d41fb9883db3bce10f969 with delete_type TABLET_DATA_DELETED (replaced by tablet b9008e7ea8f54896b5d4e51a2512f85b) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.182219 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 05e5918dcafc4accb0345a8389b65412
I20260617 20:17:08.183171 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d93449f5d5d41fb9883db3bce10f969 with delete_type TABLET_DATA_DELETED (replaced by tablet b9008e7ea8f54896b5d4e51a2512f85b) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.183763 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet 05e5918dcafc4accb0345a8389b65412 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.184269 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d93449f5d5d41fb9883db3bce10f969 with delete_type TABLET_DATA_DELETED (replaced by tablet b9008e7ea8f54896b5d4e51a2512f85b) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.184458 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet 05e5918dcafc4accb0345a8389b65412 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.184646 29379 tablet_bootstrap.cc:492] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.184790 29379 ts_tablet_manager.cc:1403] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260617 20:17:08.185894 29379 raft_consensus.cc:359] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.186211 29379 raft_consensus.cc:385] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.186331 29379 raft_consensus.cc:740] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.186951 29379 consensus_queue.cc:260] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.195758 29379 ts_tablet_manager.cc:1434] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20260617 20:17:08.196388 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 326eb1cffb9a47078320e6fcba0743ce (table default.Table_8000cf41d95f4152983d7fe1d74cbdb8 [id=42f2f56c7b0f4ac4bddd9a9eea89a7b2]). Expected version 1 got 0
I20260617 20:17:08.196691 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]). Expected version 1 got 0
I20260617 20:17:08.197739 28663 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 07ec778da4c9467d90c7151f36ffaa79 (table default.Table_4186d04aa9cf40c481d3436773b1b119 [id=1d82dfca17c74fc5a145191440d60830]). Expected version 1 got 0
I20260617 20:17:08.198287 28661 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c] alter complete (version 1)
I20260617 20:17:08.208133 29379 tablet_bootstrap.cc:492] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.208190 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 1709c52c8857412d8ed74db312f588e7 (DEFAULT_TABLE table=default.Table_9b1f182b3d5c42ac986fdc3989d04e85 [id=b27c2b2a2e0f40cf94cd8b21b78a6e1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.208750 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1709c52c8857412d8ed74db312f588e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.210693 29379 tablet_bootstrap.cc:654] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.212509 29261 raft_consensus.cc:2468] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:08.213874 30852 raft_consensus.cc:493] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.214016 30852 raft_consensus.cc:515] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.214972 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f08bdd9c769403db89c20aabdc58d59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.216372 29377 rpcz_store.cc:276] 0617 20:17:05.068659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.068709 (+ 50us) service_pool.cc:224] Handling call
0617 20:17:08.106230 (+3037521us) ts_tablet_manager.cc:1151] Deleting tablet 5bc8b1dc268b455ea263b67077e0bf6d
0617 20:17:08.106241 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.106347 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3037348}
W20260617 20:17:08.216984 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5bc8b1dc268b455ea263b67077e0bf6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bc8b1dc268b455ea263b67077e0bf6d already in progress: creating tablet
I20260617 20:17:08.217518 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 902) took 3146 ms. Trace:
I20260617 20:17:08.217676 29377 rpcz_store.cc:276] 0617 20:17:05.071233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.071322 (+ 89us) service_pool.cc:224] Handling call
0617 20:17:08.217347 (+3146025us) ts_tablet_manager.cc:1151] Deleting tablet 5d09b732e1cc4126bf7b0b17e5396607
0617 20:17:08.217362 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.217494 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3145849}
W20260617 20:17:08.218341 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5d09b732e1cc4126bf7b0b17e5396607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d09b732e1cc4126bf7b0b17e5396607 already in progress: creating tablet
I20260617 20:17:08.218952 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 903) took 3145 ms. Trace:
I20260617 20:17:08.219091 29377 rpcz_store.cc:276] 0617 20:17:05.073569 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.073616 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:08.218760 (+3145144us) ts_tablet_manager.cc:1151] Deleting tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5
0617 20:17:08.218774 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.218877 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3144979}
W20260617 20:17:08.219623 28655 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5 already in progress: creating tablet
I20260617 20:17:08.220026 29377 tablet_replica.cc:333] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:08.220310 29377 raft_consensus.cc:2243] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.220537 29377 raft_consensus.cc:2272] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.217199 30852 leader_election.cc:290] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.219344 29375 ts_tablet_manager.cc:1929] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:08.229439 29375 log.cc:1199] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/e59430dd630b4ca6b573ea4230212abf
I20260617 20:17:08.229962 29375 ts_tablet_manager.cc:1950] T e59430dd630b4ca6b573ea4230212abf P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:08.231297 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 879) took 3331 ms. Trace:
I20260617 20:17:08.236676 29377 ts_tablet_manager.cc:1916] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.241422 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 05e5918dcafc4accb0345a8389b65412 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:07 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.242745 29375 rpcz_store.cc:276] 0617 20:17:04.900180 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.900217 (+ 37us) service_pool.cc:224] Handling call
0617 20:17:08.129808 (+3229591us) ts_tablet_manager.cc:1151] Deleting tablet e59430dd630b4ca6b573ea4230212abf
0617 20:17:08.129825 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.179939 (+ 50114us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.219262 (+ 39323us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.231274 (+ 12012us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3229350}
I20260617 20:17:08.243371 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet e59430dd630b4ca6b573ea4230212abf (table default.Table_f09fba1c81844e81a218171de6721f68 [id=e9b35265c9c245e5a2d81e9f8b81a92c]) successfully deleted
I20260617 20:17:08.243844 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 878) took 3343 ms. Trace:
I20260617 20:17:08.245610 28925 leader_election.cc:304] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:17:08.245805 28925 raft_consensus.cc:2686] T 938b61a0f6dc4d178971034fd18c1674 P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260617 20:17:08.246780 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3897179e7724fdeb87a979ae4ef2091" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:08.246960 28981 raft_consensus.cc:2468] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:08.247794 29375 rpcz_store.cc:276] 0617 20:17:04.900042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.900344 (+ 302us) service_pool.cc:224] Handling call
0617 20:17:08.243725 (+3343381us) ts_tablet_manager.cc:1151] Deleting tablet 0859e56b5b7a483ea5e751f0468cbab8
0617 20:17:08.243745 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.243826 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3343206}
I20260617 20:17:08.248128 29197 leader_election.cc:304] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:17:08.248657 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 0859e56b5b7a483ea5e751f0468cbab8 because the tablet was not found. No further retry: Not found: Tablet not found: 0859e56b5b7a483ea5e751f0468cbab8
W20260617 20:17:08.209517 29063 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.195:45189, user_credentials={real_user=slave}} blocked reactor thread for 157650us
I20260617 20:17:08.250301 31009 raft_consensus.cc:493] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.250474 31009 raft_consensus.cc:515] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.250347 29375 tablet_replica.cc:333] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:08.251060 29375 raft_consensus.cc:2243] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.251127 31009 leader_election.cc:290] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:08.251256 29375 raft_consensus.cc:2272] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.251852 29375 ts_tablet_manager.cc:1916] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.252525 30967 raft_consensus.cc:493] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.252646 30967 raft_consensus.cc:515] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.253177 30967 leader_election.cc:290] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:08.252391 29062 leader_election.cc:343] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 938b61a0f6dc4d178971034fd18c1674
I20260617 20:17:08.265383 29379 tablet_bootstrap.cc:492] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.265626 29379 ts_tablet_manager.cc:1403] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.002s
I20260617 20:17:08.266482 29379 raft_consensus.cc:359] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.266721 29379 raft_consensus.cc:385] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.266824 29379 raft_consensus.cc:740] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.267071 29379 consensus_queue.cc:260] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.267659 29379 ts_tablet_manager.cc:1434] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:08.268009 29379 tablet_bootstrap.cc:492] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.270941 30967 raft_consensus.cc:493] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.271082 30967 raft_consensus.cc:515] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.271668 30967 leader_election.cc:290] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:08.277582 30967 raft_consensus.cc:493] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.277701 30967 raft_consensus.cc:515] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.278283 30967 leader_election.cc:290] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:08.283496 29377 ts_tablet_manager.cc:1929] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:08.284937 29377 log.cc:1199] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/8b6f05ae7d624efba571d059ce2f1c91
I20260617 20:17:08.285610 29377 ts_tablet_manager.cc:1950] T 8b6f05ae7d624efba571d059ce2f1c91 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:08.287214 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 904) took 3167 ms. Trace:
I20260617 20:17:08.289060 29097 tablet_service.cc:1511] Processing CreateTablet for tablet d7dc54deac9948d7a930120d73b62279 (DEFAULT_TABLE table=default.Table_c365798fc83d4befad2195f6b2ac7fca [id=94d11e5f866048c2bfc5b147e2da303f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.289489 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dc54deac9948d7a930120d73b62279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.289806 29379 tablet_bootstrap.cc:654] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.288663 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 1709c52c8857412d8ed74db312f588e7 (DEFAULT_TABLE table=default.Table_9b1f182b3d5c42ac986fdc3989d04e85 [id=b27c2b2a2e0f40cf94cd8b21b78a6e1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.290791 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1709c52c8857412d8ed74db312f588e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.292112 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 16f78c31fa80424785d35f1fb49e43e2 (DEFAULT_TABLE table=default.Table_8acde758a415485fa7e9aaa929121769 [id=c7b9ada447dd4b2cbebdb0c0e4790705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.292485 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f78c31fa80424785d35f1fb49e43e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.292565 28969 tablet_service.cc:1511] Processing CreateTablet for tablet aefd00baa1784c7887104b0650556ff6 (DEFAULT_TABLE table=default.Table_a9feae94e42c4ffc87ff57c32a580c64 [id=749a20b2889949018a13034961c884ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.292879 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefd00baa1784c7887104b0650556ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.293572 29089 tablet_service.cc:1511] Processing CreateTablet for tablet aefd00baa1784c7887104b0650556ff6 (DEFAULT_TABLE table=default.Table_a9feae94e42c4ffc87ff57c32a580c64 [id=749a20b2889949018a13034961c884ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.293907 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefd00baa1784c7887104b0650556ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.294849 29375 ts_tablet_manager.cc:1929] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:08.294945 29375 log.cc:1199] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/5faea831376646c1bdfcaf8fbbc7ca6d
I20260617 20:17:08.295332 29375 ts_tablet_manager.cc:1950] T 5faea831376646c1bdfcaf8fbbc7ca6d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:08.296087 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 875) took 3396 ms. Trace:
I20260617 20:17:08.296161 29375 rpcz_store.cc:276] 0617 20:17:04.899692 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.900230 (+ 538us) service_pool.cc:224] Handling call
0617 20:17:08.250287 (+3350057us) ts_tablet_manager.cc:1151] Deleting tablet 5faea831376646c1bdfcaf8fbbc7ca6d
0617 20:17:08.250301 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.291894 (+ 41593us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.294808 (+ 2914us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.296069 (+ 1261us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3349543}
I20260617 20:17:08.296635 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 5faea831376646c1bdfcaf8fbbc7ca6d (table default.Table_230ee4baedc44720869f17501e15a05e [id=aa54066da9fc4f3db61a51b59db1afb6]) successfully deleted
I20260617 20:17:08.290259 28954 tablet_service.cc:1511] Processing CreateTablet for tablet d7dc54deac9948d7a930120d73b62279 (DEFAULT_TABLE table=default.Table_c365798fc83d4befad2195f6b2ac7fca [id=94d11e5f866048c2bfc5b147e2da303f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.297626 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dc54deac9948d7a930120d73b62279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.248405 31017 raft_consensus.cc:2804] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:08.308318 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_440996b6cc8d431c9c09e1912c9b9ffd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.308926 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_440996b6cc8d431c9c09e1912c9b9ffd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.303038 31017 raft_consensus.cc:493] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:08.309140 31017 raft_consensus.cc:3060] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.310662 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1a39ae6042f446fb9caf98ad3c112778"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.311129 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a39ae6042f446fb9caf98ad3c112778 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.286327 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6522ae212784b7ebd47cc3403aa3477" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:08.312201 31017 raft_consensus.cc:515] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.312239 28661 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_519cbb2c93394f968d1b274487015f44" } new_table_name: "default.Table_2c2192003f3b4117a9804a627934942c" modify_external_catalogs: true
I20260617 20:17:08.286875 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d0b861d48e4baf94387f4ff9d9f778" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:08.249416 29198 leader_election.cc:343] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:08.305624 29241 tablet_service.cc:1511] Processing CreateTablet for tablet 1709c52c8857412d8ed74db312f588e7 (DEFAULT_TABLE table=default.Table_9b1f182b3d5c42ac986fdc3989d04e85 [id=b27c2b2a2e0f40cf94cd8b21b78a6e1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.313689 29241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1709c52c8857412d8ed74db312f588e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.306295 29228 tablet_service.cc:1511] Processing CreateTablet for tablet d7dc54deac9948d7a930120d73b62279 (DEFAULT_TABLE table=default.Table_c365798fc83d4befad2195f6b2ac7fca [id=94d11e5f866048c2bfc5b147e2da303f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.314743 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dc54deac9948d7a930120d73b62279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.306488 29224 tablet_service.cc:1511] Processing CreateTablet for tablet aefd00baa1784c7887104b0650556ff6 (DEFAULT_TABLE table=default.Table_a9feae94e42c4ffc87ff57c32a580c64 [id=749a20b2889949018a13034961c884ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.278862 29383 tablet_bootstrap.cc:492] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:08.315150 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aefd00baa1784c7887104b0650556ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.315176 29383 ts_tablet_manager.cc:1403] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.311s user 0.027s sys 0.019s
I20260617 20:17:08.286648 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d778641c354c679ee9e7d7b3eae3b5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:08.318037 29377 rpcz_store.cc:276] 0617 20:17:05.120242 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.120294 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:08.219967 (+3099673us) ts_tablet_manager.cc:1151] Deleting tablet 8b6f05ae7d624efba571d059ce2f1c91
0617 20:17:08.219979 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.239798 (+ 19819us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.283431 (+ 43633us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.287194 (+ 3763us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3099473}
I20260617 20:17:08.318514 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 8b6f05ae7d624efba571d059ce2f1c91 (table default.Table_00ae029b2f81402188ceedb8535a9652 [id=4ad941b11d7c4a47b5f13c8504c0ac28]) successfully deleted
I20260617 20:17:08.318816 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_b9517f8356cc47a1b60d232b6cca9dc2" } new_table_name: "default.Table_c2f68ef5042044f6aa4494001d1f0238" modify_external_catalogs: true
I20260617 20:17:08.319396 29377 tablet_replica.cc:333] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:08.319593 29377 raft_consensus.cc:2243] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.319737 29377 raft_consensus.cc:2272] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.320255 29377 ts_tablet_manager.cc:1916] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.322264 31009 raft_consensus.cc:493] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.322408 31009 raft_consensus.cc:515] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.323076 31009 leader_election.cc:290] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:08.324000 29062 leader_election.cc:343] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f24954093a45411a9cbe39415fb1adb7
I20260617 20:17:08.325466 29375 tablet_replica.cc:333] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:08.325721 29375 raft_consensus.cc:2243] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.325922 29375 raft_consensus.cc:2272] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.329227 30852 raft_consensus.cc:493] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.329388 30852 raft_consensus.cc:515] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.331612 29375 ts_tablet_manager.cc:1916] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:08.313315 29198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 63886.5us
W20260617 20:17:08.336588 29198 leader_election.cc:343] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:08.336731 29198 leader_election.cc:304] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:08.336933 31023 raft_consensus.cc:2749] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:08.338106 31017 leader_election.cc:290] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.338366 29379 tablet_bootstrap.cc:492] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.338526 29379 ts_tablet_manager.cc:1403] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.071s user 0.006s sys 0.001s
I20260617 20:17:08.340008 30852 leader_election.cc:290] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:08.340480 28925 leader_election.cc:343] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:08.342259 28925 leader_election.cc:343] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:08.342474 28925 leader_election.cc:343] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:08.342635 29379 raft_consensus.cc:359] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.342840 29379 raft_consensus.cc:385] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.342895 29379 raft_consensus.cc:740] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.344208 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3897179e7724fdeb87a979ae4ef2091" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:08.344365 28978 raft_consensus.cc:3060] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.344674 29379 consensus_queue.cc:260] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.345351 29379 ts_tablet_manager.cc:1434] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
W20260617 20:17:08.347499 28636 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 85263.6us
I20260617 20:17:08.347626 28978 raft_consensus.cc:2468] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:08.344219 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a3d9ae347845dfa9357010819ebc58" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:08.350160 29378 tablet_bootstrap.cc:492] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:08.345541 30981 tablet.cc:1724] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:08.353183 29197 leader_election.cc:304] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:17:08.353679 29197 leader_election.cc:343] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Illegal state: Tablet not RUNNING: STOPPED
I20260617 20:17:08.353929 31023 raft_consensus.cc:2804] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:08.354279 31023 raft_consensus.cc:697] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:08.354306 30967 raft_consensus.cc:493] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.354435 30967 raft_consensus.cc:515] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.355088 30967 leader_election.cc:290] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:08.357224 29378 ts_tablet_manager.cc:1403] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.260s user 0.017s sys 0.017s
I20260617 20:17:08.357805 29383 raft_consensus.cc:359] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.357978 29383 raft_consensus.cc:385] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.358042 29383 raft_consensus.cc:740] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.358243 29383 consensus_queue.cc:260] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.358343 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e7a29b7fdd411e9957d23861a996db" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:08.358565 31017 raft_consensus.cc:493] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.358680 31017 raft_consensus.cc:515] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.358757 29383 ts_tablet_manager.cc:1434] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.044s user 0.001s sys 0.000s
I20260617 20:17:08.359050 29383 tablet_bootstrap.cc:492] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:08.359216 31017 leader_election.cc:290] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.359234 29378 raft_consensus.cc:359] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.359381 29378 raft_consensus.cc:385] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.359472 29379 tablet_bootstrap.cc:492] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.360718 29383 tablet_bootstrap.cc:654] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.360893 29379 tablet_bootstrap.cc:654] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.363044 29097 tablet_service.cc:1511] Processing CreateTablet for tablet c9f2a320a1e14115bfe7e70a498a4f27 (DEFAULT_TABLE table=default.Table_ec93db29796046d78927ecf1d33c63da [id=116bc85865134fb19d3b0e361423e3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.363446 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f2a320a1e14115bfe7e70a498a4f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.363463 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 9df10ad7697f4134a13f04513c97d956 (DEFAULT_TABLE table=default.Table_3b25a09b7fe74e00a568504737da0c8e [id=90b3785ca15e4bec9d8135bae72e4998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.363816 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df10ad7697f4134a13f04513c97d956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.361654 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 16f78c31fa80424785d35f1fb49e43e2 (DEFAULT_TABLE table=default.Table_8acde758a415485fa7e9aaa929121769 [id=c7b9ada447dd4b2cbebdb0c0e4790705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.364194 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f78c31fa80424785d35f1fb49e43e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.363140 28969 tablet_service.cc:1511] Processing CreateTablet for tablet c9f2a320a1e14115bfe7e70a498a4f27 (DEFAULT_TABLE table=default.Table_ec93db29796046d78927ecf1d33c63da [id=116bc85865134fb19d3b0e361423e3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.369647 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f2a320a1e14115bfe7e70a498a4f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.371281 29376 ts_tablet_manager.cc:1929] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:08.371403 29376 log.cc:1199] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/b427ba6320be4f2a929eaf18a56b4309
I20260617 20:17:08.371752 29376 ts_tablet_manager.cc:1950] T b427ba6320be4f2a929eaf18a56b4309 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:08.372480 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 863) took 3865 ms. Trace:
I20260617 20:17:08.372555 29376 rpcz_store.cc:276] 0617 20:17:04.506522 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.508476 (+ 1954us) service_pool.cc:224] Handling call
0617 20:17:08.151534 (+3643058us) ts_tablet_manager.cc:1151] Deleting tablet b427ba6320be4f2a929eaf18a56b4309
0617 20:17:08.151543 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.317393 (+165850us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.371223 (+ 53830us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.372457 (+ 1234us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3642932}
I20260617 20:17:08.372928 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 856) took 3867 ms. Trace:
I20260617 20:17:08.373005 29376 rpcz_store.cc:276] 0617 20:17:04.505844 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.507707 (+ 1863us) service_pool.cc:224] Handling call
0617 20:17:08.372800 (+3865093us) ts_tablet_manager.cc:1151] Deleting tablet 8f058c309b87431d9517338c7484bbbd
0617 20:17:08.372808 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.372914 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3862930}
I20260617 20:17:08.373345 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 859) took 3867 ms. Trace:
I20260617 20:17:08.373409 29376 rpcz_store.cc:276] 0617 20:17:04.506160 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.508096 (+ 1936us) service_pool.cc:224] Handling call
0617 20:17:08.373243 (+3865147us) ts_tablet_manager.cc:1151] Deleting tablet 0e6cee209a5a44d6b35eb50e9c33228f
0617 20:17:08.373255 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.373330 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3863028}
I20260617 20:17:08.373694 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 893) took 3687 ms. Trace:
I20260617 20:17:08.373762 29376 rpcz_store.cc:276] 0617 20:17:04.686271 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.686319 (+ 48us) service_pool.cc:224] Handling call
0617 20:17:08.373605 (+3687286us) ts_tablet_manager.cc:1151] Deleting tablet ee5b41c446444389821a2ebb85c1bf8b
0617 20:17:08.373612 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.373680 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3686993}
I20260617 20:17:08.374054 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 894) took 3687 ms. Trace:
I20260617 20:17:08.374114 29376 rpcz_store.cc:276] 0617 20:17:04.686468 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.686642 (+ 174us) service_pool.cc:224] Handling call
0617 20:17:08.373961 (+3687319us) ts_tablet_manager.cc:1151] Deleting tablet 8ca84d3c8b8f43978692bcc61956d2b5
0617 20:17:08.373973 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.374043 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3687190}
I20260617 20:17:08.374568 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 854) took 3868 ms. Trace:
I20260617 20:17:08.374636 29376 rpcz_store.cc:276] 0617 20:17:04.505677 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.507395 (+ 1718us) service_pool.cc:224] Handling call
0617 20:17:08.374468 (+3867073us) ts_tablet_manager.cc:1151] Deleting tablet b7e3bb8cd7df47aea4746f74f1ca2dc1
0617 20:17:08.374477 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.374554 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3622895}
I20260617 20:17:08.374866 29376 tablet_replica.cc:333] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:08.375061 29376 raft_consensus.cc:2243] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:08.375360 29376 raft_consensus.cc:2272] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.376662 29376 ts_tablet_manager.cc:1916] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.376868 30852 raft_consensus.cc:493] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.377529 30852 raft_consensus.cc:515] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:08.378579 28925 leader_election.cc:343] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:08.378809 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet b427ba6320be4f2a929eaf18a56b4309 (table default.Table_62c85e3d42be4e9ca7183846e7d67145 [id=7563af483989440d91cf7f444a68d2ba]) successfully deleted
W20260617 20:17:08.379215 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 8f058c309b87431d9517338c7484bbbd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f058c309b87431d9517338c7484bbbd already in progress: creating tablet
W20260617 20:17:08.379585 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 0e6cee209a5a44d6b35eb50e9c33228f because the tablet was not found. No further retry: Not found: Tablet not found: 0e6cee209a5a44d6b35eb50e9c33228f
W20260617 20:17:08.380259 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet ee5b41c446444389821a2ebb85c1bf8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee5b41c446444389821a2ebb85c1bf8b already in progress: creating tablet
I20260617 20:17:08.380466 29378 raft_consensus.cc:740] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
W20260617 20:17:08.380631 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 8ca84d3c8b8f43978692bcc61956d2b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ca84d3c8b8f43978692bcc61956d2b5 already in progress: creating tablet
I20260617 20:17:08.380731 29378 consensus_queue.cc:260] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:08.381131 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7e3bb8cd7df47aea4746f74f1ca2dc1 already in progress: creating tablet
I20260617 20:17:08.381858 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 16f78c31fa80424785d35f1fb49e43e2 (DEFAULT_TABLE table=default.Table_8acde758a415485fa7e9aaa929121769 [id=c7b9ada447dd4b2cbebdb0c0e4790705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.381927 29226 tablet_service.cc:1511] Processing CreateTablet for tablet c9f2a320a1e14115bfe7e70a498a4f27 (DEFAULT_TABLE table=default.Table_ec93db29796046d78927ecf1d33c63da [id=116bc85865134fb19d3b0e361423e3f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.382097 30910 tablet.cc:1724] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:08.382210 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f78c31fa80424785d35f1fb49e43e2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260617 20:17:08.382510 29197 leader_election.cc:343] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 8b6f05ae7d624efba571d059ce2f1c91
I20260617 20:17:08.386067 29375 ts_tablet_manager.cc:1929] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:08.386186 29375 log.cc:1199] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/fed593a3fa7742a18ccc2124c3ee0fb9
I20260617 20:17:08.386559 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet aa626e3cdc7240deaf399b50b0258c50
I20260617 20:17:08.386607 29375 ts_tablet_manager.cc:1950] T fed593a3fa7742a18ccc2124c3ee0fb9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:08.387334 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 877) took 3487 ms. Trace:
I20260617 20:17:08.387424 29375 rpcz_store.cc:276] 0617 20:17:04.899939 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.902492 (+ 2553us) service_pool.cc:224] Handling call
0617 20:17:08.323165 (+3420673us) ts_tablet_manager.cc:1151] Deleting tablet fed593a3fa7742a18ccc2124c3ee0fb9
0617 20:17:08.323177 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.365705 (+ 42528us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.386010 (+ 20305us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.387315 (+ 1305us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3420458}
I20260617 20:17:08.387907 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet fed593a3fa7742a18ccc2124c3ee0fb9 (table default.Table_726c0ba5eb5442e68a5c029d25fb209c [id=dcdfecb6a9634f42b1b11a02b9dd7ec2]) successfully deleted
I20260617 20:17:08.391278 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet aa626e3cdc7240deaf399b50b0258c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.391355 28665 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 (table default.Table_a1c77cc368fb44969f11416cb083598b [id=475aa0d2f8044cd8b52cf31085dda15d]). Expected version 2 got 0
I20260617 20:17:08.396847 28663 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6] alter complete (version 1)
I20260617 20:17:08.400502 28662 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_3b25a09b7fe74e00a568504737da0c8e" } new_table_name: "default.Table_222acbc48ebc47a3bd27b7ab3260796a" modify_external_catalogs: true
I20260617 20:17:08.401926 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cd47ca20a5094cada0101a3fafba4f5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.402612 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd47ca20a5094cada0101a3fafba4f5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.405077 28669 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c10b96bee83b419dbfc2a8e26f88e719
I20260617 20:17:08.406040 28664 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet ca4924e2825e4ec9b3302c1abb9c0bcf
I20260617 20:17:08.406172 29379 tablet_bootstrap.cc:492] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.406176 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet c10b96bee83b419dbfc2a8e26f88e719 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.406306 29379 ts_tablet_manager.cc:1403] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.000s
I20260617 20:17:08.406932 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet 90ae9c63c8c541bc91ecedd798a7d60f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.407056 29379 raft_consensus.cc:359] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.407210 29379 raft_consensus.cc:385] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.407260 29379 raft_consensus.cc:740] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.407514 29379 consensus_queue.cc:260] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.407984 29379 ts_tablet_manager.cc:1434] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:08.408540 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet ca4924e2825e4ec9b3302c1abb9c0bcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.408706 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet c10b96bee83b419dbfc2a8e26f88e719 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.409794 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet aa626e3cdc7240deaf399b50b0258c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.410189 29097 tablet_service.cc:1558] Processing DeleteTablet for tablet ca4924e2825e4ec9b3302c1abb9c0bcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.411195 28669 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_ff86bab000284059be724d40d2dde59b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.411758 28669 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff86bab000284059be724d40d2dde59b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.414626 30852 leader_election.cc:290] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.416239 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet a6522ae212784b7ebd47cc3403aa3477 (table default.Table_332fe4fe72a24b07981c7f0150c254bd [id=a63c4334ac2d4313b19978ee3b4eeff8]). Expected version 1 got 0
I20260617 20:17:08.417140 28664 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet 80d778641c354c679ee9e7d7b3eae3b5 (table default.Table_8bc2da3ec59547e290194b2ec6184b7f [id=de3384ef7984460abc15ca893a9f8c83]). Expected version 3 got 0
I20260617 20:17:08.354532 31023 consensus_queue.cc:237] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.418689 29378 ts_tablet_manager.cc:1434] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.061s user 0.000s sys 0.001s
I20260617 20:17:08.418800 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f2a320a1e14115bfe7e70a498a4f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.419548 29383 tablet_bootstrap.cc:492] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:08.419680 29383 ts_tablet_manager.cc:1403] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.008s
I20260617 20:17:08.419909 29379 tablet_bootstrap.cc:492] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.420189 28666 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_1fd4aafa3a644484b4e40f3123e8cda2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.420665 28666 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fd4aafa3a644484b4e40f3123e8cda2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.421276 29379 tablet_bootstrap.cc:654] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:08.424211 28661 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b3631e93c8684f02a2dd28a51080d006 consensus state has no leader
I20260617 20:17:08.428747 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_07ee116a00f04f99aa9e85d08ba5b147"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:08.428862 29383 raft_consensus.cc:359] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.429044 29383 raft_consensus.cc:385] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.429095 29383 raft_consensus.cc:740] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.429312 29383 consensus_queue.cc:260] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:08.429373 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07ee116a00f04f99aa9e85d08ba5b147 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.429776 29383 ts_tablet_manager.cc:1434] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260617 20:17:08.430055 29383 tablet_bootstrap.cc:492] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:08.430532 28670 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_0a0f0ffea6394fe296afc92cf1a1ef9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.430980 28670 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a0f0ffea6394fe296afc92cf1a1ef9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.431957 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 880) took 3491 ms. Trace:
I20260617 20:17:08.432075 29375 rpcz_store.cc:276] 0617 20:17:04.940729 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:04.940781 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:08.431768 (+3490987us) ts_tablet_manager.cc:1151] Deleting tablet 211d0b0897f14ff4929ed55cd2f27b94
0617 20:17:08.431784 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.431929 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3490780}
W20260617 20:17:08.432713 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 211d0b0897f14ff4929ed55cd2f27b94 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 211d0b0897f14ff4929ed55cd2f27b94 already in progress: creating tablet
W20260617 20:17:08.447281 29197 leader_election.cc:343] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 64538fdf51f94e8e985fec6202baac22
I20260617 20:17:08.447611 29376 ts_tablet_manager.cc:1929] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:08.447717 29376 log.cc:1199] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/27c20f436b9b4a8cb659215f9579af04
I20260617 20:17:08.447842 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet aa626e3cdc7240deaf399b50b0258c50 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.448072 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet c10b96bee83b419dbfc2a8e26f88e719 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.448244 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet ca4924e2825e4ec9b3302c1abb9c0bcf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.448102 29376 ts_tablet_manager.cc:1950] T 27c20f436b9b4a8cb659215f9579af04 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:08.449674 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 896) took 3312 ms. Trace:
I20260617 20:17:08.449769 29376 rpcz_store.cc:276] 0617 20:17:05.137279 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.137378 (+ 99us) service_pool.cc:224] Handling call
0617 20:17:08.374827 (+3237449us) ts_tablet_manager.cc:1151] Deleting tablet 27c20f436b9b4a8cb659215f9579af04
0617 20:17:08.374835 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.428601 (+ 53766us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.447561 (+ 18960us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.449655 (+ 2094us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3237249}
I20260617 20:17:08.450104 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 897) took 3312 ms. Trace:
I20260617 20:17:08.450174 29376 rpcz_store.cc:276] 0617 20:17:05.137504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.137585 (+ 81us) service_pool.cc:224] Handling call
0617 20:17:08.449999 (+3312414us) ts_tablet_manager.cc:1151] Deleting tablet cc547148aa124907a5e5def6941f734c
0617 20:17:08.450006 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.450091 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3312245}
I20260617 20:17:08.450943 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 881) took 3390 ms. Trace:
I20260617 20:17:08.451043 29375 rpcz_store.cc:276] 0617 20:17:05.060917 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.060970 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:08.450795 (+3389825us) ts_tablet_manager.cc:1151] Deleting tablet 5bc8b1dc268b455ea263b67077e0bf6d
0617 20:17:08.450807 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.450917 (+ 110us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3389603}
W20260617 20:17:08.451480 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5bc8b1dc268b455ea263b67077e0bf6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bc8b1dc268b455ea263b67077e0bf6d already in progress: creating tablet
I20260617 20:17:08.451658 29383 tablet_bootstrap.cc:654] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.452771 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 898) took 3315 ms. Trace:
I20260617 20:17:08.452850 29376 rpcz_store.cc:276] 0617 20:17:05.137776 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.137853 (+ 77us) service_pool.cc:224] Handling call
0617 20:17:08.450378 (+3312525us) ts_tablet_manager.cc:1151] Deleting tablet ccd6f76a201e40f8be224a93c701fea9
0617 20:17:08.450386 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.452752 (+ 2366us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3312373}
I20260617 20:17:08.453147 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 899) took 3315 ms. Trace:
I20260617 20:17:08.453233 29376 rpcz_store.cc:276] 0617 20:17:05.138043 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.138084 (+ 41us) service_pool.cc:224] Handling call
0617 20:17:08.453071 (+3314987us) ts_tablet_manager.cc:1151] Deleting tablet 89f7b878728a495f83b6584f8a6aca67
0617 20:17:08.453080 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.453132 (+ 52us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3314856}
I20260617 20:17:08.453254 29097 tablet_service.cc:1511] Processing CreateTablet for tablet 5914907a02df482088aab72d98ea7cc1 (DEFAULT_TABLE table=default.Table_8c1e2652a5d745fda18a0e7512b22ecd [id=081eadc2fe45408ebc3c66ef10aca087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.453511 29376 tablet_replica.cc:333] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:08.453646 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5914907a02df482088aab72d98ea7cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.453692 29376 raft_consensus.cc:2243] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:08.453998 29376 pending_rounds.cc:70] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:17:08.454041 29376 pending_rounds.cc:77] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955534177177600 op_type: NO_OP noop_request { }
I20260617 20:17:08.454116 29376 raft_consensus.cc:2889] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:08.454182 29376 raft_consensus.cc:2272] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.454674 31009 raft_consensus.cc:493] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.454789 31009 raft_consensus.cc:515] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.455379 31009 leader_election.cc:290] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:08.456290 29062 leader_election.cc:343] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: dee426100bb645f391be123aeb52e412
I20260617 20:17:08.456532 29376 ts_tablet_manager.cc:1916] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.459333 29378 tablet_bootstrap.cc:492] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:08.460383 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 882) took 3390 ms. Trace:
I20260617 20:17:08.460562 30410 raft_consensus.cc:493] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.460487 29375 rpcz_store.cc:276] 0617 20:17:05.069714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.069767 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:08.460239 (+3390472us) ts_tablet_manager.cc:1151] Deleting tablet 5d09b732e1cc4126bf7b0b17e5396607
0617 20:17:08.460249 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.460367 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3390257}
I20260617 20:17:08.460758 30410 raft_consensus.cc:515] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:08.460920 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 5d09b732e1cc4126bf7b0b17e5396607 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5d09b732e1cc4126bf7b0b17e5396607 already in progress: creating tablet
I20260617 20:17:08.461071 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 9df10ad7697f4134a13f04513c97d956 (DEFAULT_TABLE table=default.Table_3b25a09b7fe74e00a568504737da0c8e [id=90b3785ca15e4bec9d8135bae72e4998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.461279 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 883) took 3388 ms. Trace:
I20260617 20:17:08.461397 29375 rpcz_store.cc:276] 0617 20:17:05.072364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.072438 (+ 74us) service_pool.cc:224] Handling call
0617 20:17:08.461172 (+3388734us) ts_tablet_manager.cc:1151] Deleting tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5
0617 20:17:08.461182 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.461264 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3388489}
I20260617 20:17:08.461653 30410 leader_election.cc:290] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:08.461840 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5 already in progress: creating tablet
I20260617 20:17:08.462213 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 885) took 3057 ms. Trace:
I20260617 20:17:08.462293 29375 rpcz_store.cc:276] 0617 20:17:05.404922 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.404972 (+ 50us) service_pool.cc:224] Handling call
0617 20:17:08.462094 (+3057122us) ts_tablet_manager.cc:1151] Deleting tablet 53d32672f44d4605b30237c0b1d72ff6
0617 20:17:08.462102 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.462198 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3056921}
W20260617 20:17:08.462694 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 53d32672f44d4605b30237c0b1d72ff6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53d32672f44d4605b30237c0b1d72ff6 already in progress: creating tablet
I20260617 20:17:08.463012 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 886) took 3057 ms. Trace:
I20260617 20:17:08.463099 29375 rpcz_store.cc:276] 0617 20:17:05.405821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.405869 (+ 48us) service_pool.cc:224] Handling call
0617 20:17:08.462906 (+3057037us) ts_tablet_manager.cc:1151] Deleting tablet 4d81457d71a34657b43c8ebe7efb0a35
0617 20:17:08.462915 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.462992 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3056890}
W20260617 20:17:08.463508 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4d81457d71a34657b43c8ebe7efb0a35 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4d81457d71a34657b43c8ebe7efb0a35 already in progress: creating tablet
I20260617 20:17:08.463914 29379 tablet_bootstrap.cc:492] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.464139 29379 ts_tablet_manager.cc:1403] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.002s
I20260617 20:17:08.463913 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 890) took 3048 ms. Trace:
I20260617 20:17:08.464498 29375 rpcz_store.cc:276] 0617 20:17:05.415144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.415190 (+ 46us) service_pool.cc:224] Handling call
0617 20:17:08.463745 (+3048555us) ts_tablet_manager.cc:1151] Deleting tablet d16bbe642edc43449d3b910ca5cf4d37
0617 20:17:08.463752 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.463892 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3048379}
W20260617 20:17:08.464880 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet d16bbe642edc43449d3b910ca5cf4d37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d16bbe642edc43449d3b910ca5cf4d37 already in progress: creating tablet
I20260617 20:17:08.465147 29379 raft_consensus.cc:359] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.465379 29379 raft_consensus.cc:385] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.465482 29379 raft_consensus.cc:740] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.465708 29379 consensus_queue.cc:260] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.466274 29379 ts_tablet_manager.cc:1434] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:08.467368 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 27c20f436b9b4a8cb659215f9579af04 (table default.Table_3d19c23664c34aff8fce1a199ca71ac9 [id=f8657da5fd504f17aa1f82c1dba56187]) successfully deleted
W20260617 20:17:08.467689 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet cc547148aa124907a5e5def6941f734c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc547148aa124907a5e5def6941f734c already in progress: creating tablet
W20260617 20:17:08.468024 28656 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet ccd6f76a201e40f8be224a93c701fea9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ccd6f76a201e40f8be224a93c701fea9 already in progress: creating tablet
W20260617 20:17:08.468343 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 89f7b878728a495f83b6584f8a6aca67 because the tablet was not found. No further retry: Not found: Tablet not found: 89f7b878728a495f83b6584f8a6aca67
I20260617 20:17:08.468946 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ebcfc80ca64129a7ab939bfd853998" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:08.469129 28981 raft_consensus.cc:2468] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:08.469712 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 9df10ad7697f4134a13f04513c97d956 (DEFAULT_TABLE table=default.Table_3b25a09b7fe74e00a568504737da0c8e [id=90b3785ca15e4bec9d8135bae72e4998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.470088 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df10ad7697f4134a13f04513c97d956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.473476 29375 tablet_replica.cc:333] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:08.476507 29375 raft_consensus.cc:2243] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.478972 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 5914907a02df482088aab72d98ea7cc1 (DEFAULT_TABLE table=default.Table_8c1e2652a5d745fda18a0e7512b22ecd [id=081eadc2fe45408ebc3c66ef10aca087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.479507 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5914907a02df482088aab72d98ea7cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.480443 28962 tablet_service.cc:1511] Processing CreateTablet for tablet ab011d76c5ff4eae8e20fceab66513e1 (DEFAULT_TABLE table=default.Table_2d90fd265e634bb9b76e516660488059 [id=c355377954e64862a570a33b91d9dd8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.480754 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab011d76c5ff4eae8e20fceab66513e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.485224 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 0d95e957008b451993e327a7acb4671a (DEFAULT_TABLE table=default.Table_4a1320838a1a477cabc0d69fbe93cc5e [id=cdfdc41eb46d496bbecd4bd651041691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.485476 29375 raft_consensus.cc:2272] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.485562 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d95e957008b451993e327a7acb4671a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.486024 29375 ts_tablet_manager.cc:1916] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.486856 28668 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 078875241c324538ad6f93de1169aeb8
I20260617 20:17:08.487278 28668 catalog_manager.cc:6784] ReplaceTablet: tablet 078875241c324538ad6f93de1169aeb8 deleted and replaced by tablet d550602ded3547999e868537e76f6616
I20260617 20:17:08.473519 29379 tablet_bootstrap.cc:492] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.489377 29379 tablet_bootstrap.cc:654] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:08.489545 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98871c8e8d6240e2bf8bd305bc986b81 consensus state has no leader
I20260617 20:17:08.489548 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 264b0b683ad44ba094eccd7f1eaa425f (DEFAULT_TABLE table=default.Table_270cf0c20609474eaf9e30d5b9a8ecf8 [id=fe8b78e2faf5430a8eb680bcf966e32e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.489838 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264b0b683ad44ba094eccd7f1eaa425f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.489887 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_c2b342d694454abb90a737a7dcb4e957" } new_table_name: "default.Table_889e523bb22f4128b77891b85373222a" modify_external_catalogs: true
W20260617 20:17:08.492947 28662 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9df10ad7697f4134a13f04513c97d956 consensus state has no leader
I20260617 20:17:08.493330 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_07414915a4624a09a17497c8455f51d3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:08.493844 28961 tablet_service.cc:1558] Processing DeleteTablet for tablet 078875241c324538ad6f93de1169aeb8 with delete_type TABLET_DATA_DELETED (replaced by tablet d550602ded3547999e868537e76f6616) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.494529 28665 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_47860f92f62f4376b2396e6936d2969a [id=fa80809528dd419192774bcc7ac5f5bf] alter complete (version 4)
I20260617 20:17:08.497423 28668 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet b6ba8b7d18af44b58800e588279e2e0b (table default.Table_daa321ef525b447390f30edf50f160bc [id=489b6871a12b4a68b7f600556cfc5b8e]). Expected version 1 got 0
W20260617 20:17:08.497603 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07414915a4624a09a17497c8455f51d3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.499852 29375 ts_tablet_manager.cc:1929] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:08.500088 28668 catalog_manager.cc:5696] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:08.498337 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_32fba2216d87484fbd69b7a0dfe9a80f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.500809 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32fba2216d87484fbd69b7a0dfe9a80f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.501942 28668 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet a3e20a1092b746a8b8ddd4386a682229 (table default.Table_8b3f418465f142c784a9c20784e64477 [id=a3772e01cb314c7e88e85833d727617d]). Expected version 2 got 0
I20260617 20:17:08.461159 29378 tablet_bootstrap.cc:654] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.508544 29224 tablet_service.cc:1511] Processing CreateTablet for tablet ab011d76c5ff4eae8e20fceab66513e1 (DEFAULT_TABLE table=default.Table_2d90fd265e634bb9b76e516660488059 [id=c355377954e64862a570a33b91d9dd8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.508965 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab011d76c5ff4eae8e20fceab66513e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.510360 29241 tablet_service.cc:1558] Processing DeleteTablet for tablet 078875241c324538ad6f93de1169aeb8 with delete_type TABLET_DATA_DELETED (replaced by tablet d550602ded3547999e868537e76f6616) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.510758 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9df10ad7697f4134a13f04513c97d956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.508563 29197 leader_election.cc:304] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.512108 31023 raft_consensus.cc:2804] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:08.512192 31023 raft_consensus.cc:493] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:08.512272 31023 raft_consensus.cc:3060] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.512727 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 264b0b683ad44ba094eccd7f1eaa425f (DEFAULT_TABLE table=default.Table_270cf0c20609474eaf9e30d5b9a8ecf8 [id=fe8b78e2faf5430a8eb680bcf966e32e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.513103 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264b0b683ad44ba094eccd7f1eaa425f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.514587 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 5914907a02df482088aab72d98ea7cc1 (DEFAULT_TABLE table=default.Table_8c1e2652a5d745fda18a0e7512b22ecd [id=081eadc2fe45408ebc3c66ef10aca087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.515123 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5914907a02df482088aab72d98ea7cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.515010 31023 raft_consensus.cc:515] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.515760 31023 leader_election.cc:290] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.516623 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ebcfc80ca64129a7ab939bfd853998" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:08.516781 28981 raft_consensus.cc:3060] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.518337 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 0d95e957008b451993e327a7acb4671a (DEFAULT_TABLE table=default.Table_4a1320838a1a477cabc0d69fbe93cc5e [id=cdfdc41eb46d496bbecd4bd651041691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.518741 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d95e957008b451993e327a7acb4671a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.519269 28981 raft_consensus.cc:2468] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:08.519721 30967 raft_consensus.cc:493] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.519831 30967 raft_consensus.cc:515] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.520375 30967 leader_election.cc:290] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:08.520960 29377 ts_tablet_manager.cc:1929] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:08.522944 29377 log.cc:1199] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/99a3d9ae347845dfa9357010819ebc58
I20260617 20:17:08.527061 29377 ts_tablet_manager.cc:1950] T 99a3d9ae347845dfa9357010819ebc58 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:08.527770 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd89c8452c444af99d8bce0c7cbf8ce1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:08.529573 29197 leader_election.cc:304] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.530346 31023 raft_consensus.cc:2804] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:08.530525 31023 raft_consensus.cc:697] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:08.530830 31023 consensus_queue.cc:237] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.534426 28664 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_5c3dfa3702bc41ad99c1ae8bb53dce13 [id=0586dbd68a634d83ab9b00d2ba7f38af] alter complete (version 3)
I20260617 20:17:08.537250 28666 master_service.cc:960] ReplaceTablet: received request to replace tablet e401eea0717d4cbb8319e4d4b1ada410 from {username='slave'} at 127.0.0.1:60552
I20260617 20:17:08.538558 28663 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6d055567cac04381821aa61e52e1df04" } modify_external_catalogs: true
W20260617 20:17:08.530133 28925 leader_election.cc:343] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:08.538779 28663 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6d055567cac04381821aa61e52e1df04" } modify_external_catalogs: true
I20260617 20:17:08.539647 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 905) took 3411 ms. Trace:
I20260617 20:17:08.539727 29377 rpcz_store.cc:276] 0617 20:17:05.128364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.128445 (+ 81us) service_pool.cc:224] Handling call
0617 20:17:08.319347 (+3190902us) ts_tablet_manager.cc:1151] Deleting tablet 99a3d9ae347845dfa9357010819ebc58
0617 20:17:08.319357 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.361884 (+ 42527us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.520908 (+159024us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.539625 (+ 18717us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3190719}
I20260617 20:17:08.540163 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 99a3d9ae347845dfa9357010819ebc58 (table default.Table_64a54638a38b4d8cab417ecd62e3d04a [id=a599d15f588a4d18961e0ec9529b5053]) successfully deleted
I20260617 20:17:08.542109 29383 tablet_bootstrap.cc:492] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:08.542265 29383 ts_tablet_manager.cc:1403] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.112s user 0.005s sys 0.000s
I20260617 20:17:08.543054 29383 raft_consensus.cc:359] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.543244 29383 raft_consensus.cc:385] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.543324 29383 raft_consensus.cc:740] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.543545 29383 consensus_queue.cc:260] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.544178 29383 ts_tablet_manager.cc:1434] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:08.544481 29383 tablet_bootstrap.cc:492] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:08.481724 29097 tablet_service.cc:1511] Processing CreateTablet for tablet ab011d76c5ff4eae8e20fceab66513e1 (DEFAULT_TABLE table=default.Table_2d90fd265e634bb9b76e516660488059 [id=c355377954e64862a570a33b91d9dd8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.546006 29097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab011d76c5ff4eae8e20fceab66513e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.546079 29383 tablet_bootstrap.cc:654] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.482372 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 264b0b683ad44ba094eccd7f1eaa425f (DEFAULT_TABLE table=default.Table_270cf0c20609474eaf9e30d5b9a8ecf8 [id=fe8b78e2faf5430a8eb680bcf966e32e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.483585 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 12d46b1259ae45fa8d80d3dc9ca539b1 (DEFAULT_TABLE table=default.Table_ea6a8570fafd4a2f979827a3711b2de4 [id=250e3cfac020471aac31a16d43ac9dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.504676 29096 tablet_service.cc:1558] Processing DeleteTablet for tablet 078875241c324538ad6f93de1169aeb8 with delete_type TABLET_DATA_DELETED (replaced by tablet d550602ded3547999e868537e76f6616) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.504863 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 938b61a0f6dc4d178971034fd18c1674 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.504891 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet dee426100bb645f391be123aeb52e412 with delete_type TABLET_DATA_DELETED (replaced by tablet c3496887f6a045e293698d09d9cc1c16) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.549643 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264b0b683ad44ba094eccd7f1eaa425f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.549815 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d46b1259ae45fa8d80d3dc9ca539b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.552318 29376 ts_tablet_manager.cc:1929] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:08.552431 29376 log.cc:1199] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/dee426100bb645f391be123aeb52e412
I20260617 20:17:08.552806 29376 ts_tablet_manager.cc:1950] T dee426100bb645f391be123aeb52e412 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:08.480739 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 0d95e957008b451993e327a7acb4671a (DEFAULT_TABLE table=default.Table_4a1320838a1a477cabc0d69fbe93cc5e [id=cdfdc41eb46d496bbecd4bd651041691]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.555696 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 906) took 3426 ms. Trace:
I20260617 20:17:08.534135 31009 raft_consensus.cc:493] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.555797 29377 rpcz_store.cc:276] 0617 20:17:05.129097 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.129145 (+ 48us) service_pool.cc:224] Handling call
0617 20:17:08.555575 (+3426430us) ts_tablet_manager.cc:1151] Deleting tablet 5faea831376646c1bdfcaf8fbbc7ca6d
0617 20:17:08.555585 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.555672 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3426271}
I20260617 20:17:08.555857 31009 raft_consensus.cc:515] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:08.556324 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 5faea831376646c1bdfcaf8fbbc7ca6d because the tablet was not found. No further retry: Not found: Tablet not found: 5faea831376646c1bdfcaf8fbbc7ca6d
I20260617 20:17:08.556478 31009 leader_election.cc:290] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:08.534654 29379 tablet_bootstrap.cc:492] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.556672 29379 ts_tablet_manager.cc:1403] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.000s
I20260617 20:17:08.557142 29375 log.cc:1199] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/3726e55ed36f420ab63bcfb5a81c5aab
I20260617 20:17:08.557524 29375 ts_tablet_manager.cc:1950] T 3726e55ed36f420ab63bcfb5a81c5aab P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:08.557478 28661 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1b6116659f754549b9c833b7b5f49b48" } modify_external_catalogs: true
I20260617 20:17:08.557658 28661 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1b6116659f754549b9c833b7b5f49b48" } modify_external_catalogs: true
I20260617 20:17:08.557699 29379 raft_consensus.cc:359] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.557866 29379 raft_consensus.cc:385] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.557931 29379 raft_consensus.cc:740] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.558128 29379 consensus_queue.cc:260] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.558626 29379 ts_tablet_manager.cc:1434] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260617 20:17:08.558836 29062 leader_election.cc:343] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 99a3d9ae347845dfa9357010819ebc58
I20260617 20:17:08.562526 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 12d46b1259ae45fa8d80d3dc9ca539b1 (DEFAULT_TABLE table=default.Table_ea6a8570fafd4a2f979827a3711b2de4 [id=250e3cfac020471aac31a16d43ac9dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.562940 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d46b1259ae45fa8d80d3dc9ca539b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.563385 30967 raft_consensus.cc:493] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.563525 30967 raft_consensus.cc:515] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.564152 30967 leader_election.cc:290] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:08.565333 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da50400f49e24ca589519e6ec823957d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:08.566526 28925 leader_election.cc:343] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:08.567988 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 12d46b1259ae45fa8d80d3dc9ca539b1 (DEFAULT_TABLE table=default.Table_ea6a8570fafd4a2f979827a3711b2de4 [id=250e3cfac020471aac31a16d43ac9dea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.568410 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12d46b1259ae45fa8d80d3dc9ca539b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.574797 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 907) took 3444 ms. Trace:
I20260617 20:17:08.574944 29377 rpcz_store.cc:276] 0617 20:17:05.129902 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.129950 (+ 48us) service_pool.cc:224] Handling call
0617 20:17:08.574690 (+3444740us) ts_tablet_manager.cc:1151] Deleting tablet 8a5d9677bc184c30be1a11bfa85a97c8
0617 20:17:08.574698 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.574773 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3444588}
W20260617 20:17:08.575513 28655 catalog_manager.cc:4994] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 8a5d9677bc184c30be1a11bfa85a97c8 because the tablet was not found. No further retry: Not found: Tablet not found: 8a5d9677bc184c30be1a11bfa85a97c8
I20260617 20:17:08.575937 29377 tablet_replica.cc:333] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:08.576191 29377 raft_consensus.cc:2243] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.576419 29377 raft_consensus.cc:2272] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.576980 29377 ts_tablet_manager.cc:1916] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.580621 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_6e09b7b68e1f406e8e0893e0f3dfba11" } new_table_name: "default.Table_f581f3582276489b851bca84cea0cd2d" modify_external_catalogs: true
I20260617 20:17:08.583379 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 5084275e29a94669b1700447fd90876b (DEFAULT_TABLE table=default.Table_4b555cc3fa1e4dd5b51da47450054b76 [id=0eb555ca618f468b9ca3c05e4d126835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.584579 29378 tablet_bootstrap.cc:492] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:08.584753 29378 ts_tablet_manager.cc:1403] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.125s user 0.000s sys 0.003s
I20260617 20:17:08.584736 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 5084275e29a94669b1700447fd90876b (DEFAULT_TABLE table=default.Table_4b555cc3fa1e4dd5b51da47450054b76 [id=0eb555ca618f468b9ca3c05e4d126835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.585134 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5084275e29a94669b1700447fd90876b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.585584 29378 raft_consensus.cc:359] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.585726 29378 raft_consensus.cc:385] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.585767 29378 raft_consensus.cc:740] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.585976 29378 consensus_queue.cc:260] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.591012 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 9d249b5bf5364d77b7a51fa9defdb628 (DEFAULT_TABLE table=default.Table_1dcb619bfb304bcc890afe629b9e4694 [id=57af564b4ab34bc88d4dae9a0f8b2ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.593760 29378 ts_tablet_manager.cc:1434] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
W20260617 20:17:08.598085 28667 catalog_manager.cc:5956] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 839ae2f924494679a1389ad61be65259 consensus state has no leader
I20260617 20:17:08.598477 28667 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2d90fd265e634bb9b76e516660488059" } modify_external_catalogs: true
I20260617 20:17:08.598654 28667 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_2d90fd265e634bb9b76e516660488059" } modify_external_catalogs: true
I20260617 20:17:08.602027 29378 tablet_bootstrap.cc:492] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:08.603569 29378 tablet_bootstrap.cc:654] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.603679 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 9d249b5bf5364d77b7a51fa9defdb628 (DEFAULT_TABLE table=default.Table_1dcb619bfb304bcc890afe629b9e4694 [id=57af564b4ab34bc88d4dae9a0f8b2ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.604089 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d249b5bf5364d77b7a51fa9defdb628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.604745 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 5084275e29a94669b1700447fd90876b (DEFAULT_TABLE table=default.Table_4b555cc3fa1e4dd5b51da47450054b76 [id=0eb555ca618f468b9ca3c05e4d126835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.605186 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5084275e29a94669b1700447fd90876b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.608695 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d95e957008b451993e327a7acb4671a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.609447 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 893) took 3177 ms. Trace:
I20260617 20:17:08.609527 29379 tablet_bootstrap.cc:492] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.610232 29383 tablet_bootstrap.cc:492] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:08.610368 29383 ts_tablet_manager.cc:1403] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.066s user 0.000s sys 0.003s
I20260617 20:17:08.610853 29379 tablet_bootstrap.cc:654] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.611135 29383 raft_consensus.cc:359] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.611313 29383 raft_consensus.cc:385] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.611388 29383 raft_consensus.cc:740] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.611600 29383 consensus_queue.cc:260] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.612206 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d249b5bf5364d77b7a51fa9defdb628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.612946 29383 ts_tablet_manager.cc:1434] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:17:08.613199 29383 tablet_bootstrap.cc:492] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:08.616705 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 900) took 3478 ms. Trace:
I20260617 20:17:08.616813 29376 rpcz_store.cc:276] 0617 20:17:05.138318 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.138358 (+ 40us) service_pool.cc:224] Handling call
0617 20:17:08.453464 (+3315106us) ts_tablet_manager.cc:1151] Deleting tablet dee426100bb645f391be123aeb52e412
0617 20:17:08.453474 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.459418 (+ 5944us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.552265 (+ 92847us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.616666 (+ 64401us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3314960}
I20260617 20:17:08.617374 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 901) took 3478 ms. Trace:
I20260617 20:17:08.617476 29376 rpcz_store.cc:276] 0617 20:17:05.138611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.138697 (+ 86us) service_pool.cc:224] Handling call
0617 20:17:08.617202 (+3478505us) ts_tablet_manager.cc:1151] Deleting tablet f8e0c5d20a4548cc8124302aa38bcb21
0617 20:17:08.617211 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.617280 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3478359}
I20260617 20:17:08.617748 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet dee426100bb645f391be123aeb52e412 (table default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]) successfully deleted
W20260617 20:17:08.618755 28656 catalog_manager.cc:4994] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet f8e0c5d20a4548cc8124302aa38bcb21 because the tablet was not found. No further retry: Not found: Tablet not found: f8e0c5d20a4548cc8124302aa38bcb21
I20260617 20:17:08.609531 29375 rpcz_store.cc:276] 0617 20:17:05.432029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.432080 (+ 51us) service_pool.cc:224] Handling call
0617 20:17:08.473428 (+3041348us) ts_tablet_manager.cc:1151] Deleting tablet 3726e55ed36f420ab63bcfb5a81c5aab
0617 20:17:08.473438 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.497105 (+ 23667us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.499800 (+ 2695us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.609428 (+109628us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3041160}
I20260617 20:17:08.619922 29375 tablet_replica.cc:333] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:08.620117 29375 raft_consensus.cc:2243] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.620271 29375 raft_consensus.cc:2272] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.620818 29375 ts_tablet_manager.cc:1916] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.623461 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5084275e29a94669b1700447fd90876b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.623593 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet 3726e55ed36f420ab63bcfb5a81c5aab (table default.Table_fbaeb71321364cca9f5c971ee3419519 [id=cd2fab71637e4b968e9957070c30c936]) successfully deleted
I20260617 20:17:08.625183 29376 tablet_replica.cc:333] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:08.625483 29376 raft_consensus.cc:2243] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:08.625886 29376 raft_consensus.cc:2272] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.626549 29376 ts_tablet_manager.cc:1916] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.639406 29383 tablet_bootstrap.cc:654] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.641103 29378 tablet_bootstrap.cc:492] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:08.641348 29378 ts_tablet_manager.cc:1403] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.001s
I20260617 20:17:08.641588 31023 raft_consensus.cc:493] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.641778 31023 raft_consensus.cc:515] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.642283 29375 ts_tablet_manager.cc:1929] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:08.642396 29375 log.cc:1199] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/b427ba6320be4f2a929eaf18a56b4309
I20260617 20:17:08.642756 29375 ts_tablet_manager.cc:1950] T b427ba6320be4f2a929eaf18a56b4309 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:08.643472 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 894) took 3211 ms. Trace:
I20260617 20:17:08.643566 29375 rpcz_store.cc:276] 0617 20:17:05.432324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.432367 (+ 43us) service_pool.cc:224] Handling call
0617 20:17:08.619871 (+3187504us) ts_tablet_manager.cc:1151] Deleting tablet b427ba6320be4f2a929eaf18a56b4309
0617 20:17:08.619880 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.639346 (+ 19466us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.642229 (+ 2883us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.643451 (+ 1222us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3187356}
I20260617 20:17:08.643985 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet b427ba6320be4f2a929eaf18a56b4309 (table default.Table_62c85e3d42be4e9ca7183846e7d67145 [id=7563af483989440d91cf7f444a68d2ba]) successfully deleted
I20260617 20:17:08.644127 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 895) took 3211 ms. Trace:
I20260617 20:17:08.644197 29375 rpcz_store.cc:276] 0617 20:17:05.432565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.432605 (+ 40us) service_pool.cc:224] Handling call
0617 20:17:08.644023 (+3211418us) ts_tablet_manager.cc:1151] Deleting tablet 75519f97f1ce49ceb3a739ba7c7bc239
0617 20:17:08.644033 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.644112 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3211284}
I20260617 20:17:08.644583 29375 tablet_replica.cc:333] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
W20260617 20:17:08.644618 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 75519f97f1ce49ceb3a739ba7c7bc239 because the tablet was not found. No further retry: Not found: Tablet not found: 75519f97f1ce49ceb3a739ba7c7bc239
I20260617 20:17:08.644855 31023 leader_election.cc:290] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.644786 29375 raft_consensus.cc:2243] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.645123 29375 raft_consensus.cc:2272] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.645794 29375 ts_tablet_manager.cc:1916] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:08.645902 29197 leader_election.cc:343] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 5b2797384f7845969ee9744b444f1acc
I20260617 20:17:08.646687 29378 raft_consensus.cc:359] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.647102 29378 raft_consensus.cc:385] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.647210 29378 raft_consensus.cc:740] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.647495 29378 consensus_queue.cc:260] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.648803 28662 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1265f7b4e2374fc9a3cbf51bdbf7f663" } modify_external_catalogs: true
I20260617 20:17:08.648974 28662 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_1265f7b4e2374fc9a3cbf51bdbf7f663" } modify_external_catalogs: true
I20260617 20:17:08.652441 29379 tablet_bootstrap.cc:492] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.652590 29379 ts_tablet_manager.cc:1403] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.001s
I20260617 20:17:08.653718 29379 raft_consensus.cc:359] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.653906 29379 raft_consensus.cc:385] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.653998 29379 raft_consensus.cc:740] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.654294 29379 consensus_queue.cc:260] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.659338 29379 ts_tablet_manager.cc:1434] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 20:17:08.659684 29379 tablet_bootstrap.cc:492] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.661381 29379 tablet_bootstrap.cc:654] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.663918 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 9d249b5bf5364d77b7a51fa9defdb628 (DEFAULT_TABLE table=default.Table_1dcb619bfb304bcc890afe629b9e4694 [id=57af564b4ab34bc88d4dae9a0f8b2ff4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.664049 29095 tablet_service.cc:1511] Processing CreateTablet for tablet 5e847937667c4915b0d4da48c3fe92e2 (DEFAULT_TABLE table=default.Table_3d7d626f6bae4e3cbfc7bd41f1cdc5f1 [id=1759f8d2f7b84bfabbcc8d99a861193b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.664426 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e847937667c4915b0d4da48c3fe92e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.664470 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d249b5bf5364d77b7a51fa9defdb628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.670398 31009 raft_consensus.cc:493] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.670463 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 5e847937667c4915b0d4da48c3fe92e2 (DEFAULT_TABLE table=default.Table_3d7d626f6bae4e3cbfc7bd41f1cdc5f1 [id=1759f8d2f7b84bfabbcc8d99a861193b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.670539 31009 raft_consensus.cc:515] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.670990 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e847937667c4915b0d4da48c3fe92e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.671152 31009 leader_election.cc:290] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:08.672050 29062 leader_election.cc:343] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 14a5e5917a414c99b25ea2efeab4063d
I20260617 20:17:08.673674 29378 ts_tablet_manager.cc:1434] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.028s user 0.001s sys 0.000s
I20260617 20:17:08.674558 28665 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ec93db29796046d78927ecf1d33c63da" } modify_external_catalogs: true
I20260617 20:17:08.674739 28665 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_ec93db29796046d78927ecf1d33c63da" } modify_external_catalogs: true
I20260617 20:17:08.679987 29378 tablet_bootstrap.cc:492] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:08.688784 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet adbc3219639748d9a0d71d45ae22ab36 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b00d3c0adcf48a48ba3d7a3de018b80) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.688863 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 99a3d9ae347845dfa9357010819ebc58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.689240 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet cde88371f4454a4bb3053c6cd1afb801 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.689402 30967 raft_consensus.cc:493] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.689574 30967 raft_consensus.cc:515] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.689726 29094 tablet_service.cc:1558] Processing DeleteTablet for tablet 5df6af49cb484f59ad1f32235753e1db with delete_type TABLET_DATA_DELETED (replaced by tablet 663dbe73689d4849a85b68a79ea4062c) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.690187 30967 leader_election.cc:290] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:08.691519 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 184abfbdc6d34f598b10ecaaf5e9b56f (DEFAULT_TABLE table=default.Table_7df03098d8c34f058bcae824c33dd2a0 [id=e89cb4b6b74547748051e304d9c71c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.692448 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54969e138cf745739b54203c11e4c94e" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:08.693163 28925 leader_election.cc:343] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:08.693730 28962 tablet_service.cc:1511] Processing CreateTablet for tablet 5e847937667c4915b0d4da48c3fe92e2 (DEFAULT_TABLE table=default.Table_3d7d626f6bae4e3cbfc7bd41f1cdc5f1 [id=1759f8d2f7b84bfabbcc8d99a861193b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.694209 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e847937667c4915b0d4da48c3fe92e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.696493 28664 catalog_manager.cc:6241] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: default.Table_a1c77cc368fb44969f11416cb083598b [id=475aa0d2f8044cd8b52cf31085dda15d] alter complete (version 2)
I20260617 20:17:08.698184 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet da50400f49e24ca589519e6ec823957d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.704325 29379 tablet_bootstrap.cc:492] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.704512 29379 ts_tablet_manager.cc:1403] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260617 20:17:08.704558 31033 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590225c8ea36448093b77385d238a34a)
I20260617 20:17:08.704787 31033 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:08.705279 29379 raft_consensus.cc:359] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.705480 29379 raft_consensus.cc:385] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.705538 29379 raft_consensus.cc:740] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.705790 29379 consensus_queue.cc:260] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:08.706036 30356 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.195:53317 (request call id 53) took 807 ms (client timeout 1000 ms). Trace:
W20260617 20:17:08.706108 30355 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.193:42269 (request call id 53) took 763 ms (client timeout 1000 ms). Trace:
W20260617 20:17:08.706209 30355 rpcz_store.cc:269] 0617 20:17:07.942215 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.942288 (+ 73us) service_pool.cc:224] Handling call
0617 20:17:08.704557 (+762269us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x616000060a54. stack: 00007fbd0d2da496 00007fbd0d2da250 00007fbd0c3053ad 000000000099c914 000000000099c8dd 00007fbd1c7bb6bd 00007fbd1c7bb7b3 00007fbd19383b21 00007fbd210e895d 00007fbd21275f08 00007fbd17cd4ca6 00007fbd17cd49d5 00007fbd143e488e 00007fbd143e376e 00007fbd143e99a8 00007fbd143ea30f
0617 20:17:08.706043 (+ 1486us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750667008}
W20260617 20:17:08.707769 30358 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.27.245.194:41851 (request call id 83) took 802 ms (client timeout 1000 ms). Trace:
W20260617 20:17:08.707911 30358 rpcz_store.cc:269] 0617 20:17:07.905639 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.905698 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:08.706726 (+801028us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x616000060a54. stack: 00007fbd0d2da496 00007fbd0d2da250 00007fbd0c3053ad 000000000099c914 000000000099c8dd 00007fbd1c7bb6bd 00007fbd1c7bb7b3 00007fbd19383b21 00007fbd210e895d 00007fbd21275f08 00007fbd17cd4ca6 00007fbd17cd49d5 00007fbd143e488e 00007fbd143e376e 00007fbd143e99a8 00007fbd143ea30f
0617 20:17:08.707725 (+ 999us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791728512}
I20260617 20:17:08.711460 29379 ts_tablet_manager.cc:1434] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260617 20:17:08.714273 28680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1260 } } ignore_live_leader: false dest_uuid: "590225c8ea36448093b77385d238a34a" is_pre_election: true
I20260617 20:17:08.715318 29379 tablet_bootstrap.cc:492] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.720021 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 203666e6127b49ed92731bc87ce01798 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:51 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.720256 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet 64538fdf51f94e8e985fec6202baac22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:02 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.721103 29226 tablet_service.cc:1511] Processing CreateTablet for tablet 184abfbdc6d34f598b10ecaaf5e9b56f (DEFAULT_TABLE table=default.Table_7df03098d8c34f058bcae824c33dd2a0 [id=e89cb4b6b74547748051e304d9c71c51]), partition=RANGE (key) PARTITION UNBOUNDED
W20260617 20:17:08.706182 30356 rpcz_store.cc:269] 0617 20:17:07.898597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.913255 (+ 14658us) service_pool.cc:224] Handling call
0617 20:17:08.704433 (+791178us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x616000060a54. stack: 00007fbd0d2da496 00007fbd0d2da250 00007fbd0c3053ad 000000000099c914 000000000099c8dd 00007fbd1c7bb6bd 00007fbd1c7bb7b3 00007fbd19383b21 00007fbd210e895d 00007fbd21275f08 00007fbd17cd4ca6 00007fbd17cd49d5 00007fbd143e488e 00007fbd143e376e 00007fbd143e99a8 00007fbd143ea30f
0617 20:17:08.705980 (+ 1547us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817157888}
I20260617 20:17:08.706036 31033 leader_election.cc:290] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059)
I20260617 20:17:08.725533 29378 tablet_bootstrap.cc:654] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.727186 29383 tablet_bootstrap.cc:492] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:08.727427 29383 ts_tablet_manager.cc:1403] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.114s user 0.002s sys 0.002s
I20260617 20:17:08.730296 29618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1260 } } ignore_live_leader: false dest_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" is_pre_election: true
I20260617 20:17:08.730931 30313 leader_election.cc:304] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87437cd320a4470fa0dedd43aa7ea3eb; no voters: 590225c8ea36448093b77385d238a34a, f5ea3f9265d84474ab3bced8dd5aecc5
I20260617 20:17:08.741223 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184abfbdc6d34f598b10ecaaf5e9b56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.743420 29379 tablet_bootstrap.cc:654] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.747110 29383 raft_consensus.cc:359] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.747313 29383 raft_consensus.cc:385] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.748288 29377 ts_tablet_manager.cc:1929] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:08.748445 29377 log.cc:1199] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/269d2bb9f1fd45f89ab765b33a502baf
I20260617 20:17:08.748770 29377 ts_tablet_manager.cc:1950] T 269d2bb9f1fd45f89ab765b33a502baf P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:08.750690 29226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184abfbdc6d34f598b10ecaaf5e9b56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.747397 29383 raft_consensus.cc:740] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.751771 29383 consensus_queue.cc:260] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.753652 29378 tablet_bootstrap.cc:492] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:08.753803 29378 ts_tablet_manager.cc:1403] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.074s user 0.001s sys 0.003s
I20260617 20:17:08.754607 29378 raft_consensus.cc:359] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.754794 29378 raft_consensus.cc:385] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.754875 29378 raft_consensus.cc:740] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.758304 30683 raft_consensus.cc:493] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.758466 30683 raft_consensus.cc:515] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.759028 30683 leader_election.cc:290] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.764442 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ba8b7d18af44b58800e588279e2e0b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:08.764674 28981 raft_consensus.cc:2468] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:08.765137 29197 leader_election.cc:304] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.766314 31023 raft_consensus.cc:2804] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:08.766439 31023 raft_consensus.cc:493] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:08.766534 31023 raft_consensus.cc:3060] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.767213 29228 tablet_service.cc:1511] Processing CreateTablet for tablet af84dd50832149e4ab7a6532e3ae2aad (DEFAULT_TABLE table=default.Table_7b002b69063948828e757ca68368920c [id=9467d8b934c542718392056fc09c83ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.768970 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af84dd50832149e4ab7a6532e3ae2aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.769448 29107 tablet_service.cc:1511] Processing CreateTablet for tablet c10b96bee83b419dbfc2a8e26f88e719 (DEFAULT_TABLE table=default.Table_a39fd5d8d0904a738db01e4866ba504f [id=78555f751c8c43c2aba4b8de7ae26ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.770028 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10b96bee83b419dbfc2a8e26f88e719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.771134 31023 raft_consensus.cc:515] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.772135 31023 leader_election.cc:290] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.772766 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ba8b7d18af44b58800e588279e2e0b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:08.772965 28981 raft_consensus.cc:3060] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.775590 28981 raft_consensus.cc:2468] T b6ba8b7d18af44b58800e588279e2e0b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:08.776363 29197 leader_election.cc:304] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.786391 28668 catalog_manager.cc:5788] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317) does not have the latest schema for tablet bcecdba377334298b883d80a9e192acd (table default.Table_5818420ded12484fb2b9e6dea664ff12 [id=e0f22822bb2d4cf2bafa8e5c49de8f45]). Expected version 1 got 0
I20260617 20:17:08.789331 28666 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet e401eea0717d4cbb8319e4d4b1ada410
I20260617 20:17:08.789798 28666 catalog_manager.cc:6784] ReplaceTablet: tablet e401eea0717d4cbb8319e4d4b1ada410 deleted and replaced by tablet 418fae5a0e3248d8a657ad150bf50376
I20260617 20:17:08.792289 29379 tablet_bootstrap.cc:492] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.792436 29379 ts_tablet_manager.cc:1403] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.077s user 0.003s sys 0.003s
I20260617 20:17:08.793467 29379 raft_consensus.cc:359] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.793643 29379 raft_consensus.cc:385] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.793694 29379 raft_consensus.cc:740] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.793874 29379 consensus_queue.cc:260] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.794159 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet e401eea0717d4cbb8319e4d4b1ada410 with delete_type TABLET_DATA_DELETED (replaced by tablet 418fae5a0e3248d8a657ad150bf50376) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.796671 29379 ts_tablet_manager.cc:1434] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:17:08.796976 29379 tablet_bootstrap.cc:492] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.799182 30683 raft_consensus.cc:2804] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:08.799363 30683 raft_consensus.cc:697] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:08.799671 30683 consensus_queue.cc:237] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.800724 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet e401eea0717d4cbb8319e4d4b1ada410 with delete_type TABLET_DATA_DELETED (replaced by tablet 418fae5a0e3248d8a657ad150bf50376) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.801246 29379 tablet_bootstrap.cc:654] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.801973 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet a3e20a1092b746a8b8ddd4386a682229 (table default.Table_8b3f418465f142c784a9c20784e64477 [id=a3772e01cb314c7e88e85833d727617d]). Expected version 2 got 0
I20260617 20:17:08.802714 28669 catalog_manager.cc:5788] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189) does not have the latest schema for tablet d2089215acdf478ca725c9d26b94d692 (table default.Table_2b5031b4d42c4d51b39279536a2c19d9 [id=395d6bc9360549c69d616b8ccf8d01cd]). Expected version 2 got 0
I20260617 20:17:08.803231 28669 catalog_manager.cc:5696] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195). New cstate: current_term: 1 leader_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } health_report { overall_health: HEALTHY } } }
I20260617 20:17:08.811998 29095 tablet_service.cc:1511] Processing CreateTablet for tablet af84dd50832149e4ab7a6532e3ae2aad (DEFAULT_TABLE table=default.Table_7b002b69063948828e757ca68368920c [id=9467d8b934c542718392056fc09c83ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.813508 31033 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:08.814503 28666 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_daa321ef525b447390f30edf50f160bc" } new_table_name: "default.Table_f5089c39d4564eee821b4bb6baeef4f0" modify_external_catalogs: true
I20260617 20:17:08.815948 30683 raft_consensus.cc:493] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.816110 30683 raft_consensus.cc:515] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.816758 30683 leader_election.cc:290] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:08.817332 28656 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet e79c6804fbb34f5baebdb366f2e0b1bf (table default.Table_c31a6d3cec584680a4f793abe57f6d24 [id=dccd13aa95b94b70882f6a59e71d2bf4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e79c6804fbb34f5baebdb366f2e0b1bf consensus state has no leader
I20260617 20:17:08.818404 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af84dd50832149e4ab7a6532e3ae2aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.821853 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00c493a5624569b8f47242fc55b6fb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:08.822177 28981 raft_consensus.cc:2468] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:08.822719 29197 leader_election.cc:304] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.823288 29379 tablet_bootstrap.cc:492] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.823434 29379 ts_tablet_manager.cc:1403] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260617 20:17:08.824167 29379 raft_consensus.cc:359] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.824327 29379 raft_consensus.cc:385] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.824386 29379 raft_consensus.cc:740] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.824628 29379 consensus_queue.cc:260] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.827422 29379 ts_tablet_manager.cc:1434] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260617 20:17:08.827708 29379 tablet_bootstrap.cc:492] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.830054 29383 ts_tablet_manager.cc:1434] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.102s user 0.001s sys 0.001s
I20260617 20:17:08.838352 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet e401eea0717d4cbb8319e4d4b1ada410 with delete_type TABLET_DATA_DELETED (replaced by tablet 418fae5a0e3248d8a657ad150bf50376) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.845845 28969 tablet_service.cc:1511] Processing CreateTablet for tablet c10b96bee83b419dbfc2a8e26f88e719 (DEFAULT_TABLE table=default.Table_a39fd5d8d0904a738db01e4866ba504f [id=78555f751c8c43c2aba4b8de7ae26ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.850158 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10b96bee83b419dbfc2a8e26f88e719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.853681 28954 tablet_service.cc:1511] Processing CreateTablet for tablet 184abfbdc6d34f598b10ecaaf5e9b56f (DEFAULT_TABLE table=default.Table_7df03098d8c34f058bcae824c33dd2a0 [id=e89cb4b6b74547748051e304d9c71c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.854176 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184abfbdc6d34f598b10ecaaf5e9b56f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.860613 28668 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_2b557d2815304bcdabeae5346a5bef96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:08.860764 29379 tablet_bootstrap.cc:654] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:08.861397 28668 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b557d2815304bcdabeae5346a5bef96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.862604 28962 tablet_service.cc:1511] Processing CreateTablet for tablet af84dd50832149e4ab7a6532e3ae2aad (DEFAULT_TABLE table=default.Table_7b002b69063948828e757ca68368920c [id=9467d8b934c542718392056fc09c83ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.863091 28962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af84dd50832149e4ab7a6532e3ae2aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.864720 28663 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet b61162160ec248b7aa6c73c399be1842
I20260617 20:17:08.866061 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet b61162160ec248b7aa6c73c399be1842 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.866794 28631 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRePpQS/build/asan/bin/kudu pid 28639
I20260617 20:17:08.867462 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet b61162160ec248b7aa6c73c399be1842 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.870223 28663 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_c851010d6b214599b076482a51e3b95f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.870796 28663 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c851010d6b214599b076482a51e3b95f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.836905 31023 raft_consensus.cc:2804] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:08.872210 31023 raft_consensus.cc:493] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:08.872400 31023 raft_consensus.cc:3060] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.875293 31023 raft_consensus.cc:515] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.876505 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 506a7db0157b42038ca6312ce987f0b8 (DEFAULT_TABLE table=default.Table_77e7189ea1ef4f3c9af44f3374988908 [id=4efc3cc7163244929a5d09c31838be7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.876979 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506a7db0157b42038ca6312ce987f0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.880826 28661 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet ee9afd550a6d4d2e9edd84e4b49186c4
I20260617 20:17:08.882110 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet ee9afd550a6d4d2e9edd84e4b49186c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.883215 28963 tablet_service.cc:1558] Processing DeleteTablet for tablet ee9afd550a6d4d2e9edd84e4b49186c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.885115 28661 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_cf9750d0cd074e80b29fe0ea53d190c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:08.885736 28661 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf9750d0cd074e80b29fe0ea53d190c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:08.888439 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 908) took 3757 ms. Trace:
I20260617 20:17:08.888559 29377 rpcz_store.cc:276] 0617 20:17:05.130803 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.130844 (+ 41us) service_pool.cc:224] Handling call
0617 20:17:08.575833 (+3444989us) ts_tablet_manager.cc:1151] Deleting tablet 269d2bb9f1fd45f89ab765b33a502baf
0617 20:17:08.575841 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.634455 (+ 58614us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.748228 (+113773us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.888395 (+140167us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3444797}
I20260617 20:17:08.888962 29377 tablet_replica.cc:333] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:08.889168 29377 raft_consensus.cc:2243] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.889381 29377 raft_consensus.cc:2272] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.889712 28655 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 269d2bb9f1fd45f89ab765b33a502baf (table default.Table_fbc7dc910d9b4eda962ff4b9328e00a3 [id=1efcb5e6de134a54bc4250ae502080e6]) successfully deleted
I20260617 20:17:08.882804 29228 tablet_service.cc:1511] Processing CreateTablet for tablet c10b96bee83b419dbfc2a8e26f88e719 (DEFAULT_TABLE table=default.Table_a39fd5d8d0904a738db01e4866ba504f [id=78555f751c8c43c2aba4b8de7ae26ce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.883147 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 506a7db0157b42038ca6312ce987f0b8 (DEFAULT_TABLE table=default.Table_77e7189ea1ef4f3c9af44f3374988908 [id=4efc3cc7163244929a5d09c31838be7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.893620 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506a7db0157b42038ca6312ce987f0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.893693 31023 leader_election.cc:290] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.894281 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00c493a5624569b8f47242fc55b6fb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:08.894456 28981 raft_consensus.cc:3060] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:08.897029 28981 raft_consensus.cc:2468] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:08.883325 29242 tablet_service.cc:1558] Processing DeleteTablet for tablet ee9afd550a6d4d2e9edd84e4b49186c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.897524 29197 leader_election.cc:304] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.897753 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c10b96bee83b419dbfc2a8e26f88e719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.867795 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet b61162160ec248b7aa6c73c399be1842 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.899338 29375 ts_tablet_manager.cc:1929] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:08.899433 29375 log.cc:1199] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/f24954093a45411a9cbe39415fb1adb7
I20260617 20:17:08.899725 29375 ts_tablet_manager.cc:1950] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:08.900147 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 896) took 3467 ms. Trace:
I20260617 20:17:08.900521 31045 raft_consensus.cc:493] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.900645 31045 raft_consensus.cc:515] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.901652 31045 leader_election.cc:290] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:08.902128 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6323292f162b4063b7c413eaecfce791" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:08.902689 28925 leader_election.cc:343] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:08.903062 29378 consensus_queue.cc:260] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.903652 29378 ts_tablet_manager.cc:1434] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.150s user 0.002s sys 0.000s
I20260617 20:17:08.906834 29379 tablet_bootstrap.cc:492] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.906993 29379 ts_tablet_manager.cc:1403] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.079s user 0.011s sys 0.003s
I20260617 20:17:08.907728 29379 raft_consensus.cc:359] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.907907 29379 raft_consensus.cc:385] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.907958 29379 raft_consensus.cc:740] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.908205 29379 consensus_queue.cc:260] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.909080 30761 raft_consensus.cc:2804] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:08.909232 30761 raft_consensus.cc:697] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:08.909505 30761 consensus_queue.cc:237] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.915064 29379 ts_tablet_manager.cc:1434] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 20:17:08.915478 29379 tablet_bootstrap.cc:492] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.917263 29379 tablet_bootstrap.cc:654] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.917156 28670 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_0dc3002823be41b18039e536eb0d547b" } new_table_name: "default.Table_52ee64ebf400478e9534dee35eadf633" modify_external_catalogs: true
I20260617 20:17:08.922821 29377 ts_tablet_manager.cc:1916] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.885030 29376 ts_tablet_manager.cc:1929] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:08.923883 29376 log.cc:1199] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/cbeae97639fd4e6290768dae12f6a4ce
I20260617 20:17:08.924376 29376 ts_tablet_manager.cc:1950] T cbeae97639fd4e6290768dae12f6a4ce P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:08.925521 28963 tablet_service.cc:1511] Processing CreateTablet for tablet 506a7db0157b42038ca6312ce987f0b8 (DEFAULT_TABLE table=default.Table_77e7189ea1ef4f3c9af44f3374988908 [id=4efc3cc7163244929a5d09c31838be7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.885396 29383 tablet_bootstrap.cc:492] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:08.925966 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5aca2e76c34c17b17a5593dc5eefe9 (DEFAULT_TABLE table=default.Table_20640097ea6e4184ac6fb53704a54d25 [id=034cf1b4052a47b4943205b51ea3841e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.926390 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5aca2e76c34c17b17a5593dc5eefe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.926903 30761 raft_consensus.cc:493] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.927054 30761 raft_consensus.cc:515] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.927479 29383 tablet_bootstrap.cc:654] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.931465 30761 leader_election.cc:290] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.941004 29378 tablet_bootstrap.cc:492] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:08.941169 29379 tablet_bootstrap.cc:492] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.941342 29379 ts_tablet_manager.cc:1403] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.000s
I20260617 20:17:08.942306 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 902) took 3803 ms. Trace:
I20260617 20:17:08.942335 29379 raft_consensus.cc:359] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.942553 29379 raft_consensus.cc:385] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.942626 29379 raft_consensus.cc:740] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.942452 29376 rpcz_store.cc:276] 0617 20:17:05.138984 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.139059 (+ 75us) service_pool.cc:224] Handling call
0617 20:17:08.625107 (+3486048us) ts_tablet_manager.cc:1151] Deleting tablet cbeae97639fd4e6290768dae12f6a4ce
0617 20:17:08.625117 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.745812 (+120695us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.884933 (+139121us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.942257 (+ 57324us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3485914}
I20260617 20:17:08.942946 29379 consensus_queue.cc:260] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.943118 28656 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet cbeae97639fd4e6290768dae12f6a4ce (table default.Table_afafb0c05ae94a57a881021813c028a4 [id=95a0bdbc8666443dbd27f9572c6ecb8c]) successfully deleted
I20260617 20:17:08.943491 29376 tablet_replica.cc:333] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:08.943675 29379 ts_tablet_manager.cc:1434] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:08.943724 29376 raft_consensus.cc:2243] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:08.944020 29379 tablet_bootstrap.cc:492] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:08.944124 29376 pending_rounds.cc:70] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:17:08.944206 29376 pending_rounds.cc:77] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955533852971008 op_type: NO_OP noop_request { }
I20260617 20:17:08.944344 29376 raft_consensus.cc:2889] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:08.944470 29376 raft_consensus.cc:2272] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.945004 29376 ts_tablet_manager.cc:1916] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.951608 28667 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet ab011d76c5ff4eae8e20fceab66513e1
I20260617 20:17:08.952231 28667 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60552:
table { table_name: "default.Table_4b555cc3fa1e4dd5b51da47450054b76" } new_table_name: "default.Table_e8af0625b52b462a80073b3d7b60c9db" modify_external_catalogs: true
I20260617 20:17:08.952427 28965 tablet_service.cc:1558] Processing DeleteTablet for tablet ab011d76c5ff4eae8e20fceab66513e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:08.952668 29379 tablet_bootstrap.cc:654] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.956239 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d81457d71a34657b43c8ebe7efb0a35" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:08.956461 28981 raft_consensus.cc:2468] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:08.957537 28963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 506a7db0157b42038ca6312ce987f0b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.962576 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5aca2e76c34c17b17a5593dc5eefe9 (DEFAULT_TABLE table=default.Table_20640097ea6e4184ac6fb53704a54d25 [id=034cf1b4052a47b4943205b51ea3841e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.962982 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5aca2e76c34c17b17a5593dc5eefe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.964279 28961 tablet_service.cc:1511] Processing CreateTablet for tablet 491aa3630ee44380aaf7c6f2d18c2eb1 (DEFAULT_TABLE table=default.Table_9e2110e4c0414947ac06773cfa319bd9 [id=c7a0a1cdc83547ea8838bc07c976f705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.964304 29094 tablet_service.cc:1511] Processing CreateTablet for tablet 491aa3630ee44380aaf7c6f2d18c2eb1 (DEFAULT_TABLE table=default.Table_9e2110e4c0414947ac06773cfa319bd9 [id=c7a0a1cdc83547ea8838bc07c976f705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.964624 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491aa3630ee44380aaf7c6f2d18c2eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.964653 29094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491aa3630ee44380aaf7c6f2d18c2eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.978410 29378 tablet_bootstrap.cc:654] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:08.900220 29375 rpcz_store.cc:276] 0617 20:17:05.432816 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.432857 (+ 41us) service_pool.cc:224] Handling call
0617 20:17:08.644538 (+3211681us) ts_tablet_manager.cc:1151] Deleting tablet f24954093a45411a9cbe39415fb1adb7
0617 20:17:08.644548 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.828456 (+183908us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.899283 (+ 70827us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:08.900130 (+ 847us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3211525}
I20260617 20:17:08.985561 28656 catalog_manager.cc:5027] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): tablet f24954093a45411a9cbe39415fb1adb7 (table default.Table_7ccf01ded0f84e49b3d9791d7ba4096a [id=28985cea8424471d86e5a1c33ee903d5]) successfully deleted
I20260617 20:17:08.986014 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 897) took 3552 ms. Trace:
I20260617 20:17:08.986166 29375 rpcz_store.cc:276] 0617 20:17:05.433054 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.433095 (+ 41us) service_pool.cc:224] Handling call
0617 20:17:08.985887 (+3552792us) ts_tablet_manager.cc:1151] Deleting tablet 7f239f81c40743b2aaa70a361997db77
0617 20:17:08.985899 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.985992 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3552662}
W20260617 20:17:08.986685 28656 catalog_manager.cc:4994] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 7f239f81c40743b2aaa70a361997db77 because the tablet was not found. No further retry: Not found: Tablet not found: 7f239f81c40743b2aaa70a361997db77
I20260617 20:17:08.987107 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 892) took 3555 ms. Trace:
I20260617 20:17:08.987206 28662 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet 93daae49ea3b4abd8623f64bffdd1f6a
I20260617 20:17:08.987253 29375 rpcz_store.cc:276] 0617 20:17:05.431218 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.433673 (+ 2455us) service_pool.cc:224] Handling call
0617 20:17:08.986982 (+3553309us) ts_tablet_manager.cc:1151] Deleting tablet ce3e1aa04bca4425a907caadd5a736f9
0617 20:17:08.986991 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.987088 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3553128}
W20260617 20:17:08.987627 28656 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet ce3e1aa04bca4425a907caadd5a736f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce3e1aa04bca4425a907caadd5a736f9 already in progress: creating tablet
I20260617 20:17:08.988458 29102 tablet_service.cc:1558] Processing DeleteTablet for tablet 93daae49ea3b4abd8623f64bffdd1f6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:08.988689 29375 tablet_replica.cc:333] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:08.988806 29379 tablet_bootstrap.cc:492] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:08.988965 29379 ts_tablet_manager.cc:1403] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.000s
I20260617 20:17:08.988991 29375 raft_consensus.cc:2243] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:08.989265 29375 raft_consensus.cc:2272] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:08.989758 29379 raft_consensus.cc:359] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.989950 29379 raft_consensus.cc:385] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:08.989886 29375 ts_tablet_manager.cc:1916] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:08.990010 29379 raft_consensus.cc:740] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:08.991163 29379 consensus_queue.cc:260] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.955510 30761 consensus_queue.cc:1048] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:08.955910 30852 raft_consensus.cc:493] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:08.956743 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet ab011d76c5ff4eae8e20fceab66513e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:08.993986 30852 raft_consensus.cc:515] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:08.994555 30852 leader_election.cc:290] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:08.956923 29197 leader_election.cc:304] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:08.995735 29228 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5aca2e76c34c17b17a5593dc5eefe9 (DEFAULT_TABLE table=default.Table_20640097ea6e4184ac6fb53704a54d25 [id=034cf1b4052a47b4943205b51ea3841e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:08.996158 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5aca2e76c34c17b17a5593dc5eefe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:08.997076 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2089215acdf478ca725c9d26b94d692" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:08.997260 28988 raft_consensus.cc:2468] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:08.997603 30761 raft_consensus.cc:2804] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:08.997678 30761 raft_consensus.cc:493] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:08.997736 30761 raft_consensus.cc:3060] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.000161 30761 raft_consensus.cc:515] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.001204 30761 leader_election.cc:290] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.001618 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 491aa3630ee44380aaf7c6f2d18c2eb1 (DEFAULT_TABLE table=default.Table_9e2110e4c0414947ac06773cfa319bd9 [id=c7a0a1cdc83547ea8838bc07c976f705]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.002012 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491aa3630ee44380aaf7c6f2d18c2eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.002825 29197 leader_election.cc:304] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:09.003366 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d81457d71a34657b43c8ebe7efb0a35" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:09.003546 28988 raft_consensus.cc:3060] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.006227 28988 raft_consensus.cc:2468] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.006907 30852 raft_consensus.cc:2804] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.007030 30852 raft_consensus.cc:493] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.007128 30852 raft_consensus.cc:3060] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.009745 29197 leader_election.cc:304] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:09.010097 30683 raft_consensus.cc:2804] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:09.010231 30683 raft_consensus.cc:697] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:09.010473 30683 consensus_queue.cc:237] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.012542 29379 ts_tablet_manager.cc:1434] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20260617 20:17:09.012351 30852 raft_consensus.cc:515] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.015060 31045 raft_consensus.cc:493] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.015225 31045 raft_consensus.cc:515] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.015610 30852 leader_election.cc:290] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.016312 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2089215acdf478ca725c9d26b94d692" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:09.016484 29379 tablet_bootstrap.cc:492] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.016606 28988 raft_consensus.cc:3060] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.017654 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba86bae9e91404185d248dfd722a413" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:09.017838 29257 raft_consensus.cc:2468] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:09.018242 29379 tablet_bootstrap.cc:654] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.018347 28925 leader_election.cc:304] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:09.018436 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 93daae49ea3b4abd8623f64bffdd1f6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:09.018679 30967 raft_consensus.cc:2804] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.018786 30967 raft_consensus.cc:493] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.018893 30967 raft_consensus.cc:3060] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.022145 28988 raft_consensus.cc:2468] T d2089215acdf478ca725c9d26b94d692 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.022080 30967 raft_consensus.cc:515] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.024434 29102 tablet_service.cc:1511] Processing CreateTablet for tablet 4f35fb10da0c452aa06f00c25105154c (DEFAULT_TABLE table=default.Table_a7a5ea2c387e417aae386b585127cb0f [id=7104732645714a098ce4a19d87a3b629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.024857 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f35fb10da0c452aa06f00c25105154c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.026227 30967 leader_election.cc:290] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.029834 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet ab011d76c5ff4eae8e20fceab66513e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:09.034081 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17684c0e6b545d1a22801071b6a72ac" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.034466 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6af49cb484f59ad1f32235753e1db" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.034610 29119 raft_consensus.cc:2468] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:09.036021 29379 tablet_bootstrap.cc:492] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.035945 29229 tablet_service.cc:1511] Processing CreateTablet for tablet 4f35fb10da0c452aa06f00c25105154c (DEFAULT_TABLE table=default.Table_a7a5ea2c387e417aae386b585127cb0f [id=7104732645714a098ce4a19d87a3b629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.036239 29379 ts_tablet_manager.cc:1403] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20260617 20:17:09.036371 29229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f35fb10da0c452aa06f00c25105154c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.037040 29379 raft_consensus.cc:359] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.037225 29379 raft_consensus.cc:385] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.037286 29379 raft_consensus.cc:740] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.037513 29379 consensus_queue.cc:260] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.038034 29379 ts_tablet_manager.cc:1434] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:17:09.037109 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba86bae9e91404185d248dfd722a413" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:09.038481 29262 raft_consensus.cc:3060] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.038862 29379 tablet_bootstrap.cc:492] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.041203 29262 raft_consensus.cc:2468] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:09.042136 28925 leader_election.cc:304] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:09.042908 30967 raft_consensus.cc:2804] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:09.045096 28662 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_16e5222656434ff38d46e698a07d9546"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:09.047147 28662 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16e5222656434ff38d46e698a07d9546 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:09.050318 29102 tablet_service.cc:1511] Processing CreateTablet for tablet f9b012261017481891665cb90f670207 (DEFAULT_TABLE table=default.Table_006cb367b3ec46459d97e77c25bc67ae [id=f9b9fa870edd48daa8498a3f371ec669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.050676 29228 tablet_service.cc:1511] Processing CreateTablet for tablet f9b012261017481891665cb90f670207 (DEFAULT_TABLE table=default.Table_006cb367b3ec46459d97e77c25bc67ae [id=f9b9fa870edd48daa8498a3f371ec669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.050964 29102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b012261017481891665cb90f670207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.051069 29228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b012261017481891665cb90f670207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.056061 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17684c0e6b545d1a22801071b6a72ac" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.058081 29197 leader_election.cc:304] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:09.058385 30852 raft_consensus.cc:2804] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:09.058507 30852 raft_consensus.cc:697] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:09.058823 29379 tablet_bootstrap.cc:654] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.058748 30852 consensus_queue.cc:237] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.016402 31045 leader_election.cc:290] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.069947 30410 raft_consensus.cc:493] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.070151 30410 raft_consensus.cc:515] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.070948 30410 leader_election.cc:290] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
W20260617 20:17:09.071868 29197 leader_election.cc:343] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: c17aa7f99fc74838b9975c3e9289ccfd
I20260617 20:17:09.073833 29379 tablet_bootstrap.cc:492] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.074044 29379 ts_tablet_manager.cc:1403] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.002s
I20260617 20:17:09.074827 29379 raft_consensus.cc:359] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.075002 29379 raft_consensus.cc:385] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.075055 29379 raft_consensus.cc:740] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.075285 29379 consensus_queue.cc:260] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.075770 29379 ts_tablet_manager.cc:1434] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:09.079741 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df6af49cb484f59ad1f32235753e1db" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.079921 29118 raft_consensus.cc:3060] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.080482 28969 tablet_service.cc:1511] Processing CreateTablet for tablet 4f35fb10da0c452aa06f00c25105154c (DEFAULT_TABLE table=default.Table_a7a5ea2c387e417aae386b585127cb0f [id=7104732645714a098ce4a19d87a3b629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.081019 28969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f35fb10da0c452aa06f00c25105154c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.082420 29118 raft_consensus.cc:2468] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.086289 28665 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 590225c8ea36448093b77385d238a34a: Sending DeleteTablet for 3 replicas of tablet c9f2a320a1e14115bfe7e70a498a4f27
I20260617 20:17:09.086817 29379 tablet_bootstrap.cc:492] T a3e20a1092b746a8b8ddd4386a682229 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.087581 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet c9f2a320a1e14115bfe7e70a498a4f27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:09.087591 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet c9f2a320a1e14115bfe7e70a498a4f27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:09.089389 31061 raft_consensus.cc:493] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.089529 31061 raft_consensus.cc:515] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.090152 31061 leader_election.cc:290] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.090986 29379 tablet_bootstrap.cc:654] T a3e20a1092b746a8b8ddd4386a682229 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.094054 29089 tablet_service.cc:1558] Processing DeleteTablet for tablet 14a5e5917a414c99b25ea2efeab4063d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:09.094921 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet cbeae97639fd4e6290768dae12f6a4ce with delete_type TABLET_DATA_DELETED (replaced by tablet cc547148aa124907a5e5def6941f734c) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:09.095602 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet eb408723f7a346c3b5ea13cad237b44e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:55 UTC) from {username='slave'} at 127.0.0.1:43332
I20260617 20:17:09.095430 29228 tablet_service.cc:1558] Processing DeleteTablet for tablet f31bf7ed828f44b398f5bdac6b9b63e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:56 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:09.096040 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet eba86bae9e91404185d248dfd722a413 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:41028
I20260617 20:17:09.097087 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet 93daae49ea3b4abd8623f64bffdd1f6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:09.098894 28665 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_272f6d4789324b869132cd475da2844b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:09.099519 28665 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_272f6d4789324b869132cd475da2844b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:09.101104 28664 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60552:
name: "default.Table_22264e3f117c4fa1a7c4fd2c9bf5a88a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:09.101547 28664 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22264e3f117c4fa1a7c4fd2c9bf5a88a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:09.103780 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3897179e7724fdeb87a979ae4ef2091" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.103986 29118 raft_consensus.cc:2468] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:09.105782 29379 tablet_bootstrap.cc:492] T a3e20a1092b746a8b8ddd4386a682229 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.105923 29379 ts_tablet_manager.cc:1403] T a3e20a1092b746a8b8ddd4386a682229 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20260617 20:17:09.106642 29379 raft_consensus.cc:359] T a3e20a1092b746a8b8ddd4386a682229 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.106801 29379 raft_consensus.cc:385] T a3e20a1092b746a8b8ddd4386a682229 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.106848 29379 raft_consensus.cc:740] T a3e20a1092b746a8b8ddd4386a682229 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.106999 29378 tablet_bootstrap.cc:492] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:09.107076 29379 consensus_queue.cc:260] T a3e20a1092b746a8b8ddd4386a682229 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.107165 29378 ts_tablet_manager.cc:1403] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.166s user 0.001s sys 0.003s
I20260617 20:17:09.107582 29379 ts_tablet_manager.cc:1434] T a3e20a1092b746a8b8ddd4386a682229 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260617 20:17:09.107709 29118 raft_consensus.cc:3060] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.108415 29378 raft_consensus.cc:359] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.114308 29379 tablet_bootstrap.cc:492] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.115885 29379 tablet_bootstrap.cc:654] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.117115 29095 tablet_service.cc:1511] Processing CreateTablet for tablet e164ead74ef44bbbb33f65f7ede5a8e2 (DEFAULT_TABLE table=default.Table_3198a4e3806449bc8871764c181d5ebf [id=cb568e8af2da4807b99a6d07c57afca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.117559 29095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e164ead74ef44bbbb33f65f7ede5a8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.117610 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3897179e7724fdeb87a979ae4ef2091" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.117728 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a3d9ae347845dfa9357010819ebc58" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.117772 29125 raft_consensus.cc:3060] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.117864 29119 raft_consensus.cc:2468] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:09.118369 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6f05ae7d624efba571d059ce2f1c91" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.118492 29119 raft_consensus.cc:2468] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:09.119263 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64538fdf51f94e8e985fec6202baac22" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.119423 29119 raft_consensus.cc:2468] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:09.119817 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ebcfc80ca64129a7ab939bfd853998" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.120302 29125 raft_consensus.cc:2468] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.120682 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26ebcfc80ca64129a7ab939bfd853998" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.123867 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2797384f7845969ee9744b444f1acc" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.124393 29119 raft_consensus.cc:2468] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:09.130848 28700 generic_service.cc:196] Checking for leaks (request via RPC)
I20260617 20:17:09.142863 29224 tablet_service.cc:1511] Processing CreateTablet for tablet e164ead74ef44bbbb33f65f7ede5a8e2 (DEFAULT_TABLE table=default.Table_3198a4e3806449bc8871764c181d5ebf [id=cb568e8af2da4807b99a6d07c57afca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.143321 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e164ead74ef44bbbb33f65f7ede5a8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.146569 29107 tablet_service.cc:1511] Processing CreateTablet for tablet 08062d7b815b49558bbb3811420d5ce5 (DEFAULT_TABLE table=default.Table_1b519a3c00d6483097bb906c3bb288dc [id=30c5ab49c17f429686ebd9f937c0c9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.147012 29107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08062d7b815b49558bbb3811420d5ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.152482 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ba8b7d18af44b58800e588279e2e0b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.152884 31062 tablet.cc:1724] T b162a0ef91d1447b838331ba6ef93bf4 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260617 20:17:09.153136 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ba8b7d18af44b58800e588279e2e0b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.158568 29224 tablet_service.cc:1511] Processing CreateTablet for tablet 08062d7b815b49558bbb3811420d5ce5 (DEFAULT_TABLE table=default.Table_1b519a3c00d6483097bb906c3bb288dc [id=30c5ab49c17f429686ebd9f937c0c9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.159097 29224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08062d7b815b49558bbb3811420d5ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.162258 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00c493a5624569b8f47242fc55b6fb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.163374 29119 raft_consensus.cc:3060] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.169112 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00c493a5624569b8f47242fc55b6fb" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.169389 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2089215acdf478ca725c9d26b94d692" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.169430 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d81457d71a34657b43c8ebe7efb0a35" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.169683 29116 raft_consensus.cc:3060] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.169871 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2089215acdf478ca725c9d26b94d692" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.170006 29118 raft_consensus.cc:3060] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.170136 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d81457d71a34657b43c8ebe7efb0a35" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.180812 29378 raft_consensus.cc:385] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.181002 29378 raft_consensus.cc:740] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.181339 29378 consensus_queue.cc:260] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.144580 30967 raft_consensus.cc:697] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:09.185374 30967 consensus_queue.cc:237] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.186956 29122 raft_consensus.cc:3060] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.187983 29379 tablet_bootstrap.cc:492] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.188164 29379 ts_tablet_manager.cc:1403] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.074s user 0.000s sys 0.006s
I20260617 20:17:09.188938 29379 raft_consensus.cc:359] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.189191 29379 raft_consensus.cc:385] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.189298 29379 raft_consensus.cc:740] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.189561 29379 consensus_queue.cc:260] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.192562 29379 ts_tablet_manager.cc:1434] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260617 20:17:09.192870 29379 tablet_bootstrap.cc:492] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.194569 29379 tablet_bootstrap.cc:654] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.194815 29116 raft_consensus.cc:3060] T a3e20a1092b746a8b8ddd4386a682229 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.197989 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6522ae212784b7ebd47cc3403aa3477" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.198261 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d0b861d48e4baf94387f4ff9d9f778" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.198309 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d778641c354c679ee9e7d7b3eae3b5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.198700 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e7a29b7fdd411e9957d23861a996db" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.200424 30852 consensus_queue.cc:1048] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.204418 29378 ts_tablet_manager.cc:1434] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.097s user 0.002s sys 0.000s
I20260617 20:17:09.148844 29377 ts_tablet_manager.cc:1929] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.167322 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bc2304de37441bb78cd12cab5ca3c3" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:09.167829 28961 tablet_service.cc:1511] Processing CreateTablet for tablet e164ead74ef44bbbb33f65f7ede5a8e2 (DEFAULT_TABLE table=default.Table_3198a4e3806449bc8871764c181d5ebf [id=cb568e8af2da4807b99a6d07c57afca9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.211836 28961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e164ead74ef44bbbb33f65f7ede5a8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.212677 29377 log.cc:1199] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/eb408723f7a346c3b5ea13cad237b44e
I20260617 20:17:09.214941 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd89c8452c444af99d8bce0c7cbf8ce1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.215478 29377 ts_tablet_manager.cc:1950] T eb408723f7a346c3b5ea13cad237b44e P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:09.217200 29378 tablet_bootstrap.cc:492] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:09.167934 28965 tablet_service.cc:1511] Processing CreateTablet for tablet 08062d7b815b49558bbb3811420d5ce5 (DEFAULT_TABLE table=default.Table_1b519a3c00d6483097bb906c3bb288dc [id=30c5ab49c17f429686ebd9f937c0c9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.168100 28954 tablet_service.cc:1511] Processing CreateTablet for tablet f9b012261017481891665cb90f670207 (DEFAULT_TABLE table=default.Table_006cb367b3ec46459d97e77c25bc67ae [id=f9b9fa870edd48daa8498a3f371ec669]), partition=RANGE (key) PARTITION UNBOUNDED
I20260617 20:17:09.168278 28962 tablet_service.cc:1558] Processing DeleteTablet for tablet c9f2a320a1e14115bfe7e70a498a4f27 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:08 UTC) from {username='slave'} at 127.0.0.1:55834
I20260617 20:17:09.219489 31084 tablet.cc:1724] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:09.219576 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da50400f49e24ca589519e6ec823957d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.221894 31085 tablet.cc:1724] T 3a17f7ef070d4879a520a3eb6bdf3d23 P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:09.228989 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54969e138cf745739b54203c11e4c94e" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.229985 29120 raft_consensus.cc:3060] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.231329 29379 tablet_bootstrap.cc:492] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.231528 29379 ts_tablet_manager.cc:1403] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.002s
I20260617 20:17:09.232326 29379 raft_consensus.cc:359] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.232553 29379 raft_consensus.cc:385] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.232642 29379 raft_consensus.cc:740] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.232929 29379 consensus_queue.cc:260] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.233562 29379 ts_tablet_manager.cc:1434] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:09.233893 29379 tablet_bootstrap.cc:492] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.235724 29379 tablet_bootstrap.cc:654] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.239451 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6323292f162b4063b7c413eaecfce791" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.239984 29063 leader_election.cc:304] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.240197 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba86bae9e91404185d248dfd722a413" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.241593 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba86bae9e91404185d248dfd722a413" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.246471 31061 raft_consensus.cc:3060] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.248927 31061 raft_consensus.cc:2749] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.252944 31084 tablet.cc:1724] T 9fb0759ee9a34f3d96623bbe6dcc46d9 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260617 20:17:09.254041 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a3d9ae347845dfa9357010819ebc58" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:09.254364 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14a5e5917a414c99b25ea2efeab4063d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:09.254251 29262 raft_consensus.cc:2468] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
W20260617 20:17:09.255281 29198 leader_election.cc:343] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.259892 31065 raft_consensus.cc:493] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.260176 31065 raft_consensus.cc:515] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:09.260506 29198 leader_election.cc:343] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.261336 31065 leader_election.cc:290] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.261550 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcecdba377334298b883d80a9e192acd" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:09.261824 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6bc2304de37441bb78cd12cab5ca3c3" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:09.263511 29198 leader_election.cc:304] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.263871 30410 raft_consensus.cc:2804] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.263943 30410 raft_consensus.cc:493] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.264014 30410 raft_consensus.cc:3060] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.266572 30410 raft_consensus.cc:515] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.267189 30410 leader_election.cc:290] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.268026 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "938b61a0f6dc4d178971034fd18c1674" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:09.268292 29257 raft_consensus.cc:2393] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate 5ca3d93189744132bbf55ac01f3a8254 in this term.
W20260617 20:17:09.262562 28925 leader_election.cc:343] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:09.268836 29197 leader_election.cc:343] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 99a3d9ae347845dfa9357010819ebc58
I20260617 20:17:09.269048 29379 tablet_bootstrap.cc:492] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.269268 29379 ts_tablet_manager.cc:1403] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260617 20:17:09.269325 29198 leader_election.cc:304] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.269726 30410 raft_consensus.cc:2804] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.269827 30410 raft_consensus.cc:493] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.269948 30410 raft_consensus.cc:3060] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.270124 29379 raft_consensus.cc:359] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.270359 29379 raft_consensus.cc:385] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.270470 29379 raft_consensus.cc:740] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.270722 29379 consensus_queue.cc:260] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.271113 29376 ts_tablet_manager.cc:1929] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.271283 29379 ts_tablet_manager.cc:1434] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:17:09.271631 29379 tablet_bootstrap.cc:492] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.273809 29379 tablet_bootstrap.cc:654] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.275115 31087 tablet.cc:1724] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260617 20:17:09.279932 28925 leader_election.cc:343] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.280073 28925 leader_election.cc:304] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.280560 30967 raft_consensus.cc:2749] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:09.282691 28925 leader_election.cc:343] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.282822 28925 leader_election.cc:304] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.283259 30967 raft_consensus.cc:2749] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:09.283777 28925 leader_election.cc:343] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.283900 28925 leader_election.cc:304] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.284283 30967 raft_consensus.cc:2749] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:09.285274 28925 leader_election.cc:343] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.285491 28925 leader_election.cc:304] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.286027 30967 raft_consensus.cc:2749] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.287688 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 909) took 4156 ms. Trace:
I20260617 20:17:09.287804 28965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08062d7b815b49558bbb3811420d5ce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.287801 29377 rpcz_store.cc:276] 0617 20:17:05.131544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.131592 (+ 48us) service_pool.cc:224] Handling call
0617 20:17:08.888884 (+3757292us) ts_tablet_manager.cc:1151] Deleting tablet eb408723f7a346c3b5ea13cad237b44e
0617 20:17:08.888897 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:08.975783 (+ 86886us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.148747 (+172964us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.287643 (+138896us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3757145}
I20260617 20:17:09.288153 29377 tablet_replica.cc:333] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:09.288383 29377 raft_consensus.cc:2243] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.288555 29377 raft_consensus.cc:2272] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.289717 28954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b012261017481891665cb90f670207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260617 20:17:09.293346 29379 tablet_bootstrap.cc:492] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.293485 29379 ts_tablet_manager.cc:1403] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.002s
I20260617 20:17:09.294209 29379 raft_consensus.cc:359] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.294355 29379 raft_consensus.cc:385] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.294399 29379 raft_consensus.cc:740] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.294587 29379 consensus_queue.cc:260] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.295185 29379 ts_tablet_manager.cc:1434] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260617 20:17:09.298918 28925 leader_election.cc:343] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.299065 28925 leader_election.cc:304] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.299463 30967 raft_consensus.cc:2749] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:09.300911 28925 leader_election.cc:343] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.301033 28925 leader_election.cc:304] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.301388 30967 raft_consensus.cc:2749] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:09.302385 28925 leader_election.cc:343] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.302502 28925 leader_election.cc:304] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.302789 30967 raft_consensus.cc:2749] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:09.303596 28925 leader_election.cc:343] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.303694 28925 leader_election.cc:304] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.304059 30967 raft_consensus.cc:2749] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:09.306226 28925 leader_election.cc:343] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.308907 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a3d9ae347845dfa9357010819ebc58" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.309134 29120 raft_consensus.cc:3060] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.311949 29120 raft_consensus.cc:2468] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:17:09.313504 29063 leader_election.cc:343] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: f24954093a45411a9cbe39415fb1adb7
I20260617 20:17:09.314253 29063 leader_election.cc:304] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:09.314517 29063 raft_consensus.cc:2686] T f24954093a45411a9cbe39415fb1adb7 P 6d4ce30e1fce4591b64c398747f8d37a: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260617 20:17:09.315517 29063 leader_election.cc:343] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: dee426100bb645f391be123aeb52e412
I20260617 20:17:09.315708 29063 leader_election.cc:304] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.315974 31061 raft_consensus.cc:2749] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.316376 29063 leader_election.cc:304] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.316653 31061 raft_consensus.cc:2749] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.317005 29063 leader_election.cc:304] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.313671 29379 tablet_bootstrap.cc:492] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.317256 31061 raft_consensus.cc:2764] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260617 20:17:09.313855 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcecdba377334298b883d80a9e192acd" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.318650 29063 leader_election.cc:304] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.318919 31061 raft_consensus.cc:2749] T b6bc2304de37441bb78cd12cab5ca3c3 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.319008 29379 tablet_bootstrap.cc:654] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.319365 29063 leader_election.cc:304] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.319628 31061 raft_consensus.cc:3060] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.320430 29377 ts_tablet_manager.cc:1916] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.322206 31061 raft_consensus.cc:2749] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:09.323159 28925 leader_election.cc:343] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.323297 28925 leader_election.cc:304] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.323804 30967 raft_consensus.cc:2749] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.328806 29375 ts_tablet_manager.cc:1929] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.328922 29375 log.cc:1199] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/cc8fa9f4c40b4ce9baa27a8837d3575c
I20260617 20:17:09.329313 29375 ts_tablet_manager.cc:1950] T cc8fa9f4c40b4ce9baa27a8837d3575c P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:09.306310 29378 tablet_bootstrap.cc:654] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.272852 30410 raft_consensus.cc:515] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.336926 29376 log.cc:1199] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/adbc3219639748d9a0d71d45ae22ab36
I20260617 20:17:09.337374 29376 ts_tablet_manager.cc:1950] T adbc3219639748d9a0d71d45ae22ab36 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:09.337502 30410 leader_election.cc:290] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.275648 29198 leader_election.cc:304] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
W20260617 20:17:09.338070 29198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 62440.5us
I20260617 20:17:09.338276 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 903) took 4199 ms. Trace:
I20260617 20:17:09.338351 29376 rpcz_store.cc:276] 0617 20:17:05.139251 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.139335 (+ 84us) service_pool.cc:224] Handling call
0617 20:17:08.943433 (+3804098us) ts_tablet_manager.cc:1151] Deleting tablet adbc3219639748d9a0d71d45ae22ab36
0617 20:17:08.943443 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.188143 (+244700us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.271060 (+ 82917us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.338258 (+ 67198us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3803969}
I20260617 20:17:09.338661 29376 tablet_replica.cc:333] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:17:09.278352 29196 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260617 20:17:09.339165 30761 raft_consensus.cc:2804] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.339242 30761 raft_consensus.cc:493] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.339308 30761 raft_consensus.cc:3060] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.340003 31023 raft_consensus.cc:493] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.340106 31023 raft_consensus.cc:515] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.340606 31023 leader_election.cc:290] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.306928 30852 consensus_queue.cc:1048] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:09.338666 29198 leader_election.cc:343] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:09.342093 29198 leader_election.cc:343] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.342548 30761 raft_consensus.cc:515] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.343082 30761 leader_election.cc:290] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:09.344002 29197 leader_election.cc:343] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 64538fdf51f94e8e985fec6202baac22
I20260617 20:17:09.345523 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31bf7ed828f44b398f5bdac6b9b63e7" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
W20260617 20:17:09.346194 29197 leader_election.cc:343] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 8b6f05ae7d624efba571d059ce2f1c91
I20260617 20:17:09.346832 28981 raft_consensus.cc:2468] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:09.346839 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6f05ae7d624efba571d059ce2f1c91" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.347021 29121 raft_consensus.cc:3060] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.347379 29197 leader_election.cc:304] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:09.347620 31023 raft_consensus.cc:2804] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.347707 31023 raft_consensus.cc:493] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.347796 31023 raft_consensus.cc:3060] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.350946 31023 raft_consensus.cc:515] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.353015 30410 consensus_queue.cc:1048] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.353137 31023 leader_election.cc:290] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.359884 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31bf7ed828f44b398f5bdac6b9b63e7" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:09.360962 28983 raft_consensus.cc:3060] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.379597 29121 raft_consensus.cc:2468] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.380417 31093 consensus_queue.cc:1048] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.381032 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 898) took 3935 ms. Trace:
I20260617 20:17:09.383283 29375 rpcz_store.cc:276] 0617 20:17:05.445612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.445671 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:08.988650 (+3542979us) ts_tablet_manager.cc:1151] Deleting tablet cc8fa9f4c40b4ce9baa27a8837d3575c
0617 20:17:08.988657 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.222569 (+233912us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.328750 (+106181us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.381011 (+ 52261us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3542786}
I20260617 20:17:09.384192 29375 tablet_replica.cc:333] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:09.384727 29375 raft_consensus.cc:2243] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.385339 29375 raft_consensus.cc:2272] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.385702 29376 raft_consensus.cc:2243] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:09.386020 29376 raft_consensus.cc:2272] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.386593 29376 ts_tablet_manager.cc:1916] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.390583 29379 tablet_bootstrap.cc:492] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.390738 29379 ts_tablet_manager.cc:1403] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.077s user 0.006s sys 0.012s
I20260617 20:17:09.395546 29379 raft_consensus.cc:359] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.395780 29379 raft_consensus.cc:385] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.395833 29379 raft_consensus.cc:740] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.396013 30967 raft_consensus.cc:493] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.396054 29379 consensus_queue.cc:260] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.396164 30967 raft_consensus.cc:515] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.396523 29379 ts_tablet_manager.cc:1434] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:17:09.396795 29379 tablet_bootstrap.cc:492] T d2089215acdf478ca725c9d26b94d692 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.396781 30967 leader_election.cc:290] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.397722 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43549813e294796baca2a1a64dbcfb9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.397755 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43549813e294796baca2a1a64dbcfb9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:09.398288 28925 leader_election.cc:343] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:09.398551 28925 leader_election.cc:343] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.398670 28925 leader_election.cc:304] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.399098 30967 raft_consensus.cc:2749] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.399605 29378 tablet_bootstrap.cc:492] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:09.399793 29378 ts_tablet_manager.cc:1403] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.195s user 0.005s sys 0.000s
I20260617 20:17:09.400641 31093 raft_consensus.cc:493] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.400638 29378 raft_consensus.cc:359] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.400882 29378 raft_consensus.cc:385] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.400821 31093 raft_consensus.cc:515] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.401628 31093 leader_election.cc:290] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:09.402339 29198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 59788.5us
I20260617 20:17:09.402992 29198 leader_election.cc:304] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.402076 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ae2f924494679a1389ad61be65259" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:09.421463 29378 raft_consensus.cc:740] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.421566 28985 raft_consensus.cc:2468] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:09.421800 29378 consensus_queue.cc:260] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.422390 29378 ts_tablet_manager.cc:1434] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20260617 20:17:09.422704 29378 tablet_bootstrap.cc:492] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:09.413266 28983 raft_consensus.cc:2468] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.424571 29378 tablet_bootstrap.cc:654] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.426401 29197 leader_election.cc:304] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:09.426733 29197 leader_election.cc:304] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:09.426784 31093 raft_consensus.cc:2804] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.429450 30683 raft_consensus.cc:2804] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:09.429797 30683 raft_consensus.cc:697] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:09.429919 30852 raft_consensus.cc:2804] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.429975 30852 raft_consensus.cc:493] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.430030 30852 raft_consensus.cc:3060] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.430050 30683 consensus_queue.cc:237] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.431509 31061 raft_consensus.cc:493] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.431650 31061 raft_consensus.cc:515] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.432243 31061 leader_election.cc:290] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.432627 30852 raft_consensus.cc:515] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.432734 29379 tablet_bootstrap.cc:654] T d2089215acdf478ca725c9d26b94d692 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.433171 30852 leader_election.cc:290] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:09.437386 29197 leader_election.cc:343] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 5b2797384f7845969ee9744b444f1acc
I20260617 20:17:09.438582 29377 ts_tablet_manager.cc:1929] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.438701 29377 log.cc:1199] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/5df6af49cb484f59ad1f32235753e1db
I20260617 20:17:09.439040 29377 ts_tablet_manager.cc:1950] T 5df6af49cb484f59ad1f32235753e1db P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:09.439270 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00c493a5624569b8f47242fc55b6fb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:09.439754 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 910) took 4307 ms. Trace:
I20260617 20:17:09.439864 29377 rpcz_store.cc:276] 0617 20:17:05.132498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.132544 (+ 46us) service_pool.cc:224] Handling call
0617 20:17:09.288080 (+4155536us) ts_tablet_manager.cc:1151] Deleting tablet 5df6af49cb484f59ad1f32235753e1db
0617 20:17:09.288088 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.323472 (+ 35384us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.438501 (+115029us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.439719 (+ 1218us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4155383}
I20260617 20:17:09.440207 29377 tablet_replica.cc:333] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:09.440389 29377 raft_consensus.cc:2243] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.440554 29377 raft_consensus.cc:2272] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.441555 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00c493a5624569b8f47242fc55b6fb" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:09.441892 29378 tablet_bootstrap.cc:492] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:09.442022 28983 raft_consensus.cc:2393] T 2d00c493a5624569b8f47242fc55b6fb P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:09.443197 31061 raft_consensus.cc:493] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.443379 31061 raft_consensus.cc:515] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.444061 31061 leader_election.cc:290] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.444929 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb29f2e56c4838b0efd0171229088a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:09.445393 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb29f2e56c4838b0efd0171229088a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
W20260617 20:17:09.445560 29063 leader_election.cc:343] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.445596 28985 raft_consensus.cc:2468] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:09.445885 29062 leader_election.cc:304] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.446138 31061 raft_consensus.cc:3060] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.446246 29062 leader_election.cc:304] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters: a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.446540 31009 raft_consensus.cc:2804] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.446601 31009 raft_consensus.cc:493] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.446653 31009 raft_consensus.cc:3060] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:09.447122 29198 leader_election.cc:343] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:09.447386 29198 leader_election.cc:343] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:09.447994 29198 leader_election.cc:343] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.448781 31061 raft_consensus.cc:2749] T 2d00c493a5624569b8f47242fc55b6fb P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.429450 31093 raft_consensus.cc:493] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260617 20:17:09.449028 29198 consensus_peers.cc:597] T a17684c0e6b545d1a22801071b6a72ac P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:09.449070 31093 raft_consensus.cc:3060] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.449096 31009 raft_consensus.cc:515] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:09.449172 29198 leader_election.cc:343] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:09.449465 29198 leader_election.cc:343] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:09.449713 29198 leader_election.cc:343] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.450243 31009 leader_election.cc:290] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:09.450273 29198 leader_election.cc:343] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.451064 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb29f2e56c4838b0efd0171229088a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:09.451256 28985 raft_consensus.cc:3060] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.442059 29378 ts_tablet_manager.cc:1403] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20260617 20:17:09.454244 28985 raft_consensus.cc:2468] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:09.457649 29062 leader_election.cc:304] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:17:09.457988 31009 raft_consensus.cc:2804] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:09.458101 31009 raft_consensus.cc:697] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:09.458339 31009 consensus_queue.cc:237] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:09.450511 29198 leader_election.cc:343] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.451047 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb29f2e56c4838b0efd0171229088a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
W20260617 20:17:09.468366 29063 leader_election.cc:343] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.469135 29383 tablet_bootstrap.cc:492] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:09.470572 29383 ts_tablet_manager.cc:1403] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.585s user 0.020s sys 0.000s
I20260617 20:17:09.477447 30967 raft_consensus.cc:493] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.477646 30967 raft_consensus.cc:515] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.478525 30967 leader_election.cc:290] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.479584 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18791cd3384f4bd48c333a3460e85286" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.480472 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18791cd3384f4bd48c333a3460e85286" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:09.480767 28925 leader_election.cc:343] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:09.482242 28925 leader_election.cc:343] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.482414 28925 leader_election.cc:304] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.483263 31065 raft_consensus.cc:2749] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.484470 29378 raft_consensus.cc:359] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.484733 29378 raft_consensus.cc:385] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.484843 29378 raft_consensus.cc:740] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.485129 29378 consensus_queue.cc:260] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.491971 29375 ts_tablet_manager.cc:1916] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.492046 29378 ts_tablet_manager.cc:1434] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.040s user 0.000s sys 0.001s
I20260617 20:17:09.497713 29378 tablet_bootstrap.cc:492] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:09.500414 29378 tablet_bootstrap.cc:654] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.500680 31093 raft_consensus.cc:515] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.501482 31093 leader_election.cc:290] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.502117 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ae2f924494679a1389ad61be65259" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:09.502513 28983 raft_consensus.cc:3060] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.506304 28983 raft_consensus.cc:2468] T 839ae2f924494679a1389ad61be65259 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.507102 29197 leader_election.cc:304] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:17:09.508086 29198 leader_election.cc:343] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: c17aa7f99fc74838b9975c3e9289ccfd
I20260617 20:17:09.508277 29198 leader_election.cc:304] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:09.508582 30683 raft_consensus.cc:2749] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.508970 30852 raft_consensus.cc:2804] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:09.509078 30852 raft_consensus.cc:697] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:09.509347 30852 consensus_queue.cc:237] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.513873 29383 raft_consensus.cc:359] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.515159 31009 raft_consensus.cc:493] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.515314 31009 raft_consensus.cc:515] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.515990 31009 leader_election.cc:290] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.517091 29383 raft_consensus.cc:385] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 20:17:09.517586 29063 leader_election.cc:343] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 75c59cf5f5e8486baf1e038a44657f33
I20260617 20:17:09.517230 29383 raft_consensus.cc:740] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.517983 29383 consensus_queue.cc:260] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.518608 29383 ts_tablet_manager.cc:1434] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.048s user 0.001s sys 0.001s
I20260617 20:17:09.518918 31009 raft_consensus.cc:493] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.519050 29383 tablet_bootstrap.cc:492] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:09.519037 31009 raft_consensus.cc:515] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.519596 31009 leader_election.cc:290] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.520186 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c73ae1007d44ce958ad02fa5787651" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:09.520429 29375 ts_tablet_manager.cc:1929] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:09.520555 29375 log.cc:1199] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/ea2a8f46e8ac4f4aa39544a9fe40b1fe
I20260617 20:17:09.520709 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c73ae1007d44ce958ad02fa5787651" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:09.521178 29063 leader_election.cc:304] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.521435 31009 raft_consensus.cc:2749] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.521962 29377 ts_tablet_manager.cc:1916] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.527235 29375 ts_tablet_manager.cc:1950] T ea2a8f46e8ac4f4aa39544a9fe40b1fe P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:09.528420 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 899) took 4082 ms. Trace:
I20260617 20:17:09.528530 29375 rpcz_store.cc:276] 0617 20:17:05.445874 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.445918 (+ 44us) service_pool.cc:224] Handling call
0617 20:17:09.384131 (+3938213us) ts_tablet_manager.cc:1151] Deleting tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe
0617 20:17:09.384144 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.507160 (+123016us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.520373 (+ 13213us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.528402 (+ 8029us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3938075}
I20260617 20:17:09.528810 29376 ts_tablet_manager.cc:1929] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.528931 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 900) took 4082 ms. Trace:
I20260617 20:17:09.528944 29376 log.cc:1199] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/f02529cd1e764a3886de27d86e9690e3
I20260617 20:17:09.529011 29375 rpcz_store.cc:276] 0617 20:17:05.446631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.446682 (+ 51us) service_pool.cc:224] Handling call
0617 20:17:09.528813 (+4082131us) ts_tablet_manager.cc:1151] Deleting tablet 380ccd1d167744248a1ccad80788d0a0
0617 20:17:09.528822 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.528917 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4081975}
I20260617 20:17:09.529264 29375 tablet_replica.cc:333] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:09.529363 29376 ts_tablet_manager.cc:1950] T f02529cd1e764a3886de27d86e9690e3 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:09.529501 29375 raft_consensus.cc:2243] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.529665 29375 raft_consensus.cc:2272] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.530082 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 904) took 4390 ms. Trace:
I20260617 20:17:09.530165 29376 rpcz_store.cc:276] 0617 20:17:05.139544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.139615 (+ 71us) service_pool.cc:224] Handling call
0617 20:17:09.338616 (+4199001us) ts_tablet_manager.cc:1151] Deleting tablet f02529cd1e764a3886de27d86e9690e3
0617 20:17:09.338625 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.454948 (+116323us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.528650 (+ 73702us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.530063 (+ 1413us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4198869}
I20260617 20:17:09.530746 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 905) took 4391 ms. Trace:
I20260617 20:17:09.530823 29376 rpcz_store.cc:276] 0617 20:17:05.139816 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.139906 (+ 90us) service_pool.cc:224] Handling call
0617 20:17:09.530637 (+4390731us) ts_tablet_manager.cc:1151] Deleting tablet 211d0b0897f14ff4929ed55cd2f27b94
0617 20:17:09.530649 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.530733 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4390594}
I20260617 20:17:09.531316 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 906) took 4391 ms. Trace:
I20260617 20:17:09.531399 29376 rpcz_store.cc:276] 0617 20:17:05.140095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.140178 (+ 83us) service_pool.cc:224] Handling call
0617 20:17:09.531203 (+4391025us) ts_tablet_manager.cc:1151] Deleting tablet 5bc8b1dc268b455ea263b67077e0bf6d
0617 20:17:09.531214 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.531300 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4390893}
I20260617 20:17:09.532033 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 908) took 4374 ms. Trace:
I20260617 20:17:09.532138 29376 rpcz_store.cc:276] 0617 20:17:05.157695 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.157936 (+ 241us) service_pool.cc:224] Handling call
0617 20:17:09.531886 (+4373950us) ts_tablet_manager.cc:1151] Deleting tablet 5d09b732e1cc4126bf7b0b17e5396607
0617 20:17:09.531910 (+ 24us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.532013 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4373636}
I20260617 20:17:09.534478 30683 consensus_queue.cc:1048] T a3e20a1092b746a8b8ddd4386a682229 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.536027 30683 consensus_queue.cc:1048] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.536666 29198 leader_election.cc:304] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.536952 30683 raft_consensus.cc:2804] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:09.537088 30683 raft_consensus.cc:697] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:09.537420 30683 consensus_queue.cc:237] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.543509 29379 tablet_bootstrap.cc:492] T d2089215acdf478ca725c9d26b94d692 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.543687 29379 ts_tablet_manager.cc:1403] T d2089215acdf478ca725c9d26b94d692 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.147s user 0.001s sys 0.001s
I20260617 20:17:09.544561 29379 raft_consensus.cc:359] T d2089215acdf478ca725c9d26b94d692 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.544782 29379 raft_consensus.cc:385] T d2089215acdf478ca725c9d26b94d692 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.544831 29379 raft_consensus.cc:740] T d2089215acdf478ca725c9d26b94d692 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.545095 29379 consensus_queue.cc:260] T d2089215acdf478ca725c9d26b94d692 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.550798 31009 raft_consensus.cc:493] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.550943 31009 raft_consensus.cc:515] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.551493 31009 leader_election.cc:290] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:09.551815 29062 leader_election.cc:343] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 75c59cf5f5e8486baf1e038a44657f33
I20260617 20:17:09.551913 29062 leader_election.cc:304] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.552363 31009 raft_consensus.cc:2749] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.553113 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f823290351d542179b8bcc683d7acf6a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:09.553332 29257 raft_consensus.cc:2468] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:09.553378 31009 raft_consensus.cc:493] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.553515 31009 raft_consensus.cc:515] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.553725 29063 leader_election.cc:304] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:09.553946 31061 raft_consensus.cc:2804] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.554028 31061 raft_consensus.cc:493] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.554065 31009 leader_election.cc:290] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.554092 31061 raft_consensus.cc:3060] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:09.558043 29062 leader_election.cc:343] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 269d2bb9f1fd45f89ab765b33a502baf
I20260617 20:17:09.558434 31061 raft_consensus.cc:515] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.558982 29375 ts_tablet_manager.cc:1916] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:09.560199 29062 leader_election.cc:343] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f823290351d542179b8bcc683d7acf6a
I20260617 20:17:09.560233 31061 leader_election.cc:290] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.562541 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269d2bb9f1fd45f89ab765b33a502baf" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:09.562870 29062 leader_election.cc:343] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f823290351d542179b8bcc683d7acf6a
I20260617 20:17:09.562894 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f823290351d542179b8bcc683d7acf6a" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:09.563022 29262 raft_consensus.cc:3060] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:09.563073 29063 leader_election.cc:343] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.563210 29063 leader_election.cc:304] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.563621 31061 raft_consensus.cc:2749] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.565279 29383 tablet_bootstrap.cc:654] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.569975 31107 raft_consensus.cc:493] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590225c8ea36448093b77385d238a34a)
I20260617 20:17:09.565567 29262 raft_consensus.cc:2468] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:09.570135 31107 raft_consensus.cc:515] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:09.568306 31094 consensus_queue.cc:1048] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.570472 29063 leader_election.cc:304] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.570801 31061 raft_consensus.cc:2804] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
W20260617 20:17:09.568573 29198 consensus_peers.cc:597] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:09.571051 31061 raft_consensus.cc:697] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:09.571122 29198 leader_election.cc:304] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.571365 31061 consensus_queue.cc:237] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.571514 31094 raft_consensus.cc:2804] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:09.571640 31094 raft_consensus.cc:697] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:09.571905 31094 consensus_queue.cc:237] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.573987 30378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1307 } } ignore_live_leader: false dest_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" is_pre_election: true
I20260617 20:17:09.574199 30378 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5ea3f9265d84474ab3bced8dd5aecc5 in term 1.
I20260617 20:17:09.574692 29527 leader_election.cc:304] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87437cd320a4470fa0dedd43aa7ea3eb, f5ea3f9265d84474ab3bced8dd5aecc5; no voters:
I20260617 20:17:09.578243 29375 ts_tablet_manager.cc:1929] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.580365 29375 log.cc:1199] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/58213ec0a9364a91a15fc0329f28605b
I20260617 20:17:09.581781 29375 ts_tablet_manager.cc:1950] T 58213ec0a9364a91a15fc0329f28605b P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:09.583021 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 906) took 4117 ms. Trace:
I20260617 20:17:09.584471 29375 rpcz_store.cc:276] 0617 20:17:05.466011 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.466054 (+ 43us) service_pool.cc:224] Handling call
0617 20:17:09.529223 (+4063169us) ts_tablet_manager.cc:1151] Deleting tablet 58213ec0a9364a91a15fc0329f28605b
0617 20:17:09.529232 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.563841 (+ 34609us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.578179 (+ 14338us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.582994 (+ 4815us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4062991}
I20260617 20:17:09.585515 29375 tablet_replica.cc:333] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:09.586097 29375 raft_consensus.cc:2243] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.586645 29375 raft_consensus.cc:2272] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.587574 29375 ts_tablet_manager.cc:1916] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.593719 31094 raft_consensus.cc:493] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.593880 31094 raft_consensus.cc:515] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.594599 31094 leader_election.cc:290] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.599426 29375 ts_tablet_manager.cc:1929] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.599615 31065 raft_consensus.cc:493] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.599754 31065 raft_consensus.cc:515] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.600256 31065 leader_election.cc:290] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.602272 29375 log.cc:1199] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/cbeae97639fd4e6290768dae12f6a4ce
I20260617 20:17:09.602795 29375 ts_tablet_manager.cc:1950] T cbeae97639fd4e6290768dae12f6a4ce P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:09.603904 31009 raft_consensus.cc:493] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.604043 31009 raft_consensus.cc:515] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.604614 31009 leader_election.cc:290] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.603914 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 907) took 4137 ms. Trace:
I20260617 20:17:09.604882 29375 rpcz_store.cc:276] 0617 20:17:05.466525 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.466839 (+ 314us) service_pool.cc:224] Handling call
0617 20:17:09.585451 (+4118612us) ts_tablet_manager.cc:1151] Deleting tablet cbeae97639fd4e6290768dae12f6a4ce
0617 20:17:09.585464 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.592483 (+ 7019us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.599372 (+ 6889us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.603895 (+ 4523us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4118472}
I20260617 20:17:09.605269 29121 raft_consensus.cc:3060] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.605400 31107 leader_election.cc:290] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), 87437cd320a4470fa0dedd43aa7ea3eb (127.27.245.253:38361)
I20260617 20:17:09.605341 31106 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590225c8ea36448093b77385d238a34a)
I20260617 20:17:09.605576 29375 tablet_replica.cc:333] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:09.605587 31107 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 20:17:09.605562 31106 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:09.605681 31107 raft_consensus.cc:493] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590225c8ea36448093b77385d238a34a)
I20260617 20:17:09.605764 31107 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 1 FOLLOWER]: Advancing to term 2
I20260617 20:17:09.605770 29375 raft_consensus.cc:2243] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.605912 29375 raft_consensus.cc:2272] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.606986 31106 leader_election.cc:290] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059)
I20260617 20:17:09.607175 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1307 } } ignore_live_leader: false dest_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" is_pre_election: true
I20260617 20:17:09.607738 29375 ts_tablet_manager.cc:1916] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.608960 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31bf7ed828f44b398f5bdac6b9b63e7" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.609126 29120 raft_consensus.cc:2468] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:09.609225 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaddd6519dc490c8358be629b21a2d9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:09.609340 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64538fdf51f94e8e985fec6202baac22" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.609450 29122 raft_consensus.cc:3060] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.609922 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31bf7ed828f44b398f5bdac6b9b63e7" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.610052 29116 raft_consensus.cc:3060] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.610544 31107 raft_consensus.cc:515] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:09.611240 31107 leader_election.cc:290] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 election: Requested vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), 87437cd320a4470fa0dedd43aa7ea3eb (127.27.245.253:38361)
I20260617 20:17:09.611922 29122 raft_consensus.cc:2468] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.612234 29620 raft_consensus.cc:2393] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87437cd320a4470fa0dedd43aa7ea3eb in current term 2: Already voted for candidate f5ea3f9265d84474ab3bced8dd5aecc5 in this term.
I20260617 20:17:09.612334 30378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1307 } } ignore_live_leader: false dest_uuid: "87437cd320a4470fa0dedd43aa7ea3eb"
I20260617 20:17:09.612465 29116 raft_consensus.cc:2468] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.612547 30378 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 1 FOLLOWER]: Advancing to term 2
I20260617 20:17:09.613597 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ae2f924494679a1389ad61be65259" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.613903 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2797384f7845969ee9744b444f1acc" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.614034 29122 raft_consensus.cc:3060] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.615043 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "839ae2f924494679a1389ad61be65259" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.617069 29122 raft_consensus.cc:2468] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.619509 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee909c8988d49779612e98f5cd82972" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.619551 30378 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5ea3f9265d84474ab3bced8dd5aecc5 in term 2.
I20260617 20:17:09.620285 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaa60028a1647e580a987c3a0836a24" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.620584 29122 raft_consensus.cc:2468] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.622279 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee909c8988d49779612e98f5cd82972" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:09.622340 29197 leader_election.cc:343] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 0eaa60028a1647e580a987c3a0836a24
I20260617 20:17:09.624444 29198 leader_election.cc:304] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
W20260617 20:17:09.625080 29198 leader_election.cc:343] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.625192 29527 leader_election.cc:304] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87437cd320a4470fa0dedd43aa7ea3eb, f5ea3f9265d84474ab3bced8dd5aecc5; no voters:
W20260617 20:17:09.625401 29198 leader_election.cc:343] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.625551 31110 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260617 20:17:09.625650 29198 leader_election.cc:304] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
W20260617 20:17:09.625756 28925 leader_election.cc:343] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.625753 31110 raft_consensus.cc:697] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [term 2 LEADER]: Becoming Leader. State: Replica: f5ea3f9265d84474ab3bced8dd5aecc5, State: Running, Role: LEADER
I20260617 20:17:09.626192 29198 leader_election.cc:304] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.626335 31110 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1307, Committed index: 1307, Last appended: 1.1307, Last appended by leader: 1306, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:09.626716 31094 consensus_queue.cc:1048] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.627189 31094 raft_consensus.cc:2804] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:09.627308 31094 raft_consensus.cc:697] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:09.627589 31094 consensus_queue.cc:237] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.628804 30852 raft_consensus.cc:2804] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
W20260617 20:17:09.628811 28925 leader_election.cc:343] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.628939 28925 leader_election.cc:304] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.629329 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 909) took 4470 ms. Trace:
I20260617 20:17:09.629407 30761 raft_consensus.cc:2804] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 20:17:09.629444 30967 raft_consensus.cc:2749] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.629516 30761 raft_consensus.cc:493] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.629593 30761 raft_consensus.cc:3060] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Advancing to term 2
I20260617 20:17:09.632778 30761 raft_consensus.cc:515] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.634938 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eaddd6519dc490c8358be629b21a2d9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:09.635349 29197 consensus_peers.cc:597] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb408723f7a346c3b5ea13cad237b44e. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:09.636035 29063 leader_election.cc:304] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.636291 31009 raft_consensus.cc:2749] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.638338 31110 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5ea3f9265d84474ab3bced8dd5aecc5. Latest consensus state: current_term: 2 leader_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:17:09.638793 31110 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: This master's current role is: LEADER
I20260617 20:17:09.641834 29377 ts_tablet_manager.cc:1929] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.642477 31119 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260617 20:17:09.642537 30761 leader_election.cc:290] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.642987 29379 ts_tablet_manager.cc:1434] T d2089215acdf478ca725c9d26b94d692 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.099s user 0.003s sys 0.000s
I20260617 20:17:09.643428 29379 tablet_bootstrap.cc:492] T a17684c0e6b545d1a22801071b6a72ac P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.651145 29377 log.cc:1199] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/e3897179e7724fdeb87a979ae4ef2091
I20260617 20:17:09.651738 29377 ts_tablet_manager.cc:1950] T e3897179e7724fdeb87a979ae4ef2091 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:09.652921 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 911) took 4519 ms. Trace:
W20260617 20:17:09.652925 29197 leader_election.cc:343] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 0eaa60028a1647e580a987c3a0836a24
I20260617 20:17:09.653851 29377 rpcz_store.cc:276] 0617 20:17:05.133099 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.133142 (+ 43us) service_pool.cc:224] Handling call
0617 20:17:09.440123 (+4306981us) ts_tablet_manager.cc:1151] Deleting tablet e3897179e7724fdeb87a979ae4ef2091
0617 20:17:09.440132 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.525535 (+ 85403us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.641767 (+116232us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.652903 (+ 11136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4306831}
I20260617 20:17:09.652510 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eaa60028a1647e580a987c3a0836a24" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.655933 29121 raft_consensus.cc:3060] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Advancing to term 2
I20260617 20:17:09.656672 31084 tablet.cc:1724] T 3a17f7ef070d4879a520a3eb6bdf3d23 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:09.629406 29376 rpcz_store.cc:276] 0617 20:17:05.159627 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.159852 (+ 225us) service_pool.cc:224] Handling call
0617 20:17:09.629177 (+4469325us) ts_tablet_manager.cc:1151] Deleting tablet 87ce10eac97d4c5fbac3ddc7bc91c6f5
0617 20:17:09.629190 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.629289 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4469135}
I20260617 20:17:09.658417 29121 raft_consensus.cc:2468] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 2.
I20260617 20:17:09.645282 29379 tablet_bootstrap.cc:654] T a17684c0e6b545d1a22801071b6a72ac P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.659015 29198 leader_election.cc:304] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.659324 30683 raft_consensus.cc:2804] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260617 20:17:09.659516 30683 raft_consensus.cc:697] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:09.659782 30683 consensus_queue.cc:237] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.660060 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 912) took 4128 ms. Trace:
I20260617 20:17:09.660151 29376 rpcz_store.cc:276] 0617 20:17:05.531775 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.531830 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:09.659938 (+4128108us) ts_tablet_manager.cc:1151] Deleting tablet 53d32672f44d4605b30237c0b1d72ff6
0617 20:17:09.659950 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.660044 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4127920}
I20260617 20:17:09.660988 29376 tablet_replica.cc:333] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:09.661186 29376 raft_consensus.cc:2243] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:09.661459 29376 pending_rounds.cc:70] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:17:09.662693 29376 pending_rounds.cc:77] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955549229244416 op_type: NO_OP noop_request { }
I20260617 20:17:09.662789 29376 raft_consensus.cc:2889] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:09.662874 29376 raft_consensus.cc:2272] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.665367 29376 ts_tablet_manager.cc:1916] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.665715 29377 tablet_replica.cc:333] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:09.665956 29377 raft_consensus.cc:2243] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.666133 29377 raft_consensus.cc:2272] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.666690 29377 ts_tablet_manager.cc:1916] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.672964 29377 ts_tablet_manager.cc:1929] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:09.673075 29377 log.cc:1199] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/26ebcfc80ca64129a7ab939bfd853998
I20260617 20:17:09.662628 30852 raft_consensus.cc:697] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:09.673755 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3efde5426d164371bad188299aea42a3 [id=00fdc977a27c4d2b909589cea193d5ce]
I20260617 20:17:09.673753 30852 consensus_queue.cc:237] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.662045 29383 tablet_bootstrap.cc:492] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:09.675159 29383 ts_tablet_manager.cc:1403] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.156s user 0.000s sys 0.003s
I20260617 20:17:09.675845 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_20640097ea6e4184ac6fb53704a54d25 [id=034cf1b4052a47b4943205b51ea3841e]
I20260617 20:17:09.675819 29383 raft_consensus.cc:359] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.675968 29383 raft_consensus.cc:385] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.676030 29383 raft_consensus.cc:740] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.676724 29379 tablet_bootstrap.cc:492] T a17684c0e6b545d1a22801071b6a72ac P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.676910 29379 ts_tablet_manager.cc:1403] T a17684c0e6b545d1a22801071b6a72ac P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.004s
I20260617 20:17:09.677704 29379 raft_consensus.cc:359] T a17684c0e6b545d1a22801071b6a72ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.678426 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_add57ff1d780483cb71151dbab223170 [id=03d78bcb3bc14b3ab6e25c348bbd067c]
I20260617 20:17:09.678927 29383 consensus_queue.cc:260] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.679379 29383 ts_tablet_manager.cc:1434] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20260617 20:17:09.679647 29383 tablet_bootstrap.cc:492] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:09.681000 29383 tablet_bootstrap.cc:654] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.681777 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_35da9942c88b483c842bd60a4e136618 [id=0484fe618c604fc6ae5cf909437940b5]
W20260617 20:17:09.682529 29197 consensus_peers.cc:597] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:09.682693 29379 raft_consensus.cc:385] T a17684c0e6b545d1a22801071b6a72ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.682806 29379 raft_consensus.cc:740] T a17684c0e6b545d1a22801071b6a72ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.683087 29379 consensus_queue.cc:260] T a17684c0e6b545d1a22801071b6a72ac P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.690099 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_5c3dfa3702bc41ad99c1ae8bb53dce13 [id=0586dbd68a634d83ab9b00d2ba7f38af]
I20260617 20:17:09.692699 29379 ts_tablet_manager.cc:1434] T a17684c0e6b545d1a22801071b6a72ac P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20260617 20:17:09.697590 29379 tablet_bootstrap.cc:492] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.699539 29379 tablet_bootstrap.cc:654] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.700214 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_62b5e2225918452592675fc7e49ea2e0 [id=05a8eb4228f84b2b9eba7ee1c90dd385]
I20260617 20:17:09.700904 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_7ab3e811b872450d856ef65057509c9e [id=062470abc0a44c6a847efb062ea85285]
I20260617 20:17:09.701218 29377 ts_tablet_manager.cc:1950] T 26ebcfc80ca64129a7ab939bfd853998 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:09.702081 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 912) took 4568 ms. Trace:
I20260617 20:17:09.706221 29377 rpcz_store.cc:276] 0617 20:17:05.133961 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.134003 (+ 42us) service_pool.cc:224] Handling call
0617 20:17:09.665658 (+4531655us) ts_tablet_manager.cc:1151] Deleting tablet 26ebcfc80ca64129a7ab939bfd853998
0617 20:17:09.665673 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.670111 (+ 4438us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.672877 (+ 2766us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.702061 (+ 29184us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4531498}
I20260617 20:17:09.707206 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_84c1d2b01f524da3917249139afe19b4 [id=07b0ad409eb74e75bd9d78b40faee1b7]
I20260617 20:17:09.708609 29377 tablet_replica.cc:333] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:09.708860 29377 raft_consensus.cc:2243] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.709089 29377 raft_consensus.cc:2272] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.706175 29375 ts_tablet_manager.cc:1929] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.709345 29375 log.cc:1199] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/203666e6127b49ed92731bc87ce01798
I20260617 20:17:09.709748 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8c1e2652a5d745fda18a0e7512b22ecd [id=081eadc2fe45408ebc3c66ef10aca087]
I20260617 20:17:09.709818 29375 ts_tablet_manager.cc:1950] T 203666e6127b49ed92731bc87ce01798 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:09.710449 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_ecf2ff52cdbb4225b5543050fe111b98 [id=0a2de017443647cfb80f0d4906471adb]
I20260617 20:17:09.710632 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 908) took 4243 ms. Trace:
I20260617 20:17:09.710770 29375 rpcz_store.cc:276] 0617 20:17:05.467083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.467123 (+ 40us) service_pool.cc:224] Handling call
0617 20:17:09.605527 (+4138404us) ts_tablet_manager.cc:1151] Deleting tablet 203666e6127b49ed92731bc87ce01798
0617 20:17:09.605538 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.645626 (+ 40088us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.649281 (+ 3655us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.710611 (+ 61330us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4138267}
I20260617 20:17:09.710922 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_07e0f258ed6b45a7ad99bcf9bb2c3b75 [id=0a8eaaf090244a6c8d16398a62b5a2f1]
I20260617 20:17:09.711750 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_5ace1745da5345cfa1f9f0c9585cb25b [id=0c5b63bc129d49cbb0994843cc2ef6c9]
I20260617 20:17:09.711844 29375 tablet_replica.cc:333] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:09.712260 29375 raft_consensus.cc:2243] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.712283 29377 ts_tablet_manager.cc:1916] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.712481 29375 raft_consensus.cc:2272] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.713023 29375 ts_tablet_manager.cc:1916] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.715277 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_4b555cc3fa1e4dd5b51da47450054b76 [id=0eb555ca618f468b9ca3c05e4d126835]
I20260617 20:17:09.719329 29375 ts_tablet_manager.cc:1929] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.719485 29375 log.cc:1199] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/370db89a92a6455190edaf80e5a56205
I20260617 20:17:09.719874 29375 ts_tablet_manager.cc:1950] T 370db89a92a6455190edaf80e5a56205 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:09.720592 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 905) took 4254 ms. Trace:
I20260617 20:17:09.720728 29375 rpcz_store.cc:276] 0617 20:17:05.465933 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.470046 (+ 4113us) service_pool.cc:224] Handling call
0617 20:17:09.711801 (+4241755us) ts_tablet_manager.cc:1151] Deleting tablet 370db89a92a6455190edaf80e5a56205
0617 20:17:09.711811 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.716554 (+ 4743us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.719283 (+ 2729us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.720574 (+ 1291us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4241550}
I20260617 20:17:09.721238 29375 tablet_replica.cc:333] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:09.721498 29375 raft_consensus.cc:2243] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.721698 29375 raft_consensus.cc:2272] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.722455 29375 ts_tablet_manager.cc:1916] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.722615 29376 ts_tablet_manager.cc:1929] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.722724 29376 log.cc:1199] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/4d81457d71a34657b43c8ebe7efb0a35
I20260617 20:17:09.723055 29376 ts_tablet_manager.cc:1950] T 4d81457d71a34657b43c8ebe7efb0a35 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:09.723788 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 913) took 4191 ms. Trace:
I20260617 20:17:09.723877 29376 rpcz_store.cc:276] 0617 20:17:05.531854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.531903 (+ 49us) service_pool.cc:224] Handling call
0617 20:17:09.660940 (+4129037us) ts_tablet_manager.cc:1151] Deleting tablet 4d81457d71a34657b43c8ebe7efb0a35
0617 20:17:09.660951 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.684679 (+ 23728us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.722564 (+ 37885us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.723768 (+ 1204us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4128880}
I20260617 20:17:09.724943 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_d353f219381d4d17a2927a233465454c [id=0ef22e22306747b28d49d58d0fa45620]
I20260617 20:17:09.727115 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8d0debb3585c4a1f80594e8f6e5600dd [id=10265d7c2b0a467c8d5a3aded9e23521]
I20260617 20:17:09.728186 29375 ts_tablet_manager.cc:1929] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.728363 29375 log.cc:1199] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/7cafcade995b407f84f56b8cd3ab6892
I20260617 20:17:09.728853 29375 ts_tablet_manager.cc:1950] T 7cafcade995b407f84f56b8cd3ab6892 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:09.729024 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fc956f2e299343cd846ec9a9272c1440 [id=1128539144124290bbe452162d53e83b]
I20260617 20:17:09.729331 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 917) took 4195 ms. Trace:
I20260617 20:17:09.729430 29376 rpcz_store.cc:276] 0617 20:17:05.533435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.537340 (+ 3905us) service_pool.cc:224] Handling call
0617 20:17:09.729161 (+4191821us) ts_tablet_manager.cc:1151] Deleting tablet d16bbe642edc43449d3b910ca5cf4d37
0617 20:17:09.729173 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.729309 (+ 136us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4191663}
I20260617 20:17:09.729948 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 919) took 4196 ms. Trace:
I20260617 20:17:09.730090 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_cf5a1e5db7c2470ab6ad65a7d57777d1 [id=13717f883a3449dd9014fff544ad7d7a]
I20260617 20:17:09.730028 29376 rpcz_store.cc:276] 0617 20:17:05.533617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.538044 (+ 4427us) service_pool.cc:224] Handling call
0617 20:17:09.729845 (+4191801us) ts_tablet_manager.cc:1151] Deleting tablet ce3e1aa04bca4425a907caadd5a736f9
0617 20:17:09.729852 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.729931 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4191654}
I20260617 20:17:09.730407 29376 tablet_replica.cc:333] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:09.730594 29376 raft_consensus.cc:2243] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:09.730767 29383 tablet_bootstrap.cc:492] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:09.730890 29383 ts_tablet_manager.cc:1403] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.000s
I20260617 20:17:09.730916 29376 raft_consensus.cc:2272] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.731444 29376 ts_tablet_manager.cc:1916] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.731632 29383 raft_consensus.cc:359] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.731806 29383 raft_consensus.cc:385] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.731865 29383 raft_consensus.cc:740] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.732105 29383 consensus_queue.cc:260] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.735029 29377 ts_tablet_manager.cc:1929] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.735553 29383 ts_tablet_manager.cc:1434] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:17:09.735833 29383 tablet_bootstrap.cc:492] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:09.736728 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6f988db656bc49f9b1dede83c87d1795 [id=1389c47aaaba4a9196cfaa09cde5da44]
I20260617 20:17:09.737180 29383 tablet_bootstrap.cc:654] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.737218 29377 log.cc:1199] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/5eaddd6519dc490c8358be629b21a2d9
I20260617 20:17:09.737922 29377 ts_tablet_manager.cc:1950] T 5eaddd6519dc490c8358be629b21a2d9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:09.738521 29379 tablet_bootstrap.cc:492] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.738695 29379 ts_tablet_manager.cc:1403] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.003s
W20260617 20:17:09.738735 29198 consensus_peers.cc:597] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7cafcade995b407f84f56b8cd3ab6892. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:09.739460 29379 raft_consensus.cc:359] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.739666 29379 raft_consensus.cc:385] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.739745 29379 raft_consensus.cc:740] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.740010 29379 consensus_queue.cc:260] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.740676 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 926) took 4217 ms. Trace:
I20260617 20:17:09.740803 29375 rpcz_store.cc:276] 0617 20:17:05.522817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.522879 (+ 62us) service_pool.cc:224] Handling call
0617 20:17:09.721195 (+4198316us) ts_tablet_manager.cc:1151] Deleting tablet 7cafcade995b407f84f56b8cd3ab6892
0617 20:17:09.721204 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.725595 (+ 4391us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.728145 (+ 2550us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.740658 (+ 12513us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4198120}
I20260617 20:17:09.741649 29375 tablet_replica.cc:333] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:09.742125 29375 raft_consensus.cc:2243] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.744603 29379 ts_tablet_manager.cc:1434] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:17:09.744848 29379 tablet_bootstrap.cc:492] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.746805 29379 tablet_bootstrap.cc:654] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.748042 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_889e523bb22f4128b77891b85373222a [id=151b6dafa03949f5a089baff4544f16d]
I20260617 20:17:09.750030 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 913) took 4615 ms. Trace:
I20260617 20:17:09.750555 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f]
I20260617 20:17:09.751032 29377 rpcz_store.cc:276] 0617 20:17:05.134638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.134694 (+ 56us) service_pool.cc:224] Handling call
0617 20:17:09.708558 (+4573864us) ts_tablet_manager.cc:1151] Deleting tablet 5eaddd6519dc490c8358be629b21a2d9
0617 20:17:09.708568 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.721363 (+ 12795us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.734965 (+ 13602us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.750007 (+ 15042us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4573718}
I20260617 20:17:09.751500 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0bc4f3c08e5b47659b13d6eca2ae81e9 [id=173e3b23db204721a1f091565549c7a9]
W20260617 20:17:09.753566 28925 consensus_peers.cc:597] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:09.753901 29378 tablet_bootstrap.cc:492] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:09.754036 29378 ts_tablet_manager.cc:1403] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.256s user 0.025s sys 0.001s
I20260617 20:17:09.754572 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3d7d626f6bae4e3cbfc7bd41f1cdc5f1 [id=1759f8d2f7b84bfabbcc8d99a861193b]
I20260617 20:17:09.754694 29377 tablet_replica.cc:333] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:09.754727 29378 raft_consensus.cc:359] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.754882 29378 raft_consensus.cc:385] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.754933 29378 raft_consensus.cc:740] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.755033 29376 ts_tablet_manager.cc:1929] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.755155 29376 log.cc:1199] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/593d9de6a2fb47e18d86649e45ba80b9
I20260617 20:17:09.755132 29378 consensus_queue.cc:260] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.755167 29377 raft_consensus.cc:2243] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.755532 29376 ts_tablet_manager.cc:1950] T 593d9de6a2fb47e18d86649e45ba80b9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:09.755877 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8a75e972290d447da9487d018bf2f205 [id=186b2fd455324d58a32cf586defc04a3]
I20260617 20:17:09.756336 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 925) took 4222 ms. Trace:
I20260617 20:17:09.756440 29376 rpcz_store.cc:276] 0617 20:17:05.534144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.541358 (+ 7214us) service_pool.cc:224] Handling call
0617 20:17:09.730357 (+4188999us) ts_tablet_manager.cc:1151] Deleting tablet 593d9de6a2fb47e18d86649e45ba80b9
0617 20:17:09.730364 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.751497 (+ 21133us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.754971 (+ 3474us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.756317 (+ 1346us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4188829}
I20260617 20:17:09.742355 29375 raft_consensus.cc:2272] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.758409 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_778028dc2b7b43e9b5b16d42baf40772 [id=19bd9015790b453194adb1f20e520a9a]
I20260617 20:17:09.758735 29375 ts_tablet_manager.cc:1916] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.759836 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_74a72450663a45a99d4b9e8a250bd9db [id=1d4c9a9b22e44723ae5c2ed384191a94]
I20260617 20:17:09.763304 29377 raft_consensus.cc:2272] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.764645 29377 ts_tablet_manager.cc:1916] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.768172 29375 ts_tablet_manager.cc:1929] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:17:09.768307 29375 log.cc:1199] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/c3014c93d6804f3896f452f041cbedc9
I20260617 20:17:09.768667 29375 ts_tablet_manager.cc:1950] T c3014c93d6804f3896f452f041cbedc9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:09.768958 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_4186d04aa9cf40c481d3436773b1b119 [id=1d82dfca17c74fc5a145191440d60830]
I20260617 20:17:09.769556 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_bf4ce88a9888453a8c775f1f1d264daa [id=1d8700d6c96e48d7986478065e73fef3]
I20260617 20:17:09.770318 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_873f0c1e037f45099135433d2b96f732 [id=1ef49ac225d4413eb812605395bafda5]
I20260617 20:17:09.770864 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 920) took 4237 ms. Trace:
I20260617 20:17:09.770992 29376 rpcz_store.cc:276] 0617 20:17:05.533696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.541471 (+ 7775us) service_pool.cc:224] Handling call
0617 20:17:09.770688 (+4229217us) ts_tablet_manager.cc:1151] Deleting tablet 380ccd1d167744248a1ccad80788d0a0
0617 20:17:09.770703 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.770835 (+ 132us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4229067}
I20260617 20:17:09.772140 29376 tablet_replica.cc:333] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:09.772507 29378 ts_tablet_manager.cc:1434] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20260617 20:17:09.773439 29376 raft_consensus.cc:2243] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:09.773788 29376 raft_consensus.cc:2272] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.774297 29383 tablet_bootstrap.cc:492] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:09.774423 29383 ts_tablet_manager.cc:1403] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.003s
I20260617 20:17:09.774304 29376 ts_tablet_manager.cc:1916] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.775615 29383 raft_consensus.cc:359] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.775767 29383 raft_consensus.cc:385] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.775835 29383 raft_consensus.cc:740] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.776067 29383 consensus_queue.cc:260] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.776501 29379 tablet_bootstrap.cc:492] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.776670 29379 ts_tablet_manager.cc:1403] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.004s
I20260617 20:17:09.777442 29379 raft_consensus.cc:359] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:09.777663 29379 raft_consensus.cc:385] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.777762 29379 raft_consensus.cc:740] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.778010 29379 consensus_queue.cc:260] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:09.778596 29379 ts_tablet_manager.cc:1434] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:09.784250 29379 tablet_bootstrap.cc:492] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.785549 29383 ts_tablet_manager.cc:1434] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260617 20:17:09.785866 29383 tablet_bootstrap.cc:492] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:09.785872 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fbc7dc910d9b4eda962ff4b9328e00a3 [id=1efcb5e6de134a54bc4250ae502080e6]
I20260617 20:17:09.787438 29383 tablet_bootstrap.cc:654] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.788021 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_cdb4c1e8ce7042bc828e729ef36aba9b [id=1fb4a405d43541e4bc7d9dc251a2c25e]
I20260617 20:17:09.788655 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 934) took 3842 ms. Trace:
I20260617 20:17:09.788787 29375 rpcz_store.cc:276] 0617 20:17:05.946438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.946683 (+ 245us) service_pool.cc:224] Handling call
0617 20:17:09.741601 (+3794918us) ts_tablet_manager.cc:1151] Deleting tablet c3014c93d6804f3896f452f041cbedc9
0617 20:17:09.741612 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.765349 (+ 23737us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.768123 (+ 2774us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.788634 (+ 20511us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3677277}
I20260617 20:17:09.789911 29378 tablet_bootstrap.cc:492] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:09.790938 29119 raft_consensus.cc:3060] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.791247 29378 tablet_bootstrap.cc:654] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.796828 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 953) took 3365 ms. Trace:
I20260617 20:17:09.797071 29375 rpcz_store.cc:276] 0617 20:17:06.430921 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.451564 (+ 20643us) service_pool.cc:224] Handling call
0617 20:17:09.796607 (+3345043us) ts_tablet_manager.cc:1151] Deleting tablet 4281bbef1efb4986a23c6fb24e62e49c
0617 20:17:09.796619 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.796803 (+ 184us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3337551}
I20260617 20:17:09.797715 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 954) took 3365 ms. Trace:
I20260617 20:17:09.798617 29376 ts_tablet_manager.cc:1929] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.798741 29376 log.cc:1199] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/7cafcade995b407f84f56b8cd3ab6892
I20260617 20:17:09.799154 29376 ts_tablet_manager.cc:1950] T 7cafcade995b407f84f56b8cd3ab6892 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:09.799680 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_9628d76200d64a67a8095ff0895ab927 [id=23afb56e2d6d4944943854ecd94017ea]
I20260617 20:17:09.800120 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 924) took 4266 ms. Trace:
I20260617 20:17:09.800231 29376 rpcz_store.cc:276] 0617 20:17:05.534065 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.549956 (+ 15891us) service_pool.cc:224] Handling call
0617 20:17:09.772092 (+4222136us) ts_tablet_manager.cc:1151] Deleting tablet 7cafcade995b407f84f56b8cd3ab6892
0617 20:17:09.772101 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.778451 (+ 6350us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.798546 (+ 20095us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.800093 (+ 1547us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4221925}
I20260617 20:17:09.801527 29377 ts_tablet_manager.cc:1929] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.801654 29376 tablet_replica.cc:333] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:09.801695 29377 log.cc:1199] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/cde88371f4454a4bb3053c6cd1afb801
I20260617 20:17:09.801857 29376 raft_consensus.cc:2243] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:09.802209 29377 ts_tablet_manager.cc:1950] T cde88371f4454a4bb3053c6cd1afb801 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:09.802191 29376 raft_consensus.cc:2272] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.802567 29379 tablet_bootstrap.cc:654] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.802892 29376 ts_tablet_manager.cc:1916] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:09.803843 29198 consensus_peers.cc:597] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:09.805881 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 914) took 4670 ms. Trace:
I20260617 20:17:09.806026 29377 rpcz_store.cc:276] 0617 20:17:05.135241 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.135283 (+ 42us) service_pool.cc:224] Handling call
0617 20:17:09.754038 (+4618755us) ts_tablet_manager.cc:1151] Deleting tablet cde88371f4454a4bb3053c6cd1afb801
0617 20:17:09.754049 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.767773 (+ 13724us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.801456 (+ 33683us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.805847 (+ 4391us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7840,"tablet-delete.queue_time_us":4618608}
I20260617 20:17:09.797884 29375 rpcz_store.cc:276] 0617 20:17:06.431873 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.451754 (+ 19881us) service_pool.cc:224] Handling call
0617 20:17:09.797553 (+3345799us) ts_tablet_manager.cc:1151] Deleting tablet edf884e801d74362ad05435a76efcc1f
0617 20:17:09.797562 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.797679 (+ 117us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3345669}
I20260617 20:17:09.807271 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_7b904ff553254117afb61cd5048f33a2 [id=24dc3c39fc64419ab0f47fa8358ad585]
I20260617 20:17:09.808169 29377 tablet_replica.cc:333] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:09.808401 29377 raft_consensus.cc:2243] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.808513 30683 consensus_queue.cc:1048] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.808840 29377 raft_consensus.cc:2272] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.810704 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 955) took 3359 ms. Trace:
I20260617 20:17:09.811657 29375 rpcz_store.cc:276] 0617 20:17:06.450733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.451894 (+ 1161us) service_pool.cc:224] Handling call
0617 20:17:09.808234 (+3356340us) ts_tablet_manager.cc:1151] Deleting tablet 266ff05cc91b43dfbb30ce9e961eeb54
0617 20:17:09.808247 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.810514 (+ 2267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3355934}
I20260617 20:17:09.814186 29383 tablet_bootstrap.cc:492] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:09.815395 29383 ts_tablet_manager.cc:1403] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20260617 20:17:09.815726 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 956) took 3364 ms. Trace:
I20260617 20:17:09.811031 29378 tablet_bootstrap.cc:492] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:09.816421 29378 ts_tablet_manager.cc:1403] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.008s
I20260617 20:17:09.817073 29378 raft_consensus.cc:359] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.817219 29378 raft_consensus.cc:385] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.817258 29378 raft_consensus.cc:740] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.817466 29378 consensus_queue.cc:260] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.816496 29375 rpcz_store.cc:276] 0617 20:17:06.450849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.451996 (+ 1147us) service_pool.cc:224] Handling call
0617 20:17:09.814433 (+3362437us) ts_tablet_manager.cc:1151] Deleting tablet cdd24a60a91b43cd9e31ecca3d21ec60
0617 20:17:09.814445 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.815475 (+ 1030us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3361961}
I20260617 20:17:09.817935 29378 ts_tablet_manager.cc:1434] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260617 20:17:09.818176 29378 tablet_bootstrap.cc:492] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:09.819801 29378 tablet_bootstrap.cc:654] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.820076 29375 tablet_replica.cc:333] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:09.823690 29375 raft_consensus.cc:2243] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.825429 31118 consensus_queue.cc:1048] T b6ba8b7d18af44b58800e588279e2e0b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.825496 29375 raft_consensus.cc:2272] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.825901 29383 raft_consensus.cc:359] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.827291 29377 ts_tablet_manager.cc:1916] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.827155 29383 raft_consensus.cc:385] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.827890 29383 raft_consensus.cc:740] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.828501 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_ea6a8570fafd4a2f979827a3711b2de4 [id=250e3cfac020471aac31a16d43ac9dea]
I20260617 20:17:09.829438 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6f8a81734a6345ebb32b7ac32365e739 [id=259e4a64dcfe44db8b28b012ed5b400f]
I20260617 20:17:09.829932 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_b1e1ccfbd65149709f90def87a0de455 [id=269eefef16a244c7b332a14c1e54c1c0]
I20260617 20:17:09.830613 30967 raft_consensus.cc:493] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.830753 30967 raft_consensus.cc:515] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.830983 29375 ts_tablet_manager.cc:1916] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.831446 30967 leader_election.cc:290] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.830442 29383 consensus_queue.cc:260] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.831900 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71049338f673401bad32204d232bfe43" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.831882 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71049338f673401bad32204d232bfe43" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:09.832356 28925 leader_election.cc:343] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:09.832535 28925 leader_election.cc:343] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.832600 28925 leader_election.cc:304] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.833112 30967 raft_consensus.cc:2749] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.835520 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_883b608d1f174bd19a9e3d10a4c6ee3f [id=2727bf760ca44d7487975216690b2739]
I20260617 20:17:09.835743 29383 ts_tablet_manager.cc:1434] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20260617 20:17:09.837450 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_5ba1cc04120f480096f12966b301a7ac [id=27dd87e5a02e40c08b5e66d0d47aafcb]
I20260617 20:17:09.844404 29376 ts_tablet_manager.cc:1929] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.844527 29376 log.cc:1199] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/370db89a92a6455190edaf80e5a56205
I20260617 20:17:09.844868 29376 ts_tablet_manager.cc:1950] T 370db89a92a6455190edaf80e5a56205 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:09.851979 29383 tablet_bootstrap.cc:492] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:09.853430 31084 tablet.cc:1724] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260617 20:17:09.853790 29377 ts_tablet_manager.cc:1929] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:09.853912 29377 log.cc:1199] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/dd89c8452c444af99d8bce0c7cbf8ce1
I20260617 20:17:09.854249 29377 ts_tablet_manager.cc:1950] T dd89c8452c444af99d8bce0c7cbf8ce1 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:09.854293 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_35fc3c1b8a6c461087e80918d278d106 [id=2822a1c1a34341019a5380cec3062f69]
I20260617 20:17:09.854732 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_87e22bfc578e47a49cb67beea659b86e [id=2844b3e6636d4e77bce1461fb477b36d]
I20260617 20:17:09.855044 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 915) took 4674 ms. Trace:
I20260617 20:17:09.855183 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_eddd37adcac449fdafd97ff4e5f726ea [id=28482c1294b7476d96b490f73d8b9d28]
I20260617 20:17:09.855120 29377 rpcz_store.cc:276] 0617 20:17:05.181096 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.181152 (+ 56us) service_pool.cc:224] Handling call
0617 20:17:09.807521 (+4626369us) ts_tablet_manager.cc:1151] Deleting tablet dd89c8452c444af99d8bce0c7cbf8ce1
0617 20:17:09.807536 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.839506 (+ 31970us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.853732 (+ 14226us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.855023 (+ 1291us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4626164}
I20260617 20:17:09.855440 29377 tablet_replica.cc:333] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:09.855638 29377 raft_consensus.cc:2243] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.855767 29377 raft_consensus.cc:2272] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.856307 29377 ts_tablet_manager.cc:1916] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.859351 29378 tablet_bootstrap.cc:492] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:09.859534 29378 ts_tablet_manager.cc:1403] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.005s
I20260617 20:17:09.869711 30761 consensus_queue.cc:1048] T 2d00c493a5624569b8f47242fc55b6fb P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.870426 29378 raft_consensus.cc:359] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.871023 29378 raft_consensus.cc:385] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.871120 29378 raft_consensus.cc:740] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.871373 29378 consensus_queue.cc:260] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.880218 31084 tablet.cc:1719] T 74c73ae1007d44ce958ad02fa5787651 P 6d4ce30e1fce4591b64c398747f8d37a: Skipping requested alter to schema version 3, tablet already version 3
I20260617 20:17:09.882735 29379 tablet_bootstrap.cc:492] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.884682 29383 tablet_bootstrap.cc:654] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.886667 29379 ts_tablet_manager.cc:1403] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.102s user 0.009s sys 0.000s
I20260617 20:17:09.887445 29379 raft_consensus.cc:359] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.886463 29119 raft_consensus.cc:3060] T d2089215acdf478ca725c9d26b94d692 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.891788 29121 raft_consensus.cc:3060] T a17684c0e6b545d1a22801071b6a72ac P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.892323 29378 ts_tablet_manager.cc:1434] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20260617 20:17:09.893167 29379 raft_consensus.cc:385] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.893478 31065 raft_consensus.cc:493] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.893468 30761 consensus_queue.cc:1048] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.893246 29379 raft_consensus.cc:740] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.893699 31065 raft_consensus.cc:515] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.893807 29379 consensus_queue.cc:260] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.894623 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 951) took 4142 ms. Trace:
I20260617 20:17:09.894862 31065 leader_election.cc:290] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:09.895018 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c6f0765b4329af28d72c8e94240a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:09.895516 28925 leader_election.cc:343] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.895241 29378 tablet_bootstrap.cc:492] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:09.895103 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c6f0765b4329af28d72c8e94240a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:09.896126 28925 leader_election.cc:343] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:09.896225 28925 leader_election.cc:304] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:09.896140 29376 rpcz_store.cc:276] 0617 20:17:05.752600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.785648 (+ 33048us) service_pool.cc:224] Handling call
0617 20:17:09.801607 (+4015959us) ts_tablet_manager.cc:1151] Deleting tablet 370db89a92a6455190edaf80e5a56205
0617 20:17:09.801616 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.806523 (+ 4907us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.844345 (+ 37822us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.894604 (+ 50259us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4014899}
I20260617 20:17:09.896639 31065 raft_consensus.cc:2749] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.897178 29376 tablet_replica.cc:333] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:09.899288 29376 raft_consensus.cc:2243] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:09.899765 29379 ts_tablet_manager.cc:1434] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20260617 20:17:09.900104 29379 tablet_bootstrap.cc:492] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:09.899808 29376 raft_consensus.cc:2272] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.900712 29376 ts_tablet_manager.cc:1916] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.901443 29378 tablet_bootstrap.cc:654] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.904546 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6a6c1b531b834b7394845c8421570068 [id=29bf58c24f9742b38fe3a37c509f92e8]
I20260617 20:17:09.905395 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_4a5199c078ea4aa18d688909588c0a96 [id=2b30d550d0e445e882179d01fb066334]
I20260617 20:17:09.907189 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_daffb8813d634b3aa74a7b834732a833 [id=2b41138080f94fd6907df45a5cb21850]
I20260617 20:17:09.907899 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_47b418c88d02450e9238113d4fc932de [id=2b7e7c876e3c42eda2033e3d88820007]
I20260617 20:17:09.908834 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a0abac57842c430484585d01d659001e [id=2c08c48fb49b49b0bd0fc07ce29b460b]
I20260617 20:17:09.909193 29375 ts_tablet_manager.cc:1929] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:17:09.909775 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f2c4f9d463814ae2883f800f27c5d14d [id=2e23848d3d274b3b950f282dc2e7b767]
I20260617 20:17:09.910353 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_97ba340d89a0446caac56caf5b2cde59 [id=2f5114c6a06f42cd8742c62168dd5032]
I20260617 20:17:09.911329 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8d26d11366614614982fcb5b40bb6620 [id=2f7caf34e912409caa372c4ac69c6f7d]
I20260617 20:17:09.913661 29377 ts_tablet_manager.cc:1929] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:09.913774 29377 log.cc:1199] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/f31bf7ed828f44b398f5bdac6b9b63e7
I20260617 20:17:09.914070 29377 ts_tablet_manager.cc:1950] T f31bf7ed828f44b398f5bdac6b9b63e7 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:09.914846 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 916) took 4695 ms. Trace:
I20260617 20:17:09.914930 29377 rpcz_store.cc:276] 0617 20:17:05.219594 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.219660 (+ 66us) service_pool.cc:224] Handling call
0617 20:17:09.855386 (+4635726us) ts_tablet_manager.cc:1151] Deleting tablet f31bf7ed828f44b398f5bdac6b9b63e7
0617 20:17:09.855406 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.886779 (+ 31373us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.913597 (+ 26818us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.914824 (+ 1227us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4635495}
I20260617 20:17:09.916987 31094 consensus_queue.cc:1048] T d2089215acdf478ca725c9d26b94d692 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.917733 29377 tablet_replica.cc:333] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:09.917944 29377 raft_consensus.cc:2243] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.918097 29377 raft_consensus.cc:2272] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.918687 29377 ts_tablet_manager.cc:1916] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.918933 29378 tablet_bootstrap.cc:492] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:09.919106 29378 ts_tablet_manager.cc:1403] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.003s
I20260617 20:17:09.919723 29378 raft_consensus.cc:359] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.919956 29378 raft_consensus.cc:385] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.920042 29378 raft_consensus.cc:740] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.920306 29378 consensus_queue.cc:260] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.920926 29378 ts_tablet_manager.cc:1434] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:17:09.921217 29378 tablet_bootstrap.cc:492] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:09.925060 29378 tablet_bootstrap.cc:654] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.925678 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_904b2e0f8c594d039717f494c0d47a1d [id=306bb3660c38430d9f1f414b05d94a34]
I20260617 20:17:09.926193 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_1b519a3c00d6483097bb906c3bb288dc [id=30c5ab49c17f429686ebd9f937c0c9e2]
I20260617 20:17:09.928393 29375 log.cc:1199] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/086bd3079e8f4a6d85ccc681a38a47b0
I20260617 20:17:09.928757 29375 ts_tablet_manager.cc:1950] T 086bd3079e8f4a6d85ccc681a38a47b0 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:09.917613 29379 tablet_bootstrap.cc:654] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.922781 29122 raft_consensus.cc:3060] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.931631 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 965) took 3138 ms. Trace:
I20260617 20:17:09.932482 29383 tablet_bootstrap.cc:492] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:09.932678 29383 ts_tablet_manager.cc:1403] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.081s user 0.003s sys 0.003s
I20260617 20:17:09.933130 31094 raft_consensus.cc:493] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.933254 31094 raft_consensus.cc:515] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.933545 29383 raft_consensus.cc:359] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.933692 29383 raft_consensus.cc:385] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.933741 29383 raft_consensus.cc:740] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.933897 31094 leader_election.cc:290] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.933903 29375 rpcz_store.cc:276] 0617 20:17:06.792956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.793013 (+ 57us) service_pool.cc:224] Handling call
0617 20:17:09.819227 (+3026214us) ts_tablet_manager.cc:1151] Deleting tablet 086bd3079e8f4a6d85ccc681a38a47b0
0617 20:17:09.819237 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.888525 (+ 69288us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.909141 (+ 20616us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.931609 (+ 22468us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3025990}
I20260617 20:17:09.934305 29383 consensus_queue.cc:260] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.934645 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb29f2e56c4838b0efd0171229088a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:09.934680 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6efb29f2e56c4838b0efd0171229088a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.934862 28983 raft_consensus.cc:2393] T 6efb29f2e56c4838b0efd0171229088a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 6d4ce30e1fce4591b64c398747f8d37a in this term.
I20260617 20:17:09.935218 29197 leader_election.cc:304] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:09.935439 31094 raft_consensus.cc:3060] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.936391 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a7ae2b556b104787bb92a47f706bc91a [id=31199bd88feb40559cb20211be2ec3c1]
I20260617 20:17:09.937355 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8fe57f69092a42f585d9f8c5abeb30f7 [id=3294644f679b4a5ebad7932a3eeceb22]
I20260617 20:17:09.937765 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_c7301f39e0a54609801e5454f391767b [id=32a68fccc83848e2a7c85692a0ad59a0]
I20260617 20:17:09.937858 31094 raft_consensus.cc:2749] T 6efb29f2e56c4838b0efd0171229088a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:09.938225 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fe54346acedc4aee9fe8151c12a389fc [id=32c61aa9610e428fa8d5c794b078e0a1]
I20260617 20:17:09.945145 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_be5429b8220b4c0abce2d16b0dea29a9 [id=390c6d1236a3439ea3efc34e561174a7]
I20260617 20:17:09.950004 29377 ts_tablet_manager.cc:1929] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:09.950138 29377 log.cc:1199] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/4d81457d71a34657b43c8ebe7efb0a35
I20260617 20:17:09.950465 29377 ts_tablet_manager.cc:1950] T 4d81457d71a34657b43c8ebe7efb0a35 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:09.951416 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 919) took 4550 ms. Trace:
I20260617 20:17:09.951514 29377 rpcz_store.cc:276] 0617 20:17:05.400600 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.401134 (+ 534us) service_pool.cc:224] Handling call
0617 20:17:09.915414 (+4514280us) ts_tablet_manager.cc:1151] Deleting tablet 4d81457d71a34657b43c8ebe7efb0a35
0617 20:17:09.917678 (+ 2264us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x61800000ed18. stack: 00007ffae652a496 00007ffae652a250 00007ffae55553ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007ffae651ff2d 00007ffae6520f9e 00007ffafa3d51ad 00007ffafa3541d3 00007ffaf64dde96 00007ffaf64df229 00007ffaf6512bb4 00007ffaf64f35d0 00007ffaf64f335d 0000000000aa681c
0617 20:17:09.917687 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.921606 (+ 3919us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.949933 (+ 28327us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.951372 (+ 1439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4571904,"tablet-delete.queue_time_us":4514049}
I20260617 20:17:09.934728 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 967) took 3120 ms. Trace:
I20260617 20:17:09.951797 29375 rpcz_store.cc:276] 0617 20:17:06.814220 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.814674 (+ 454us) service_pool.cc:224] Handling call
0617 20:17:09.934609 (+3119935us) ts_tablet_manager.cc:1151] Deleting tablet 5ad81ce1ab114fc395f8efb930f4d949
0617 20:17:09.934619 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.934712 (+ 93us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3119740}
I20260617 20:17:09.952060 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 923) took 4551 ms. Trace:
I20260617 20:17:09.952152 29377 rpcz_store.cc:276] 0617 20:17:05.400971 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.413345 (+ 12374us) service_pool.cc:224] Handling call
0617 20:17:09.951937 (+4538592us) ts_tablet_manager.cc:1151] Deleting tablet d16bbe642edc43449d3b910ca5cf4d37
0617 20:17:09.951948 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.952045 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4538400}
I20260617 20:17:09.952581 29383 ts_tablet_manager.cc:1434] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20260617 20:17:09.952436 31084 tablet.cc:1724] T e7eb77c619e04c448a084638668dbb6a P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:09.953761 29383 tablet_bootstrap.cc:492] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:09.958248 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 968) took 3143 ms. Trace:
I20260617 20:17:09.958346 29375 rpcz_store.cc:276] 0617 20:17:06.814368 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.831191 (+ 16823us) service_pool.cc:224] Handling call
0617 20:17:09.953507 (+3122316us) ts_tablet_manager.cc:1151] Deleting tablet 1bf654918dc148cdbca0e420e337478b
0617 20:17:09.955771 (+ 2264us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.958230 (+ 2459us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3122122}
I20260617 20:17:09.959158 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_2b5031b4d42c4d51b39279536a2c19d9 [id=395d6bc9360549c69d616b8ccf8d01cd]
I20260617 20:17:09.959550 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a17cfbbd20be4ffe99351c3b1ac11457 [id=39cd55a8cab4400db925a6c2d7e7da82]
I20260617 20:17:09.959971 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 966) took 3145 ms. Trace:
I20260617 20:17:09.960049 29375 rpcz_store.cc:276] 0617 20:17:06.814116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.832126 (+ 18010us) service_pool.cc:224] Handling call
0617 20:17:09.959859 (+3127733us) ts_tablet_manager.cc:1151] Deleting tablet b1064bce50b64aa9afe8bb249545c5ab
0617 20:17:09.959868 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.959956 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3127569}
I20260617 20:17:09.960417 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 970) took 3121 ms. Trace:
I20260617 20:17:09.960439 29379 tablet_bootstrap.cc:492] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:09.960500 29375 rpcz_store.cc:276] 0617 20:17:06.838829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.839666 (+ 837us) service_pool.cc:224] Handling call
0617 20:17:09.960350 (+3120684us) ts_tablet_manager.cc:1151] Deleting tablet d2db0467c5e64e38961d3b0e66375544
0617 20:17:09.960358 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.960404 (+ 46us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3120497}
I20260617 20:17:09.960722 29379 ts_tablet_manager.cc:1403] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.000s
I20260617 20:17:09.961012 29375 tablet_replica.cc:333] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:09.961195 29375 raft_consensus.cc:2243] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.961350 29375 raft_consensus.cc:2272] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.961792 29375 ts_tablet_manager.cc:1916] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.962587 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca]
I20260617 20:17:09.962831 29383 tablet_bootstrap.cc:654] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:09.963204 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_ef916ebf00b449979408f9dab4fb264e [id=3b1ee3a0a7f54dfd921749144e963305]
I20260617 20:17:09.963764 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e259b984fdf44bde85b3546242987b20 [id=3b2b81a363c74e6c9e602bf6fb5b0218]
I20260617 20:17:09.964169 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_430bbaa8b17349048f8c2e456ddc650f [id=3b2c339d6e9542b4ac564c99abae1946]
I20260617 20:17:09.964740 31094 raft_consensus.cc:493] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:09.964865 31094 raft_consensus.cc:515] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.965667 29378 tablet_bootstrap.cc:492] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:09.965790 29378 ts_tablet_manager.cc:1403] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.005s
I20260617 20:17:09.966146 31094 leader_election.cc:290] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.966429 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269d2bb9f1fd45f89ab765b33a502baf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:09.966514 29378 raft_consensus.cc:359] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.966665 29122 raft_consensus.cc:2468] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:17:09.966907 29197 leader_election.cc:343] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 269d2bb9f1fd45f89ab765b33a502baf
I20260617 20:17:09.966750 29378 raft_consensus.cc:385] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.967116 29198 leader_election.cc:304] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.967280 29378 raft_consensus.cc:740] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.967510 31094 raft_consensus.cc:2804] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:09.967583 31094 raft_consensus.cc:493] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:09.967585 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 925) took 4531 ms. Trace:
I20260617 20:17:09.967640 31094 raft_consensus.cc:3060] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.967657 29377 rpcz_store.cc:276] 0617 20:17:05.421103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.421287 (+ 184us) service_pool.cc:224] Handling call
0617 20:17:09.952509 (+4531222us) ts_tablet_manager.cc:1151] Deleting tablet ce3e1aa04bca4425a907caadd5a736f9
0617 20:17:09.952518 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.952596 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4531018}
I20260617 20:17:09.968626 29378 consensus_queue.cc:260] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.971067 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 926) took 4549 ms. Trace:
I20260617 20:17:09.971151 29377 rpcz_store.cc:276] 0617 20:17:05.421237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.421528 (+ 291us) service_pool.cc:224] Handling call
0617 20:17:09.970949 (+4549421us) ts_tablet_manager.cc:1151] Deleting tablet 380ccd1d167744248a1ccad80788d0a0
0617 20:17:09.970959 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.971051 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4549289}
I20260617 20:17:09.969266 29378 ts_tablet_manager.cc:1434] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:09.972666 29376 ts_tablet_manager.cc:1929] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:09.972697 31094 raft_consensus.cc:515] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.972800 29376 log.cc:1199] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/cde88371f4454a4bb3053c6cd1afb801
I20260617 20:17:09.973141 29376 ts_tablet_manager.cc:1950] T cde88371f4454a4bb3053c6cd1afb801 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:09.973867 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269d2bb9f1fd45f89ab765b33a502baf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:09.973927 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 952) took 4099 ms. Trace:
W20260617 20:17:09.973980 29197 leader_election.cc:343] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 269d2bb9f1fd45f89ab765b33a502baf
I20260617 20:17:09.974035 29121 raft_consensus.cc:3060] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:09.974438 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855]
I20260617 20:17:09.974442 31094 leader_election.cc:290] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:09.976262 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_c2f68ef5042044f6aa4494001d1f0238 [id=3d58d8b3e80d42bc9ac7f1481831b490]
I20260617 20:17:09.978397 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_66545ee179e84436aea66f777fb80da9 [id=3f31b8564b28492c88c42f1534943265]
I20260617 20:17:09.973994 29376 rpcz_store.cc:276] 0617 20:17:05.874659 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.874770 (+ 111us) service_pool.cc:224] Handling call
0617 20:17:09.897119 (+4022349us) ts_tablet_manager.cc:1151] Deleting tablet cde88371f4454a4bb3053c6cd1afb801
0617 20:17:09.897133 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.952587 (+ 55454us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.972605 (+ 20018us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:09.973909 (+ 1304us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4022134}
I20260617 20:17:09.981367 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 918) took 4580 ms. Trace:
I20260617 20:17:09.981483 29377 rpcz_store.cc:276] 0617 20:17:05.400484 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.465371 (+ 64887us) service_pool.cc:224] Handling call
0617 20:17:09.978154 (+4512783us) ts_tablet_manager.cc:1151] Deleting tablet 53d32672f44d4605b30237c0b1d72ff6
0617 20:17:09.981194 (+ 3040us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.981344 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4512373}
I20260617 20:17:09.982662 31065 consensus_queue.cc:1048] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:09.982792 29378 tablet_bootstrap.cc:492] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:09.983501 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_2a25294e78fe41a7ae7affa51831441f [id=3f6be16f12bc4b4c8560d7f09e341caa]
I20260617 20:17:09.984368 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fc1d88f958a0469686a6eb2def4897dd [id=3fa51dbd276946a1acfb91f97348743b]
I20260617 20:17:09.985157 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_dd291560b73540e38b18bf2c933613e3 [id=402dda6ba37a41cfa20933ed8152918e]
I20260617 20:17:09.986171 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_83cd5e3f2921420f822eee497a0087d5 [id=40c032065fd44e7eb34da35cc4e451eb]
I20260617 20:17:09.987213 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8000cf41d95f4152983d7fe1d74cbdb8 [id=42f2f56c7b0f4ac4bddd9a9eea89a7b2]
I20260617 20:17:09.987742 29377 tablet_replica.cc:333] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:09.988046 29377 raft_consensus.cc:2243] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:09.988237 29377 raft_consensus.cc:2272] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:09.988930 29377 ts_tablet_manager.cc:1916] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:09.992957 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e610c8b1186543a1ba5ab1899c8b672a [id=449b06b7f15e49dda75c4027f7f8e833]
I20260617 20:17:09.995361 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_eb9f201319f9403fb808594dd9583fe8 [id=44e8c8aaae8242c6993b571a018ec8b6]
W20260617 20:17:09.995996 28925 consensus_peers.cc:597] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:09.996500 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a1c77cc368fb44969f11416cb083598b [id=475aa0d2f8044cd8b52cf31085dda15d]
I20260617 20:17:09.996982 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0fa7c2d732b943eb86cf43d30ab2d880 [id=47a11e9a79bb4d778e64e90707d01584]
I20260617 20:17:09.997453 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_088c2b4ca59e4dd49f684c9f6648bc57 [id=47c6b29f6e284a1b9cd984f16d925103]
I20260617 20:17:09.997689 29121 raft_consensus.cc:2468] T 269d2bb9f1fd45f89ab765b33a502baf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:09.998296 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_daa321ef525b447390f30edf50f160bc [id=489b6871a12b4a68b7f600556cfc5b8e]
I20260617 20:17:09.998239 29198 leader_election.cc:304] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:09.998674 30683 raft_consensus.cc:2804] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:09.998636 29379 raft_consensus.cc:359] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.998777 30683 raft_consensus.cc:697] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:09.998826 29379 raft_consensus.cc:385] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:09.998874 29379 raft_consensus.cc:740] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:09.999010 30683 consensus_queue.cc:237] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.999045 29379 consensus_queue.cc:260] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:09.999519 29379 ts_tablet_manager.cc:1434] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.039s user 0.000s sys 0.000s
I20260617 20:17:09.999866 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6084cccbc3fe415eb83ba19e8c8edb9c [id=4b3cdb2f571542888c313ddae66d4c8b]
I20260617 20:17:10.000303 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_cdb98c9b862142e289f947e9d07a2a53 [id=4b77ac1b27aa415dbcb873621ee4ddd9]
I20260617 20:17:10.000716 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_321214072f004f76a346e51f39acde1f [id=4bed2d5737114eeda76e61e6a4a3fddd]
I20260617 20:17:10.001163 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_560c145ddbd849009a37389bcd5428eb [id=4bf3d921af9d4bb89d123dad34a6cffa]
I20260617 20:17:10.001639 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330]
I20260617 20:17:10.002604 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_b5d227c61e734225b76fd057b7ad9b96 [id=4cb0ef24b723455aacc2dc61526886d1]
I20260617 20:17:10.003648 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_7b4739816cc340b5b1f9a29e08d5032d [id=4e09fd32f7a44b49bb9dbeb71dae470d]
I20260617 20:17:10.003719 29379 tablet_bootstrap.cc:492] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.004208 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_9c108f2be5f14aa3a1a939e8c6bb18ae [id=4e979fc0459843cd95a5268458cd5175]
I20260617 20:17:10.004925 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_77e7189ea1ef4f3c9af44f3374988908 [id=4efc3cc7163244929a5d09c31838be7a]
I20260617 20:17:10.005496 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5]
I20260617 20:17:10.006018 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_25485c53fc824593aebd48840afae10e [id=4f66039ab9ea457fa2bc42d45a087826]
I20260617 20:17:10.006448 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_18d04b2793af4915ac6a2f592f197b41 [id=4fa0724d031447898614e9f9f1ce16ec]
I20260617 20:17:10.006904 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_1ba25cf94e2c4be8a766c5e248de7a85 [id=4fa575ccc91743c09374480aea4e5e34]
I20260617 20:17:10.007216 29376 tablet_replica.cc:333] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.007450 29376 raft_consensus.cc:2243] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.007783 29376 raft_consensus.cc:2272] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.008385 29376 ts_tablet_manager.cc:1916] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.010246 31065 raft_consensus.cc:493] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.010391 31065 raft_consensus.cc:515] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.011041 31065 leader_election.cc:290] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.011189 30378 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 2 FOLLOWER]: Refusing update from remote peer f5ea3f9265d84474ab3bced8dd5aecc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1307. Preceding OpId from leader: term: 2 index: 1308. (index mismatch)
I20260617 20:17:10.012048 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d79b7023ae478698a06562b2e4c578" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:10.012555 28925 leader_election.cc:343] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.012584 31107 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1308, Last known committed idx: 1307, Time since last communication: 0.000s
I20260617 20:17:10.014246 31106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5ea3f9265d84474ab3bced8dd5aecc5. Latest consensus state: current_term: 2 leader_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:17:10.014788 31106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:17:10.014748 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d79b7023ae478698a06562b2e4c578" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.015609 28925 leader_election.cc:343] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.015759 28925 leader_election.cc:304] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:10.016350 31065 raft_consensus.cc:2749] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:10.022409 29383 tablet_bootstrap.cc:492] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.022574 29383 ts_tablet_manager.cc:1403] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.069s user 0.010s sys 0.012s
I20260617 20:17:10.023345 29383 raft_consensus.cc:359] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.023532 29383 raft_consensus.cc:385] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.023586 29383 raft_consensus.cc:740] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.027547 29375 ts_tablet_manager.cc:1929] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.027662 29383 consensus_queue.cc:260] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.028795 29383 ts_tablet_manager.cc:1434] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:17:10.034747 29375 log.cc:1199] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/593d9de6a2fb47e18d86649e45ba80b9
I20260617 20:17:10.037495 29383 tablet_bootstrap.cc:492] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.038235 29375 ts_tablet_manager.cc:1950] T 593d9de6a2fb47e18d86649e45ba80b9 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.039580 29383 tablet_bootstrap.cc:654] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.034586 29379 tablet_bootstrap.cc:654] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.043104 29376 ts_tablet_manager.cc:1929] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.043322 29376 log.cc:1199] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/14a5e5917a414c99b25ea2efeab4063d
I20260617 20:17:10.043835 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 969) took 3205 ms. Trace:
I20260617 20:17:10.043983 29376 ts_tablet_manager.cc:1950] T 14a5e5917a414c99b25ea2efeab4063d P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.044499 29378 tablet_bootstrap.cc:654] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.045097 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_1a3d321b3ffa4bc6b94fe6ca3068cda5 [id=5002bb6a396143d498c1a5c11a5be2df]
I20260617 20:17:10.046494 29375 rpcz_store.cc:276] 0617 20:17:06.838681 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.839942 (+ 1261us) service_pool.cc:224] Handling call
0617 20:17:09.960977 (+3121035us) ts_tablet_manager.cc:1151] Deleting tablet 593d9de6a2fb47e18d86649e45ba80b9
0617 20:17:09.960984 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.977064 (+ 16080us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.027472 (+ 50408us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.043799 (+ 16327us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3120896}
I20260617 20:17:10.047528 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_07414915a4624a09a17497c8455f51d3 [id=50f64b2e895c4669b7d4b1714175392b]
I20260617 20:17:10.048069 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_28f33cd39a814646bedf696c7f0db67c [id=52f1243091174b5885f65dc87f1afbbf]
I20260617 20:17:10.049501 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 953) took 4095 ms. Trace:
I20260617 20:17:10.047436 29379 tablet_bootstrap.cc:492] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.051618 29379 ts_tablet_manager.cc:1403] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.048s user 0.010s sys 0.000s
I20260617 20:17:10.052951 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f72a129643494deabc2a8c6f86129b46 [id=542d2522b8a44eae883475e3cdbeba0a]
I20260617 20:17:10.053064 29379 raft_consensus.cc:359] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.053373 29379 raft_consensus.cc:385] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.053534 31065 raft_consensus.cc:493] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.053666 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_cd47ca20a5094cada0101a3fafba4f5d [id=550f5bf4ac614fc9a1a2778070e7f3a0]
I20260617 20:17:10.053718 31065 raft_consensus.cc:515] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.054558 31065 leader_election.cc:290] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.054592 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_1e0e98bdedab480c9d07bc266771250e [id=55e2fa74a9a4405886cfb7982e27eb5f]
I20260617 20:17:10.055989 29376 rpcz_store.cc:276] 0617 20:17:05.953944 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.954012 (+ 68us) service_pool.cc:224] Handling call
0617 20:17:09.980219 (+4026207us) ts_tablet_manager.cc:1151] Deleting tablet 14a5e5917a414c99b25ea2efeab4063d
0617 20:17:10.007157 (+ 26938us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.020261 (+ 13104us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.043038 (+ 22777us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.049476 (+ 6438us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4025980}
I20260617 20:17:10.056284 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d23acc051c34ebfb0edb790faec1b2b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.056831 29376 tablet_replica.cc:333] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.056895 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d23acc051c34ebfb0edb790faec1b2b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.057099 29376 raft_consensus.cc:2243] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.057406 29376 pending_rounds.cc:70] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:17:10.057453 29376 pending_rounds.cc:77] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7297955551889842176 op_type: NO_OP noop_request { }
I20260617 20:17:10.057533 29376 raft_consensus.cc:2889] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:10.057606 29376 raft_consensus.cc:2272] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:10.057964 28925 leader_election.cc:343] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:10.058264 28925 leader_election.cc:343] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.058379 28925 leader_election.cc:304] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:10.058856 29376 ts_tablet_manager.cc:1916] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.059051 30967 raft_consensus.cc:2749] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:10.053448 29379 raft_consensus.cc:740] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.061676 29379 consensus_queue.cc:260] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.063067 29379 ts_tablet_manager.cc:1434] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.011s user 0.001s sys 0.002s
I20260617 20:17:10.062335 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 972) took 3151 ms. Trace:
I20260617 20:17:10.064514 29375 rpcz_store.cc:276] 0617 20:17:06.911237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.911314 (+ 77us) service_pool.cc:224] Handling call
0617 20:17:10.062148 (+3150834us) ts_tablet_manager.cc:1151] Deleting tablet fc7cb1160fe94c2baf9775a193ef4c77
0617 20:17:10.062165 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.062309 (+ 144us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3150591}
I20260617 20:17:10.063462 29379 tablet_bootstrap.cc:492] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.068166 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 971) took 3157 ms. Trace:
I20260617 20:17:10.068282 29375 rpcz_store.cc:276] 0617 20:17:06.911104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.911673 (+ 569us) service_pool.cc:224] Handling call
0617 20:17:10.065251 (+3153578us) ts_tablet_manager.cc:1151] Deleting tablet e9ea2f6574d44d1a80fd4787fb6ca0e1
0617 20:17:10.065603 (+ 352us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.068136 (+ 2533us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3153421}
I20260617 20:17:10.068733 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 974) took 2726 ms. Trace:
I20260617 20:17:10.068821 29375 rpcz_store.cc:276] 0617 20:17:07.342355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.342720 (+ 365us) service_pool.cc:224] Handling call
0617 20:17:10.068610 (+2725890us) ts_tablet_manager.cc:1151] Deleting tablet 5559b78afa0d4043971bb433500a21e4
0617 20:17:10.068622 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.068716 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2725715}
I20260617 20:17:10.069114 29375 tablet_replica.cc:333] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.069339 29375 raft_consensus.cc:2243] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.069577 29375 raft_consensus.cc:2272] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.070205 29375 ts_tablet_manager.cc:1916] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.073575 31110 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:17:10.073849 31110 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [sys.catalog]: This master's current role is: LEADER
I20260617 20:17:10.080926 31106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } } }
I20260617 20:17:10.081156 31106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [sys.catalog]: This master's current role is: FOLLOWER
I20260617 20:17:10.083544 29379 tablet_bootstrap.cc:654] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.086294 29378 tablet_bootstrap.cc:492] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.086344 30683 raft_consensus.cc:493] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.086545 29378 ts_tablet_manager.cc:1403] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.104s user 0.005s sys 0.000s
I20260617 20:17:10.086539 30683 raft_consensus.cc:515] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.087661 30683 leader_election.cc:290] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.088122 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71342100c8f746d384b4cef73086afd2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:10.088330 28985 raft_consensus.cc:2468] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:10.088814 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71342100c8f746d384b4cef73086afd2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.089092 29121 raft_consensus.cc:2468] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:10.089658 29198 leader_election.cc:304] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:10.090122 30683 raft_consensus.cc:2804] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:10.090206 30683 raft_consensus.cc:493] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:10.090278 30683 raft_consensus.cc:3060] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.090256 29378 raft_consensus.cc:359] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.090420 29378 raft_consensus.cc:385] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.090469 29378 raft_consensus.cc:740] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.090734 29378 consensus_queue.cc:260] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.091287 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_cc1b1d5f363341f89757851580c7be12 [id=56c7ef0d2f9b4f6f9265a1f64d01dc76]
I20260617 20:17:10.092422 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_1dcb619bfb304bcc890afe629b9e4694 [id=57af564b4ab34bc88d4dae9a0f8b2ff4]
I20260617 20:17:10.092869 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_7ba6c34c2fdb41c7a28dd9b7d555eeba [id=57f51996903e41d6bf32d9b398240a95]
I20260617 20:17:10.093169 30683 raft_consensus.cc:515] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.094131 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_cba2415155904e39af29aadcd63568b1 [id=5a8b12e534a84300b4feaedb62477673]
I20260617 20:17:10.094597 30683 leader_election.cc:290] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.101174 29376 ts_tablet_manager.cc:1929] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260617 20:17:10.104786 29375 ts_tablet_manager.cc:1929] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.104724 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71342100c8f746d384b4cef73086afd2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:10.105005 28985 raft_consensus.cc:3060] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.105043 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8caf7f807d004b8b9f981df76b53a90f [id=5b8a7c9b972345b4ad60d664e3dfd9c3]
I20260617 20:17:10.105865 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_1404d8949a194779a7fe937bc4857a4a [id=5c83a4e7711c4b928e15a365aa351fbe]
I20260617 20:17:10.106427 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_99df9464c22045a1ac1834514adf1ade [id=5cc4725ffa5544ba8675f6734818f8d6]
I20260617 20:17:10.106815 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_9620456571e44a95930dec879ff4ad69 [id=5cdd5fb7c9d044b580f8670847d3c60e]
I20260617 20:17:10.107149 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_aead2dfbc56e41b09cb8d70dd31f9fe7 [id=5ced09db636a4865bbb6661928063245]
I20260617 20:17:10.107512 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0b8e0aa46bda414b9cd909ead421e411 [id=5cfb591827bb415bb5e640c3f4dad12a]
I20260617 20:17:10.107864 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_07ee116a00f04f99aa9e85d08ba5b147 [id=5d39a5d87ba74b7abc3ee6e074f9591b]
I20260617 20:17:10.108223 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6608950ce63c4189ba3fd0cca3a42bd9 [id=5e4eb42ba8894b78a217d5af391de888]
I20260617 20:17:10.108492 28985 raft_consensus.cc:2468] T 71342100c8f746d384b4cef73086afd2 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:10.109148 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_143cff941bb14515ba8932f1263aedce [id=622a20953f3e4e9ab9469343794042c7]
I20260617 20:17:10.109360 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71342100c8f746d384b4cef73086afd2" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:10.109844 29375 log.cc:1199] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/f02529cd1e764a3886de27d86e9690e3
I20260617 20:17:10.109882 29121 raft_consensus.cc:3060] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.110191 29375 ts_tablet_manager.cc:1950] T f02529cd1e764a3886de27d86e9690e3 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.110910 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 975) took 2768 ms. Trace:
I20260617 20:17:10.110985 29375 rpcz_store.cc:276] 0617 20:17:07.342464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.342927 (+ 463us) service_pool.cc:224] Handling call
0617 20:17:10.069071 (+2726144us) ts_tablet_manager.cc:1151] Deleting tablet f02529cd1e764a3886de27d86e9690e3
0617 20:17:10.069080 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.101586 (+ 32506us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.104736 (+ 3150us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.110891 (+ 6155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2726015}
I20260617 20:17:10.111372 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 973) took 2769 ms. Trace:
I20260617 20:17:10.111469 29375 rpcz_store.cc:276] 0617 20:17:07.341459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.343104 (+ 1645us) service_pool.cc:224] Handling call
0617 20:17:10.111257 (+2768153us) ts_tablet_manager.cc:1151] Deleting tablet 05494b097ba0480e91d338cf6b50ddc8
0617 20:17:10.111266 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.111358 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2768025}
I20260617 20:17:10.111768 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 977) took 2769 ms. Trace:
I20260617 20:17:10.111855 29121 raft_consensus.cc:2468] T 71342100c8f746d384b4cef73086afd2 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:10.111824 29375 rpcz_store.cc:276] 0617 20:17:07.342666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.343162 (+ 496us) service_pool.cc:224] Handling call
0617 20:17:10.111684 (+2768522us) ts_tablet_manager.cc:1151] Deleting tablet 4b94d8148cf74a899c3d025f22541bd9
0617 20:17:10.111691 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.111756 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2768420}
I20260617 20:17:10.111958 29376 log.cc:1199] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/0eaa60028a1647e580a987c3a0836a24
I20260617 20:17:10.109644 29197 leader_election.cc:304] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:10.112398 29376 ts_tablet_manager.cc:1950] T 0eaa60028a1647e580a987c3a0836a24 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.112517 30683 raft_consensus.cc:2804] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:10.112660 30683 raft_consensus.cc:697] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:10.112928 30683 consensus_queue.cc:237] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.113147 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 954) took 4159 ms. Trace:
I20260617 20:17:10.113234 29376 rpcz_store.cc:276] 0617 20:17:05.954066 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.954131 (+ 65us) service_pool.cc:224] Handling call
0617 20:17:10.056659 (+4102528us) ts_tablet_manager.cc:1151] Deleting tablet 0eaa60028a1647e580a987c3a0836a24
0617 20:17:10.056789 (+ 130us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.097799 (+ 41010us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.101082 (+ 3283us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.113107 (+ 12025us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4102364}
I20260617 20:17:10.113561 29376 tablet_replica.cc:333] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.113754 29376 raft_consensus.cc:2243] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.113884 29376 raft_consensus.cc:2272] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.115154 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_78df0b7688e5419a8ae514d3c4e5399e [id=62448d1c0fe54010b3b491e6c5b47bfc]
I20260617 20:17:10.114346 29376 ts_tablet_manager.cc:1916] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.117273 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_2a05556c6a7e4dfa97378055d732828a [id=6361cd6c2ce14ffca426481ea0208f3c]
I20260617 20:17:10.110351 29383 tablet_bootstrap.cc:492] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.117556 29383 ts_tablet_manager.cc:1403] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.080s user 0.028s sys 0.031s
I20260617 20:17:10.118098 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_dc3d1baf230b4c32b23beb5d647a300d [id=642a5256a45b4ff3b1557a6c50d25d73]
I20260617 20:17:10.118317 29383 raft_consensus.cc:359] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.118490 29383 raft_consensus.cc:385] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.118559 29383 raft_consensus.cc:740] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.119238 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_068e6f9e0da44fbba32efb8418d43f31 [id=652e7bce101f468aaf1d8d011bb396c5]
I20260617 20:17:10.120096 29383 consensus_queue.cc:260] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:10.120791 30313 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.245.254:37301 timed out after 0.513s (SENT)
I20260617 20:17:10.120908 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f251f69819b7456a9a108dfefb1414bd [id=659fc9e914b14c72b7d2a3571a01608a]
I20260617 20:17:10.123975 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_5970f728d64e408e83358eb27947ecc7 [id=673bf1a902ce4f54938b68a4c5cd01a3]
I20260617 20:17:10.124596 29378 ts_tablet_manager.cc:1434] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20260617 20:17:10.124668 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_12eedf674e4d4de99a03e816f2b6475c [id=67fea9aec2234faca7f0af0743c8601d]
I20260617 20:17:10.125100 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e3dc5d6e636a48dcb8ea35c12167a65c [id=687ab84417184ad2a95410c6c1ffc4a4]
I20260617 20:17:10.125765 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_86ee1dcdebe4461692b1cc1234cc4965 [id=6a1430fa99ea4bbe98f5513393111db0]
I20260617 20:17:10.127645 29376 ts_tablet_manager.cc:1929] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:10.128105 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_487f14a2a0554f68af6b03801e647fac [id=6a8fb68aa5024673a1b88ae934abd00e]
I20260617 20:17:10.128616 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_b25f36c0ba1247f5a4b85a5b4add8420 [id=6a948594185b42128136770dbe3f0ffb]
I20260617 20:17:10.130101 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_202d346de7a14d6f9cad64a5e8ea8391 [id=6cef714c5570465286ae445cc7bb9109]
I20260617 20:17:10.130153 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 976) took 2787 ms. Trace:
I20260617 20:17:10.130323 29376 log.cc:1199] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/c17aa7f99fc74838b9975c3e9289ccfd
I20260617 20:17:10.130730 29376 ts_tablet_manager.cc:1950] T c17aa7f99fc74838b9975c3e9289ccfd P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.131222 29383 ts_tablet_manager.cc:1434] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260617 20:17:10.131522 29383 tablet_bootstrap.cc:492] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.131877 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 955) took 4176 ms. Trace:
W20260617 20:17:10.131894 28631 external_mini_cluster.cc:1721] Unable to check leaks on /tmp/dist-test-taskRePpQS/build/asan/bin/kudu pid 28639: Timed out: CheckLeaks RPC to 127.27.245.254:37301 timed out after 1.000s (SENT)
I20260617 20:17:10.132042 28631 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRePpQS/build/asan/bin/kudu with pid 28639
I20260617 20:17:10.132570 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3463b514edb64b81813246ee4f8ed157 [id=6e73368fb6f74908b0583b369af8de2c]
I20260617 20:17:10.132689 29376 rpcz_store.cc:276] 0617 20:17:05.955820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.955867 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:10.113497 (+4157630us) ts_tablet_manager.cc:1151] Deleting tablet c17aa7f99fc74838b9975c3e9289ccfd
0617 20:17:10.113506 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.122046 (+ 8540us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.127578 (+ 5532us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.131858 (+ 4280us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4157452}
I20260617 20:17:10.133061 29376 tablet_replica.cc:333] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.133464 29376 raft_consensus.cc:2243] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.133816 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_2bb5f77d341647ff9184094cb26eb790 [id=6e83cc5f778f46de8d9d7d8aa2c4512d]
I20260617 20:17:10.134109 29375 rpcz_store.cc:276] 0617 20:17:07.342560 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.343082 (+ 522us) service_pool.cc:224] Handling call
0617 20:17:10.130000 (+2786918us) ts_tablet_manager.cc:1151] Deleting tablet 08290c23fff5449481789b29d15c4781
0617 20:17:10.130013 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.130129 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2786648}
I20260617 20:17:10.134699 29376 raft_consensus.cc:2272] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.135298 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 978) took 2760 ms. Trace:
I20260617 20:17:10.135456 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_143ae9e7e1ec4c7abc9cd48b0623f7b7 [id=6fcc9d1bbca646d78518552e7930e293]
I20260617 20:17:10.136005 29375 rpcz_store.cc:276] 0617 20:17:07.375046 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.375759 (+ 713us) service_pool.cc:224] Handling call
0617 20:17:10.135164 (+2759405us) ts_tablet_manager.cc:1151] Deleting tablet 5559b78afa0d4043971bb433500a21e4
0617 20:17:10.135175 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.135278 (+ 103us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2759214}
I20260617 20:17:10.136294 29376 ts_tablet_manager.cc:1916] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.138123 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 992) took 2722 ms. Trace:
I20260617 20:17:10.138271 29375 rpcz_store.cc:276] 0617 20:17:07.415738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.415821 (+ 83us) service_pool.cc:224] Handling call
0617 20:17:10.137997 (+2722176us) ts_tablet_manager.cc:1151] Deleting tablet 5f7534d57f1740af8b211d646488c90f
0617 20:17:10.138007 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.138104 (+ 97us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2721973}
I20260617 20:17:10.138818 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 987) took 2725 ms. Trace:
I20260617 20:17:10.139731 29375 rpcz_store.cc:276] 0617 20:17:07.413259 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.418378 (+ 5119us) service_pool.cc:224] Handling call
0617 20:17:10.138714 (+2720336us) ts_tablet_manager.cc:1151] Deleting tablet f13c7d600d334e549a5abfe0040b3296
0617 20:17:10.138723 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.138803 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2720177}
I20260617 20:17:10.140265 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 993) took 2565 ms. Trace:
I20260617 20:17:10.140647 29383 tablet_bootstrap.cc:654] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.140748 29375 rpcz_store.cc:276] 0617 20:17:07.574334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.598503 (+ 24169us) service_pool.cc:224] Handling call
0617 20:17:10.140171 (+2541668us) ts_tablet_manager.cc:1151] Deleting tablet cb95c048212948dfb00baafbd0c691d9
0617 20:17:10.140180 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.140249 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2541362}
W20260617 20:17:10.136062 29527 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.245.254:37301 timed out after 0.521s (SENT)
I20260617 20:17:10.142033 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 994) took 2499 ms. Trace:
I20260617 20:17:10.142154 29378 tablet_bootstrap.cc:492] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.142843 29375 rpcz_store.cc:276] 0617 20:17:07.642648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.643242 (+ 594us) service_pool.cc:224] Handling call
0617 20:17:10.141935 (+2498693us) ts_tablet_manager.cc:1151] Deleting tablet fc0081e8742248a0ba088006a905ce85
0617 20:17:10.141945 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.142018 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2497258}
I20260617 20:17:10.143339 29375 tablet_replica.cc:333] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.143592 29375 raft_consensus.cc:2243] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.143796 29375 raft_consensus.cc:2272] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.144567 29375 ts_tablet_manager.cc:1916] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.147965 29378 tablet_bootstrap.cc:654] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.148164 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_cee27611d8f547eca1c10f1e335f4a7c [id=6ffa00c2439b4485b9fd7cfcc84ad616]
I20260617 20:17:10.149667 31065 raft_consensus.cc:493] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.149844 31065 raft_consensus.cc:515] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.150135 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a7a5ea2c387e417aae386b585127cb0f [id=7104732645714a098ce4a19d87a3b629]
I20260617 20:17:10.150594 31065 leader_election.cc:290] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.151445 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_766764a313d042c290c82395b15fcbfa [id=71a8746b74234cc5998761b1a5f7c85a]
I20260617 20:17:10.151736 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a89e42d091f423bb926f671797141ea" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.152046 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a89e42d091f423bb926f671797141ea" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.152428 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fdeeb511d87e4fcc8659b17d363c9834 [id=71f04739faee495782d0b18a7c3ab912]
W20260617 20:17:10.152635 28925 leader_election.cc:343] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.153065 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_440996b6cc8d431c9c09e1912c9b9ffd [id=7270dd3680e948a0aa58347b5ae70b2a]
W20260617 20:17:10.153142 28925 leader_election.cc:343] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.153234 28925 leader_election.cc:304] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:10.153823 31065 raft_consensus.cc:2749] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:10.154862 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_411f66b9447a436d8d71bc99a62285fc [id=732a974bd6a84f428014fcc980ed9390]
I20260617 20:17:10.155694 29378 tablet_bootstrap.cc:492] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.155905 29378 ts_tablet_manager.cc:1403] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.001s
I20260617 20:17:10.156637 29378 raft_consensus.cc:359] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.156862 29378 raft_consensus.cc:385] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.156965 29378 raft_consensus.cc:740] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.157224 29378 consensus_queue.cc:260] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.157476 29375 ts_tablet_manager.cc:1929] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:10.157621 29375 log.cc:1199] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/29c65bb7c45e40a081de91d4c1c5cf56
I20260617 20:17:10.158967 29377 ts_tablet_manager.cc:1929] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:10.159057 29377 log.cc:1199] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/ebd98889d08f4683ba4b2ee98a74254d
I20260617 20:17:10.159312 29377 ts_tablet_manager.cc:1950] T ebd98889d08f4683ba4b2ee98a74254d P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:10.159976 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 951) took 4638 ms. Trace:
I20260617 20:17:10.160048 29377 rpcz_store.cc:276] 0617 20:17:05.521956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.562461 (+ 40505us) service_pool.cc:224] Handling call
0617 20:17:09.982613 (+4420152us) ts_tablet_manager.cc:1151] Deleting tablet ebd98889d08f4683ba4b2ee98a74254d
0617 20:17:09.987662 (+ 5049us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:09.992944 (+ 5282us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.158920 (+165976us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.159956 (+ 1036us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4419987}
I20260617 20:17:10.160532 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 952) took 4638 ms. Trace:
I20260617 20:17:10.160600 29377 rpcz_store.cc:276] 0617 20:17:05.522047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.562629 (+ 40582us) service_pool.cc:224] Handling call
0617 20:17:10.160443 (+4597814us) ts_tablet_manager.cc:1151] Deleting tablet cc8fa9f4c40b4ce9baa27a8837d3575c
0617 20:17:10.160452 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.160516 (+ 64us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4597719}
I20260617 20:17:10.160866 29378 ts_tablet_manager.cc:1434] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260617 20:17:10.160966 29377 tablet_replica.cc:333] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:10.161131 29377 raft_consensus.cc:2243] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.161258 29378 tablet_bootstrap.cc:492] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.161356 29375 ts_tablet_manager.cc:1950] T 29c65bb7c45e40a081de91d4c1c5cf56 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.161450 29377 raft_consensus.cc:2272] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.162245 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 995) took 2516 ms. Trace:
I20260617 20:17:10.162388 29375 rpcz_store.cc:276] 0617 20:17:07.645747 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.647504 (+ 1757us) service_pool.cc:224] Handling call
0617 20:17:10.143297 (+2495793us) ts_tablet_manager.cc:1151] Deleting tablet 29c65bb7c45e40a081de91d4c1c5cf56
0617 20:17:10.143305 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.148555 (+ 5250us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.157421 (+ 8866us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.162212 (+ 4791us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2495380}
I20260617 20:17:10.162851 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 997) took 2472 ms. Trace:
I20260617 20:17:10.162909 29378 tablet_bootstrap.cc:654] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.163012 29375 rpcz_store.cc:276] 0617 20:17:07.690130 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.690180 (+ 50us) service_pool.cc:224] Handling call
0617 20:17:10.162723 (+2472543us) ts_tablet_manager.cc:1151] Deleting tablet 841664f40c02423095bb9e63b85006a6
0617 20:17:10.162732 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.162821 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2468599}
I20260617 20:17:10.163429 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 998) took 2473 ms. Trace:
I20260617 20:17:10.163559 29375 rpcz_store.cc:276] 0617 20:17:07.690226 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.690349 (+ 123us) service_pool.cc:224] Handling call
0617 20:17:10.163303 (+2472954us) ts_tablet_manager.cc:1151] Deleting tablet b7a26cb68df548f9b716c72e36b11647
0617 20:17:10.163313 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.163400 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2469164}
I20260617 20:17:10.163930 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 996) took 2473 ms. Trace:
I20260617 20:17:10.164091 29375 rpcz_store.cc:276] 0617 20:17:07.690023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.690496 (+ 473us) service_pool.cc:224] Handling call
0617 20:17:10.163824 (+2473328us) ts_tablet_manager.cc:1151] Deleting tablet dbc2e5ecad0c41d5a24e0dad708b1a5c
0617 20:17:10.163833 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.163899 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2466041}
I20260617 20:17:10.164512 29375 tablet_replica.cc:333] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.164757 29375 raft_consensus.cc:2243] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.164973 29375 raft_consensus.cc:2272] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.158753 29379 tablet_bootstrap.cc:492] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.165612 29375 ts_tablet_manager.cc:1916] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.169386 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a9feae94e42c4ffc87ff57c32a580c64 [id=749a20b2889949018a13034961c884ed]
I20260617 20:17:10.170809 29376 ts_tablet_manager.cc:1929] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.171303 29375 ts_tablet_manager.cc:1929] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.171391 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_102ea82c80b64c00b6f6a79a87b687f7 [id=74c63621fa8d4b8894442b7897d714a6]
I20260617 20:17:10.171510 29375 log.cc:1199] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/30f6dcc384154d41866cf8060cf05837
I20260617 20:17:10.171916 29375 ts_tablet_manager.cc:1950] T 30f6dcc384154d41866cf8060cf05837 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.172067 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f83bfe624dc64693998c453f0f0c42fd [id=756fa2b70ecd4112ad896545476251be]
I20260617 20:17:10.172516 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_5d01dcb6629a40f2a3dc693bbb860d62 [id=75a5082717854698a606ad842b2f107d]
I20260617 20:17:10.172703 29376 log.cc:1199] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/30f6dcc384154d41866cf8060cf05837
I20260617 20:17:10.172735 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 999) took 2482 ms. Trace:
I20260617 20:17:10.172911 29375 rpcz_store.cc:276] 0617 20:17:07.690334 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.690527 (+ 193us) service_pool.cc:224] Handling call
0617 20:17:10.164448 (+2473921us) ts_tablet_manager.cc:1151] Deleting tablet 30f6dcc384154d41866cf8060cf05837
0617 20:17:10.164457 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.168513 (+ 4056us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.171258 (+ 2745us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.172717 (+ 1459us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2466562}
I20260617 20:17:10.173067 29376 ts_tablet_manager.cc:1950] T 30f6dcc384154d41866cf8060cf05837 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.173501 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1000) took 2483 ms. Trace:
I20260617 20:17:10.173698 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f581f3582276489b851bca84cea0cd2d [id=75b4797252e34fb0a8875cf4c084cfc1]
I20260617 20:17:10.173628 29375 rpcz_store.cc:276] 0617 20:17:07.690449 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.690698 (+ 249us) service_pool.cc:224] Handling call
0617 20:17:10.173391 (+2482693us) ts_tablet_manager.cc:1151] Deleting tablet 75e3e15cade7403fa70096516d83c3c0
0617 20:17:10.173400 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.173484 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2475446}
I20260617 20:17:10.174109 29375 tablet_replica.cc:333] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.174348 29375 raft_consensus.cc:2243] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.174542 29375 raft_consensus.cc:2272] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.175154 29375 ts_tablet_manager.cc:1916] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.177644 30683 raft_consensus.cc:493] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.177768 30683 raft_consensus.cc:515] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.178324 30683 leader_election.cc:290] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.179057 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd98889d08f4683ba4b2ee98a74254d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.179474 29197 leader_election.cc:343] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: ebd98889d08f4683ba4b2ee98a74254d
W20260617 20:17:10.179698 29198 leader_election.cc:343] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.179787 29198 leader_election.cc:304] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:10.179886 29383 tablet_bootstrap.cc:492] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.180001 29383 ts_tablet_manager.cc:1403] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.002s
I20260617 20:17:10.180207 30683 raft_consensus.cc:2749] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:10.180917 29383 raft_consensus.cc:359] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.181070 29383 raft_consensus.cc:385] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.181121 29383 raft_consensus.cc:740] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.181351 29383 consensus_queue.cc:260] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.181756 29383 ts_tablet_manager.cc:1434] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:10.182062 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_9a706992e1f74b07b585f66b6491d7e3 [id=763ed9048a1747ca897515ce507ae459]
I20260617 20:17:10.182894 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_89dd72be1c17431fb9eca41b33a12fc7 [id=77f8609e9cfc4c9ca0ba955bbb7b088b]
I20260617 20:17:10.183262 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_50b5db1ff0ab437f8ae21d80d7b14f64 [id=781947c106f041dda409062a199c828b]
I20260617 20:17:10.183777 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fc2cdea718fc4d83ab66e9c4d231a8f0 [id=791fd9c127eb4213b1f362d7ac1acf73]
I20260617 20:17:10.184522 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_675137d48e694996a1fbfc31e4fd7c9b [id=7a5ce2f1ca114a508611d15c5a7c18c4]
W20260617 20:17:10.185427 29197 consensus_peers.cc:597] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5eaddd6519dc490c8358be629b21a2d9. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.185889 29377 ts_tablet_manager.cc:1916] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.187364 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 956) took 4231 ms. Trace:
I20260617 20:17:10.187456 29376 rpcz_store.cc:276] 0617 20:17:05.955930 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.955981 (+ 51us) service_pool.cc:224] Handling call
0617 20:17:10.133021 (+4177040us) ts_tablet_manager.cc:1151] Deleting tablet 30f6dcc384154d41866cf8060cf05837
0617 20:17:10.133030 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.139790 (+ 6760us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.170753 (+ 30963us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.187344 (+ 16591us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4176876}
I20260617 20:17:10.187989 29383 tablet_bootstrap.cc:492] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.189435 29383 tablet_bootstrap.cc:654] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.193267 29376 tablet_replica.cc:333] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.193580 29376 raft_consensus.cc:2243] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.193799 29376 raft_consensus.cc:2272] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.194332 29378 tablet_bootstrap.cc:492] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.194352 29376 ts_tablet_manager.cc:1916] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.194540 29378 ts_tablet_manager.cc:1403] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.010s
I20260617 20:17:10.195380 29378 raft_consensus.cc:359] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.195657 29378 raft_consensus.cc:385] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.195777 29378 raft_consensus.cc:740] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.196025 29378 consensus_queue.cc:260] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.196592 29378 ts_tablet_manager.cc:1434] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:10.199965 29376 ts_tablet_manager.cc:1929] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:17:10.200117 29376 log.cc:1199] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/c3014c93d6804f3896f452f041cbedc9
I20260617 20:17:10.200531 29376 ts_tablet_manager.cc:1950] T c3014c93d6804f3896f452f041cbedc9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.202316 29378 tablet_bootstrap.cc:492] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.203974 29378 tablet_bootstrap.cc:654] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.204596 29383 tablet_bootstrap.cc:492] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.204780 29383 ts_tablet_manager.cc:1403] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.004s
I20260617 20:17:10.205857 29383 raft_consensus.cc:359] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.206981 29383 raft_consensus.cc:385] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.207098 29383 raft_consensus.cc:740] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.207376 29383 consensus_queue.cc:260] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.207907 29383 ts_tablet_manager.cc:1434] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:17:10.208418 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 960) took 4239 ms. Trace:
I20260617 20:17:10.208700 29383 tablet_bootstrap.cc:492] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.208609 29376 rpcz_store.cc:276] 0617 20:17:05.969167 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.969234 (+ 67us) service_pool.cc:224] Handling call
0617 20:17:10.190120 (+4220886us) ts_tablet_manager.cc:1151] Deleting tablet c3014c93d6804f3896f452f041cbedc9
0617 20:17:10.193216 (+ 3096us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.197385 (+ 4169us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.199904 (+ 2519us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.208397 (+ 8493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":425,"tablet-delete.queue_time_us":4220637}
I20260617 20:17:10.210021 29383 tablet_bootstrap.cc:654] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.211006 29375 ts_tablet_manager.cc:1929] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:10.211202 29375 log.cc:1199] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/0eaa60028a1647e580a987c3a0836a24
I20260617 20:17:10.211598 29375 ts_tablet_manager.cc:1950] T 0eaa60028a1647e580a987c3a0836a24 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.212508 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1001) took 2476 ms. Trace:
I20260617 20:17:10.212674 29375 rpcz_store.cc:276] 0617 20:17:07.735827 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.735891 (+ 64us) service_pool.cc:224] Handling call
0617 20:17:10.174067 (+2438176us) ts_tablet_manager.cc:1151] Deleting tablet 0eaa60028a1647e580a987c3a0836a24
0617 20:17:10.174077 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.208144 (+ 34067us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.210942 (+ 2798us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.212482 (+ 1540us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2437974}
I20260617 20:17:10.213459 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1003) took 2033 ms. Trace:
I20260617 20:17:10.213624 29375 rpcz_store.cc:276] 0617 20:17:08.180447 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.180496 (+ 49us) service_pool.cc:224] Handling call
0617 20:17:10.213274 (+2032778us) ts_tablet_manager.cc:1151] Deleting tablet 6f08bdd9c769403db89c20aabdc58d59
0617 20:17:10.213287 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.213430 (+ 143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2032601}
I20260617 20:17:10.214233 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1004) took 2032 ms. Trace:
I20260617 20:17:10.214376 29375 rpcz_store.cc:276] 0617 20:17:08.181605 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.181654 (+ 49us) service_pool.cc:224] Handling call
0617 20:17:10.214117 (+2032463us) ts_tablet_manager.cc:1151] Deleting tablet 5d93449f5d5d41fb9883db3bce10f969
0617 20:17:10.214128 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.214218 (+ 90us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2032300}
I20260617 20:17:10.214947 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1005) took 2031 ms. Trace:
I20260617 20:17:10.215096 29375 rpcz_store.cc:276] 0617 20:17:08.183645 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.183705 (+ 60us) service_pool.cc:224] Handling call
0617 20:17:10.214836 (+2031131us) ts_tablet_manager.cc:1151] Deleting tablet 05e5918dcafc4accb0345a8389b65412
0617 20:17:10.214848 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.214932 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2030955}
I20260617 20:17:10.215687 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1012) took 1828 ms. Trace:
I20260617 20:17:10.215828 29375 rpcz_store.cc:276] 0617 20:17:08.387237 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.391213 (+ 3976us) service_pool.cc:224] Handling call
0617 20:17:10.215574 (+1824361us) ts_tablet_manager.cc:1151] Deleting tablet aa626e3cdc7240deaf399b50b0258c50
0617 20:17:10.215586 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.215670 (+ 84us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1823576}
I20260617 20:17:10.216495 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1013) took 1807 ms. Trace:
I20260617 20:17:10.216630 29375 rpcz_store.cc:276] 0617 20:17:08.408588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.408648 (+ 60us) service_pool.cc:224] Handling call
0617 20:17:10.216373 (+1807725us) ts_tablet_manager.cc:1151] Deleting tablet c10b96bee83b419dbfc2a8e26f88e719
0617 20:17:10.216384 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.216478 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1807282}
I20260617 20:17:10.217550 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1014) took 1807 ms. Trace:
I20260617 20:17:10.217676 29375 rpcz_store.cc:276] 0617 20:17:08.409848 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.410142 (+ 294us) service_pool.cc:224] Handling call
0617 20:17:10.217444 (+1807302us) ts_tablet_manager.cc:1151] Deleting tablet ca4924e2825e4ec9b3302c1abb9c0bcf
0617 20:17:10.217462 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.217532 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1807104}
I20260617 20:17:10.217758 29378 tablet_bootstrap.cc:492] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.217885 29378 ts_tablet_manager.cc:1403] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
I20260617 20:17:10.218214 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1020) took 1713 ms. Trace:
I20260617 20:17:10.218325 29375 rpcz_store.cc:276] 0617 20:17:08.504566 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.504623 (+ 57us) service_pool.cc:224] Handling call
0617 20:17:10.218115 (+1713492us) ts_tablet_manager.cc:1151] Deleting tablet 078875241c324538ad6f93de1169aeb8
0617 20:17:10.218126 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.218199 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1668587}
I20260617 20:17:10.218763 29375 tablet_replica.cc:333] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.218694 29378 raft_consensus.cc:359] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.218878 29378 raft_consensus.cc:385] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.218936 29378 raft_consensus.cc:740] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.219187 29375 raft_consensus.cc:2243] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.219142 29378 consensus_queue.cc:260] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.219403 29375 raft_consensus.cc:2272] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.219940 29375 ts_tablet_manager.cc:1916] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.221560 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 979) took 3728 ms. Trace:
I20260617 20:17:10.224670 29378 ts_tablet_manager.cc:1434] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260617 20:17:10.225006 29378 tablet_bootstrap.cc:492] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.225879 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_432834dd55704c4589b84bcfae673d03 [id=7a61e654611a483488b8efdf8c0197bc]
I20260617 20:17:10.226073 29375 ts_tablet_manager.cc:1929] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:10.226209 29375 log.cc:1199] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/938b61a0f6dc4d178971034fd18c1674
I20260617 20:17:10.226559 29375 ts_tablet_manager.cc:1950] T 938b61a0f6dc4d178971034fd18c1674 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.226613 29378 tablet_bootstrap.cc:654] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.227300 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3dc2c3ecaddb44aab8d117d29872dfd5 [id=7c887cea4a7c4feea06af161c4c9b87d]
I20260617 20:17:10.227349 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1022) took 1722 ms. Trace:
I20260617 20:17:10.227762 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3f75a4b3577e427ba1b39fa83075b1c2 [id=7c94e39032fa4cf39a1187691bff2739]
I20260617 20:17:10.228261 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a]
I20260617 20:17:10.227504 29375 rpcz_store.cc:276] 0617 20:17:08.504788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.504828 (+ 40us) service_pool.cc:224] Handling call
0617 20:17:10.218722 (+1713894us) ts_tablet_manager.cc:1151] Deleting tablet 938b61a0f6dc4d178971034fd18c1674
0617 20:17:10.218731 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.222913 (+ 4182us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.226023 (+ 3110us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.227330 (+ 1307us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1669129}
I20260617 20:17:10.229087 29375 tablet_replica.cc:333] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.229362 29375 raft_consensus.cc:2243] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.229557 29375 raft_consensus.cc:2272] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.230212 29375 ts_tablet_manager.cc:1916] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.237085 29378 tablet_bootstrap.cc:492] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.237232 29378 ts_tablet_manager.cc:1403] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20260617 20:17:10.237982 29378 raft_consensus.cc:359] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.238549 29378 raft_consensus.cc:385] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.238660 29378 raft_consensus.cc:740] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.238945 29378 consensus_queue.cc:260] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.239562 29378 ts_tablet_manager.cc:1434] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:10.241629 29378 tablet_bootstrap.cc:492] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.241899 29375 ts_tablet_manager.cc:1929] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:10.242024 29375 log.cc:1199] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/dee426100bb645f391be123aeb52e412
I20260617 20:17:10.242339 29375 ts_tablet_manager.cc:1950] T dee426100bb645f391be123aeb52e412 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.243223 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1021) took 1738 ms. Trace:
I20260617 20:17:10.243324 29375 rpcz_store.cc:276] 0617 20:17:08.504679 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.504846 (+ 167us) service_pool.cc:224] Handling call
0617 20:17:10.229027 (+1724181us) ts_tablet_manager.cc:1151] Deleting tablet dee426100bb645f391be123aeb52e412
0617 20:17:10.229041 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.233987 (+ 4946us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.241834 (+ 7847us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.243201 (+ 1367us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1679393}
I20260617 20:17:10.228403 29383 tablet_bootstrap.cc:492] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.243927 29383 ts_tablet_manager.cc:1403] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.002s
I20260617 20:17:10.244170 29378 tablet_bootstrap.cc:654] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.244757 29383 raft_consensus.cc:359] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.244946 29383 raft_consensus.cc:385] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.245012 29383 raft_consensus.cc:740] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.245234 29383 consensus_queue.cc:260] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.245990 29383 ts_tablet_manager.cc:1434] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:10.246569 29383 tablet_bootstrap.cc:492] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.247462 31009 consensus_queue.cc:1048] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:10.249202 29383 tablet_bootstrap.cc:654] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.254397 29376 rpcz_store.cc:276] 0617 20:17:06.493467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.525441 (+ 31974us) service_pool.cc:224] Handling call
0617 20:17:10.209260 (+3683819us) ts_tablet_manager.cc:1151] Deleting tablet 4281bbef1efb4986a23c6fb24e62e49c
0617 20:17:10.221421 (+ 12161us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.221537 (+ 116us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3683535}
I20260617 20:17:10.255141 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 982) took 3729 ms. Trace:
I20260617 20:17:10.255270 29376 rpcz_store.cc:276] 0617 20:17:06.526131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.526172 (+ 41us) service_pool.cc:224] Handling call
0617 20:17:10.254991 (+3728819us) ts_tablet_manager.cc:1151] Deleting tablet 266ff05cc91b43dfbb30ce9e961eeb54
0617 20:17:10.255003 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.255121 (+ 118us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3728635}
I20260617 20:17:10.255700 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 983) took 3729 ms. Trace:
I20260617 20:17:10.255710 29383 tablet_bootstrap.cc:492] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.255963 29383 ts_tablet_manager.cc:1403] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260617 20:17:10.255848 29376 rpcz_store.cc:276] 0617 20:17:06.526204 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.526383 (+ 179us) service_pool.cc:224] Handling call
0617 20:17:10.255601 (+3729218us) ts_tablet_manager.cc:1151] Deleting tablet cdd24a60a91b43cd9e31ecca3d21ec60
0617 20:17:10.255608 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.255685 (+ 77us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3729058}
I20260617 20:17:10.256289 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 980) took 3730 ms. Trace:
I20260617 20:17:10.256455 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727]
I20260617 20:17:10.256412 29376 rpcz_store.cc:276] 0617 20:17:06.525898 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.526413 (+ 515us) service_pool.cc:224] Handling call
0617 20:17:10.256186 (+3729773us) ts_tablet_manager.cc:1151] Deleting tablet edf884e801d74362ad05435a76efcc1f
0617 20:17:10.256195 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.256268 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3729561}
I20260617 20:17:10.256701 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 984) took 3730 ms. Trace:
I20260617 20:17:10.256742 29383 raft_consensus.cc:359] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.256929 29383 raft_consensus.cc:385] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.256829 29376 rpcz_store.cc:276] 0617 20:17:06.526295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.551659 (+ 25364us) service_pool.cc:224] Handling call
0617 20:17:10.256624 (+3704965us) ts_tablet_manager.cc:1151] Deleting tablet 18440a4a5c254a25b87f8632de9c92b9
0617 20:17:10.256633 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.256686 (+ 53us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3704740}
I20260617 20:17:10.256992 29383 raft_consensus.cc:740] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.257248 29383 consensus_queue.cc:260] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.257249 29376 tablet_replica.cc:333] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.257612 29375 tablet_replica.cc:333] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.257817 29383 ts_tablet_manager.cc:1434] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:10.258092 29376 raft_consensus.cc:2243] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.258354 29383 tablet_bootstrap.cc:492] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.258653 29376 raft_consensus.cc:2272] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.260067 29383 tablet_bootstrap.cc:654] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.261320 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_2a1a4568e12941bf8abda5bc5f6a3477 [id=7ff91d1db9e249efa3d80acfddc13a27]
I20260617 20:17:10.261812 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_07b69bc96042426b925d4a1072ec0d08 [id=8015a245e8574c7580068edea8104f06]
I20260617 20:17:10.262199 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_977eca2b43be413ea87a6f080ea27de0 [id=805224e5ece140629e8db5fc81aac186]
I20260617 20:17:10.262674 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0abef9ea18ea4a1ab736d589813de366 [id=80b783d8ec91433c904e27e8f78b6bd6]
I20260617 20:17:10.262784 29377 ts_tablet_manager.cc:1929] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.262967 29377 log.cc:1199] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/eba86bae9e91404185d248dfd722a413
I20260617 20:17:10.263164 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3f639bb9ece9443ea9d7f7cf5ec04be4 [id=80f77a5c1229411b9e3b5c0094eca5f5]
I20260617 20:17:10.263368 29377 ts_tablet_manager.cc:1950] T eba86bae9e91404185d248dfd722a413 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:10.264163 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 954) took 4741 ms. Trace:
I20260617 20:17:10.264287 29377 rpcz_store.cc:276] 0617 20:17:05.522248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.612647 (+ 90399us) service_pool.cc:224] Handling call
0617 20:17:10.160920 (+4548273us) ts_tablet_manager.cc:1151] Deleting tablet eba86bae9e91404185d248dfd722a413
0617 20:17:10.160930 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.190726 (+ 29796us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.262721 (+ 71995us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.264144 (+ 1423us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4548056}
I20260617 20:17:10.259521 29376 ts_tablet_manager.cc:1916] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.264443 29375 raft_consensus.cc:2243] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.264810 29377 tablet_replica.cc:333] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:10.265025 29375 pending_rounds.cc:70] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: Trying to abort 1 pending ops.
I20260617 20:17:10.265108 29375 pending_rounds.cc:77] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955533852971008 op_type: NO_OP noop_request { }
I20260617 20:17:10.270221 29375 raft_consensus.cc:2889] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:10.270427 29375 raft_consensus.cc:2272] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.276227 29375 ts_tablet_manager.cc:1916] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.276834 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_1a39ae6042f446fb9caf98ad3c112778 [id=81ed246c6c4e472cae20325602c523a2]
I20260617 20:17:10.278280 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fb7dcd897fa349bb9ea70a359a51453c [id=83f9dade4df942c1b12e41fa46385fe0]
I20260617 20:17:10.278803 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_15da5b97a103487c96348ca7f22dc3b0 [id=842f3db66d544b8c8ea0a8b58f8ea775]
I20260617 20:17:10.279330 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a819c05e072c49eca6f58ced1b6f4887 [id=845b578a03fd4bae95a9be628a2f1194]
I20260617 20:17:10.279830 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_89996edf26734b579b82eaf9bc18dbd0 [id=8486a38e5e0344b4ab9c222ea975ac2e]
I20260617 20:17:10.280313 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_4290f341cd6741dd921290be5d1e3032 [id=84e2e8a1c775449282853c7e5a85b1e6]
I20260617 20:17:10.280712 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_c2d261c0ee9147409da728ff7de82e89 [id=850325382fbe4208aa36305354ab7044]
I20260617 20:17:10.281108 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8d05c7ebda0b4513a30b51d3248efb1f [id=867f1e0df6cf48cf90ddde6238e9b9c2]
I20260617 20:17:10.292205 31009 consensus_queue.cc:1048] T 6efb29f2e56c4838b0efd0171229088a P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:10.293581 29383 tablet_bootstrap.cc:492] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.293774 29383 ts_tablet_manager.cc:1403] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20260617 20:17:10.294736 29383 raft_consensus.cc:359] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.294976 29383 raft_consensus.cc:385] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.295063 29383 raft_consensus.cc:740] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.295409 29383 consensus_queue.cc:260] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.296301 29383 ts_tablet_manager.cc:1434] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:10.296677 29383 tablet_bootstrap.cc:492] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.300100 30852 raft_consensus.cc:493] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.300264 30852 raft_consensus.cc:515] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.300405 29383 tablet_bootstrap.cc:654] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.301030 30852 leader_election.cc:290] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.301816 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d778641c354c679ee9e7d7b3eae3b5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.302454 29198 leader_election.cc:343] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.301476 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d778641c354c679ee9e7d7b3eae3b5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:10.302932 28985 raft_consensus.cc:2468] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:10.303333 29197 leader_election.cc:304] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:10.303678 30852 raft_consensus.cc:2804] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:10.303759 30852 raft_consensus.cc:493] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:10.303840 30852 raft_consensus.cc:3060] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.303866 29376 ts_tablet_manager.cc:1929] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:17:10.304021 29376 log.cc:1199] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/086bd3079e8f4a6d85ccc681a38a47b0
I20260617 20:17:10.304495 29376 ts_tablet_manager.cc:1950] T 086bd3079e8f4a6d85ccc681a38a47b0 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.306810 30852 raft_consensus.cc:515] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.307459 30852 leader_election.cc:290] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.309031 29375 ts_tablet_manager.cc:1929] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.309166 29375 log.cc:1199] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/adbc3219639748d9a0d71d45ae22ab36
I20260617 20:17:10.310331 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d778641c354c679ee9e7d7b3eae3b5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:10.312054 29383 tablet_bootstrap.cc:492] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.312186 29383 ts_tablet_manager.cc:1403] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20260617 20:17:10.312885 29383 raft_consensus.cc:359] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.313032 29383 raft_consensus.cc:385] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.313083 29383 raft_consensus.cc:740] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.313385 29383 consensus_queue.cc:260] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.314056 29383 ts_tablet_manager.cc:1434] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:10.314630 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 995) took 3503 ms. Trace:
I20260617 20:17:10.314728 29376 rpcz_store.cc:276] 0617 20:17:06.810935 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.810979 (+ 44us) service_pool.cc:224] Handling call
0617 20:17:10.257209 (+3446230us) ts_tablet_manager.cc:1151] Deleting tablet 086bd3079e8f4a6d85ccc681a38a47b0
0617 20:17:10.257219 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.290535 (+ 33316us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.303794 (+ 13259us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.314609 (+ 10815us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":332,"tablet-delete.queue_time_us":3446059}
I20260617 20:17:10.315241 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 997) took 3493 ms. Trace:
I20260617 20:17:10.315328 29376 rpcz_store.cc:276] 0617 20:17:06.821685 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.821732 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:10.315079 (+3493347us) ts_tablet_manager.cc:1151] Deleting tablet 5ad81ce1ab114fc395f8efb930f4d949
0617 20:17:10.315093 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.315223 (+ 130us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3493156}
I20260617 20:17:10.315753 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 996) took 3494 ms. Trace:
I20260617 20:17:10.315871 29376 rpcz_store.cc:276] 0617 20:17:06.821562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.821845 (+ 283us) service_pool.cc:224] Handling call
0617 20:17:10.315628 (+3493783us) ts_tablet_manager.cc:1151] Deleting tablet b1064bce50b64aa9afe8bb249545c5ab
0617 20:17:10.315641 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.315736 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3493668}
I20260617 20:17:10.316274 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 998) took 3494 ms. Trace:
I20260617 20:17:10.316380 29376 rpcz_store.cc:276] 0617 20:17:06.821800 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.821945 (+ 145us) service_pool.cc:224] Handling call
0617 20:17:10.316155 (+3494210us) ts_tablet_manager.cc:1151] Deleting tablet 1bf654918dc148cdbca0e420e337478b
0617 20:17:10.316167 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.316258 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3494066}
I20260617 20:17:10.316699 29376 tablet_replica.cc:333] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:17:10.316916 29198 leader_election.cc:343] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.316953 29376 raft_consensus.cc:2243] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.317365 29376 raft_consensus.cc:2272] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.318147 29376 ts_tablet_manager.cc:1916] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.319471 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d778641c354c679ee9e7d7b3eae3b5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:10.319696 28985 raft_consensus.cc:3060] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.321753 29375 ts_tablet_manager.cc:1950] T adbc3219639748d9a0d71d45ae22ab36 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.322428 28985 raft_consensus.cc:2468] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:10.322845 29197 leader_election.cc:304] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:10.322841 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1029) took 1634 ms. Trace:
I20260617 20:17:10.323067 31094 raft_consensus.cc:2804] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:10.322954 29375 rpcz_store.cc:276] 0617 20:17:08.688667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.688719 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:10.257403 (+1568684us) ts_tablet_manager.cc:1151] Deleting tablet adbc3219639748d9a0d71d45ae22ab36
0617 20:17:10.257419 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.280684 (+ 23265us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.308951 (+ 28267us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.322814 (+ 13863us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1568427}
I20260617 20:17:10.323211 31094 raft_consensus.cc:697] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:10.323426 31094 consensus_queue.cc:237] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.323908 29383 tablet_bootstrap.cc:492] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.326438 29383 tablet_bootstrap.cc:654] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.319532 29377 raft_consensus.cc:2243] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.327757 29375 tablet_replica.cc:333] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.328033 29375 raft_consensus.cc:2243] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.328228 29375 raft_consensus.cc:2272] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.328209 29377 raft_consensus.cc:2272] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.328934 29375 ts_tablet_manager.cc:1916] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.329136 29377 ts_tablet_manager.cc:1916] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.331691 29379 ts_tablet_manager.cc:1403] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.268s user 0.020s sys 0.004s
I20260617 20:17:10.332377 29379 raft_consensus.cc:359] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.332556 29379 raft_consensus.cc:385] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.332612 29379 raft_consensus.cc:740] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.332827 29379 consensus_queue.cc:260] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.334158 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3f075eeaca7944f5a62ec0392ebea2d6 [id=869901d606b0494db3b02b698908f9b2]
I20260617 20:17:10.341490 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8767b23f3baa41c883f4884d81573ee8 [id=87863576402f427c91cd119026c041f7]
I20260617 20:17:10.342060 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_10a2068f0dcf4304897997f6f319612a [id=87b48be639d14f4c8ef661db36695716]
I20260617 20:17:10.343238 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_2c2192003f3b4117a9804a627934942c [id=89f26a2cd90440a4948ae3718ee5cf3b]
W20260617 20:17:10.344458 29197 consensus_peers.cc:597] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99a3d9ae347845dfa9357010819ebc58. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.344638 29378 tablet_bootstrap.cc:492] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.344789 29378 ts_tablet_manager.cc:1403] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.103s user 0.051s sys 0.033s
I20260617 20:17:10.345615 29378 raft_consensus.cc:359] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.345801 29378 raft_consensus.cc:385] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.345860 29378 raft_consensus.cc:740] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.346060 29383 tablet_bootstrap.cc:492] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.346191 29383 ts_tablet_manager.cc:1403] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.000s
I20260617 20:17:10.346896 29383 raft_consensus.cc:359] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.347054 29383 raft_consensus.cc:385] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.347111 29383 raft_consensus.cc:740] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.347285 29383 consensus_queue.cc:260] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.347766 29383 ts_tablet_manager.cc:1434] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:17:10.348052 29383 tablet_bootstrap.cc:492] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.349632 29383 tablet_bootstrap.cc:654] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.350808 29378 consensus_queue.cc:260] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.351347 29378 ts_tablet_manager.cc:1434] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 20:17:10.351622 29378 tablet_bootstrap.cc:492] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.345247 29376 ts_tablet_manager.cc:1929] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.352005 29376 log.cc:1199] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/eb408723f7a346c3b5ea13cad237b44e
I20260617 20:17:10.352348 29376 ts_tablet_manager.cc:1950] T eb408723f7a346c3b5ea13cad237b44e P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.353070 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1000) took 3509 ms. Trace:
I20260617 20:17:10.353237 29378 tablet_bootstrap.cc:654] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.353168 29376 rpcz_store.cc:276] 0617 20:17:06.843324 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.843472 (+ 148us) service_pool.cc:224] Handling call
0617 20:17:10.316644 (+3473172us) ts_tablet_manager.cc:1151] Deleting tablet eb408723f7a346c3b5ea13cad237b44e
0617 20:17:10.316655 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.342486 (+ 25831us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.345197 (+ 2711us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.353050 (+ 7853us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3472943}
I20260617 20:17:10.353701 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 999) took 3510 ms. Trace:
I20260617 20:17:10.353786 29376 rpcz_store.cc:276] 0617 20:17:06.843188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.844012 (+ 824us) service_pool.cc:224] Handling call
0617 20:17:10.353607 (+3509595us) ts_tablet_manager.cc:1151] Deleting tablet 3726e55ed36f420ab63bcfb5a81c5aab
0617 20:17:10.353617 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.353687 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3509386}
I20260617 20:17:10.354467 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1002) took 3444 ms. Trace:
I20260617 20:17:10.354543 29376 rpcz_store.cc:276] 0617 20:17:06.909713 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.909774 (+ 61us) service_pool.cc:224] Handling call
0617 20:17:10.354375 (+3444601us) ts_tablet_manager.cc:1151] Deleting tablet fc7cb1160fe94c2baf9775a193ef4c77
0617 20:17:10.354383 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.354453 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3444354}
I20260617 20:17:10.343684 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_60168eec2672477faf619c2033f3b5c7 [id=8b0b35107e334201892508576676c82b]
I20260617 20:17:10.333272 29379 ts_tablet_manager.cc:1434] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:17:10.355317 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1001) took 3445 ms. Trace:
I20260617 20:17:10.355378 29376 rpcz_store.cc:276] 0617 20:17:06.909580 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.909774 (+ 194us) service_pool.cc:224] Handling call
0617 20:17:10.355219 (+3445445us) ts_tablet_manager.cc:1151] Deleting tablet e9ea2f6574d44d1a80fd4787fb6ca0e1
0617 20:17:10.355227 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.355303 (+ 76us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123,"tablet-delete.queue_time_us":3445199}
I20260617 20:17:10.351912 29375 ts_tablet_manager.cc:1929] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:10.355789 29375 log.cc:1199] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/99a3d9ae347845dfa9357010819ebc58
I20260617 20:17:10.356077 29375 ts_tablet_manager.cc:1950] T 99a3d9ae347845dfa9357010819ebc58 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.356386 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a108c0a8edf2412b8c8bf5decbc848b5 [id=8b8782763690454cbcd32eb9deecab63]
I20260617 20:17:10.356859 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_64b68bdc9cc04e1eb9ccc1ce83bf1035 [id=8c3f534be9cd4c8dacc5628028f0469e]
I20260617 20:17:10.357076 29383 tablet_bootstrap.cc:492] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.357208 29383 ts_tablet_manager.cc:1403] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260617 20:17:10.357362 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_7ad9b9d0a81a4059917a01a2dbea08ac [id=8c5c9c21499c4df9ba40b549f7911217]
I20260617 20:17:10.357842 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fcd950bebde64e8bafd0dae2ec3f7149 [id=8ca6a6b12902442fbff567cb44a4e03d]
I20260617 20:17:10.358278 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_99e2a4b9958548c38b48f359a9a50f00 [id=8cd039ca4c474501ae4578e0c815829b]
I20260617 20:17:10.358326 29383 raft_consensus.cc:359] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.358507 29383 raft_consensus.cc:385] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.358562 29383 raft_consensus.cc:740] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.358779 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fa31011cf98e493ab6cbc8a5a4a9e05a [id=8d0ad45f785648c4a5cf9a99fe251233]
I20260617 20:17:10.359215 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a2980fa5162245c081e94675f6a1fd9e [id=8d19f88dfaeb45c088856dfb46408809]
I20260617 20:17:10.359481 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1027) took 1671 ms. Trace:
I20260617 20:17:10.359594 29375 rpcz_store.cc:276] 0617 20:17:08.688438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.688835 (+ 397us) service_pool.cc:224] Handling call
0617 20:17:10.327683 (+1638848us) ts_tablet_manager.cc:1151] Deleting tablet 99a3d9ae347845dfa9357010819ebc58
0617 20:17:10.327698 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.339502 (+ 11804us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.351838 (+ 12336us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.359458 (+ 7620us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1638514}
I20260617 20:17:10.359951 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_33cfc094d5004faab8f883e15663eac5 [id=8e179900a6774ea3877a6e4347aa9fbe]
I20260617 20:17:10.360440 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e6d2efb704e44c7a8ea2697ad784c448 [id=8e71ae5eb0e44723af7609769009a976]
I20260617 20:17:10.360524 29383 consensus_queue.cc:260] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.360845 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_b6faf540da644f658eb715d3ffacd616 [id=8ebd35bd7b464cd489f6a15d0e70800e]
I20260617 20:17:10.361243 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a19dcdf8816f4caf9cf0d25a9aa3094d [id=8ef73a8dfb464790947b7bf43986d370]
I20260617 20:17:10.362083 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6f87ebb700cd4bcd8c9970ecae935a1a [id=908d6aab19ee442a9d9246694407969e]
I20260617 20:17:10.362462 29379 tablet_bootstrap.cc:492] T 839ae2f924494679a1389ad61be65259 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.362533 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_222acbc48ebc47a3bd27b7ab3260796a [id=90b3785ca15e4bec9d8135bae72e4998]
I20260617 20:17:10.362924 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6878f9bd771944d8be106fbf847f8baa [id=91adfc411b404fa097607e44707e211c]
I20260617 20:17:10.363318 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f81311971e2a4b36a7bf5ac219b8ab58 [id=9258b09978fe4fc7a60b8c621fadb5b0]
I20260617 20:17:10.363380 29375 tablet_replica.cc:333] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.363547 29375 raft_consensus.cc:2243] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.363692 29375 raft_consensus.cc:2272] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.363826 29379 tablet_bootstrap.cc:654] T 839ae2f924494679a1389ad61be65259 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.363946 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_706c0e9f917f49388f2da836758dcf8d [id=92baee89c27c4013a1a3fcc703ee1c23]
I20260617 20:17:10.364233 29375 ts_tablet_manager.cc:1916] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.364348 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_cb082a7a5a9a4bc2a3bbec80980daecd [id=92cf868f819444efa0bbc6b0bb233b8e]
I20260617 20:17:10.365005 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_7f36ddd489fc48f8b9ad5920baa0d8cb [id=93862a2d6edb4810bd079433287be030]
I20260617 20:17:10.366776 29383 ts_tablet_manager.cc:1434] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260617 20:17:10.367089 29383 tablet_bootstrap.cc:492] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.369010 29383 tablet_bootstrap.cc:654] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.370082 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1003) took 2915 ms. Trace:
I20260617 20:17:10.370173 29376 rpcz_store.cc:276] 0617 20:17:07.454454 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.454523 (+ 69us) service_pool.cc:224] Handling call
0617 20:17:10.369956 (+2915433us) ts_tablet_manager.cc:1151] Deleting tablet 05494b097ba0480e91d338cf6b50ddc8
0617 20:17:10.369964 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.370063 (+ 99us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2915222}
I20260617 20:17:10.370654 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1004) took 2916 ms. Trace:
I20260617 20:17:10.370736 29376 rpcz_store.cc:276] 0617 20:17:07.454578 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.454628 (+ 50us) service_pool.cc:224] Handling call
0617 20:17:10.370556 (+2915928us) ts_tablet_manager.cc:1151] Deleting tablet 5559b78afa0d4043971bb433500a21e4
0617 20:17:10.370565 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.370639 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2915752}
I20260617 20:17:10.370828 29378 tablet_bootstrap.cc:492] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.370956 29378 ts_tablet_manager.cc:1403] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260617 20:17:10.371119 29376 tablet_replica.cc:333] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.371310 29376 raft_consensus.cc:2243] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.371471 29376 raft_consensus.cc:2272] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.372169 29376 ts_tablet_manager.cc:1916] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.373744 29378 raft_consensus.cc:359] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.373912 29378 raft_consensus.cc:385] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.373965 29378 raft_consensus.cc:740] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.374439 31094 raft_consensus.cc:493] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.374548 31094 raft_consensus.cc:515] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.375090 31094 leader_election.cc:290] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.375433 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d0b861d48e4baf94387f4ff9d9f778" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:10.375615 28985 raft_consensus.cc:2468] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:10.375618 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d0b861d48e4baf94387f4ff9d9f778" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.376021 29197 leader_election.cc:304] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:17:10.376137 29198 leader_election.cc:343] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.376418 31094 raft_consensus.cc:2804] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:10.376477 31094 raft_consensus.cc:493] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:10.376533 31094 raft_consensus.cc:3060] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.376709 29375 ts_tablet_manager.cc:1929] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.377391 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_7b002b69063948828e757ca68368920c [id=9467d8b934c542718392056fc09c83ec]
I20260617 20:17:10.377431 29378 consensus_queue.cc:260] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.378015 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_c365798fc83d4befad2195f6b2ac7fca [id=94d11e5f866048c2bfc5b147e2da303f]
I20260617 20:17:10.376796 29375 log.cc:1199] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/cde88371f4454a4bb3053c6cd1afb801
I20260617 20:17:10.378427 29375 ts_tablet_manager.cc:1950] T cde88371f4454a4bb3053c6cd1afb801 P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.378456 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_49d176333f04466aa2554d7107e748f7 [id=954a691bcf674227964a49a2a73c91ef]
I20260617 20:17:10.379084 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_94e5e206c8b144c1816cbe3cc8338ffa [id=95ab812b28e14b0e9285f3e3bedf77fc]
I20260617 20:17:10.379117 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1026) took 1690 ms. Trace:
I20260617 20:17:10.379140 31094 raft_consensus.cc:515] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.379194 29375 rpcz_store.cc:276] 0617 20:17:08.688311 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.689190 (+ 879us) service_pool.cc:224] Handling call
0617 20:17:10.360809 (+1671619us) ts_tablet_manager.cc:1151] Deleting tablet cde88371f4454a4bb3053c6cd1afb801
0617 20:17:10.363340 (+ 2531us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.372774 (+ 9434us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.376664 (+ 3890us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.379099 (+ 2435us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1671435}
I20260617 20:17:10.379537 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e92a88d95d63479491b84cc8ead2dc24 [id=95cd9fa957494d3a99653c28159cf4b2]
I20260617 20:17:10.379769 31094 leader_election.cc:290] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.379940 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_50062ea6504540bf8c760f69ae119740 [id=97e6dec6db75462c87ea869c7c4fe9f8]
I20260617 20:17:10.380034 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d0b861d48e4baf94387f4ff9d9f778" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:10.380071 31065 raft_consensus.cc:493] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.380182 28985 raft_consensus.cc:3060] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.380208 31065 raft_consensus.cc:515] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.380399 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_657118477519461f9cc86b131622bc53 [id=9823363011cb4dd18410323e0f58b7b0]
I20260617 20:17:10.380826 31065 leader_election.cc:290] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.381439 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_4facc39fb37f4b1e88d70be7148b6582 [id=98fc6157ed4d4c618c7b9dba872d0ecb]
I20260617 20:17:10.381564 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00c2be45d82425bb70ae577fa3155fa" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.381939 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_d99a8e190b524b4086d8c7686477e583 [id=99881d02691245928c6b1ffb48a5b11b]
W20260617 20:17:10.382414 28925 leader_election.cc:343] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.382691 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_ac58b4b8071a43ea8e6c8839689b83dd [id=9a98514409064f4bbfd6c2d962b0d03c]
I20260617 20:17:10.382664 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d0b861d48e4baf94387f4ff9d9f778" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:10.382741 28985 raft_consensus.cc:2468] T 20d0b861d48e4baf94387f4ff9d9f778 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:10.383105 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_b1dbf26dd897427fb16163fa330af154 [id=9aadc9d3022d495c893d9293d28b2d78]
I20260617 20:17:10.383122 29197 leader_election.cc:304] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:17:10.383246 29198 leader_election.cc:343] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.383550 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00c2be45d82425bb70ae577fa3155fa" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.383952 29378 ts_tablet_manager.cc:1434] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
W20260617 20:17:10.384047 28925 leader_election.cc:343] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.384138 31094 raft_consensus.cc:2804] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:10.384156 28925 leader_election.cc:304] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:10.384249 31094 raft_consensus.cc:697] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:10.384478 31065 raft_consensus.cc:2749] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:10.384460 31094 consensus_queue.cc:237] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.385860 29375 tablet_replica.cc:333] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.386075 29375 raft_consensus.cc:2243] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.386226 29375 raft_consensus.cc:2272] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.387502 29375 ts_tablet_manager.cc:1916] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.390820 29378 tablet_bootstrap.cc:492] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.392632 29378 tablet_bootstrap.cc:654] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.395457 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_489218ed90a3450591befcb0c8064bc7 [id=9f014e9b411e496398d894dc77706d04]
I20260617 20:17:10.396623 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_d4ee09ae0a4649cdb22c66655ef3b4e6 [id=a0096dddd4124258915aa8acec69d3ff]
I20260617 20:17:10.397148 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6ff97e18c72d48f69a219285a41f4d5d [id=a06591d34596487a9191e5f06f2572da]
I20260617 20:17:10.398090 31065 raft_consensus.cc:493] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.398240 31065 raft_consensus.cc:515] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.398355 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6ff346c8167a49878fc3900007fa2904 [id=a3145e0f371647c98fb79739624d5258]
I20260617 20:17:10.399036 31065 leader_election.cc:290] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.399695 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceb3ae3c1a44442966ad37fbcbc658b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.399923 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceb3ae3c1a44442966ad37fbcbc658b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.400430 28925 leader_election.cc:343] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:10.400972 28925 leader_election.cc:343] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.401067 29376 ts_tablet_manager.cc:1929] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:10.401093 28925 leader_election.cc:304] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:10.401167 29376 log.cc:1199] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/08290c23fff5449481789b29d15c4781
I20260617 20:17:10.401515 29376 ts_tablet_manager.cc:1950] T 08290c23fff5449481789b29d15c4781 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.401599 31065 raft_consensus.cc:2749] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:10.402211 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1005) took 2947 ms. Trace:
I20260617 20:17:10.402299 29376 rpcz_store.cc:276] 0617 20:17:07.454988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.455029 (+ 41us) service_pool.cc:224] Handling call
0617 20:17:10.371078 (+2916049us) ts_tablet_manager.cc:1151] Deleting tablet 08290c23fff5449481789b29d15c4781
0617 20:17:10.371089 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.375926 (+ 4837us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.401016 (+ 25090us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.402195 (+ 1179us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2915907}
I20260617 20:17:10.402675 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1006) took 2947 ms. Trace:
I20260617 20:17:10.402756 29376 rpcz_store.cc:276] 0617 20:17:07.455337 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.466789 (+ 11452us) service_pool.cc:224] Handling call
0617 20:17:10.402569 (+2935780us) ts_tablet_manager.cc:1151] Deleting tablet 4b94d8148cf74a899c3d025f22541bd9
0617 20:17:10.402579 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.402661 (+ 82us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2935590}
I20260617 20:17:10.403062 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1007) took 2935 ms. Trace:
I20260617 20:17:10.403136 29376 rpcz_store.cc:276] 0617 20:17:07.467823 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.468655 (+ 832us) service_pool.cc:224] Handling call
0617 20:17:10.402968 (+2934313us) ts_tablet_manager.cc:1151] Deleting tablet 5559b78afa0d4043971bb433500a21e4
0617 20:17:10.402977 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.403049 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2934154}
I20260617 20:17:10.403436 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1022) took 2888 ms. Trace:
I20260617 20:17:10.403506 29376 rpcz_store.cc:276] 0617 20:17:07.514657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.515946 (+ 1289us) service_pool.cc:224] Handling call
0617 20:17:10.403325 (+2887379us) ts_tablet_manager.cc:1151] Deleting tablet 5f7534d57f1740af8b211d646488c90f
0617 20:17:10.403333 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.403420 (+ 87us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2887231}
I20260617 20:17:10.403801 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1017) took 2889 ms. Trace:
I20260617 20:17:10.403875 29376 rpcz_store.cc:276] 0617 20:17:07.514207 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.517195 (+ 2988us) service_pool.cc:224] Handling call
0617 20:17:10.403710 (+2886515us) ts_tablet_manager.cc:1151] Deleting tablet f13c7d600d334e549a5abfe0040b3296
0617 20:17:10.403721 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.403789 (+ 68us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2886308}
I20260617 20:17:10.404158 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1026) took 2828 ms. Trace:
I20260617 20:17:10.404228 29376 rpcz_store.cc:276] 0617 20:17:07.575269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.575368 (+ 99us) service_pool.cc:224] Handling call
0617 20:17:10.404087 (+2828719us) ts_tablet_manager.cc:1151] Deleting tablet ea2a8f46e8ac4f4aa39544a9fe40b1fe
0617 20:17:10.404094 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.404143 (+ 49us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2828544}
I20260617 20:17:10.404624 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1027) took 2829 ms. Trace:
I20260617 20:17:10.404706 29376 rpcz_store.cc:276] 0617 20:17:07.575376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.575582 (+ 206us) service_pool.cc:224] Handling call
0617 20:17:10.404502 (+2828920us) ts_tablet_manager.cc:1151] Deleting tablet cb95c048212948dfb00baafbd0c691d9
0617 20:17:10.404512 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.404608 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2828787}
I20260617 20:17:10.404981 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1025) took 2829 ms. Trace:
I20260617 20:17:10.404805 29375 ts_tablet_manager.cc:1929] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.405055 29376 rpcz_store.cc:276] 0617 20:17:07.575171 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.634204 (+ 59033us) service_pool.cc:224] Handling call
0617 20:17:10.404907 (+2770703us) ts_tablet_manager.cc:1151] Deleting tablet 58213ec0a9364a91a15fc0329f28605b
0617 20:17:10.404916 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.404968 (+ 52us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2770506}
I20260617 20:17:10.405328 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8b3f418465f142c784a9c20784e64477 [id=a3772e01cb314c7e88e85833d727617d]
I20260617 20:17:10.405401 29375 log.cc:1199] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/5df6af49cb484f59ad1f32235753e1db
I20260617 20:17:10.406208 29379 tablet_bootstrap.cc:492] T 839ae2f924494679a1389ad61be65259 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.406193 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_367156c006bc4543b26e6c3c6cb494a8 [id=a51c20a22e004ab984955c1231c87c20]
I20260617 20:17:10.406246 31065 raft_consensus.cc:493] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.406355 29379 ts_tablet_manager.cc:1403] T 839ae2f924494679a1389ad61be65259 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.002s
I20260617 20:17:10.406405 31065 raft_consensus.cc:515] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.407040 31065 leader_election.cc:290] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.407018 29379 raft_consensus.cc:359] T 839ae2f924494679a1389ad61be65259 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.407191 29379 raft_consensus.cc:385] T 839ae2f924494679a1389ad61be65259 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.407249 29379 raft_consensus.cc:740] T 839ae2f924494679a1389ad61be65259 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.407437 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8d8166172c80424da57e5f348c59a32c [id=a5d1a4cb417d4d7ba4d33324672c42a9]
I20260617 20:17:10.407475 29379 consensus_queue.cc:260] T 839ae2f924494679a1389ad61be65259 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.407950 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5949e832ca477e9effbe340f439e9c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.408268 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_332fe4fe72a24b07981c7f0150c254bd [id=a63c4334ac2d4313b19978ee3b4eeff8]
W20260617 20:17:10.408490 28925 leader_election.cc:343] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.408774 29383 tablet_bootstrap.cc:492] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.408782 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_618ad76b555e4e38a2a0f86b2a755535 [id=a675f66582984b53aaed7fef04f05745]
I20260617 20:17:10.409034 29383 ts_tablet_manager.cc:1403] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.042s user 0.006s sys 0.004s
I20260617 20:17:10.409382 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e449fc7e82964090996a0aa1e86bc42d [id=a7832fcf4d9c4b48a4670981229e49ac]
I20260617 20:17:10.411510 29383 raft_consensus.cc:359] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.411695 29383 raft_consensus.cc:385] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.411759 29383 raft_consensus.cc:740] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.412021 29383 consensus_queue.cc:260] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.412127 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_eeda1b309ce24b77967522bd8810c6d8 [id=aaa2d2913e5d438b901d6bd519eaf891]
I20260617 20:17:10.412989 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_18e868cdbb12445fb4ae545f0bb0fe4a [id=ab13b375103549b4b6a7d6f05f1d23f1]
W20260617 20:17:10.413802 29197 consensus_peers.cc:597] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3897179e7724fdeb87a979ae4ef2091. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.414299 29383 ts_tablet_manager.cc:1434] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 20:17:10.407948 29379 ts_tablet_manager.cc:1434] T 839ae2f924494679a1389ad61be65259 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:17:10.414342 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_52b729f02c4d498794d81ba38d3b5364 [id=ab1ca24d24264ec7a935227ddc98d5a3]
I20260617 20:17:10.414956 29379 tablet_bootstrap.cc:492] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.417129 29379 tablet_bootstrap.cc:654] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.417507 29375 ts_tablet_manager.cc:1950] T 5df6af49cb484f59ad1f32235753e1db P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.417692 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_b483cf7dec364fe98091142bf8d1a6a2 [id=ace0c10d79f74e72877f216ad9ac8415]
I20260617 20:17:10.418406 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5949e832ca477e9effbe340f439e9c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:10.419014 28925 leader_election.cc:343] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.419164 28925 leader_election.cc:304] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:10.419180 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_ff86bab000284059be724d40d2dde59b [id=ad35a5714c444343b6fad6d58dc87e04]
I20260617 20:17:10.419569 31065 raft_consensus.cc:2749] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:10.419890 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1028) took 1731 ms. Trace:
I20260617 20:17:10.420032 29375 rpcz_store.cc:276] 0617 20:17:08.688555 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.689683 (+ 1128us) service_pool.cc:224] Handling call
0617 20:17:10.385811 (+1696128us) ts_tablet_manager.cc:1151] Deleting tablet 5df6af49cb484f59ad1f32235753e1db
0617 20:17:10.385822 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.392833 (+ 7011us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.404692 (+ 11859us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.419872 (+ 15180us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1695980}
I20260617 20:17:10.420518 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1033) took 1629 ms. Trace:
I20260617 20:17:10.420599 29375 rpcz_store.cc:276] 0617 20:17:08.790782 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.794095 (+ 3313us) service_pool.cc:224] Handling call
0617 20:17:10.420410 (+1626315us) ts_tablet_manager.cc:1151] Deleting tablet e401eea0717d4cbb8319e4d4b1ada410
0617 20:17:10.420420 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.420501 (+ 81us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1625989}
I20260617 20:17:10.420878 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6997907f38d14a7aa42f81aae35fae5c [id=af163181d9af4bfbb34871d76855800a]
I20260617 20:17:10.421487 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_c77f056453554773a2687ccba8bb4056 [id=afcac1117c1a4e0e972ca9c008b1acfe]
I20260617 20:17:10.421802 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1034) took 1555 ms. Trace:
I20260617 20:17:10.421883 29375 rpcz_store.cc:276] 0617 20:17:08.865956 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.866010 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:10.421689 (+1555679us) ts_tablet_manager.cc:1151] Deleting tablet b61162160ec248b7aa6c73c399be1842
0617 20:17:10.421697 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.421786 (+ 89us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1555488}
I20260617 20:17:10.422362 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1036) took 1540 ms. Trace:
I20260617 20:17:10.422441 29375 rpcz_store.cc:276] 0617 20:17:08.882005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.882062 (+ 57us) service_pool.cc:224] Handling call
0617 20:17:10.422265 (+1540203us) ts_tablet_manager.cc:1151] Deleting tablet ee9afd550a6d4d2e9edd84e4b49186c4
0617 20:17:10.422273 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.422347 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1540026}
I20260617 20:17:10.422731 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1040) took 1434 ms. Trace:
I20260617 20:17:10.422812 29375 rpcz_store.cc:276] 0617 20:17:08.988362 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.988411 (+ 49us) service_pool.cc:224] Handling call
0617 20:17:10.422642 (+1434231us) ts_tablet_manager.cc:1151] Deleting tablet 93daae49ea3b4abd8623f64bffdd1f6a
0617 20:17:10.422651 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.422718 (+ 67us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1434063}
I20260617 20:17:10.423244 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1038) took 1467 ms. Trace:
I20260617 20:17:10.423322 29375 rpcz_store.cc:276] 0617 20:17:08.956062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.029770 (+ 73708us) service_pool.cc:224] Handling call
0617 20:17:10.423137 (+1393367us) ts_tablet_manager.cc:1151] Deleting tablet ab011d76c5ff4eae8e20fceab66513e1
0617 20:17:10.423146 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.423229 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1393158}
I20260617 20:17:10.423802 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1043) took 1336 ms. Trace:
I20260617 20:17:10.423875 29375 rpcz_store.cc:276] 0617 20:17:09.086854 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.087531 (+ 677us) service_pool.cc:224] Handling call
0617 20:17:10.423699 (+1336168us) ts_tablet_manager.cc:1151] Deleting tablet c9f2a320a1e14115bfe7e70a498a4f27
0617 20:17:10.423708 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.423788 (+ 80us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1335919}
I20260617 20:17:10.424198 29375 tablet_replica.cc:333] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.424378 29375 raft_consensus.cc:2243] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.424535 29375 raft_consensus.cc:2272] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.425088 29375 ts_tablet_manager.cc:1916] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.425545 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f847106ae8c04ab0ace089e9e123c60b [id=b057fddf626d4168909b6102afc67f7a]
I20260617 20:17:10.429085 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1029) took 2786 ms. Trace:
I20260617 20:17:10.429176 29376 rpcz_store.cc:276] 0617 20:17:07.642435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.644281 (+ 1846us) service_pool.cc:224] Handling call
0617 20:17:10.405269 (+2760988us) ts_tablet_manager.cc:1151] Deleting tablet fc0081e8742248a0ba088006a905ce85
0617 20:17:10.405278 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.429058 (+ 23780us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2760776}
I20260617 20:17:10.429572 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1030) took 2783 ms. Trace:
I20260617 20:17:10.429643 29376 rpcz_store.cc:276] 0617 20:17:07.646537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.646698 (+ 161us) service_pool.cc:224] Handling call
0617 20:17:10.429473 (+2782775us) ts_tablet_manager.cc:1151] Deleting tablet 29c65bb7c45e40a081de91d4c1c5cf56
0617 20:17:10.429481 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.429559 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2782573}
I20260617 20:17:10.429919 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1031) took 2741 ms. Trace:
I20260617 20:17:10.429972 29383 tablet_bootstrap.cc:492] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.432586 31172 consensus_queue.cc:1048] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:10.433060 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_56be7326decb482f8c632474abe1fba3 [id=b068fb664ccb41908426d488f2d1303c]
W20260617 20:17:10.433243 29197 consensus_peers.cc:597] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64538fdf51f94e8e985fec6202baac22. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.434437 29383 tablet_bootstrap.cc:654] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.429980 29376 rpcz_store.cc:276] 0617 20:17:07.688505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.688569 (+ 64us) service_pool.cc:224] Handling call
0617 20:17:10.429832 (+2741263us) ts_tablet_manager.cc:1151] Deleting tablet dbc2e5ecad0c41d5a24e0dad708b1a5c
0617 20:17:10.429840 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.429905 (+ 65us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2741069}
I20260617 20:17:10.436288 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1032) took 2747 ms. Trace:
I20260617 20:17:10.436383 29376 rpcz_store.cc:276] 0617 20:17:07.688620 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.688809 (+ 189us) service_pool.cc:224] Handling call
0617 20:17:10.436175 (+2747366us) ts_tablet_manager.cc:1151] Deleting tablet 841664f40c02423095bb9e63b85006a6
0617 20:17:10.436186 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.436272 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2747242}
I20260617 20:17:10.437754 29376 tablet_replica.cc:333] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:17:10.440402 29197 consensus_peers.cc:597] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f31bf7ed828f44b398f5bdac6b9b63e7. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.443552 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_d4f8ff9bb47c440b96251b7d063e73f6 [id=b267380ca82144ebbc909227070c204e]
I20260617 20:17:10.444989 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_9b1f182b3d5c42ac986fdc3989d04e85 [id=b27c2b2a2e0f40cf94cd8b21b78a6e1d]
I20260617 20:17:10.446472 29378 tablet_bootstrap.cc:492] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.446660 29378 ts_tablet_manager.cc:1403] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260617 20:17:10.447576 29378 raft_consensus.cc:359] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.447809 29378 raft_consensus.cc:385] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.447896 29378 raft_consensus.cc:740] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.448210 29378 consensus_queue.cc:260] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.448565 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f47ba95e589c47759a3ca685e8e9a067 [id=b41299e9f3a84c2e91c6a082d8bba55d]
I20260617 20:17:10.449259 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a]
I20260617 20:17:10.450222 29379 tablet_bootstrap.cc:492] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.450368 29379 ts_tablet_manager.cc:1403] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.005s
I20260617 20:17:10.451395 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_5a7af34a137e4cd5bc14d4166ea07903 [id=b4ce945ce47043d68218ebf69c580d3f]
I20260617 20:17:10.452144 29378 ts_tablet_manager.cc:1434] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260617 20:17:10.452458 29378 tablet_bootstrap.cc:492] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.454063 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c]
I20260617 20:17:10.454167 29378 tablet_bootstrap.cc:654] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.455869 29379 raft_consensus.cc:359] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.456063 29379 raft_consensus.cc:385] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.456117 29379 raft_consensus.cc:740] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.456338 29379 consensus_queue.cc:260] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.456691 29376 raft_consensus.cc:2243] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.456827 29377 ts_tablet_manager.cc:1929] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:17:10.456982 29377 log.cc:1199] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/c3014c93d6804f3896f452f041cbedc9
I20260617 20:17:10.457120 29376 pending_rounds.cc:70] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:17:10.457177 29376 pending_rounds.cc:77] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955551527321600 op_type: NO_OP noop_request { }
I20260617 20:17:10.457278 29376 raft_consensus.cc:2889] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:10.457408 29376 raft_consensus.cc:2272] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.457427 29377 ts_tablet_manager.cc:1950] T c3014c93d6804f3896f452f041cbedc9 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
W20260617 20:17:10.457703 31184 consensus_queue.cc:1175] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260617 20:17:10.458210 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 958) took 4514 ms. Trace:
I20260617 20:17:10.458321 29377 rpcz_store.cc:276] 0617 20:17:05.944139 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:05.945250 (+ 1111us) service_pool.cc:224] Handling call
0617 20:17:10.264764 (+4319514us) ts_tablet_manager.cc:1151] Deleting tablet c3014c93d6804f3896f452f041cbedc9
0617 20:17:10.264775 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.431884 (+167109us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.456769 (+ 24885us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.458155 (+ 1386us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4319269}
I20260617 20:17:10.458864 29376 ts_tablet_manager.cc:1916] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.462108 29375 ts_tablet_manager.cc:1929] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.462224 29375 log.cc:1199] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/14a5e5917a414c99b25ea2efeab4063d
I20260617 20:17:10.464277 29379 ts_tablet_manager.cc:1434] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
W20260617 20:17:10.465134 29062 consensus_peers.cc:597] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f823290351d542179b8bcc683d7acf6a. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.465481 29379 tablet_bootstrap.cc:492] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.465423 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0d8a074c057147a5a47d1cf13ada48d1 [id=ba513fbd2a834f0994b528a1927fde6b]
W20260617 20:17:10.466187 29063 consensus_peers.cc:597] T f823290351d542179b8bcc683d7acf6a P 6d4ce30e1fce4591b64c398747f8d37a -> Peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Couldn't send request to peer a8c0aea0206f44d683ed3b6b18c719f6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.466230 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_5bb2dea5397f4dee834759955006f657 [id=bbd9142963fd450583aef1d8d715e35c]
I20260617 20:17:10.466667 29383 tablet_bootstrap.cc:492] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.466701 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8a887192caa742b9a34884b64f306fee [id=bc5bc55a1e904cefa6910c6519f0d8a1]
I20260617 20:17:10.466818 29383 ts_tablet_manager.cc:1403] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.037s user 0.007s sys 0.003s
I20260617 20:17:10.467618 29383 raft_consensus.cc:359] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.467798 29383 raft_consensus.cc:385] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.467924 29383 raft_consensus.cc:740] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.468144 29383 consensus_queue.cc:260] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.468392 30852 consensus_queue.cc:1048] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:10.469513 29383 ts_tablet_manager.cc:1434] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:10.469789 29383 tablet_bootstrap.cc:492] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.471619 29383 tablet_bootstrap.cc:654] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.473845 29379 tablet_bootstrap.cc:654] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.474838 29375 ts_tablet_manager.cc:1950] T 14a5e5917a414c99b25ea2efeab4063d P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
I20260617 20:17:10.475684 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1045) took 1381 ms. Trace:
I20260617 20:17:10.475777 29375 rpcz_store.cc:276] 0617 20:17:09.093923 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.093995 (+ 72us) service_pool.cc:224] Handling call
0617 20:17:10.424161 (+1330166us) ts_tablet_manager.cc:1151] Deleting tablet 14a5e5917a414c99b25ea2efeab4063d
0617 20:17:10.424169 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.451807 (+ 27638us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.462050 (+ 10243us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.475663 (+ 13613us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1329986}
I20260617 20:17:10.476136 29375 tablet_replica.cc:333] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a: stopping tablet replica
I20260617 20:17:10.476325 29375 raft_consensus.cc:2243] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.476475 29375 raft_consensus.cc:2272] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.476598 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_724f440ee4704ab9b73c964377608058 [id=bcc2e0ae5e6b4ab9b36f37350872c6f8]
I20260617 20:17:10.477022 29375 ts_tablet_manager.cc:1916] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.477685 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a85f39b0bb4a487098a661b4eca8de9f [id=bd35b542e6d84cf3bf32977390914403]
I20260617 20:17:10.478591 29378 tablet_bootstrap.cc:492] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.478801 29378 ts_tablet_manager.cc:1403] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20260617 20:17:10.480060 29378 raft_consensus.cc:359] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.480270 29378 raft_consensus.cc:385] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.480372 29378 raft_consensus.cc:740] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.480639 29378 consensus_queue.cc:260] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.481249 29378 ts_tablet_manager.cc:1434] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:10.481593 29378 tablet_bootstrap.cc:492] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:17:10.481602 29197 consensus_peers.cc:597] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5df6af49cb484f59ad1f32235753e1db. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.481954 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0a0f0ffea6394fe296afc92cf1a1ef9e [id=bd87cc18b72d4802a143af7e8786dd97]
I20260617 20:17:10.483189 29376 ts_tablet_manager.cc:1929] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.483386 29379 tablet_bootstrap.cc:492] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.483518 29379 ts_tablet_manager.cc:1403] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260617 20:17:10.484005 29378 tablet_bootstrap.cc:654] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.484251 29379 raft_consensus.cc:359] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.484432 29379 raft_consensus.cc:385] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.484491 29379 raft_consensus.cc:740] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.484702 29379 consensus_queue.cc:260] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.485126 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_2831ca4ebfea4801b37ec6e9d3c0dca2 [id=beac08fbe27b40de8af16d42634ed76f]
I20260617 20:17:10.489430 29379 ts_tablet_manager.cc:1434] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:17:10.489717 29379 tablet_bootstrap.cc:492] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.490258 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_1be0a0d75ff04898884097a3fee41047 [id=bebb09bca83942438374ea8a0a0b978a]
I20260617 20:17:10.491403 29379 tablet_bootstrap.cc:654] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:10.493883 28924 connection.cc:573] server connection from 127.0.0.1:55834 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260617 20:17:10.494244 29064 connection.cc:573] server connection from 127.0.0.1:43332 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260617 20:17:10.493793 29197 connection.cc:573] server connection from 127.0.0.1:41028 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 20:17:10.495994 29376 log.cc:1199] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/f823290351d542179b8bcc683d7acf6a
I20260617 20:17:10.494376 29383 tablet_bootstrap.cc:492] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.496220 29383 ts_tablet_manager.cc:1403] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.001s
I20260617 20:17:10.496392 29376 ts_tablet_manager.cc:1950] T f823290351d542179b8bcc683d7acf6a P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
W20260617 20:17:10.496896 29527 connection.cc:573] client connection to 127.27.245.254:37301 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260617 20:17:10.497123 29527 leader_election.cc:336] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590225c8ea36448093b77385d238a34a (127.27.245.254:37301): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 20:17:10.497148 29383 raft_consensus.cc:359] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.497287 29383 raft_consensus.cc:385] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.497363 29383 raft_consensus.cc:740] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.497413 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb]
W20260617 20:17:10.497495 29527 leader_election.cc:336] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590225c8ea36448093b77385d238a34a (127.27.245.254:37301): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 20:17:10.497547 29383 consensus_queue.cc:260] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:10.498373 29318 connection.cc:573] client connection to 127.27.245.254:37301 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 20:17:10.498656 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_26c8b16b5bf24bda8bf9851b87f0bde0 [id=bf02335abe5b47bb8251b52c6dc5ab81]
I20260617 20:17:10.499089 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_2b5d45aad044441c84c126666d3c05d5 [id=bf23e5dfb99040f2987306a3d260e92a]
I20260617 20:17:10.499491 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a856b87de7f949c4b0afa2cfc3a8489e [id=bf33219f4b4f449f8fc11bcea9b04f4f]
I20260617 20:17:10.499902 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_1e06b58a614b4e83af282cace8749f39 [id=bf54a099a679476485430b505a037ea3]
W20260617 20:17:10.500012 29318 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.27.245.254:37301)
I20260617 20:17:10.500312 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e1570318e62a4455991ccbddfea26e31 [id=bf708541e8b248beb550ef49994ed8d0]
I20260617 20:17:10.500705 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_b87313ed947a489785485464059c33f9 [id=bfa8263671b84608b42d9967fc75076a]
W20260617 20:17:10.500773 29318 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.27.245.254:37301)
I20260617 20:17:10.501099 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_500d59e85d2c4e8187ce78b975eacfa3 [id=bfdb2fa2c6914b33ac9d1aa90be0d8b3]
W20260617 20:17:10.501641 29318 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.27.245.254:37301)
I20260617 20:17:10.501845 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886]
I20260617 20:17:10.501860 29383 ts_tablet_manager.cc:1434] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20260617 20:17:10.502379 29318 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.27.245.254:37301)
I20260617 20:17:10.502471 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_95eb640bc73740e7b1c9475c7f7bcbe4 [id=c1092a9a835f4dc79f36cae5bb02e374]
I20260617 20:17:10.502921 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_d6c8360190ec4dfeb18e990430f716cd [id=c11c505593f1442e8811e75167217fb9]
I20260617 20:17:10.503347 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_d4d37c5379c9419c8b12c966da753137 [id=c1634e2c68bd4432a3d7552f7ae02e07]
I20260617 20:17:10.504038 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_32efdf31b50248e5ada2c2b690ff5aba [id=c275e777ecd64ecebf32e9cd34239a86]
I20260617 20:17:10.504501 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3f6418bb5b1044818dab9ca960037e3b [id=c27ec2a6a229457594d26bae2222fec1]
I20260617 20:17:10.506062 29378 tablet_bootstrap.cc:492] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.506497 29378 ts_tablet_manager.cc:1403] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.001s
I20260617 20:17:10.506923 29375 ts_tablet_manager.cc:1929] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.507061 29375 log.cc:1199] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-1/wal/wals/eb408723f7a346c3b5ea13cad237b44e
I20260617 20:17:10.507917 29378 raft_consensus.cc:359] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.508526 31094 raft_consensus.cc:493] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.508662 31094 raft_consensus.cc:515] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.508957 29378 raft_consensus.cc:385] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.509188 29378 raft_consensus.cc:740] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.509264 31094 leader_election.cc:290] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.509707 29378 consensus_queue.cc:260] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.509859 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd89c8452c444af99d8bce0c7cbf8ce1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.510052 29121 raft_consensus.cc:2468] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:10.510453 29198 leader_election.cc:304] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:17:10.510592 29197 leader_election.cc:343] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: dd89c8452c444af99d8bce0c7cbf8ce1
I20260617 20:17:10.510705 31094 raft_consensus.cc:2804] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:10.510800 31094 raft_consensus.cc:493] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:10.510881 31094 raft_consensus.cc:3060] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.511075 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_ab1320db24234450830394363e3d77d8 [id=c3b8272c0a664a97878487a63f309f6f]
I20260617 20:17:10.513082 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_5c6561f5414e4882a5dda6848359c27b [id=c4224ca184794bd2ae291ed645b924d0]
I20260617 20:17:10.513603 31094 raft_consensus.cc:515] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.515261 31094 leader_election.cc:290] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.515322 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd89c8452c444af99d8bce0c7cbf8ce1" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:10.515517 29121 raft_consensus.cc:3060] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:10.518251 29197 leader_election.cc:343] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: dd89c8452c444af99d8bce0c7cbf8ce1
W20260617 20:17:10.518803 29197 consensus_peers.cc:597] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b2797384f7845969ee9744b444f1acc. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.519178 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1037) took 2830 ms. Trace:
I20260617 20:17:10.515728 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 976) took 4082 ms. Trace:
I20260617 20:17:10.519255 29376 rpcz_store.cc:276] 0617 20:17:07.689079 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.689269 (+ 190us) service_pool.cc:224] Handling call
0617 20:17:10.437703 (+2748434us) ts_tablet_manager.cc:1151] Deleting tablet f823290351d542179b8bcc683d7acf6a
0617 20:17:10.437715 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.457041 (+ 19326us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x6160000c9454. stack: 00007f5f5963e496 00007f5f5963e250 00007f5f586693ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f5f656e47e0 00007f5f66a30933 00007f5f695f3ae7 00007f5f69626bb4 00007f5f696075d0 00007f5f6960735d 0000000000aa681c 00007f5f596849ff 00007f5f59687d1b 00007f5f59687b98
0617 20:17:10.461795 (+ 4754us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.483134 (+ 21339us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.519161 (+ 36027us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42942848,"tablet-delete.queue_time_us":2748251}
I20260617 20:17:10.519412 29377 rpcz_store.cc:276] 0617 20:17:06.433033 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.443845 (+ 10812us) service_pool.cc:224] Handling call
0617 20:17:10.515548 (+4071703us) ts_tablet_manager.cc:1151] Deleting tablet 4281bbef1efb4986a23c6fb24e62e49c
0617 20:17:10.515560 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.515666 (+ 106us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4071480}
W20260617 20:17:10.519544 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1037) could send its response
I20260617 20:17:10.519670 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1033) took 2830 ms. Trace:
W20260617 20:17:10.519662 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 976) could send its response
I20260617 20:17:10.519731 29376 rpcz_store.cc:276] 0617 20:17:07.688712 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.689325 (+ 613us) service_pool.cc:224] Handling call
0617 20:17:10.519551 (+2830226us) ts_tablet_manager.cc:1151] Deleting tablet b7a26cb68df548f9b716c72e36b11647
0617 20:17:10.519561 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.519653 (+ 92us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2830070}
I20260617 20:17:10.519973 29376 tablet_replica.cc:333] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.520062 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 977) took 4086 ms. Trace:
I20260617 20:17:10.520164 29376 raft_consensus.cc:2243] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.520135 29377 rpcz_store.cc:276] 0617 20:17:06.433153 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.444325 (+ 11172us) service_pool.cc:224] Handling call
0617 20:17:10.519899 (+4075574us) ts_tablet_manager.cc:1151] Deleting tablet edf884e801d74362ad05435a76efcc1f
0617 20:17:10.519909 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.520005 (+ 96us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4075399}
W20260617 20:17:10.520357 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 977) could send its response
I20260617 20:17:10.520418 29376 pending_rounds.cc:70] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:17:10.520473 29376 pending_rounds.cc:77] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955551389171712 op_type: NO_OP noop_request { }
I20260617 20:17:10.520550 29376 raft_consensus.cc:2889] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:10.520617 29376 raft_consensus.cc:2272] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:10.521220 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1033) could send its response
I20260617 20:17:10.521845 29376 ts_tablet_manager.cc:1916] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.518334 29121 raft_consensus.cc:2468] T dd89c8452c444af99d8bce0c7cbf8ce1 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:10.525671 29378 ts_tablet_manager.cc:1434] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260617 20:17:10.525835 29198 leader_election.cc:304] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:10.526269 31094 raft_consensus.cc:2804] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:10.526516 31094 raft_consensus.cc:697] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:10.526786 31094 consensus_queue.cc:237] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.527864 29376 ts_tablet_manager.cc:1929] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.527962 29376 log.cc:1199] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/99a3d9ae347845dfa9357010819ebc58
I20260617 20:17:10.528316 29376 ts_tablet_manager.cc:1950] T 99a3d9ae347845dfa9357010819ebc58 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.528709 29378 tablet_bootstrap.cc:492] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.529064 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1038) took 2839 ms. Trace:
I20260617 20:17:10.529145 29376 rpcz_store.cc:276] 0617 20:17:07.689156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.689491 (+ 335us) service_pool.cc:224] Handling call
0617 20:17:10.519934 (+2830443us) ts_tablet_manager.cc:1151] Deleting tablet 99a3d9ae347845dfa9357010819ebc58
0617 20:17:10.519941 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.524682 (+ 4741us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.527817 (+ 3135us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.529046 (+ 1229us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2830317}
I20260617 20:17:10.524173 29375 ts_tablet_manager.cc:1950] T eb408723f7a346c3b5ea13cad237b44e P 6d4ce30e1fce4591b64c398747f8d37a: Deleting consensus metadata
W20260617 20:17:10.529385 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1038) could send its response
I20260617 20:17:10.529732 29383 tablet_bootstrap.cc:492] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.530234 29375 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1044) took 1436 ms. Trace:
I20260617 20:17:10.530409 29378 tablet_bootstrap.cc:654] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.530434 29375 rpcz_store.cc:276] 0617 20:17:09.093753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.095561 (+ 1808us) service_pool.cc:224] Handling call
0617 20:17:10.476094 (+1380533us) ts_tablet_manager.cc:1151] Deleting tablet eb408723f7a346c3b5ea13cad237b44e
0617 20:17:10.476104 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.494829 (+ 18725us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.506860 (+ 12031us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.530212 (+ 23352us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1380372}
I20260617 20:17:10.530792 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 978) took 4082 ms. Trace:
W20260617 20:17:10.530992 29064 connection.cc:466] server connection from 127.0.0.1:43332 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43332 (request call id 1044) could send its response
I20260617 20:17:10.531235 29383 tablet_bootstrap.cc:654] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.531276 29377 rpcz_store.cc:276] 0617 20:17:06.448644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.448699 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:10.530548 (+4081849us) ts_tablet_manager.cc:1151] Deleting tablet 266ff05cc91b43dfbb30ce9e961eeb54
0617 20:17:10.530560 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.530667 (+ 107us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4081585}
I20260617 20:17:10.532476 29379 tablet_bootstrap.cc:492] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.532666 29379 ts_tablet_manager.cc:1403] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.000s
I20260617 20:17:10.533622 29379 raft_consensus.cc:359] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.533857 29379 raft_consensus.cc:385] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.533950 29379 raft_consensus.cc:740] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.534260 29379 consensus_queue.cc:260] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.536904 29379 ts_tablet_manager.cc:1434] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260617 20:17:10.537256 29379 tablet_bootstrap.cc:492] T b6ba8b7d18af44b58800e588279e2e0b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.537936 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_24dde6dc70d64bee8c127475dac477af [id=c6e16b1e13ec49cd8e2660e0e336abeb]
I20260617 20:17:10.538312 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1035) took 2849 ms. Trace:
W20260617 20:17:10.538332 28926 connection.cc:573] client connection to 127.27.245.254:37301 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260617 20:17:10.538559 29064 connection.cc:573] client connection to 127.27.245.254:37301 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 20:17:10.539052 29379 tablet_bootstrap.cc:654] T b6ba8b7d18af44b58800e588279e2e0b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:10.539281 30313 connection.cc:573] client connection to 127.27.245.254:37301 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260617 20:17:10.539521 30313 leader_election.cc:336] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590225c8ea36448093b77385d238a34a (127.27.245.254:37301): Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 20:17:10.539665 30313 leader_election.cc:304] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87437cd320a4470fa0dedd43aa7ea3eb; no voters: 590225c8ea36448093b77385d238a34a, f5ea3f9265d84474ab3bced8dd5aecc5
I20260617 20:17:10.540218 31106 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:10.540984 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_9e2110e4c0414947ac06773cfa319bd9 [id=c7a0a1cdc83547ea8838bc07c976f705]
W20260617 20:17:10.538794 29199 connection.cc:573] client connection to 127.27.245.254:37301 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260617 20:17:10.541353 29376 rpcz_store.cc:276] 0617 20:17:07.688904 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.689507 (+ 603us) service_pool.cc:224] Handling call
0617 20:17:10.538167 (+2848660us) ts_tablet_manager.cc:1151] Deleting tablet 75e3e15cade7403fa70096516d83c3c0
0617 20:17:10.538178 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.538290 (+ 112us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2848432}
W20260617 20:17:10.541651 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1035) could send its response
I20260617 20:17:10.541926 29376 tablet_replica.cc:333] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
W20260617 20:17:10.541211 31191 negotiation.cc:336] Failed RPC negotiation. Trace:
0617 20:17:10.498412 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.27.245.254:37301 (local address 127.0.0.1:58800)
0617 20:17:10.514000 (+ 15588us) negotiation.cc:107] Waiting for socket to connect
0617 20:17:10.514023 (+ 23us) client_negotiation.cc:175] Beginning negotiation
0617 20:17:10.514181 (+ 158us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
0617 20:17:10.540855 (+ 26674us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.245.254:37301: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":15439,"thread_start_us":15855,"threads_started":1}
I20260617 20:17:10.543744 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8acde758a415485fa7e9aaa929121769 [id=c7b9ada447dd4b2cbebdb0c0e4790705]
I20260617 20:17:10.542151 29376 raft_consensus.cc:2243] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.544211 29376 raft_consensus.cc:2272] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.544834 29376 ts_tablet_manager.cc:1916] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.546253 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_874c5733c8264dda8206652cd4019646 [id=c98f3dd0bba745a8949f2742d8917003]
W20260617 20:17:10.547974 31192 negotiation.cc:336] Failed RPC negotiation. Trace:
0617 20:17:10.505028 (+ 0us) reactor.cc:730] Submitting negotiation task for client connection to 127.27.245.254:37301 (local address 127.0.0.1:58810)
0617 20:17:10.545533 (+ 40505us) negotiation.cc:107] Waiting for socket to connect
0617 20:17:10.545790 (+ 257us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.27.245.254:37301: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":40128,"threads_started":1}
W20260617 20:17:10.550746 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 978) could send its response
I20260617 20:17:10.550822 29379 tablet_bootstrap.cc:492] T b6ba8b7d18af44b58800e588279e2e0b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.550947 29379 ts_tablet_manager.cc:1403] T b6ba8b7d18af44b58800e588279e2e0b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.004s
I20260617 20:17:10.551239 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 979) took 4101 ms. Trace:
I20260617 20:17:10.551324 29377 rpcz_store.cc:276] 0617 20:17:06.449370 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.449421 (+ 51us) service_pool.cc:224] Handling call
0617 20:17:10.551047 (+4101626us) ts_tablet_manager.cc:1151] Deleting tablet cdd24a60a91b43cd9e31ecca3d21ec60
0617 20:17:10.551059 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.551182 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4101408}
W20260617 20:17:10.551563 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 979) could send its response
I20260617 20:17:10.551883 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 990) took 3744 ms. Trace:
I20260617 20:17:10.552021 29379 raft_consensus.cc:359] T b6ba8b7d18af44b58800e588279e2e0b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.552218 29379 raft_consensus.cc:385] T b6ba8b7d18af44b58800e588279e2e0b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.552100 29377 rpcz_store.cc:276] 0617 20:17:06.807245 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.809627 (+ 2382us) service_pool.cc:224] Handling call
0617 20:17:10.551732 (+3742105us) ts_tablet_manager.cc:1151] Deleting tablet b1064bce50b64aa9afe8bb249545c5ab
0617 20:17:10.551749 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.551824 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3741927}
I20260617 20:17:10.552270 29379 raft_consensus.cc:740] T b6ba8b7d18af44b58800e588279e2e0b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
W20260617 20:17:10.552354 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 990) could send its response
I20260617 20:17:10.552386 29376 ts_tablet_manager.cc:1929] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.552479 29376 log.cc:1199] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/5df6af49cb484f59ad1f32235753e1db
I20260617 20:17:10.552546 29379 consensus_queue.cc:260] T b6ba8b7d18af44b58800e588279e2e0b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.552700 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 991) took 3741 ms. Trace:
I20260617 20:17:10.552827 29376 ts_tablet_manager.cc:1950] T 5df6af49cb484f59ad1f32235753e1db P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.552829 29377 rpcz_store.cc:276] 0617 20:17:06.810773 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.811460 (+ 687us) service_pool.cc:224] Handling call
0617 20:17:10.552549 (+3741089us) ts_tablet_manager.cc:1151] Deleting tablet 5ad81ce1ab114fc395f8efb930f4d949
0617 20:17:10.552561 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.552647 (+ 86us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3740930}
W20260617 20:17:10.553081 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 991) could send its response
W20260617 20:17:10.546772 29527 consensus_peers.cc:597] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 -> Peer 590225c8ea36448093b77385d238a34a (127.27.245.254:37301): Couldn't send request to peer 590225c8ea36448093b77385d238a34a. Status: Network error: Client connection negotiation failed: client connection to 127.27.245.254:37301: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.554692 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3198a4e3806449bc8871764c181d5ebf [id=cb568e8af2da4807b99a6d07c57afca9]
I20260617 20:17:10.555160 29378 tablet_bootstrap.cc:492] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.555337 29378 ts_tablet_manager.cc:1403] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260617 20:17:10.556186 29379 ts_tablet_manager.cc:1434] T b6ba8b7d18af44b58800e588279e2e0b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260617 20:17:10.556118 29378 raft_consensus.cc:359] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.556317 29378 raft_consensus.cc:385] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.556414 29378 raft_consensus.cc:740] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.556494 29379 tablet_bootstrap.cc:492] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.556828 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fae70178b45747a29dfd1be32d78cff6 [id=cbe52ba840694bfea51b5f0e1fe56cfb]
I20260617 20:17:10.558375 31065 raft_consensus.cc:493] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.558555 29379 tablet_bootstrap.cc:654] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.558552 31065 raft_consensus.cc:515] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.558454 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_b16811c4e5c6448194a1adf7df3d96a2 [id=cc3218b558cf46c8ad88fb1ec7fa82b5]
I20260617 20:17:10.559314 31065 leader_election.cc:290] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.559741 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a176d1f3b0446984af141e02bac329" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.559935 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a176d1f3b0446984af141e02bac329" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:10.560312 28925 leader_election.cc:343] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:10.560704 28925 leader_election.cc:343] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.560838 28925 leader_election.cc:304] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:10.561242 31065 raft_consensus.cc:2749] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:10.562397 29378 consensus_queue.cc:260] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.559347 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_9cbb96ec056a4e329cf862c7bd244585 [id=cc73212423a64c5eab12af219ad5af5c]
I20260617 20:17:10.563880 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_20dcfb508ecf4cacbaca2e229fe563d7 [id=ccb19fa7c76b445f9801722edcd4dfb0]
I20260617 20:17:10.566166 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0ea7c7718805448cbcc37cfd8539684e [id=cd4abe077ee04673bad87834b3af273b]
I20260617 20:17:10.566915 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_02d45e2cbb6a42f893c6227bbaa2a9f4 [id=cdb2e24324f546e5b21edbf9e6214aed]
I20260617 20:17:10.568625 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_4a1320838a1a477cabc0d69fbe93cc5e [id=cdfdc41eb46d496bbecd4bd651041691]
I20260617 20:17:10.569689 29378 ts_tablet_manager.cc:1434] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20260617 20:17:10.575117 29122 raft_consensus.cc:3060] T 839ae2f924494679a1389ad61be65259 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.577706 29378 tablet_bootstrap.cc:492] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.579208 31115 consensus_queue.cc:1048] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:10.579591 29378 tablet_bootstrap.cc:654] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.585968 29379 tablet_bootstrap.cc:492] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.586040 31065 raft_consensus.cc:493] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.586099 29379 ts_tablet_manager.cc:1403] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20260617 20:17:10.586220 31065 raft_consensus.cc:515] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.586756 29379 raft_consensus.cc:359] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.586892 29379 raft_consensus.cc:385] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.586932 29379 raft_consensus.cc:740] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.586941 31065 leader_election.cc:290] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.587232 29379 consensus_queue.cc:260] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.587682 29379 ts_tablet_manager.cc:1434] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:10.587754 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19d34e3bbe3453ca6de6ed7e62f7af4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.587944 29379 tablet_bootstrap.cc:492] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:17:10.588294 28925 leader_election.cc:343] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.589371 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19d34e3bbe3453ca6de6ed7e62f7af4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.589706 31115 consensus_queue.cc:1048] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:10.590058 28925 leader_election.cc:343] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.590173 28925 leader_election.cc:304] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:10.590698 29379 tablet_bootstrap.cc:654] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.591006 30967 raft_consensus.cc:2749] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:10.592631 31065 raft_consensus.cc:493] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.592801 31065 raft_consensus.cc:515] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.593554 31065 leader_election.cc:290] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.594302 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a56191018d04a2881ee3e1a243c1a19" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.594703 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a56191018d04a2881ee3e1a243c1a19" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:10.595309 28925 leader_election.cc:343] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:10.595561 28925 leader_election.cc:343] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.595687 28925 leader_election.cc:304] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:10.596194 31065 raft_consensus.cc:2749] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:10.601672 31065 raft_consensus.cc:493] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.601949 31065 raft_consensus.cc:515] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.602795 31065 leader_election.cc:290] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.603580 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c65bb7c45e40a081de91d4c1c5cf56" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.603765 29262 raft_consensus.cc:2468] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:10.604171 29378 tablet_bootstrap.cc:492] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.604310 29378 ts_tablet_manager.cc:1403] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.007s
W20260617 20:17:10.604573 28925 leader_election.cc:343] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 29c65bb7c45e40a081de91d4c1c5cf56
I20260617 20:17:10.604853 28925 leader_election.cc:304] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:10.605165 29378 raft_consensus.cc:359] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.605376 31065 raft_consensus.cc:2804] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:10.605376 29378 raft_consensus.cc:385] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.605527 31065 raft_consensus.cc:493] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:10.605566 29378 raft_consensus.cc:740] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.605661 31065 raft_consensus.cc:3060] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.605841 29378 consensus_queue.cc:260] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.607076 29379 tablet_bootstrap.cc:492] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.607225 29379 ts_tablet_manager.cc:1403] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.004s
I20260617 20:17:10.605134 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1036) took 2916 ms. Trace:
I20260617 20:17:10.607493 29376 rpcz_store.cc:276] 0617 20:17:07.688985 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.689758 (+ 773us) service_pool.cc:224] Handling call
0617 20:17:10.541884 (+2852126us) ts_tablet_manager.cc:1151] Deleting tablet 5df6af49cb484f59ad1f32235753e1db
0617 20:17:10.541892 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.549395 (+ 7503us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.552328 (+ 2933us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.605113 (+ 52785us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2852000}
W20260617 20:17:10.607745 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1036) could send its response
I20260617 20:17:10.607961 29379 raft_consensus.cc:359] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.608126 29379 raft_consensus.cc:385] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.608182 29379 raft_consensus.cc:740] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.608371 29379 consensus_queue.cc:260] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.608855 29379 ts_tablet_manager.cc:1434] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:17:10.609131 29379 tablet_bootstrap.cc:492] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.608501 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_db3cad8ad5504503992f09f4cbfa7246 [id=ce09aecc32044c59a85905f3c8d82e42]
I20260617 20:17:10.609647 29376 tablet_replica.cc:333] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.610378 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e7b17c557187475d91de751c47b28644 [id=ce30ff8f9aa148879cb0f930fffc1f51]
I20260617 20:17:10.611171 29376 raft_consensus.cc:2243] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.611225 31065 raft_consensus.cc:515] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.612378 29376 raft_consensus.cc:2272] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:10.612811 28925 leader_election.cc:343] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 29c65bb7c45e40a081de91d4c1c5cf56
I20260617 20:17:10.613021 31065 leader_election.cc:290] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.613421 29378 ts_tablet_manager.cc:1434] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.000s sys 0.003s
I20260617 20:17:10.612819 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c65bb7c45e40a081de91d4c1c5cf56" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:10.613552 29262 raft_consensus.cc:3060] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.614029 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 992) took 3794 ms. Trace:
I20260617 20:17:10.614118 29377 rpcz_store.cc:276] 0617 20:17:06.820008 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.820110 (+ 102us) service_pool.cc:224] Handling call
0617 20:17:10.607986 (+3787876us) ts_tablet_manager.cc:1151] Deleting tablet 1bf654918dc148cdbca0e420e337478b
0617 20:17:10.608000 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.613973 (+ 5973us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3769522}
I20260617 20:17:10.614801 29378 tablet_bootstrap.cc:492] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:17:10.615044 29197 consensus_peers.cc:597] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b6f05ae7d624efba571d059ce2f1c91. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:10.616398 29262 raft_consensus.cc:2468] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:10.617072 28925 leader_election.cc:304] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:10.617566 31065 raft_consensus.cc:2804] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
W20260617 20:17:10.617638 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 992) could send its response
I20260617 20:17:10.617995 29377 tablet_replica.cc:333] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:10.618068 31065 raft_consensus.cc:697] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:10.618223 29377 raft_consensus.cc:2243] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.618417 29377 raft_consensus.cc:2272] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.618387 31065 consensus_queue.cc:237] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.620553 29379 tablet_bootstrap.cc:654] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.621616 29376 ts_tablet_manager.cc:1916] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.622560 29378 tablet_bootstrap.cc:654] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.625998 29377 ts_tablet_manager.cc:1916] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.615909 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8c9ad175c7d645afb125d140eb250bfc [id=cf56b2890579404caad095aac8bcc4db]
I20260617 20:17:10.631856 29383 tablet_bootstrap.cc:492] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.631940 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_d4ddf99bf0e44da4bd61741ec0ac2065 [id=cfcf57f5da064087ba790a7f348b4778]
I20260617 20:17:10.632030 29383 ts_tablet_manager.cc:1403] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.102s user 0.005s sys 0.007s
I20260617 20:17:10.632261 29379 tablet_bootstrap.cc:492] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.632401 29379 ts_tablet_manager.cc:1403] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.007s
I20260617 20:17:10.632834 29383 raft_consensus.cc:359] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.633014 29383 raft_consensus.cc:385] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.633064 29383 raft_consensus.cc:740] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.633574 29383 consensus_queue.cc:260] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.634069 31115 consensus_queue.cc:1048] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:10.634423 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_fe8f1bae47eb40e8b88f9832e8b127b3 [id=d037cdc970c044ec92ca7b0b46be209f]
I20260617 20:17:10.634841 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_122065b5c3db4c0eae386133c84b7940 [id=d1350616b5dc41e98e4b1554a10ddafb]
I20260617 20:17:10.640637 31009 raft_consensus.cc:493] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.640533 29379 raft_consensus.cc:359] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.640735 29379 raft_consensus.cc:385] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.640805 29379 raft_consensus.cc:740] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.640758 31009 raft_consensus.cc:515] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.640998 29379 consensus_queue.cc:260] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.641366 31009 leader_election.cc:290] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.641597 29379 ts_tablet_manager.cc:1434] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260617 20:17:10.641870 29379 tablet_bootstrap.cc:492] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.642109 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43549813e294796baca2a1a64dbcfb9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:10.642325 28983 raft_consensus.cc:2468] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:10.643334 29383 ts_tablet_manager.cc:1434] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260617 20:17:10.643814 29383 tablet_bootstrap.cc:492] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.644919 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_66d9873c0541455b9003127d8cd07f3d [id=d31cb66a2e974a00a957dd5e0ad579cf]
I20260617 20:17:10.647496 29062 leader_election.cc:304] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:17:10.649091 29378 tablet_bootstrap.cc:492] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.649269 29378 ts_tablet_manager.cc:1403] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.001s
I20260617 20:17:10.650074 29378 raft_consensus.cc:359] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.650269 29378 raft_consensus.cc:385] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.650341 29378 raft_consensus.cc:740] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.650595 29379 tablet_bootstrap.cc:654] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.650570 29378 consensus_queue.cc:260] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.650985 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_c355818357334e2b98c839a655ef35eb [id=d3cd825ca5b742e4be6b655a235b7185]
I20260617 20:17:10.651796 31115 raft_consensus.cc:493] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.651974 31115 raft_consensus.cc:515] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.652777 31115 leader_election.cc:290] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.651507 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8de2d6a5ba0a4db08a56a40d929e5d4a [id=d3e9fc87749f46a3a6a2e222cbff718d]
I20260617 20:17:10.653378 29383 tablet_bootstrap.cc:654] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.654197 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43549813e294796baca2a1a64dbcfb9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.654361 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0f5f4151702f48399790f86347a98506 [id=d4319ca115ed4935b14fef47fd239c03]
I20260617 20:17:10.654428 29262 raft_consensus.cc:2468] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:10.654822 30683 raft_consensus.cc:493] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.654944 30683 raft_consensus.cc:515] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.655516 30683 leader_election.cc:290] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.655623 30683 raft_consensus.cc:493] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.655712 30683 raft_consensus.cc:515] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.656152 30683 leader_election.cc:290] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.656420 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ec778da4c9467d90c7151f36ffaa79" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:10.656597 28983 raft_consensus.cc:2468] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:10.657166 31009 raft_consensus.cc:2804] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:10.657245 31009 raft_consensus.cc:493] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:10.657335 31009 raft_consensus.cc:3060] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.658129 29378 ts_tablet_manager.cc:1434] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260617 20:17:10.658943 29376 ts_tablet_manager.cc:1929] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:10.659031 29376 log.cc:1199] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/39ca961cfea54a7187cc7ea8d16a627f
I20260617 20:17:10.659308 29376 ts_tablet_manager.cc:1950] T 39ca961cfea54a7187cc7ea8d16a627f P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.659896 29378 tablet_bootstrap.cc:492] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.659969 31009 raft_consensus.cc:515] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.660874 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43549813e294796baca2a1a64dbcfb9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:10.661057 28983 raft_consensus.cc:3060] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.662335 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e7a29b7fdd411e9957d23861a996db" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.663831 28983 raft_consensus.cc:2468] T f43549813e294796baca2a1a64dbcfb9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:10.664268 29062 leader_election.cc:304] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:17:10.664628 31171 raft_consensus.cc:2804] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:10.664701 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ec778da4c9467d90c7151f36ffaa79" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.664765 31171 raft_consensus.cc:697] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:10.664633 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326eb1cffb9a47078320e6fcba0743ce" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.665067 31171 consensus_queue.cc:237] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.665480 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_c816a44858d34b368a1e701cdbebd429 [id=d4618abed4d0489187b4d138ed28867a]
I20260617 20:17:10.666061 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_be59d14cee3545fbb5d986ae101f78cc [id=d4b52b5f7b144e3e9c22e38c33ff0a06]
I20260617 20:17:10.666567 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_b97bf3349f93422cbd2b08e176e4d5da [id=d50a3264b4d349dea980a3ad95ac87f8]
I20260617 20:17:10.669016 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326eb1cffb9a47078320e6fcba0743ce" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:10.669224 28985 raft_consensus.cc:2468] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:10.669884 29378 tablet_bootstrap.cc:654] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:10.670197 29198 leader_election.cc:343] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:10.670423 29198 leader_election.cc:343] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:10.670586 29198 leader_election.cc:343] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.671262 29377 ts_tablet_manager.cc:1929] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260617 20:17:10.672079 29377 log.cc:1199] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/086bd3079e8f4a6d85ccc681a38a47b0
I20260617 20:17:10.670189 29383 tablet_bootstrap.cc:492] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.673460 29383 ts_tablet_manager.cc:1403] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.002s
I20260617 20:17:10.674505 29383 raft_consensus.cc:359] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.675379 29377 ts_tablet_manager.cc:1950] T 086bd3079e8f4a6d85ccc681a38a47b0 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:10.675653 29383 raft_consensus.cc:385] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.675828 29383 raft_consensus.cc:740] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.676302 29383 consensus_queue.cc:260] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.676688 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e7a29b7fdd411e9957d23861a996db" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:10.676889 28983 raft_consensus.cc:2468] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:10.678531 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 989) took 3898 ms. Trace:
I20260617 20:17:10.679036 29377 rpcz_store.cc:276] 0617 20:17:06.779583 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.848631 (+ 69048us) service_pool.cc:224] Handling call
0617 20:17:10.617898 (+3769267us) ts_tablet_manager.cc:1151] Deleting tablet 086bd3079e8f4a6d85ccc681a38a47b0
0617 20:17:10.617908 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.629247 (+ 11339us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.670815 (+ 41568us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.678393 (+ 7578us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3765361}
W20260617 20:17:10.679917 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 989) could send its response
I20260617 20:17:10.680630 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 994) took 3794 ms. Trace:
I20260617 20:17:10.681025 29377 rpcz_store.cc:276] 0617 20:17:06.885623 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.885684 (+ 61us) service_pool.cc:224] Handling call
0617 20:17:10.680101 (+3794417us) ts_tablet_manager.cc:1151] Deleting tablet fc7cb1160fe94c2baf9775a193ef4c77
0617 20:17:10.680111 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.680505 (+ 394us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3794117}
I20260617 20:17:10.682328 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 993) took 3796 ms. Trace:
I20260617 20:17:10.682611 29377 rpcz_store.cc:276] 0617 20:17:06.885451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:06.889279 (+ 3828us) service_pool.cc:224] Handling call
0617 20:17:10.681920 (+3792641us) ts_tablet_manager.cc:1151] Deleting tablet e9ea2f6574d44d1a80fd4787fb6ca0e1
0617 20:17:10.681929 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.682207 (+ 278us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3792334}
I20260617 20:17:10.684026 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 996) took 3358 ms. Trace:
W20260617 20:17:10.685076 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 994) could send its response
I20260617 20:17:10.684675 29377 rpcz_store.cc:276] 0617 20:17:07.325655 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.325718 (+ 63us) service_pool.cc:224] Handling call
0617 20:17:10.683496 (+3357778us) ts_tablet_manager.cc:1151] Deleting tablet 5559b78afa0d4043971bb433500a21e4
0617 20:17:10.683505 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.683891 (+ 386us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3357482}
W20260617 20:17:10.685262 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 993) could send its response
W20260617 20:17:10.685685 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 996) could send its response
I20260617 20:17:10.685585 31094 consensus_queue.cc:1048] T 839ae2f924494679a1389ad61be65259 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:10.686044 31065 raft_consensus.cc:493] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.686241 31065 raft_consensus.cc:515] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.686765 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 995) took 3361 ms. Trace:
I20260617 20:17:10.687642 31065 leader_election.cc:290] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.688226 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f544f486c144cd89ca7c5b83d252ee9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.688827 28925 leader_election.cc:343] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.690876 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_ff10865b6d2c4c6d9ab53cc4154f7340 [id=d795edb3e121421a9c66a4ab7906bcb9]
I20260617 20:17:10.691162 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1039) took 2992 ms. Trace:
I20260617 20:17:10.691447 29376 rpcz_store.cc:276] 0617 20:17:07.689258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.689966 (+ 708us) service_pool.cc:224] Handling call
0617 20:17:10.609598 (+2919632us) ts_tablet_manager.cc:1151] Deleting tablet 39ca961cfea54a7187cc7ea8d16a627f
0617 20:17:10.609609 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.626300 (+ 16691us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.658888 (+ 32588us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.681630 (+ 22742us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2919505}
I20260617 20:17:10.692590 29376 tablet_replica.cc:333] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.693712 29376 raft_consensus.cc:2243] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.694375 29376 raft_consensus.cc:2272] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.698261 29376 ts_tablet_manager.cc:1916] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.703364 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_5568c77256244c37989abf62aea01e5e [id=d86155eb37074ec3a29fa8b560d0649d]
I20260617 20:17:10.699707 29383 ts_tablet_manager.cc:1434] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.026s user 0.001s sys 0.004s
I20260617 20:17:10.705677 29383 tablet_bootstrap.cc:492] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.706305 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_3e14083b032f4f0aa58a5586a505644f [id=d8748c2388784fad857370a86fb9fc4e]
I20260617 20:17:10.687312 29377 rpcz_store.cc:276] 0617 20:17:07.325521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.325729 (+ 208us) service_pool.cc:224] Handling call
0617 20:17:10.686006 (+3360277us) ts_tablet_manager.cc:1151] Deleting tablet 05494b097ba0480e91d338cf6b50ddc8
0617 20:17:10.686017 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.686539 (+ 522us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3359335}
W20260617 20:17:10.707526 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 995) could send its response
I20260617 20:17:10.707919 29377 tablet_replica.cc:333] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:10.712335 29377 raft_consensus.cc:2243] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:10.712842 31009 leader_election.cc:290] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.713083 29377 raft_consensus.cc:2272] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.714318 29383 tablet_bootstrap.cc:654] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.715296 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_00f049c59fbd43bc8134a419c3d654a5 [id=da1befcdf0ba45d1b52d9236dfbbde60]
I20260617 20:17:10.716122 29377 ts_tablet_manager.cc:1916] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.717767 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_36ec6892bea94b65b641c5b752fd1fdf [id=dacea1c7ac4243d8acd20757eaa05249]
I20260617 20:17:10.721110 29378 tablet_bootstrap.cc:492] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.721350 29378 ts_tablet_manager.cc:1403] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.062s user 0.013s sys 0.002s
I20260617 20:17:10.721695 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_d9c37095429e4a2c8300865cb8711a27 [id=dad13ba825d74009ad1899b403ab5745]
I20260617 20:17:10.722232 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_9ff46b3a183c48f8b7111d7d5651879e [id=db00d9615d1b48ceb5cf02f8de509878]
I20260617 20:17:10.722988 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f168e10b93404a79b1d7a16f09857071 [id=db84a2ce6b424df9a2e40f4ae49b9efe]
I20260617 20:17:10.722815 29378 raft_consensus.cc:359] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.723167 29378 raft_consensus.cc:385] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.723286 29378 raft_consensus.cc:740] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.723691 29378 consensus_queue.cc:260] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.725766 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0dc3002823be41b18039e536eb0d547b [id=dbc091c9fea64e68b8218477cc22f456]
I20260617 20:17:10.726315 30967 raft_consensus.cc:493] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.726428 30967 raft_consensus.cc:515] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.726930 30967 leader_election.cc:290] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.727741 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_70b749ff7ffb4047b023ae8c67106dfb [id=dc6173b97e40451aaf245fe2ec542e94]
I20260617 20:17:10.729058 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f15a7c18faa4e36bbb62809bb6e976c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.729830 29376 ts_tablet_manager.cc:1929] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 20:17:10.729888 28925 leader_election.cc:343] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.731664 31009 raft_consensus.cc:493] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.731812 31009 raft_consensus.cc:515] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.731724 29378 ts_tablet_manager.cc:1434] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260617 20:17:10.732117 29376 log.cc:1199] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/5eaddd6519dc490c8358be629b21a2d9
W20260617 20:17:10.733126 29062 leader_election.cc:343] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 39ca961cfea54a7187cc7ea8d16a627f
I20260617 20:17:10.733338 31009 leader_election.cc:290] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.733732 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8556e2b7c18a49e09b7a01b9683d4f58 [id=dd9bbf5c95fe461faf077a1efd67e0d4]
I20260617 20:17:10.733994 29376 ts_tablet_manager.cc:1950] T 5eaddd6519dc490c8358be629b21a2d9 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.733784 29378 tablet_bootstrap.cc:492] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.734552 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_87d2647a76934415a43629381e657e1e [id=de24e09cee8e4f28998625c2697769b3]
I20260617 20:17:10.736122 29383 tablet_bootstrap.cc:492] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.737797 29383 ts_tablet_manager.cc:1403] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.002s
I20260617 20:17:10.738652 29383 raft_consensus.cc:359] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.738870 29383 raft_consensus.cc:385] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.738969 29383 raft_consensus.cc:740] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.739205 29383 consensus_queue.cc:260] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.739926 29383 ts_tablet_manager.cc:1434] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:10.740218 29383 tablet_bootstrap.cc:492] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.741855 29383 tablet_bootstrap.cc:654] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.742913 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_8bc2da3ec59547e290194b2ec6184b7f [id=de3384ef7984460abc15ca893a9f8c83]
I20260617 20:17:10.742794 29378 tablet_bootstrap.cc:654] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.742358 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1040) took 2973 ms. Trace:
I20260617 20:17:10.743871 29376 rpcz_store.cc:276] 0617 20:17:07.768595 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.768658 (+ 63us) service_pool.cc:224] Handling call
0617 20:17:10.692536 (+2923878us) ts_tablet_manager.cc:1151] Deleting tablet 5eaddd6519dc490c8358be629b21a2d9
0617 20:17:10.692551 (+ 15us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.719818 (+ 27267us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.729766 (+ 9948us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.742338 (+ 12572us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6953,"tablet-delete.queue_time_us":2923680}
I20260617 20:17:10.744589 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_75e979e8d7bd46d29cf374e5f594e095 [id=df45a919527444a5b096737284b70a5c]
I20260617 20:17:10.745487 29376 tablet_replica.cc:333] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.748157 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6a488f8547fe46278096d8acc2c1753f [id=e0ac5a8ae5b34be48d2d85947f803ead]
I20260617 20:17:10.748695 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_5818420ded12484fb2b9e6dea664ff12 [id=e0f22822bb2d4cf2bafa8e5c49de8f45]
I20260617 20:17:10.749140 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f168b2e932084d149c71a4b87f021c3d [id=e21edff75b2e411d80a8f97ab4ab7956]
I20260617 20:17:10.751101 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6ead2c895ac049739a31aaabe45390fe [id=e24801a55bc8441891995304c46d0e57]
I20260617 20:17:10.751579 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c]
I20260617 20:17:10.752100 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_213292c85f774f9cadad87077963c82a [id=e2933414bca44da084411334f63ccfb7]
I20260617 20:17:10.756651 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_287b99d05553492ea2ef943ec6e829b7 [id=e32642a0d72a44b1817195574c4ad00f]
I20260617 20:17:10.757848 29383 tablet_bootstrap.cc:492] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.758060 29383 ts_tablet_manager.cc:1403] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20260617 20:17:10.758911 29383 raft_consensus.cc:359] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.759143 29383 raft_consensus.cc:385] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.759235 29383 raft_consensus.cc:740] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.759536 29383 consensus_queue.cc:260] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.761034 29383 ts_tablet_manager.cc:1434] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:10.761373 29383 tablet_bootstrap.cc:492] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.763140 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_6791b989125046d893a9c24ae1e65c12 [id=e495b17f9a99422e9e29cf49befb762a]
I20260617 20:17:10.763197 29378 tablet_bootstrap.cc:492] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.763410 29378 ts_tablet_manager.cc:1403] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.001s
I20260617 20:17:10.764462 29383 tablet_bootstrap.cc:654] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.764643 29378 raft_consensus.cc:359] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:10.764931 29378 raft_consensus.cc:385] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.765064 29378 raft_consensus.cc:740] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.765142 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_bb2d4abaff574992b845f37916732047 [id=e5516c07301447348a57361f1cdc74bf]
I20260617 20:17:10.765455 29378 consensus_queue.cc:260] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:10.766464 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_aa47b2f6d9c446669f0a2ba8447cb83f [id=e57dad6d4c2e4149827ee1829842ae76]
I20260617 20:17:10.766625 29378 ts_tablet_manager.cc:1434] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:17:10.778901 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f1bf6a12189741bc8144442a0121eb38 [id=e60c0236ff6e436cb51cef3b9ef21106]
I20260617 20:17:10.779613 31223 raft_consensus.cc:493] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.779748 31223 raft_consensus.cc:515] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.780377 31223 leader_election.cc:290] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.781136 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18791cd3384f4bd48c333a3460e85286" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.781769 29198 leader_election.cc:343] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.782733 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e4bae15c95f24a148e48b458b3ffd46d [id=e68eecbfbae442c493ec7dbf49c718f2]
I20260617 20:17:10.784227 29383 tablet_bootstrap.cc:492] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.784397 29383 ts_tablet_manager.cc:1403] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20260617 20:17:10.785249 29383 raft_consensus.cc:359] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.785619 29383 raft_consensus.cc:385] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.785715 29383 raft_consensus.cc:740] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.785986 29383 consensus_queue.cc:260] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.786648 29383 ts_tablet_manager.cc:1434] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:10.787298 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e260ca83764a418697982bac8c69b880 [id=e7190b334ac442dbaf3eaca387972445]
I20260617 20:17:10.788965 31223 raft_consensus.cc:493] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.789088 31223 raft_consensus.cc:515] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.789667 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_7df03098d8c34f058bcae824c33dd2a0 [id=e89cb4b6b74547748051e304d9c71c51]
I20260617 20:17:10.789808 31223 leader_election.cc:290] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.790437 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6522ae212784b7ebd47cc3403aa3477" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.790634 29122 raft_consensus.cc:2468] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:10.791079 31065 raft_consensus.cc:493] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.791222 31065 raft_consensus.cc:515] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.791273 29198 leader_election.cc:304] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:10.791517 31223 raft_consensus.cc:2804] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:10.791581 31223 raft_consensus.cc:493] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:10.791635 31223 raft_consensus.cc:3060] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.791808 31065 leader_election.cc:290] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.792160 29378 tablet_bootstrap.cc:492] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.793784 29378 tablet_bootstrap.cc:654] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.794240 31223 raft_consensus.cc:515] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.796128 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6522ae212784b7ebd47cc3403aa3477" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:10.796346 29121 raft_consensus.cc:3060] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.797730 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8d29712eee47e497872df101404f26" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.798352 28925 leader_election.cc:343] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.800776 29121 raft_consensus.cc:2468] T a6522ae212784b7ebd47cc3403aa3477 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:10.801329 29198 leader_election.cc:304] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:10.801623 31221 raft_consensus.cc:2804] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:10.801730 31221 raft_consensus.cc:697] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:10.801971 31221 consensus_queue.cc:237] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.803475 31223 leader_election.cc:290] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.811617 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e4eb4ddc78ad49f8b8b28c441d0ca39f [id=ea076d1ff6b74b85b228164033b35451]
I20260617 20:17:10.815815 29378 tablet_bootstrap.cc:492] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.816133 29378 ts_tablet_manager.cc:1403] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.006s
I20260617 20:17:10.816682 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_bb7b4e5ce3324565ab3f5893c46299d5 [id=ec77c3ad28074d489fc33acbb85fab04]
I20260617 20:17:10.817693 29378 raft_consensus.cc:359] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:10.817996 29378 raft_consensus.cc:385] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.818085 29378 raft_consensus.cc:740] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.818554 29378 consensus_queue.cc:260] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:10.820266 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6]
I20260617 20:17:10.820835 29378 ts_tablet_manager.cc:1434] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260617 20:17:10.821595 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_91ce1deb19d345e983397a67460cabcb [id=ee557d3a99a5471398131086daf8412f]
I20260617 20:17:10.822403 29378 tablet_bootstrap.cc:492] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.823130 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_41576d8b3a1d4789ab70d3afb1cd0fbe [id=efa2e89ef6244e92803dd43d0ef74d50]
I20260617 20:17:10.824549 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_7412226c178b4fdfa79664f5975d834a [id=f398dc41286d4aa690f3d7b3d45015a8]
I20260617 20:17:10.829173 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e271ce7263b74cbfadbee5ec752a965d [id=f3ff33ab728e488a802d626b5dff181d]
I20260617 20:17:10.830068 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_c67156b0dace4897967975f7f41f09fe [id=f48dcb0c33bd44f484cc4d1b0caadb88]
I20260617 20:17:10.830588 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_d545ddbe325840ff8bcb2ab57f727e55 [id=f4d29aefa68d44c68fc90dd0f1d0bcdf]
W20260617 20:17:10.831027 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 160161us
I20260617 20:17:10.831300 29197 leader_election.cc:304] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:10.831568 31094 raft_consensus.cc:2804] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:10.831640 31094 raft_consensus.cc:493] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:10.831704 31094 raft_consensus.cc:3060] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.832176 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_0016b41ee33e4881852a29e9a5ae7da1 [id=f58da0cf9be14bf99ee86cbbacf3dda0]
I20260617 20:17:10.833727 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_828a81e6756742db828d8880981f1021 [id=f5d1fae02fa1431d9913117bbef77d7d]
I20260617 20:17:10.833930 29378 tablet_bootstrap.cc:654] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.834232 31094 raft_consensus.cc:515] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.834582 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_702d2d2262b845b68b13e005c388d10b [id=f608d4e53a0f4d37af562e6ce53576d8]
I20260617 20:17:10.834784 31094 leader_election.cc:290] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.835103 29197 leader_election.cc:304] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:10.835305 31094 raft_consensus.cc:2804] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:10.835372 31094 raft_consensus.cc:493] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:10.835438 31094 raft_consensus.cc:3060] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.835346 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ec778da4c9467d90c7151f36ffaa79" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:10.835999 29198 leader_election.cc:343] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.836053 29377 ts_tablet_manager.cc:1929] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:10.836472 29377 log.cc:1199] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/08290c23fff5449481789b29d15c4781
I20260617 20:17:10.837387 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_762c733e4f8445ad97f36fc9ee70147a [id=f62d71842e284523bbca857af62a367a]
I20260617 20:17:10.837939 31094 raft_consensus.cc:515] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.838632 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_c095015a04284e9186b06fe5c250ab93 [id=f64859ec3a8a4c508922ed8483275b6d]
I20260617 20:17:10.838539 29377 ts_tablet_manager.cc:1950] T 08290c23fff5449481789b29d15c4781 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:10.838732 31094 leader_election.cc:290] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.839145 29197 leader_election.cc:304] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:10.839236 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326eb1cffb9a47078320e6fcba0743ce" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:10.839915 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1039) could send its response
I20260617 20:17:10.841786 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 997) took 3514 ms. Trace:
I20260617 20:17:10.842056 29377 rpcz_store.cc:276] 0617 20:17:07.327662 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.327707 (+ 45us) service_pool.cc:224] Handling call
0617 20:17:10.707832 (+3380125us) ts_tablet_manager.cc:1151] Deleting tablet 08290c23fff5449481789b29d15c4781
0617 20:17:10.707845 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.811840 (+103995us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.835681 (+ 23841us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.841668 (+ 5987us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107,"tablet-delete.queue_time_us":3379961}
W20260617 20:17:10.843061 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 997) could send its response
I20260617 20:17:10.844000 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 998) took 3514 ms. Trace:
I20260617 20:17:10.844270 29377 rpcz_store.cc:276] 0617 20:17:07.329908 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.329955 (+ 47us) service_pool.cc:224] Handling call
0617 20:17:10.843563 (+3513608us) ts_tablet_manager.cc:1151] Deleting tablet 4b94d8148cf74a899c3d025f22541bd9
0617 20:17:10.843576 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.843978 (+ 402us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3513374}
W20260617 20:17:10.845060 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 998) could send its response
I20260617 20:17:10.845796 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 999) took 3497 ms. Trace:
I20260617 20:17:10.846035 29377 rpcz_store.cc:276] 0617 20:17:07.347929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.347983 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:10.845420 (+3497437us) ts_tablet_manager.cc:1151] Deleting tablet 5559b78afa0d4043971bb433500a21e4
0617 20:17:10.845515 (+ 95us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.845780 (+ 265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3497252}
W20260617 20:17:10.846480 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 999) could send its response
I20260617 20:17:10.847249 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1009) took 3458 ms. Trace:
I20260617 20:17:10.847522 29377 rpcz_store.cc:276] 0617 20:17:07.388564 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.388657 (+ 93us) service_pool.cc:224] Handling call
0617 20:17:10.846760 (+3458103us) ts_tablet_manager.cc:1151] Deleting tablet f13c7d600d334e549a5abfe0040b3296
0617 20:17:10.846768 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.847145 (+ 377us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3457330}
W20260617 20:17:10.848315 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1009) could send its response
I20260617 20:17:10.849263 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1013) took 3455 ms. Trace:
I20260617 20:17:10.849675 29377 rpcz_store.cc:276] 0617 20:17:07.393842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.397340 (+ 3498us) service_pool.cc:224] Handling call
0617 20:17:10.848776 (+3451436us) ts_tablet_manager.cc:1151] Deleting tablet 5f7534d57f1740af8b211d646488c90f
0617 20:17:10.848784 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.849162 (+ 378us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3451175}
W20260617 20:17:10.851220 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1013) could send its response
I20260617 20:17:10.852630 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1016) took 3287 ms. Trace:
I20260617 20:17:10.852983 29377 rpcz_store.cc:276] 0617 20:17:07.565123 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.565184 (+ 61us) service_pool.cc:224] Handling call
0617 20:17:10.852076 (+3286892us) ts_tablet_manager.cc:1151] Deleting tablet cb95c048212948dfb00baafbd0c691d9
0617 20:17:10.852096 (+ 20us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.852522 (+ 426us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3286633}
W20260617 20:17:10.852705 29198 leader_election.cc:343] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:10.854380 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1016) could send its response
I20260617 20:17:10.855297 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1017) took 3290 ms. Trace:
I20260617 20:17:10.856225 31221 raft_consensus.cc:493] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.856379 31221 raft_consensus.cc:515] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.856622 29383 tablet_bootstrap.cc:492] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.857025 31221 leader_election.cc:290] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.857769 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_32fba2216d87484fbd69b7a0dfe9a80f [id=f6c336d65ae448b08d66b390926bd547]
I20260617 20:17:10.858243 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_24b0bdcfb9354683bf9478d54ffdf945 [id=f6cf07559f1d4f52a95b5ee1dbad77eb]
I20260617 20:17:10.858605 29383 tablet_bootstrap.cc:654] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.855758 29377 rpcz_store.cc:276] 0617 20:17:07.565258 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.565354 (+ 96us) service_pool.cc:224] Handling call
0617 20:17:10.854909 (+3289555us) ts_tablet_manager.cc:1151] Deleting tablet e79c6804fbb34f5baebdb366f2e0b1bf
0617 20:17:10.855011 (+ 102us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.855281 (+ 270us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3289263}
I20260617 20:17:10.859218 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_f43bb549bf7345e1ad723086a9536f11 [id=f94ce78782ee4bb1955c515b945a4279]
W20260617 20:17:10.859622 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1017) could send its response
I20260617 20:17:10.860669 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1018) took 3292 ms. Trace:
I20260617 20:17:10.861122 29377 rpcz_store.cc:276] 0617 20:17:07.568414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.568492 (+ 78us) service_pool.cc:224] Handling call
0617 20:17:10.860175 (+3291683us) ts_tablet_manager.cc:1151] Deleting tablet 370db89a92a6455190edaf80e5a56205
0617 20:17:10.860278 (+ 103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.860651 (+ 373us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3291399}
W20260617 20:17:10.861943 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1018) could send its response
I20260617 20:17:10.862205 29383 tablet_bootstrap.cc:492] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.862382 29383 ts_tablet_manager.cc:1403] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260617 20:17:10.862571 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da50400f49e24ca589519e6ec823957d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.863066 29198 leader_election.cc:343] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.863224 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1020) took 3287 ms. Trace:
I20260617 20:17:10.863202 29383 raft_consensus.cc:359] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.863519 29383 raft_consensus.cc:385] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.850335 30683 raft_consensus.cc:2804] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:10.863586 29383 raft_consensus.cc:740] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.863722 30683 raft_consensus.cc:493] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:10.863842 30683 raft_consensus.cc:3060] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.863873 29383 consensus_queue.cc:260] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.863601 29377 rpcz_store.cc:276] 0617 20:17:07.575074 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.575133 (+ 59us) service_pool.cc:224] Handling call
0617 20:17:10.862676 (+3287543us) ts_tablet_manager.cc:1151] Deleting tablet 27c20f436b9b4a8cb659215f9579af04
0617 20:17:10.862845 (+ 169us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.863004 (+ 159us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3287239}
I20260617 20:17:10.864356 29383 ts_tablet_manager.cc:1434] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:10.864619 31221 raft_consensus.cc:493] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:17:10.864689 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1020) could send its response
I20260617 20:17:10.864735 31221 raft_consensus.cc:515] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.865605 31221 leader_election.cc:290] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.864630 29383 tablet_bootstrap.cc:492] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.867323 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1019) took 3292 ms. Trace:
I20260617 20:17:10.867945 29383 tablet_bootstrap.cc:654] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.867709 29377 rpcz_store.cc:276] 0617 20:17:07.574941 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.575130 (+ 189us) service_pool.cc:224] Handling call
0617 20:17:10.866924 (+3291794us) ts_tablet_manager.cc:1151] Deleting tablet 75c59cf5f5e8486baf1e038a44657f33
0617 20:17:10.866936 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.867304 (+ 368us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3291047}
W20260617 20:17:10.868752 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1019) could send its response
I20260617 20:17:10.869498 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b278ba32316c42d1b101e9803657af99" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.870085 29198 leader_election.cc:343] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.870127 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1021) took 3228 ms. Trace:
I20260617 20:17:10.870582 29377 rpcz_store.cc:276] 0617 20:17:07.641672 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.641782 (+ 110us) service_pool.cc:224] Handling call
0617 20:17:10.869391 (+3227609us) ts_tablet_manager.cc:1151] Deleting tablet fc0081e8742248a0ba088006a905ce85
0617 20:17:10.869402 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.869996 (+ 594us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3227233}
W20260617 20:17:10.871641 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1021) could send its response
I20260617 20:17:10.872588 29377 tablet_replica.cc:333] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:10.875291 29383 tablet_bootstrap.cc:492] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:10.875418 29383 ts_tablet_manager.cc:1403] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20260617 20:17:10.876178 29383 raft_consensus.cc:359] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.876317 29383 raft_consensus.cc:385] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.876359 29383 raft_consensus.cc:740] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.876549 29383 consensus_queue.cc:260] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.876674 30683 raft_consensus.cc:515] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.877017 29383 ts_tablet_manager.cc:1434] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260617 20:17:10.877251 29376 raft_consensus.cc:2243] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.877290 29383 tablet_bootstrap.cc:492] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:10.877782 29376 raft_consensus.cc:2272] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.877954 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e7a29b7fdd411e9957d23861a996db" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:10.878496 29198 leader_election.cc:343] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.878718 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_006cb367b3ec46459d97e77c25bc67ae [id=f9b9fa870edd48daa8498a3f371ec669]
I20260617 20:17:10.879105 29383 tablet_bootstrap.cc:654] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.879674 29376 ts_tablet_manager.cc:1916] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.881664 29377 raft_consensus.cc:2243] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.883993 29377 pending_rounds.cc:70] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: Trying to abort 1 pending ops.
I20260617 20:17:10.884359 29377 pending_rounds.cc:77] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955555815792640 op_type: NO_OP noop_request { }
I20260617 20:17:10.884832 29377 raft_consensus.cc:2889] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:10.885716 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_47860f92f62f4376b2396e6936d2969a [id=fa80809528dd419192774bcc7ac5f5bf]
I20260617 20:17:10.886368 29376 ts_tablet_manager.cc:1929] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.886448 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_e0d3bd7023894d139716d67bbe5357d4 [id=fb58b5a1d10847ef8221618e0fd77784]
I20260617 20:17:10.886000 29377 raft_consensus.cc:2272] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.886632 29376 log.cc:1199] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/8b6f05ae7d624efba571d059ce2f1c91
I20260617 20:17:10.887100 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_1fd4aafa3a644484b4e40f3123e8cda2 [id=fbb1db6a8a474a0380eaa5ed2322e744]
I20260617 20:17:10.887431 29376 ts_tablet_manager.cc:1950] T 8b6f05ae7d624efba571d059ce2f1c91 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.887581 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_42197450734d46538ca8460001e86a63 [id=fc499f8db0824acfaf15a78fd5bb2a5f]
I20260617 20:17:10.888024 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_dff75187402b408b81d75a7c7619d2d5 [id=fce0f344d79e48c791907e51536847d6]
I20260617 20:17:10.888550 29379 tablet_bootstrap.cc:492] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.888685 29379 ts_tablet_manager.cc:1403] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.247s user 0.032s sys 0.051s
I20260617 20:17:10.888696 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_c25af0a4fa2f44b5b7680070d7f18a31 [id=fe89136dd04a45a18a88883eb05e12d7]
I20260617 20:17:10.889118 31119 catalog_manager.cc:679] Loaded metadata for table default.Table_270cf0c20609474eaf9e30d5b9a8ecf8 [id=fe8b78e2faf5430a8eb680bcf966e32e]
I20260617 20:17:10.889410 29379 raft_consensus.cc:359] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.889600 29379 raft_consensus.cc:385] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.889581 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1041) took 3119 ms. Trace:
I20260617 20:17:10.889657 29379 raft_consensus.cc:740] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.889698 29376 rpcz_store.cc:276] 0617 20:17:07.769661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.769715 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:10.745427 (+2975712us) ts_tablet_manager.cc:1151] Deleting tablet 8b6f05ae7d624efba571d059ce2f1c91
0617 20:17:10.745438 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.877507 (+132069us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x6160001a2054. stack: 00007f5f5963e496 00007f5f5963e250 00007f5f586693ad 000000000099c914 000000000099c8dd 000000000099c2aa 00007f5f656e47e0 00007f5f66a30933 00007f5f695f3ae7 00007f5f69626bb4 00007f5f696075d0 00007f5f6960735d 0000000000aa681c 00007f5f596849ff 00007f5f59687d1b 00007f5f59687b98
0617 20:17:10.882776 (+ 5269us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.886306 (+ 3530us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.889539 (+ 3233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22,"spinlock_wait_cycles":302469376,"tablet-delete.queue_time_us":2975566}
I20260617 20:17:10.889914 29379 consensus_queue.cc:260] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.890221 29376 tablet_replica.cc:333] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:10.890486 29379 ts_tablet_manager.cc:1434] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:10.890484 29376 raft_consensus.cc:2243] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:10.890813 29376 pending_rounds.cc:70] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: Trying to abort 1 pending ops.
I20260617 20:17:10.890970 29376 pending_rounds.cc:77] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955547264925696 op_type: NO_OP noop_request { }
I20260617 20:17:10.891149 29376 raft_consensus.cc:2889] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:10.891305 29379 tablet_bootstrap.cc:492] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.891321 29376 raft_consensus.cc:2272] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:10.892302 29376 ts_tablet_manager.cc:1916] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.894997 29378 tablet_bootstrap.cc:492] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.895140 29378 ts_tablet_manager.cc:1403] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.009s
I20260617 20:17:10.895850 29378 raft_consensus.cc:359] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:10.896029 29378 raft_consensus.cc:385] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.896083 29378 raft_consensus.cc:740] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.896306 29378 consensus_queue.cc:260] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:10.897413 29377 ts_tablet_manager.cc:1916] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:10.897511 29378 ts_tablet_manager.cc:1434] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:10.898313 29379 tablet_bootstrap.cc:654] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.902657 31009 raft_consensus.cc:493] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.902922 31009 raft_consensus.cc:515] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.903944 31009 leader_election.cc:290] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:10.904428 29062 leader_election.cc:343] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 4d81457d71a34657b43c8ebe7efb0a35
I20260617 20:17:10.908707 31115 consensus_queue.cc:1048] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260617 20:17:10.915937 30967 raft_consensus.cc:493] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.916133 30967 raft_consensus.cc:515] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.916320 31065 raft_consensus.cc:493] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.916456 31065 raft_consensus.cc:515] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.915475 31115 raft_consensus.cc:493] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.916739 30967 leader_election.cc:290] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.916962 31065 leader_election.cc:290] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.917388 31221 consensus_queue.cc:1048] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:10.917996 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ae9c63c8c541bc91ecedd798a7d60f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.917991 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b278ba32316c42d1b101e9803657af99" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.918592 28925 leader_election.cc:343] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:10.918833 28925 leader_election.cc:343] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.919168 31065 raft_consensus.cc:493] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:10.919301 31065 raft_consensus.cc:515] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.919972 31065 leader_election.cc:290] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:10.920567 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40845d7a668045ec9a40cb6d1d76137d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:10.921020 28925 leader_election.cc:343] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:10.934316 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1040) could send its response
I20260617 20:17:10.917383 31115 raft_consensus.cc:515] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.942433 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ae9c63c8c541bc91ecedd798a7d60f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:10.943478 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18791cd3384f4bd48c333a3460e85286" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:10.943732 28985 raft_consensus.cc:2468] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:10.944643 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6522ae212784b7ebd47cc3403aa3477" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
W20260617 20:17:10.944737 29198 leader_election.cc:343] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:10.944813 28983 raft_consensus.cc:3060] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.945065 31115 leader_election.cc:290] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.947451 28983 raft_consensus.cc:2468] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:10.948997 31119 tablet_loader.cc:96] loaded metadata for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 (table default.Table_f1bf6a12189741bc8144442a0121eb38 [id=e60c0236ff6e436cb51cef3b9ef21106])
I20260617 20:17:10.951164 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6522ae212784b7ebd47cc3403aa3477" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:10.951520 28985 raft_consensus.cc:2376] T a6522ae212784b7ebd47cc3403aa3477 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1. Re-sending same reply.
I20260617 20:17:10.954191 29379 tablet_bootstrap.cc:492] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:10.954488 29379 ts_tablet_manager.cc:1403] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.000s
I20260617 20:17:10.955380 31119 tablet_loader.cc:96] loaded metadata for tablet 01bd5ecfb2bf4e2eb4ff984272003fb9 (table default.Table_28f33cd39a814646bedf696c7f0db67c [id=52f1243091174b5885f65dc87f1afbbf])
I20260617 20:17:10.955641 29379 raft_consensus.cc:359] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.955955 29379 raft_consensus.cc:385] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.956070 29379 raft_consensus.cc:740] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.956411 29379 consensus_queue.cc:260] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:10.957268 29379 ts_tablet_manager.cc:1434] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:10.958186 29379 tablet_bootstrap.cc:492] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:10.958846 31119 tablet_loader.cc:96] loaded metadata for tablet 0259cf955d74419d92f1fe0da519cf72 (table default.Table_0dc3002823be41b18039e536eb0d547b [id=dbc091c9fea64e68b8218477cc22f456])
I20260617 20:17:10.960064 31119 tablet_loader.cc:96] loaded metadata for tablet 0307139a910c4850b717a36f22f80be1 (table default.Table_8c9ad175c7d645afb125d140eb250bfc [id=cf56b2890579404caad095aac8bcc4db])
I20260617 20:17:10.962083 29379 tablet_bootstrap.cc:654] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.962809 31119 tablet_loader.cc:96] loaded metadata for tablet 0332617d0db44eda9166a88e75539d16 (table default.Table_cc1b1d5f363341f89757851580c7be12 [id=56c7ef0d2f9b4f6f9265a1f64d01dc76])
I20260617 20:17:10.963686 31119 tablet_loader.cc:96] loaded metadata for tablet 0385c347d2824b2dbb985b37cf8809b8 (table default.Table_e0d3bd7023894d139716d67bbe5357d4 [id=fb58b5a1d10847ef8221618e0fd77784])
I20260617 20:17:10.964493 29378 tablet_bootstrap.cc:492] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.966156 29378 tablet_bootstrap.cc:654] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.968429 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326eb1cffb9a47078320e6fcba0743ce" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:10.968535 31119 tablet_loader.cc:96] loaded metadata for tablet 03f9ef2626b641bf895f7da11a7a652e (table default.Table_b87313ed947a489785485464059c33f9 [id=bfa8263671b84608b42d9967fc75076a])
I20260617 20:17:10.968760 28983 raft_consensus.cc:3060] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.968972 31119 tablet_loader.cc:96] loaded metadata for tablet 043f11c4e0d84c6ba4c5b6b6cc9c10db (table default.Table_0d8a074c057147a5a47d1cf13ada48d1 [id=ba513fbd2a834f0994b528a1927fde6b])
I20260617 20:17:10.971208 31119 tablet_loader.cc:96] loaded metadata for tablet 07ec778da4c9467d90c7151f36ffaa79 (table default.Table_4186d04aa9cf40c481d3436773b1b119 [id=1d82dfca17c74fc5a145191440d60830])
I20260617 20:17:10.971266 29376 ts_tablet_manager.cc:1929] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:10.972636 28983 raft_consensus.cc:2468] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:10.973104 31119 tablet_loader.cc:96] loaded metadata for tablet 08062d7b815b49558bbb3811420d5ce5 (table default.Table_1b519a3c00d6483097bb906c3bb288dc [id=30c5ab49c17f429686ebd9f937c0c9e2])
I20260617 20:17:10.972558 29376 log.cc:1199] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/26ebcfc80ca64129a7ab939bfd853998
I20260617 20:17:10.973244 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ec778da4c9467d90c7151f36ffaa79" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:10.973484 28985 raft_consensus.cc:3060] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.976011 31119 tablet_loader.cc:96] loaded metadata for tablet 081844c92e744d5a870c47437999e895 (table default.Table_15da5b97a103487c96348ca7f22dc3b0 [id=842f3db66d544b8c8ea0a8b58f8ea775])
I20260617 20:17:10.976678 28985 raft_consensus.cc:2468] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:10.977023 31119 tablet_loader.cc:96] loaded metadata for tablet 0822654770594804be2413296f6c94dc (table default.Table_7ba6c34c2fdb41c7a28dd9b7d555eeba [id=57f51996903e41d6bf32d9b398240a95])
I20260617 20:17:10.977339 29376 ts_tablet_manager.cc:1950] T 26ebcfc80ca64129a7ab939bfd853998 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:10.977815 29378 tablet_bootstrap.cc:492] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:10.977965 29378 ts_tablet_manager.cc:1403] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.008s
I20260617 20:17:10.978757 29378 raft_consensus.cc:359] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:10.978957 29378 raft_consensus.cc:385] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:10.979035 29378 raft_consensus.cc:740] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.979272 29378 consensus_queue.cc:260] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:10.979333 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f43549813e294796baca2a1a64dbcfb9" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:10.979490 29262 raft_consensus.cc:3060] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:10.980587 29378 ts_tablet_manager.cc:1434] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:10.980664 31119 tablet_loader.cc:96] loaded metadata for tablet 083b8903abd646dc89717b9d2caf5647 (table default.Table_4a5199c078ea4aa18d688909588c0a96 [id=2b30d550d0e445e882179d01fb066334])
I20260617 20:17:10.981078 31119 tablet_loader.cc:96] loaded metadata for tablet 084bd5befcae496a93a5111f844a28ea (table default.Table_12eedf674e4d4de99a03e816f2b6475c [id=67fea9aec2234faca7f0af0743c8601d])
I20260617 20:17:10.982259 31119 tablet_loader.cc:96] loaded metadata for tablet 090b8720e5df447aa0da147bd8dfaa8c (table default.Table_af56ee6211a54ce4b85c0fc8f2558372 [id=4f255a0a35b74f0784ca51e2186485f5])
I20260617 20:17:10.982494 29262 raft_consensus.cc:2468] T f43549813e294796baca2a1a64dbcfb9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:10.983044 31119 tablet_loader.cc:96] loaded metadata for tablet 0a1f2f87da1143d99668fe223201aa16 (table default.Table_e259b984fdf44bde85b3546242987b20 [id=3b2b81a363c74e6c9e602bf6fb5b0218])
I20260617 20:17:10.984267 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f544f486c144cd89ca7c5b83d252ee9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.984586 29262 raft_consensus.cc:2468] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:10.986151 29378 tablet_bootstrap.cc:492] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:10.987789 29378 tablet_bootstrap.cc:654] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:10.990924 31119 tablet_loader.cc:96] loaded metadata for tablet 0ae5bf7cdde5427cb24d6144ccb274f5 (table default.Table_c095015a04284e9186b06fe5c250ab93 [id=f64859ec3a8a4c508922ed8483275b6d])
I20260617 20:17:10.989284 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1042) took 3151 ms. Trace:
I20260617 20:17:10.992246 30683 leader_election.cc:290] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:10.992406 31119 tablet_loader.cc:96] loaded metadata for tablet 0b194772c9054192b7639cbab5f86ca8 (table default.Table_f168b2e932084d149c71a4b87f021c3d [id=e21edff75b2e411d80a8f97ab4ab7956])
I20260617 20:17:10.992789 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f15a7c18faa4e36bbb62809bb6e976c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.992852 31119 tablet_loader.cc:96] loaded metadata for tablet 0ba3386bd0444fc0b67558e0979a0065 (table default.Table_fa31011cf98e493ab6cbc8a5a4a9e05a [id=8d0ad45f785648c4a5cf9a99fe251233])
I20260617 20:17:10.993039 29262 raft_consensus.cc:2468] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:10.993479 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8d29712eee47e497872df101404f26" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.993803 31119 tablet_loader.cc:96] loaded metadata for tablet 0cb1277c83554dfbb541961c1e6c3617 (table default.Table_cdb98c9b862142e289f947e9d07a2a53 [id=4b77ac1b27aa415dbcb873621ee4ddd9])
I20260617 20:17:10.991155 29376 rpcz_store.cc:276] 0617 20:17:07.837849 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.837911 (+ 62us) service_pool.cc:224] Handling call
0617 20:17:10.890154 (+3052243us) ts_tablet_manager.cc:1151] Deleting tablet 26ebcfc80ca64129a7ab939bfd853998
0617 20:17:10.890165 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.914177 (+ 24012us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.970611 (+ 56434us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.989267 (+ 18656us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3052035}
I20260617 20:17:10.994211 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b278ba32316c42d1b101e9803657af99" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.994436 29262 raft_consensus.cc:2468] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:10.994496 31119 tablet_loader.cc:96] loaded metadata for tablet 0d95e957008b451993e327a7acb4671a (table default.Table_4a1320838a1a477cabc0d69fbe93cc5e [id=cdfdc41eb46d496bbecd4bd651041691])
I20260617 20:17:10.995078 31119 tablet_loader.cc:96] loaded metadata for tablet 0e328704dd1c402d999d5a7421b4bf80 (table default.Table_2a25294e78fe41a7ae7affa51831441f [id=3f6be16f12bc4b4c8560d7f09e341caa])
I20260617 20:17:10.993539 30683 consensus_queue.cc:1048] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260617 20:17:10.996129 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ae9c63c8c541bc91ecedd798a7d60f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:10.996317 29262 raft_consensus.cc:2468] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:10.996945 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40845d7a668045ec9a40cb6d1d76137d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:10.999626 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1041) could send its response
I20260617 20:17:11.009357 31119 tablet_loader.cc:96] loaded metadata for tablet 0f2a0705c8e341739696d5ea028e2728 (table default.Table_0016b41ee33e4881852a29e9a5ae7da1 [id=f58da0cf9be14bf99ee86cbbacf3dda0])
I20260617 20:17:10.996903 29378 tablet_bootstrap.cc:492] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:11.010298 29378 ts_tablet_manager.cc:1403] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.004s
I20260617 20:17:10.999593 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49e7a29b7fdd411e9957d23861a996db" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.011178 28978 raft_consensus.cc:3060] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.009497 29376 tablet_replica.cc:333] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:11.011137 29378 raft_consensus.cc:359] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.011300 29378 raft_consensus.cc:385] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.011351 29378 raft_consensus.cc:740] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:10.996116 29377 ts_tablet_manager.cc:1929] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:11.011570 29378 consensus_queue.cc:260] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.012071 29378 ts_tablet_manager.cc:1434] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:11.013060 29378 tablet_bootstrap.cc:492] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:11.000254 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ae9c63c8c541bc91ecedd798a7d60f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.013540 28981 raft_consensus.cc:2468] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:11.012032 29377 log.cc:1199] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/29c65bb7c45e40a081de91d4c1c5cf56
I20260617 20:17:10.998772 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b278ba32316c42d1b101e9803657af99" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.014536 28983 raft_consensus.cc:2468] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:11.015044 31119 tablet_loader.cc:96] loaded metadata for tablet 0f3032155e4e4ea8a23984f547d78752 (table default.Table_0833862700c248bd97ebd638a1e1868b [id=39ea53bdb6784c0d82a82077cc6210ca])
I20260617 20:17:11.015638 31119 tablet_loader.cc:96] loaded metadata for tablet 108c9a1f329d48ad9f2a92c0a9ef07e2 (table default.Table_64b68bdc9cc04e1eb9ccc1ce83bf1035 [id=8c3f534be9cd4c8dacc5628028f0469e])
I20260617 20:17:11.015889 28978 raft_consensus.cc:2468] T 49e7a29b7fdd411e9957d23861a996db P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:11.016680 31119 tablet_loader.cc:96] loaded metadata for tablet 12d46b1259ae45fa8d80d3dc9ca539b1 (table default.Table_ea6a8570fafd4a2f979827a3711b2de4 [id=250e3cfac020471aac31a16d43ac9dea])
I20260617 20:17:11.019158 31119 tablet_loader.cc:96] loaded metadata for tablet 159bd65d4f05426d9297ee6755a7ed67 (table default.Table_a0abac57842c430484585d01d659001e [id=2c08c48fb49b49b0bd0fc07ce29b460b])
I20260617 20:17:11.019837 31119 tablet_loader.cc:96] loaded metadata for tablet 160dbee15c874758b461f9a7b7ee5d59 (table default.Table_d99a8e190b524b4086d8c7686477e583 [id=99881d02691245928c6b1ffb48a5b11b])
I20260617 20:17:10.997711 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da50400f49e24ca589519e6ec823957d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.020377 28985 raft_consensus.cc:2468] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:11.020565 31119 tablet_loader.cc:96] loaded metadata for tablet 16a6cd2684ae4bc0994473b9e7ec30b7 (table default.Table_1a3d321b3ffa4bc6b94fe6ca3068cda5 [id=5002bb6a396143d498c1a5c11a5be2df])
I20260617 20:17:11.023494 29376 raft_consensus.cc:2243] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:11.023679 31119 tablet_loader.cc:96] loaded metadata for tablet 16f78c31fa80424785d35f1fb49e43e2 (table default.Table_8acde758a415485fa7e9aaa929121769 [id=c7b9ada447dd4b2cbebdb0c0e4790705])
I20260617 20:17:11.023698 29376 raft_consensus.cc:2272] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:11.024187 31119 tablet_loader.cc:96] loaded metadata for tablet 1709c52c8857412d8ed74db312f588e7 (table default.Table_9b1f182b3d5c42ac986fdc3989d04e85 [id=b27c2b2a2e0f40cf94cd8b21b78a6e1d])
I20260617 20:17:11.024277 29376 ts_tablet_manager.cc:1916] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:11.024693 31119 tablet_loader.cc:96] loaded metadata for tablet 174cb0af57d64742a49070a5a44e2292 (table default.Table_bb7b4e5ce3324565ab3f5893c46299d5 [id=ec77c3ad28074d489fc33acbb85fab04])
I20260617 20:17:11.025368 31119 tablet_loader.cc:96] loaded metadata for tablet 17b98bfc9b4d4ee79ad9efb83a82f370 (table default.Table_7ad9b9d0a81a4059917a01a2dbea08ac [id=8c5c9c21499c4df9ba40b549f7911217])
I20260617 20:17:11.025820 31119 tablet_loader.cc:96] loaded metadata for tablet 17d1d5603a9d4aa8bb41c651025fad16 (table default.Table_83cd5e3f2921420f822eee497a0087d5 [id=40c032065fd44e7eb34da35cc4e451eb])
W20260617 20:17:11.026965 29063 leader_election.cc:343] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 39ca961cfea54a7187cc7ea8d16a627f
I20260617 20:17:11.027115 29063 leader_election.cc:304] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.027464 31171 raft_consensus.cc:2749] T 39ca961cfea54a7187cc7ea8d16a627f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.027879 31119 tablet_loader.cc:96] loaded metadata for tablet 184abfbdc6d34f598b10ecaaf5e9b56f (table default.Table_7df03098d8c34f058bcae824c33dd2a0 [id=e89cb4b6b74547748051e304d9c71c51])
I20260617 20:17:11.028663 31119 tablet_loader.cc:96] loaded metadata for tablet 18791cd3384f4bd48c333a3460e85286 (table default.Table_6a6c1b531b834b7394845c8421570068 [id=29bf58c24f9742b38fe3a37c509f92e8])
I20260617 20:17:11.029114 31119 tablet_loader.cc:96] loaded metadata for tablet 19f1c625d26747579b5e3a14cafa05ae (table default.Table_2bb5f77d341647ff9184094cb26eb790 [id=6e83cc5f778f46de8d9d7d8aa2c4512d])
I20260617 20:17:11.030301 31119 tablet_loader.cc:96] loaded metadata for tablet 1cd75cc0dd244ee8b3c19a9597c8c7d3 (table default.Table_143ae9e7e1ec4c7abc9cd48b0623f7b7 [id=6fcc9d1bbca646d78518552e7930e293])
I20260617 20:17:11.033998 31119 tablet_loader.cc:96] loaded metadata for tablet 1d23b3cac3e540a48f4f8e44bd81756e (table default.Table_7b904ff553254117afb61cd5048f33a2 [id=24dc3c39fc64419ab0f47fa8358ad585])
I20260617 20:17:11.034461 31119 tablet_loader.cc:96] loaded metadata for tablet 1d3c078de415458e824d710be7f39e59 (table default.Table_a108c0a8edf2412b8c8bf5decbc848b5 [id=8b8782763690454cbcd32eb9deecab63])
W20260617 20:17:11.034689 29063 leader_election.cc:343] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 4d81457d71a34657b43c8ebe7efb0a35
I20260617 20:17:11.034758 28925 leader_election.cc:304] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.034843 29063 leader_election.cc:304] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.035168 31065 raft_consensus.cc:2804] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.035185 31119 tablet_loader.cc:96] loaded metadata for tablet 1d75020e2d2e427082beb79691e86de7 (table default.Table_8556e2b7c18a49e09b7a01b9683d4f58 [id=dd9bbf5c95fe461faf077a1efd67e0d4])
I20260617 20:17:11.035248 31065 raft_consensus.cc:493] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.035317 31065 raft_consensus.cc:3060] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.035526 31119 tablet_loader.cc:96] loaded metadata for tablet 1e0495da261b4935a44bd02d85f24c86 (table default.Table_0a0f0ffea6394fe296afc92cf1a1ef9e [id=bd87cc18b72d4802a143af7e8786dd97])
I20260617 20:17:11.035537 31171 raft_consensus.cc:2749] T 4d81457d71a34657b43c8ebe7efb0a35 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.037075 30967 raft_consensus.cc:493] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.037184 30967 raft_consensus.cc:515] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.037775 30967 leader_election.cc:290] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.037923 31065 raft_consensus.cc:515] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.038419 31065 leader_election.cc:290] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.038558 29377 ts_tablet_manager.cc:1950] T 29c65bb7c45e40a081de91d4c1c5cf56 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:11.038626 29378 tablet_bootstrap.cc:654] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.039244 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f544f486c144cd89ca7c5b83d252ee9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.039372 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1022) took 3394 ms. Trace:
I20260617 20:17:11.039458 29377 rpcz_store.cc:276] 0617 20:17:07.645139 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.645195 (+ 56us) service_pool.cc:224] Handling call
0617 20:17:10.872288 (+3227093us) ts_tablet_manager.cc:1151] Deleting tablet 29c65bb7c45e40a081de91d4c1c5cf56
0617 20:17:10.872516 (+ 228us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:10.951563 (+ 79047us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:10.995213 (+ 43650us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.039351 (+ 44138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3226802}
W20260617 20:17:11.039790 28925 leader_election.cc:343] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:11.039816 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1022) could send its response
I20260617 20:17:11.039999 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1025) took 3347 ms. Trace:
I20260617 20:17:11.040078 29377 rpcz_store.cc:276] 0617 20:17:07.692210 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.692359 (+ 149us) service_pool.cc:224] Handling call
0617 20:17:11.039847 (+3347488us) ts_tablet_manager.cc:1151] Deleting tablet b7a26cb68df548f9b716c72e36b11647
0617 20:17:11.039856 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.039941 (+ 85us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3347307}
I20260617 20:17:11.040179 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed860fa375848708beb31ff89056214" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.040315 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1025) could send its response
I20260617 20:17:11.040393 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1024) took 3348 ms. Trace:
I20260617 20:17:11.040444 29377 rpcz_store.cc:276] 0617 20:17:07.692122 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.692683 (+ 561us) service_pool.cc:224] Handling call
0617 20:17:11.040291 (+3347608us) ts_tablet_manager.cc:1151] Deleting tablet 841664f40c02423095bb9e63b85006a6
0617 20:17:11.040301 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.040375 (+ 74us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3347457}
W20260617 20:17:11.040652 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1024) could send its response
W20260617 20:17:11.040716 28925 leader_election.cc:343] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.040747 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1026) took 3348 ms. Trace:
I20260617 20:17:11.041769 29383 tablet_bootstrap.cc:492] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:11.041905 29383 ts_tablet_manager.cc:1403] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.165s user 0.027s sys 0.031s
I20260617 20:17:11.042562 29383 raft_consensus.cc:359] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.042713 29383 raft_consensus.cc:385] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.042769 29383 raft_consensus.cc:740] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.042940 29383 consensus_queue.cc:260] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.043362 29383 ts_tablet_manager.cc:1434] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:17:11.043627 29383 tablet_bootstrap.cc:492] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:11.044984 29383 tablet_bootstrap.cc:654] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.046337 31119 tablet_loader.cc:96] loaded metadata for tablet 1e27a027e29845728fd09c9e6362efc0 (table default.Table_e3dc5d6e636a48dcb8ea35c12167a65c [id=687ab84417184ad2a95410c6c1ffc4a4])
I20260617 20:17:11.047734 28925 leader_election.cc:304] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.047987 31065 raft_consensus.cc:2804] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.048120 31065 raft_consensus.cc:493] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.048256 31065 raft_consensus.cc:3060] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:11.048599 28925 leader_election.cc:343] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.048710 28925 leader_election.cc:304] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.048928 30967 raft_consensus.cc:2749] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.049432 28925 leader_election.cc:304] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.049649 30967 raft_consensus.cc:2804] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.049729 30967 raft_consensus.cc:493] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.049796 30967 raft_consensus.cc:3060] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:11.049959 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1042) could send its response
I20260617 20:17:11.050199 28925 leader_election.cc:304] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.052577 30967 raft_consensus.cc:515] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.040812 29377 rpcz_store.cc:276] 0617 20:17:07.692309 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.692860 (+ 551us) service_pool.cc:224] Handling call
0617 20:17:11.040655 (+3347795us) ts_tablet_manager.cc:1151] Deleting tablet 75e3e15cade7403fa70096516d83c3c0
0617 20:17:11.040665 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.040735 (+ 70us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3347697}
W20260617 20:17:11.054178 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1026) could send its response
I20260617 20:17:11.055693 31065 raft_consensus.cc:515] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.056281 31065 leader_election.cc:290] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.056434 31065 raft_consensus.cc:2804] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.056509 31065 raft_consensus.cc:493] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.056565 31065 raft_consensus.cc:3060] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.053575 30967 leader_election.cc:290] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.059131 31065 raft_consensus.cc:515] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.060027 31220 raft_consensus.cc:493] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.060178 31220 raft_consensus.cc:515] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.060771 31220 leader_election.cc:290] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.061429 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c6804fbb34f5baebdb366f2e0b1bf" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:11.061870 31119 tablet_loader.cc:96] loaded metadata for tablet 1f1600da5c434063a8458ebed1f6d4de (table default.Table_be59d14cee3545fbb5d986ae101f78cc [id=d4b52b5f7b144e3e9c22e38c33ff0a06])
W20260617 20:17:11.061957 29198 leader_election.cc:343] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.062634 31119 tablet_loader.cc:96] loaded metadata for tablet 1f2c8a0fe63c440493b357e73f763357 (table default.Table_bf4ce88a9888453a8c775f1f1d264daa [id=1d8700d6c96e48d7986478065e73fef3])
I20260617 20:17:11.059456 30967 raft_consensus.cc:493] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.059576 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1023) took 3364 ms. Trace:
I20260617 20:17:11.062954 30967 raft_consensus.cc:515] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.062891 29377 rpcz_store.cc:276] 0617 20:17:07.692004 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.692976 (+ 972us) service_pool.cc:224] Handling call
0617 20:17:11.055007 (+3362031us) ts_tablet_manager.cc:1151] Deleting tablet dbc2e5ecad0c41d5a24e0dad708b1a5c
0617 20:17:11.055019 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.055816 (+ 797us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3361755}
W20260617 20:17:11.063275 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1023) could send its response
I20260617 20:17:11.063675 30967 leader_election.cc:290] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.063818 29120 raft_consensus.cc:3060] T b6ba8b7d18af44b58800e588279e2e0b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.064225 31065 leader_election.cc:290] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.067196 31119 tablet_loader.cc:96] loaded metadata for tablet 1f3ca6d6dfbe4ec9be48ea43db907676 (table default.Table_8de2d6a5ba0a4db08a56a40d929e5d4a [id=d3e9fc87749f46a3a6a2e222cbff718d])
I20260617 20:17:11.064342 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1027) took 2883 ms. Trace:
I20260617 20:17:11.067409 29377 rpcz_store.cc:276] 0617 20:17:08.180434 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.180486 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:11.063528 (+2883042us) ts_tablet_manager.cc:1151] Deleting tablet 6f08bdd9c769403db89c20aabdc58d59
0617 20:17:11.063563 (+ 35us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.064130 (+ 567us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2882855}
W20260617 20:17:11.067960 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1027) could send its response
I20260617 20:17:11.068410 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1028) took 2884 ms. Trace:
I20260617 20:17:11.068832 29377 rpcz_store.cc:276] 0617 20:17:08.184163 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.184218 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:11.068278 (+2884060us) ts_tablet_manager.cc:1151] Deleting tablet 5d93449f5d5d41fb9883db3bce10f969
0617 20:17:11.068288 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.068396 (+ 108us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2883884}
W20260617 20:17:11.069267 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1028) could send its response
I20260617 20:17:11.069712 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1029) took 2885 ms. Trace:
I20260617 20:17:11.070675 31119 tablet_loader.cc:96] loaded metadata for tablet 1f9a733fbbdd4e95a02eb064c4cea68d (table default.Table_c7301f39e0a54609801e5454f391767b [id=32a68fccc83848e2a7c85692a0ad59a0])
I20260617 20:17:11.072192 29377 rpcz_store.cc:276] 0617 20:17:08.184327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.184424 (+ 97us) service_pool.cc:224] Handling call
0617 20:17:11.069607 (+2885183us) ts_tablet_manager.cc:1151] Deleting tablet 05e5918dcafc4accb0345a8389b65412
0617 20:17:11.069618 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.069696 (+ 78us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2885050}
W20260617 20:17:11.072705 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1029) could send its response
I20260617 20:17:11.073091 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1039) took 2667 ms. Trace:
I20260617 20:17:11.073446 29377 rpcz_store.cc:276] 0617 20:17:08.406059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.406114 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:11.072982 (+2666868us) ts_tablet_manager.cc:1151] Deleting tablet c10b96bee83b419dbfc2a8e26f88e719
0617 20:17:11.072992 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.073075 (+ 83us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2666684}
W20260617 20:17:11.075074 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1039) could send its response
I20260617 20:17:11.075409 29377 tablet_replica.cc:333] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:11.076192 31119 tablet_loader.cc:96] loaded metadata for tablet 1ffbd145b8cc49fb99ed5eb544d17c41 (table default.Table_c355818357334e2b98c839a655ef35eb [id=d3cd825ca5b742e4be6b655a235b7185])
I20260617 20:17:11.076620 29377 raft_consensus.cc:2243] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:11.077056 29377 raft_consensus.cc:2272] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:11.078434 28925 leader_election.cc:343] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.078562 28925 leader_election.cc:304] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.078876 29377 ts_tablet_manager.cc:1916] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:11.079286 31065 raft_consensus.cc:2749] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.082712 29197 leader_election.cc:304] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.083345 29197 leader_election.cc:304] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.083575 31220 raft_consensus.cc:2804] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.083650 31220 raft_consensus.cc:493] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.083721 31220 raft_consensus.cc:3060] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.083914 31119 tablet_loader.cc:96] loaded metadata for tablet 209a90eea5ef4061a1b935d7aa5dd1ed (table default.Table_add57ff1d780483cb71151dbab223170 [id=03d78bcb3bc14b3ab6e25c348bbd067c])
I20260617 20:17:11.084672 29378 tablet_bootstrap.cc:492] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:11.084856 29378 ts_tablet_manager.cc:1403] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.072s user 0.004s sys 0.008s
I20260617 20:17:11.085736 29378 raft_consensus.cc:359] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.085973 29378 raft_consensus.cc:385] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.086082 29378 raft_consensus.cc:740] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.086228 31220 raft_consensus.cc:515] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.086339 29378 consensus_queue.cc:260] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.086941 31220 leader_election.cc:290] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.087220 29378 ts_tablet_manager.cc:1434] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:11.087138 31220 raft_consensus.cc:2804] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.087400 31220 raft_consensus.cc:697] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:11.087644 31220 consensus_queue.cc:237] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.088004 29378 tablet_bootstrap.cc:492] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:11.089553 29197 leader_election.cc:304] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.089774 31094 raft_consensus.cc:2804] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.089880 29197 leader_election.cc:304] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.090166 31115 raft_consensus.cc:2804] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.090185 29197 leader_election.cc:304] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.090238 31115 raft_consensus.cc:493] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.090242 31119 tablet_loader.cc:96] loaded metadata for tablet 20d0b861d48e4baf94387f4ff9d9f778 (table default.Table_3f75a4b3577e427ba1b39fa83075b1c2 [id=7c94e39032fa4cf39a1187691bff2739])
I20260617 20:17:11.090305 31115 raft_consensus.cc:3060] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.090765 29122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b278ba32316c42d1b101e9803657af99" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.091100 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f15a7c18faa4e36bbb62809bb6e976c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.091286 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d811ca370ee54db8a7e4f6056017cd01" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:11.091507 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ae9c63c8c541bc91ecedd798a7d60f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.092700 31115 raft_consensus.cc:515] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:11.093194 28925 leader_election.cc:343] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:11.093417 28925 leader_election.cc:343] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.093240 31115 leader_election.cc:290] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.093417 30852 raft_consensus.cc:2804] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.094130 30852 raft_consensus.cc:493] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.094208 30852 raft_consensus.cc:3060] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:11.093564 28925 leader_election.cc:343] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:11.094483 28925 leader_election.cc:343] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.093683 29197 leader_election.cc:304] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.095271 29197 leader_election.cc:304] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.095497 29377 ts_tablet_manager.cc:1929] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:11.095587 29377 log.cc:1199] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/90ae9c63c8c541bc91ecedd798a7d60f
I20260617 20:17:11.095844 29377 ts_tablet_manager.cc:1950] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:11.096221 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1038) took 2697 ms. Trace:
I20260617 20:17:11.096283 31223 raft_consensus.cc:2804] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.096376 31223 raft_consensus.cc:697] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:11.096284 29377 rpcz_store.cc:276] 0617 20:17:08.398629 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.406893 (+ 8264us) service_pool.cc:224] Handling call
0617 20:17:11.075361 (+2668468us) ts_tablet_manager.cc:1151] Deleting tablet 90ae9c63c8c541bc91ecedd798a7d60f
0617 20:17:11.075372 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.092741 (+ 17369us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.095432 (+ 2691us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.096206 (+ 774us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2668320}
W20260617 20:17:11.096560 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1038) could send its response
I20260617 20:17:11.096518 30852 raft_consensus.cc:515] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.096606 31223 consensus_queue.cc:237] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.097647 31119 tablet_loader.cc:96] loaded metadata for tablet 219d85e4fd9b4ba3baf1e08d2b18a32c (table default.Table_fae70178b45747a29dfd1be32d78cff6 [id=cbe52ba840694bfea51b5f0e1fe56cfb])
I20260617 20:17:11.097648 30852 leader_election.cc:290] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.097800 30852 raft_consensus.cc:2804] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.097882 30852 raft_consensus.cc:493] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.098011 30852 raft_consensus.cc:3060] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.098992 29378 tablet_bootstrap.cc:654] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.100139 31119 tablet_loader.cc:96] loaded metadata for tablet 227d8a0d46294108a6b98a1a4b67fd6d (table default.Table_87d2647a76934415a43629381e657e1e [id=de24e09cee8e4f28998625c2697769b3])
I20260617 20:17:11.100605 31119 tablet_loader.cc:96] loaded metadata for tablet 24e4b91def8642b7a8a063c06f43e060 (table default.Table_e7c9eac3b94540da98ec3d751dbd0e66 [id=e290bb3d06a24182916980d122e5454c])
I20260617 20:17:11.101027 31119 tablet_loader.cc:96] loaded metadata for tablet 260b9cfb79684b168c20652392856808 (table default.Table_a819c05e072c49eca6f58ced1b6f4887 [id=845b578a03fd4bae95a9be628a2f1194])
I20260617 20:17:11.100996 30852 raft_consensus.cc:515] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.101668 31119 tablet_loader.cc:96] loaded metadata for tablet 264b0b683ad44ba094eccd7f1eaa425f (table default.Table_270cf0c20609474eaf9e30d5b9a8ecf8 [id=fe8b78e2faf5430a8eb680bcf966e32e])
I20260617 20:17:11.089928 31094 raft_consensus.cc:697] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:11.102433 31094 consensus_queue.cc:237] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.102566 31119 tablet_loader.cc:96] loaded metadata for tablet 26be48e94e504f489743b58516257e84 (table default.Table_1be0a0d75ff04898884097a3fee41047 [id=bebb09bca83942438374ea8a0a0b978a])
I20260617 20:17:11.103183 31119 tablet_loader.cc:96] loaded metadata for tablet 27bc0aa8024c48c5974ea2d8a292c2cb (table default.Table_be5429b8220b4c0abce2d16b0dea29a9 [id=390c6d1236a3439ea3efc34e561174a7])
I20260617 20:17:11.104144 31119 tablet_loader.cc:96] loaded metadata for tablet 285d44720ade4baab468fa423f71e26d (table default.Table_fc956f2e299343cd846ec9a9272c1440 [id=1128539144124290bbe452162d53e83b])
I20260617 20:17:11.104583 31119 tablet_loader.cc:96] loaded metadata for tablet 2860409277a0423cadadd79363713fd3 (table default.Table_b25f36c0ba1247f5a4b85a5b4add8420 [id=6a948594185b42128136770dbe3f0ffb])
I20260617 20:17:11.104596 31221 consensus_queue.cc:1048] T 71342100c8f746d384b4cef73086afd2 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.108040 30852 leader_election.cc:290] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.111647 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1040) took 2703 ms. Trace:
I20260617 20:17:11.111757 29377 rpcz_store.cc:276] 0617 20:17:08.408439 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.408503 (+ 64us) service_pool.cc:224] Handling call
0617 20:17:11.111481 (+2702978us) ts_tablet_manager.cc:1151] Deleting tablet ca4924e2825e4ec9b3302c1abb9c0bcf
0617 20:17:11.111497 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.111623 (+ 126us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2702823}
W20260617 20:17:11.112020 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1040) could send its response
I20260617 20:17:11.112506 31119 tablet_loader.cc:96] loaded metadata for tablet 287ddfe1b0a9419aab328beeb579d61b (table default.Table_432834dd55704c4589b84bcfae673d03 [id=7a61e654611a483488b8efdf8c0197bc])
I20260617 20:17:11.087653 29383 tablet_bootstrap.cc:492] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:11.113466 31119 tablet_loader.cc:96] loaded metadata for tablet 29a1074073ca48529275baaa3a065b4d (table default.Table_068e6f9e0da44fbba32efb8418d43f31 [id=652e7bce101f468aaf1d8d011bb396c5])
I20260617 20:17:11.113794 29383 ts_tablet_manager.cc:1403] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.070s user 0.007s sys 0.001s
I20260617 20:17:11.113924 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1036) took 2725 ms. Trace:
I20260617 20:17:11.114003 29377 rpcz_store.cc:276] 0617 20:17:08.388546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.408758 (+ 20212us) service_pool.cc:224] Handling call
0617 20:17:11.113800 (+2705042us) ts_tablet_manager.cc:1151] Deleting tablet aa626e3cdc7240deaf399b50b0258c50
0617 20:17:11.113813 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.113907 (+ 94us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2703882}
W20260617 20:17:11.114212 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1036) could send its response
I20260617 20:17:11.115245 29118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18791cd3384f4bd48c333a3460e85286" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.115669 31119 tablet_loader.cc:96] loaded metadata for tablet 2a63e5f4c5ec4b6ba53b4a072b022a6d (table default.Table_07414915a4624a09a17497c8455f51d3 [id=50f64b2e895c4669b7d4b1714175392b])
I20260617 20:17:11.116639 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ae9c63c8c541bc91ecedd798a7d60f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.117026 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da50400f49e24ca589519e6ec823957d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.117461 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b278ba32316c42d1b101e9803657af99" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.119114 29379 tablet_bootstrap.cc:492] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:11.119278 31119 tablet_loader.cc:96] loaded metadata for tablet 2acfbcce4bbd403aa608f9b62d611723 (table default.Table_cba2415155904e39af29aadcd63568b1 [id=5a8b12e534a84300b4feaedb62477673])
I20260617 20:17:11.119612 31119 tablet_loader.cc:96] loaded metadata for tablet 2b91a692a9c245cc897842ac29c210b3 (table default.Table_6791b989125046d893a9c24ae1e65c12 [id=e495b17f9a99422e9e29cf49befb762a])
I20260617 20:17:11.119930 31119 tablet_loader.cc:96] loaded metadata for tablet 2bdc7552bcf44fec9abfad002903b624 (table default.Table_18d04b2793af4915ac6a2f592f197b41 [id=4fa0724d031447898614e9f9f1ce16ec])
I20260617 20:17:11.120147 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18791cd3384f4bd48c333a3460e85286" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.120245 31119 tablet_loader.cc:96] loaded metadata for tablet 2c583de2973e4fb0abacf2692f3ab829 (table default.Table_2a05556c6a7e4dfa97378055d732828a [id=6361cd6c2ce14ffca426481ea0208f3c])
I20260617 20:17:11.120332 28985 raft_consensus.cc:3060] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.120882 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1046) took 2627 ms. Trace:
I20260617 20:17:11.120962 29377 rpcz_store.cc:276] 0617 20:17:08.493718 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.493783 (+ 65us) service_pool.cc:224] Handling call
0617 20:17:11.117639 (+2623856us) ts_tablet_manager.cc:1151] Deleting tablet 078875241c324538ad6f93de1169aeb8
0617 20:17:11.120778 (+ 3139us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.120866 (+ 88us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2623677}
W20260617 20:17:11.121155 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1046) could send its response
I20260617 20:17:11.121371 29377 tablet_replica.cc:333] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:11.121578 29377 raft_consensus.cc:2243] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:11.121737 29377 raft_consensus.cc:2272] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:11.121824 29198 leader_election.cc:343] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:11.122030 29198 leader_election.cc:343] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:11.122164 29198 leader_election.cc:343] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.122252 29377 ts_tablet_manager.cc:1916] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:11.122308 29198 leader_election.cc:343] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.122897 29383 raft_consensus.cc:359] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.122982 28985 raft_consensus.cc:2468] T 18791cd3384f4bd48c333a3460e85286 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:11.124207 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b278ba32316c42d1b101e9803657af99" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.124437 28985 raft_consensus.cc:2393] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 5ca3d93189744132bbf55ac01f3a8254 in this term.
I20260617 20:17:11.124998 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da50400f49e24ca589519e6ec823957d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.125506 29379 ts_tablet_manager.cc:1403] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.167s user 0.007s sys 0.003s
I20260617 20:17:11.132974 29379 raft_consensus.cc:359] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.134618 29379 raft_consensus.cc:385] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.135823 29379 raft_consensus.cc:740] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.137140 31119 tablet_loader.cc:96] loaded metadata for tablet 2d00c493a5624569b8f47242fc55b6fb (table default.Table_9c108f2be5f14aa3a1a939e8c6bb18ae [id=4e979fc0459843cd95a5268458cd5175])
I20260617 20:17:11.138065 31119 tablet_loader.cc:96] loaded metadata for tablet 2d0cce8795d34d64a702fc2b92dbfd9a (table default.Table_84c1d2b01f524da3917249139afe19b4 [id=07b0ad409eb74e75bd9d78b40faee1b7])
I20260617 20:17:11.137117 29379 consensus_queue.cc:260] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.139050 29379 ts_tablet_manager.cc:1434] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260617 20:17:11.139293 31119 tablet_loader.cc:96] loaded metadata for tablet 2dc25c0259c2414f86594418d7e92e18 (table default.Table_8a887192caa742b9a34884b64f306fee [id=bc5bc55a1e904cefa6910c6519f0d8a1])
I20260617 20:17:11.140138 31119 tablet_loader.cc:96] loaded metadata for tablet 2fa78288e42844a8ac19b961f2028c60 (table default.Table_50b5db1ff0ab437f8ae21d80d7b14f64 [id=781947c106f041dda409062a199c828b])
I20260617 20:17:11.142674 31119 tablet_loader.cc:96] loaded metadata for tablet 30882d71f69648058ed2a12b101a5d6b (table default.Table_8767b23f3baa41c883f4884d81573ee8 [id=87863576402f427c91cd119026c041f7])
I20260617 20:17:11.146144 31171 raft_consensus.cc:493] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.146297 31171 raft_consensus.cc:515] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.146631 31119 tablet_loader.cc:96] loaded metadata for tablet 31267063d24f4e89898349117a9a3031 (table default.Table_6f87ebb700cd4bcd8c9970ecae935a1a [id=908d6aab19ee442a9d9246694407969e])
I20260617 20:17:11.146919 31171 leader_election.cc:290] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:11.148161 29062 leader_election.cc:343] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: ebd98889d08f4683ba4b2ee98a74254d
I20260617 20:17:11.148669 31119 tablet_loader.cc:96] loaded metadata for tablet 326eb1cffb9a47078320e6fcba0743ce (table default.Table_8000cf41d95f4152983d7fe1d74cbdb8 [id=42f2f56c7b0f4ac4bddd9a9eea89a7b2])
I20260617 20:17:11.149168 31119 tablet_loader.cc:96] loaded metadata for tablet 32c3a4c3bee5444697f5d53d51c62894 (table default.Table_675137d48e694996a1fbfc31e4fd7c9b [id=7a5ce2f1ca114a508611d15c5a7c18c4])
I20260617 20:17:11.149319 29379 tablet_bootstrap.cc:492] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:11.149662 29377 ts_tablet_manager.cc:1929] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:11.150357 31119 tablet_loader.cc:96] loaded metadata for tablet 331273aec09e4ec894dc28c2e4387dda (table default.Table_e449fc7e82964090996a0aa1e86bc42d [id=a7832fcf4d9c4b48a4670981229e49ac])
I20260617 20:17:11.150550 29377 log.cc:1199] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/da50400f49e24ca589519e6ec823957d
I20260617 20:17:11.150991 29377 ts_tablet_manager.cc:1950] T da50400f49e24ca589519e6ec823957d P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:11.151098 29379 tablet_bootstrap.cc:654] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.154559 31119 tablet_loader.cc:96] loaded metadata for tablet 3369727329a74fa5bab98deb507f0d06 (table default.Table_6f988db656bc49f9b1dede83c87d1795 [id=1389c47aaaba4a9196cfaa09cde5da44])
I20260617 20:17:11.156173 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1051) took 2458 ms. Trace:
I20260617 20:17:11.157784 31119 tablet_loader.cc:96] loaded metadata for tablet 3413b0add2df453bb2839377af2e42cf (table default.Table_dc3d1baf230b4c32b23beb5d647a300d [id=642a5256a45b4ff3b1557a6c50d25d73])
I20260617 20:17:11.158406 29377 rpcz_store.cc:276] 0617 20:17:08.698058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.698116 (+ 58us) service_pool.cc:224] Handling call
0617 20:17:11.121336 (+2423220us) ts_tablet_manager.cc:1151] Deleting tablet da50400f49e24ca589519e6ec823957d
0617 20:17:11.121344 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.125018 (+ 3674us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.149602 (+ 24584us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.156152 (+ 6550us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2423021}
W20260617 20:17:11.158932 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1051) could send its response
I20260617 20:17:11.159415 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1055) took 2321 ms. Trace:
I20260617 20:17:11.159850 29377 rpcz_store.cc:276] 0617 20:17:08.838235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.838277 (+ 42us) service_pool.cc:224] Handling call
0617 20:17:11.159262 (+2320985us) ts_tablet_manager.cc:1151] Deleting tablet e401eea0717d4cbb8319e4d4b1ada410
0617 20:17:11.159273 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.159396 (+ 123us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2320766}
W20260617 20:17:11.160315 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1055) could send its response
I20260617 20:17:11.165567 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1056) took 2298 ms. Trace:
I20260617 20:17:11.166374 31119 tablet_loader.cc:96] loaded metadata for tablet 351860a39ac74dfaa95cd4d918980c23 (table default.Table_904b2e0f8c594d039717f494c0d47a1d [id=306bb3660c38430d9f1f414b05d94a34])
I20260617 20:17:11.166533 29377 rpcz_store.cc:276] 0617 20:17:08.867347 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.867400 (+ 53us) service_pool.cc:224] Handling call
0617 20:17:11.165449 (+2298049us) ts_tablet_manager.cc:1151] Deleting tablet b61162160ec248b7aa6c73c399be1842
0617 20:17:11.165459 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.165550 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2297863}
I20260617 20:17:11.166705 29379 tablet_bootstrap.cc:492] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:11.166859 29379 ts_tablet_manager.cc:1403] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.005s
I20260617 20:17:11.129521 31255 raft_consensus.cc:493] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.133715 29262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed860fa375848708beb31ff89056214" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.167008 31255 raft_consensus.cc:515] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:11.167132 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1056) could send its response
I20260617 20:17:11.167438 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1057) took 2284 ms. Trace:
I20260617 20:17:11.167513 29377 rpcz_store.cc:276] 0617 20:17:08.883091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.883143 (+ 52us) service_pool.cc:224] Handling call
0617 20:17:11.167334 (+2284191us) ts_tablet_manager.cc:1151] Deleting tablet ee9afd550a6d4d2e9edd84e4b49186c4
0617 20:17:11.167343 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.167422 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2283986}
I20260617 20:17:11.167701 31255 leader_election.cc:290] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:11.167699 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1057) could send its response
I20260617 20:17:11.134169 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b278ba32316c42d1b101e9803657af99" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:11.134353 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ae9c63c8c541bc91ecedd798a7d60f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:11.167840 29379 raft_consensus.cc:359] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.167953 29259 raft_consensus.cc:2393] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ca3d93189744132bbf55ac01f3a8254 in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:11.167971 29255 raft_consensus.cc:2393] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ca3d93189744132bbf55ac01f3a8254 in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:11.168081 29379 raft_consensus.cc:385] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.134419 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d811ca370ee54db8a7e4f6056017cd01" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.168160 29379 raft_consensus.cc:740] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.134357 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f15a7c18faa4e36bbb62809bb6e976c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:11.136396 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f544f486c144cd89ca7c5b83d252ee9" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
W20260617 20:17:11.138073 29197 consensus_peers.cc:597] T 269d2bb9f1fd45f89ab765b33a502baf P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 269d2bb9f1fd45f89ab765b33a502baf. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:11.168339 29256 raft_consensus.cc:3060] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.168365 29257 raft_consensus.cc:3060] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.168442 29379 consensus_queue.cc:260] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:11.168725 29197 leader_election.cc:343] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: e79c6804fbb34f5baebdb366f2e0b1bf
I20260617 20:17:11.168846 29197 leader_election.cc:304] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.168998 29379 ts_tablet_manager.cc:1434] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260617 20:17:11.169348 29379 tablet_bootstrap.cc:492] T 49e7a29b7fdd411e9957d23861a996db P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:11.169325 29197 leader_election.cc:304] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.170053 31221 raft_consensus.cc:2749] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.170372 31221 raft_consensus.cc:2804] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.170528 31221 raft_consensus.cc:697] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:11.170756 31221 consensus_queue.cc:237] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.170866 29257 raft_consensus.cc:2468] T 6f544f486c144cd89ca7c5b83d252ee9 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:11.170925 29256 raft_consensus.cc:2468] T 6f15a7c18faa4e36bbb62809bb6e976c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:11.171173 29379 tablet_bootstrap.cc:654] T 49e7a29b7fdd411e9957d23861a996db P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.171646 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1059) took 2219 ms. Trace:
I20260617 20:17:11.171995 31119 tablet_loader.cc:96] loaded metadata for tablet 35d04a55d6524131b29aef7c6795fbf9 (table default.Table_8caf7f807d004b8b9f981df76b53a90f [id=5b8a7c9b972345b4ad60d664e3dfd9c3])
I20260617 20:17:11.172360 29377 rpcz_store.cc:276] 0617 20:17:08.952320 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.952375 (+ 55us) service_pool.cc:224] Handling call
0617 20:17:11.171526 (+2219151us) ts_tablet_manager.cc:1151] Deleting tablet ab011d76c5ff4eae8e20fceab66513e1
0617 20:17:11.171536 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.171631 (+ 95us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2218956}
I20260617 20:17:11.172988 31119 tablet_loader.cc:96] loaded metadata for tablet 36234ae72453439c85474912870aec2d (table default.Table_10a2068f0dcf4304897997f6f319612a [id=87b48be639d14f4c8ef661db36695716])
W20260617 20:17:11.173260 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1059) could send its response
I20260617 20:17:11.173645 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1062) took 2183 ms. Trace:
I20260617 20:17:11.174079 29377 rpcz_store.cc:276] 0617 20:17:08.990091 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.096882 (+106791us) service_pool.cc:224] Handling call
0617 20:17:11.173548 (+2076666us) ts_tablet_manager.cc:1151] Deleting tablet 93daae49ea3b4abd8623f64bffdd1f6a
0617 20:17:11.173556 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.173631 (+ 75us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2076287}
I20260617 20:17:11.174652 31119 tablet_loader.cc:96] loaded metadata for tablet 3656e8549ea543e3b7a7cc1490aad71c (table default.Table_6084cccbc3fe415eb83ba19e8c8edb9c [id=4b3cdb2f571542888c313ddae66d4c8b])
W20260617 20:17:11.174906 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1062) could send its response
I20260617 20:17:11.175246 29377 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1064) took 2008 ms. Trace:
I20260617 20:17:11.175562 29377 rpcz_store.cc:276] 0617 20:17:09.167266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.168213 (+ 947us) service_pool.cc:224] Handling call
0617 20:17:11.175151 (+2006938us) ts_tablet_manager.cc:1151] Deleting tablet c9f2a320a1e14115bfe7e70a498a4f27
0617 20:17:11.175160 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.175231 (+ 71us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1956519}
I20260617 20:17:11.176651 31119 tablet_loader.cc:96] loaded metadata for tablet 371b85d5e6974d45b5ca122d9bf96201 (table default.Table_102ea82c80b64c00b6f6a79a87b687f7 [id=74c63621fa8d4b8894442b7897d714a6])
W20260617 20:17:11.176903 28924 connection.cc:466] server connection from 127.0.0.1:55834 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55834 (request call id 1064) could send its response
I20260617 20:17:11.178345 31119 tablet_loader.cc:96] loaded metadata for tablet 37214b955d63478088b9f723bcbc588a (table default.Table_70b749ff7ffb4047b023ae8c67106dfb [id=dc6173b97e40451aaf245fe2ec542e94])
I20260617 20:17:11.179762 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54969e138cf745739b54203c11e4c94e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:11.179963 31119 tablet_loader.cc:96] loaded metadata for tablet 3992cf5fd268481297c29515416d47e5 (table default.Table_36ec6892bea94b65b641c5b752fd1fdf [id=dacea1c7ac4243d8acd20757eaa05249])
W20260617 20:17:11.180420 29198 leader_election.cc:343] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.180606 31119 tablet_loader.cc:96] loaded metadata for tablet 39e1b23e6ea843df8d0528f9b427f47f (table default.Table_e4eb4ddc78ad49f8b8b28c441d0ca39f [id=ea076d1ff6b74b85b228164033b35451])
I20260617 20:17:11.180856 29383 raft_consensus.cc:385] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.180954 29383 raft_consensus.cc:740] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.181361 29383 consensus_queue.cc:260] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.182252 29383 ts_tablet_manager.cc:1434] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.068s user 0.002s sys 0.000s
I20260617 20:17:11.182578 29383 tablet_bootstrap.cc:492] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:11.184190 31119 tablet_loader.cc:96] loaded metadata for tablet 39ea9cfa1c5a42359e5fa8a2c4c433a4 (table default.Table_99e2a4b9958548c38b48f359a9a50f00 [id=8cd039ca4c474501ae4578e0c815829b])
I20260617 20:17:11.184615 31119 tablet_loader.cc:96] loaded metadata for tablet 3a17f7ef070d4879a520a3eb6bdf3d23 (table default.Table_f581f3582276489b851bca84cea0cd2d [id=75b4797252e34fb0a8875cf4c084cfc1])
I20260617 20:17:11.192556 31119 tablet_loader.cc:96] loaded metadata for tablet 3a5aca2e76c34c17b17a5593dc5eefe9 (table default.Table_20640097ea6e4184ac6fb53704a54d25 [id=034cf1b4052a47b4943205b51ea3841e])
I20260617 20:17:11.193105 31171 raft_consensus.cc:493] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.193349 31171 raft_consensus.cc:515] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.194190 31119 tablet_loader.cc:96] loaded metadata for tablet 3b4092872f00406db21748740131eb3e (table default.Table_86ee1dcdebe4461692b1cc1234cc4965 [id=6a1430fa99ea4bbe98f5513393111db0])
I20260617 20:17:11.194273 31171 leader_election.cc:290] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.195025 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d778641c354c679ee9e7d7b3eae3b5" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.195253 28985 raft_consensus.cc:2393] T 80d778641c354c679ee9e7d7b3eae3b5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:11.197055 31119 tablet_loader.cc:96] loaded metadata for tablet 3ba37157424248b6abbb1db9d3d6ab33 (table default.Table_f847106ae8c04ab0ace089e9e123c60b [id=b057fddf626d4168909b6102afc67f7a])
I20260617 20:17:11.197957 31119 tablet_loader.cc:96] loaded metadata for tablet 3ca8f0b0eee3442cb3480a4a82b0f36a (table default.Table_1fd4aafa3a644484b4e40f3123e8cda2 [id=fbb1db6a8a474a0380eaa5ed2322e744])
I20260617 20:17:11.200192 31119 tablet_loader.cc:96] loaded metadata for tablet 3e5949e832ca477e9effbe340f439e9c (table default.Table_8fe57f69092a42f585d9f8c5abeb30f7 [id=3294644f679b4a5ebad7932a3eeceb22])
I20260617 20:17:11.204689 31119 tablet_loader.cc:96] loaded metadata for tablet 3eb95fe84c254f2aa7c7cb62374ac3ca (table default.Table_f81311971e2a4b36a7bf5ac219b8ab58 [id=9258b09978fe4fc7a60b8c621fadb5b0])
I20260617 20:17:11.206058 31119 tablet_loader.cc:96] loaded metadata for tablet 401c2793bc6241c0aef1263597a3ef24 (table default.Table_49d176333f04466aa2554d7107e748f7 [id=954a691bcf674227964a49a2a73c91ef])
I20260617 20:17:11.211331 31119 tablet_loader.cc:96] loaded metadata for tablet 418fae5a0e3248d8a657ad150bf50376 (table default.Table_91ce1deb19d345e983397a67460cabcb [id=ee557d3a99a5471398131086daf8412f])
I20260617 20:17:11.213615 29378 tablet_bootstrap.cc:492] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:11.213799 29378 ts_tablet_manager.cc:1403] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.126s user 0.010s sys 0.017s
I20260617 20:17:11.214700 29378 raft_consensus.cc:359] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.214910 29378 raft_consensus.cc:385] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.214999 29378 raft_consensus.cc:740] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.215279 29378 consensus_queue.cc:260] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.216215 29383 tablet_bootstrap.cc:654] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.217851 31249 raft_consensus.cc:493] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.217972 31249 raft_consensus.cc:515] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.218500 31249 leader_election.cc:290] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.219419 29378 ts_tablet_manager.cc:1434] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260617 20:17:11.220640 29378 tablet_bootstrap.cc:492] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:11.221565 31249 raft_consensus.cc:493] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.221704 31249 raft_consensus.cc:515] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.222215 31249 leader_election.cc:290] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.222954 31119 tablet_loader.cc:96] loaded metadata for tablet 425c1727564745b2ab84b39a2d190db5 (table default.Table_b483cf7dec364fe98091142bf8d1a6a2 [id=ace0c10d79f74e72877f216ad9ac8415])
I20260617 20:17:11.222898 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6d214816540ac90dc9b2ad3cdb89f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.223413 28925 leader_election.cc:343] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.225081 31119 tablet_loader.cc:96] loaded metadata for tablet 43462cf7003747d08e6b0e5db5999b3f (table default.Table_d4f8ff9bb47c440b96251b7d063e73f6 [id=b267380ca82144ebbc909227070c204e])
I20260617 20:17:11.086705 29376 ts_tablet_manager.cc:1929] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:11.225462 29376 log.cc:1199] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/938b61a0f6dc4d178971034fd18c1674
I20260617 20:17:11.225546 31119 tablet_loader.cc:96] loaded metadata for tablet 4372081172384c9f96388d38208d9853 (table default.Table_b6faf540da644f658eb715d3ffacd616 [id=8ebd35bd7b464cd489f6a15d0e70800e])
I20260617 20:17:11.225971 29376 ts_tablet_manager.cc:1950] T 938b61a0f6dc4d178971034fd18c1674 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:11.226711 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1043) took 3304 ms. Trace:
I20260617 20:17:11.227098 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52873eade4048af81a8e51233b9d079" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.227582 28925 leader_election.cc:343] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.228223 31119 tablet_loader.cc:96] loaded metadata for tablet 44ee3364741d445880281da93d13f400 (table default.Table_a85f39b0bb4a487098a661b4eca8de9f [id=bd35b542e6d84cf3bf32977390914403])
I20260617 20:17:11.228636 31119 tablet_loader.cc:96] loaded metadata for tablet 450b08b439814915ab4371770f49f45b (table default.Table_706c0e9f917f49388f2da836758dcf8d [id=92baee89c27c4013a1a3fcc703ee1c23])
W20260617 20:17:11.228968 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 59681us
W20260617 20:17:11.229172 29197 leader_election.cc:343] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 90ae9c63c8c541bc91ecedd798a7d60f
I20260617 20:17:11.229270 29197 leader_election.cc:304] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.229645 29197 leader_election.cc:304] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:17:11.229996 29197 leader_election.cc:343] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Illegal state: Tablet not RUNNING: STOPPED
I20260617 20:17:11.230091 29197 leader_election.cc:304] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.230362 31221 raft_consensus.cc:2749] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.230518 31221 raft_consensus.cc:2749] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.230638 31221 raft_consensus.cc:2749] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.226845 29376 rpcz_store.cc:276] 0617 20:17:07.922661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.922723 (+ 62us) service_pool.cc:224] Handling call
0617 20:17:10.995641 (+3072918us) ts_tablet_manager.cc:1151] Deleting tablet 938b61a0f6dc4d178971034fd18c1674
0617 20:17:10.995657 (+ 16us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.027477 (+ 31820us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.086551 (+ 59074us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.226694 (+140143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3072191}
I20260617 20:17:11.231081 31119 tablet_loader.cc:96] loaded metadata for tablet 46dc6997caa74ccea3e5d4a7fb34a6f6 (table default.Table_c2d261c0ee9147409da728ff7de82e89 [id=850325382fbe4208aa36305354ab7044])
I20260617 20:17:11.231370 29376 tablet_replica.cc:333] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:11.231698 29376 raft_consensus.cc:2243] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
W20260617 20:17:11.231710 28925 leader_election.cc:343] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.231824 28925 leader_election.cc:304] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.232024 31249 raft_consensus.cc:2749] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.232427 29376 raft_consensus.cc:2272] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:11.232530 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54969e138cf745739b54203c11e4c94e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.232641 28925 leader_election.cc:304] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.232684 28985 raft_consensus.cc:2468] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:11.232946 31249 raft_consensus.cc:2749] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.233335 28925 leader_election.cc:304] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.233467 29376 ts_tablet_manager.cc:1916] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260617 20:17:11.233485 28925 raft_consensus.cc:2686] T 90ae9c63c8c541bc91ecedd798a7d60f P 5ca3d93189744132bbf55ac01f3a8254: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260617 20:17:11.233968 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1043) could send its response
W20260617 20:17:11.234032 28925 leader_election.cc:343] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.234117 28925 leader_election.cc:304] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.234393 28925 leader_election.cc:304] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.234436 29256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd98889d08f4683ba4b2ee98a74254d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.234575 29256 raft_consensus.cc:2468] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:11.234740 28925 leader_election.cc:304] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.235087 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80d778641c354c679ee9e7d7b3eae3b5" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.235544 31259 raft_consensus.cc:493] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.235576 31065 raft_consensus.cc:2749] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.235646 31259 raft_consensus.cc:515] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.235733 31065 raft_consensus.cc:2804] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.235814 31065 raft_consensus.cc:697] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:11.236047 31065 consensus_queue.cc:237] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.236513 30967 raft_consensus.cc:2804] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.236572 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c6f0765b4329af28d72c8e94240a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.237012 29198 leader_election.cc:343] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.237224 31259 leader_election.cc:290] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.237564 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52873eade4048af81a8e51233b9d079" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.237986 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6d214816540ac90dc9b2ad3cdb89f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.238027 31249 raft_consensus.cc:493] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.238132 31249 raft_consensus.cc:515] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.238416 29063 leader_election.cc:304] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:11.238646 31249 leader_election.cc:290] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.238797 31171 raft_consensus.cc:2804] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.238898 31171 raft_consensus.cc:493] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.238986 31171 raft_consensus.cc:3060] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.239208 29376 ts_tablet_manager.cc:1929] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:11.239295 29376 log.cc:1199] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/5b2797384f7845969ee9744b444f1acc
I20260617 20:17:11.239609 29376 ts_tablet_manager.cc:1950] T 5b2797384f7845969ee9744b444f1acc P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:11.240245 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1044) took 3317 ms. Trace:
I20260617 20:17:11.240314 29376 rpcz_store.cc:276] 0617 20:17:07.922778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:07.922962 (+ 184us) service_pool.cc:224] Handling call
0617 20:17:11.231095 (+3308133us) ts_tablet_manager.cc:1151] Deleting tablet 5b2797384f7845969ee9744b444f1acc
0617 20:17:11.231106 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.236434 (+ 5328us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.239158 (+ 2724us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.240229 (+ 1071us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3307949}
I20260617 20:17:11.240604 29376 tablet_replica.cc:333] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:11.240769 29376 raft_consensus.cc:2243] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:11.241019 29376 raft_consensus.cc:2272] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:11.241359 31009 raft_consensus.cc:493] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.241493 31009 raft_consensus.cc:515] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.242136 31009 leader_election.cc:290] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:11.243984 29062 leader_election.cc:343] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 26ebcfc80ca64129a7ab939bfd853998
I20260617 20:17:11.244336 31171 raft_consensus.cc:515] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.244902 31171 leader_election.cc:290] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:11.246296 29062 leader_election.cc:343] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: ebd98889d08f4683ba4b2ee98a74254d
I20260617 20:17:11.247126 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3dd481bc2745fba5460e26e49fa53b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.247639 28925 leader_election.cc:343] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.248189 29121 raft_consensus.cc:3060] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.249127 29378 tablet_bootstrap.cc:654] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.251550 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c6f0765b4329af28d72c8e94240a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.251732 28985 raft_consensus.cc:2468] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:11.251719 29197 leader_election.cc:304] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.251821 29063 leader_election.cc:304] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.252218 31221 raft_consensus.cc:2804] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.252336 31221 raft_consensus.cc:493] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.252430 31221 raft_consensus.cc:3060] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:11.252427 28925 leader_election.cc:343] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.252542 28925 leader_election.cc:304] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:11.252923 28925 leader_election.cc:343] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.253032 28925 leader_election.cc:304] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.253363 31249 raft_consensus.cc:2749] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.253521 31249 raft_consensus.cc:2749] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.254315 31119 tablet_loader.cc:96] loaded metadata for tablet 4885f685cdcd4f01adea4819f09ef51e (table default.Table_489218ed90a3450591befcb0c8064bc7 [id=9f014e9b411e496398d894dc77706d04])
I20260617 20:17:11.255076 31119 tablet_loader.cc:96] loaded metadata for tablet 48caf549502b4493b73ba33aeccc1a5a (table default.Table_a856b87de7f949c4b0afa2cfc3a8489e [id=bf33219f4b4f449f8fc11bcea9b04f4f])
I20260617 20:17:11.255460 31119 tablet_loader.cc:96] loaded metadata for tablet 48cfb5fe21bc477cab8df011b6bee2d5 (table default.Table_3efde5426d164371bad188299aea42a3 [id=00fdc977a27c4d2b909589cea193d5ce])
I20260617 20:17:11.255944 31119 tablet_loader.cc:96] loaded metadata for tablet 491aa3630ee44380aaf7c6f2d18c2eb1 (table default.Table_9e2110e4c0414947ac06773cfa319bd9 [id=c7a0a1cdc83547ea8838bc07c976f705])
I20260617 20:17:11.256307 31119 tablet_loader.cc:96] loaded metadata for tablet 49e7a29b7fdd411e9957d23861a996db (table default.Table_1e0e98bdedab480c9d07bc266771250e [id=55e2fa74a9a4405886cfb7982e27eb5f])
I20260617 20:17:11.256436 29383 tablet_bootstrap.cc:492] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:11.256629 29383 ts_tablet_manager.cc:1403] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.074s user 0.003s sys 0.000s
I20260617 20:17:11.256747 31221 raft_consensus.cc:515] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.256915 31119 tablet_loader.cc:96] loaded metadata for tablet 4a9c78405277486a820893557701001d (table default.Table_1a39ae6042f446fb9caf98ad3c112778 [id=81ed246c6c4e472cae20325602c523a2])
I20260617 20:17:11.257347 30967 raft_consensus.cc:697] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:11.257622 29383 raft_consensus.cc:359] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.257822 29383 raft_consensus.cc:385] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.257601 30967 consensus_queue.cc:237] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.257998 29383 raft_consensus.cc:740] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.258356 29383 consensus_queue.cc:260] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.258823 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54969e138cf745739b54203c11e4c94e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:11.259469 29198 leader_election.cc:343] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.259675 31221 leader_election.cc:290] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.262548 31171 raft_consensus.cc:2749] T 80d778641c354c679ee9e7d7b3eae3b5 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.257138 29376 ts_tablet_manager.cc:1916] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:11.257504 29197 leader_election.cc:304] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
W20260617 20:17:11.264708 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1044) could send its response
I20260617 20:17:11.265426 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54969e138cf745739b54203c11e4c94e" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.265658 28985 raft_consensus.cc:3060] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.265827 31094 consensus_queue.cc:1048] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.266667 31094 raft_consensus.cc:2804] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.266743 31094 raft_consensus.cc:493] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.266804 31094 raft_consensus.cc:3060] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.269727 28985 raft_consensus.cc:2468] T 54969e138cf745739b54203c11e4c94e P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:11.270973 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebd98889d08f4683ba4b2ee98a74254d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:11.271186 29255 raft_consensus.cc:3060] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.272570 31094 raft_consensus.cc:515] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.274188 31094 leader_election.cc:290] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.274325 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c6f0765b4329af28d72c8e94240a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:11.274916 29198 leader_election.cc:343] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.275121 29255 raft_consensus.cc:2468] T ebd98889d08f4683ba4b2ee98a74254d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:11.275533 31171 raft_consensus.cc:493] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.275724 31171 raft_consensus.cc:515] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.276691 31171 leader_election.cc:290] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.277848 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326eb1cffb9a47078320e6fcba0743ce" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.278206 28985 raft_consensus.cc:2393] T 326eb1cffb9a47078320e6fcba0743ce P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:11.278331 31119 tablet_loader.cc:96] loaded metadata for tablet 4f0697e4379141238d1fa70297731187 (table default.Table_3f639bb9ece9443ea9d7f7cf5ec04be4 [id=80f77a5c1229411b9e3b5c0094eca5f5])
I20260617 20:17:11.279157 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3dd481bc2745fba5460e26e49fa53b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:11.279914 29063 leader_election.cc:343] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 26ebcfc80ca64129a7ab939bfd853998
I20260617 20:17:11.280088 29063 leader_election.cc:304] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.280622 31171 raft_consensus.cc:2749] T 26ebcfc80ca64129a7ab939bfd853998 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.281880 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c6f0765b4329af28d72c8e94240a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.282153 28985 raft_consensus.cc:3060] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.285732 28985 raft_consensus.cc:2468] T 9574c6f0765b4329af28d72c8e94240a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:11.286150 29063 leader_election.cc:304] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:11.286692 31171 raft_consensus.cc:2804] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.286280 29383 ts_tablet_manager.cc:1434] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.030s user 0.002s sys 0.000s
I20260617 20:17:11.287271 31171 raft_consensus.cc:697] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:11.287631 31171 consensus_queue.cc:237] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.289561 29197 leader_election.cc:304] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.290174 31221 raft_consensus.cc:493] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.290346 31221 raft_consensus.cc:515] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.291113 31221 leader_election.cc:290] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.291290 31221 raft_consensus.cc:2804] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.292053 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71049338f673401bad32204d232bfe43" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:11.292445 31221 raft_consensus.cc:697] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
W20260617 20:17:11.292711 29198 leader_election.cc:343] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.292824 31221 consensus_queue.cc:237] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.293862 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326eb1cffb9a47078320e6fcba0743ce" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.295436 29063 leader_election.cc:304] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.295969 31009 raft_consensus.cc:3060] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.296518 29383 tablet_bootstrap.cc:492] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:11.299499 31009 raft_consensus.cc:2749] T 326eb1cffb9a47078320e6fcba0743ce P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:11.289203 28925 leader_election.cc:343] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.302788 28925 leader_election.cc:304] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.303292 31065 raft_consensus.cc:2749] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.293519 29378 tablet_bootstrap.cc:492] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:11.294827 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71049338f673401bad32204d232bfe43" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.304169 28978 raft_consensus.cc:2468] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:11.304550 29378 ts_tablet_manager.cc:1403] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.084s user 0.005s sys 0.001s
I20260617 20:17:11.305106 31119 tablet_loader.cc:96] loaded metadata for tablet 4f232832e4af48e691ddd50576188203 (table default.Table_0f5f4151702f48399790f86347a98506 [id=d4319ca115ed4935b14fef47fd239c03])
I20260617 20:17:11.305380 29378 raft_consensus.cc:359] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.305544 29378 raft_consensus.cc:385] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.305647 29378 raft_consensus.cc:740] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.305683 31119 tablet_loader.cc:96] loaded metadata for tablet 4f35fb10da0c452aa06f00c25105154c (table default.Table_a7a5ea2c387e417aae386b585127cb0f [id=7104732645714a098ce4a19d87a3b629])
I20260617 20:17:11.305931 29378 consensus_queue.cc:260] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.306432 29378 ts_tablet_manager.cc:1434] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:11.306627 31119 tablet_loader.cc:96] loaded metadata for tablet 4fa767d4abdb49e2acdc4f6af75d35e4 (table default.Table_9ff46b3a183c48f8b7111d7d5651879e [id=db00d9615d1b48ceb5cf02f8de509878])
I20260617 20:17:11.307067 31119 tablet_loader.cc:96] loaded metadata for tablet 506a7db0157b42038ca6312ce987f0b8 (table default.Table_77e7189ea1ef4f3c9af44f3374988908 [id=4efc3cc7163244929a5d09c31838be7a])
I20260617 20:17:11.309722 31119 tablet_loader.cc:96] loaded metadata for tablet 5084275e29a94669b1700447fd90876b (table default.Table_4b555cc3fa1e4dd5b51da47450054b76 [id=0eb555ca618f468b9ca3c05e4d126835])
I20260617 20:17:11.310184 31119 tablet_loader.cc:96] loaded metadata for tablet 50a5480896af417f93a98e336890f8e1 (table default.Table_50062ea6504540bf8c760f69ae119740 [id=97e6dec6db75462c87ea869c7c4fe9f8])
I20260617 20:17:11.311105 31119 tablet_loader.cc:96] loaded metadata for tablet 51182783b1ba499fbd7f06c7e580e8af (table default.Table_3f6418bb5b1044818dab9ca960037e3b [id=c27ec2a6a229457594d26bae2222fec1])
I20260617 20:17:11.311960 29379 tablet_bootstrap.cc:492] T 49e7a29b7fdd411e9957d23861a996db P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:11.312170 29379 ts_tablet_manager.cc:1403] T 49e7a29b7fdd411e9957d23861a996db P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.143s user 0.034s sys 0.062s
I20260617 20:17:11.312912 29379 raft_consensus.cc:359] T 49e7a29b7fdd411e9957d23861a996db P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.313082 29379 raft_consensus.cc:385] T 49e7a29b7fdd411e9957d23861a996db P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.313148 29379 raft_consensus.cc:740] T 49e7a29b7fdd411e9957d23861a996db P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.313355 29378 tablet_bootstrap.cc:492] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:11.313367 29379 consensus_queue.cc:260] T 49e7a29b7fdd411e9957d23861a996db P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.314090 29376 ts_tablet_manager.cc:1929] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:11.314201 29376 log.cc:1199] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/e3897179e7724fdeb87a979ae4ef2091
I20260617 20:17:11.314594 29376 ts_tablet_manager.cc:1950] T e3897179e7724fdeb87a979ae4ef2091 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:11.314939 29197 leader_election.cc:304] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.315315 29197 leader_election.cc:304] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.315747 30852 raft_consensus.cc:2804] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.315913 30852 raft_consensus.cc:697] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:11.316177 30852 consensus_queue.cc:237] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.316480 29383 tablet_bootstrap.cc:654] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.317413 31259 raft_consensus.cc:2804] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.317512 31259 raft_consensus.cc:493] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.317601 31259 raft_consensus.cc:3060] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.319108 29379 ts_tablet_manager.cc:1434] T 49e7a29b7fdd411e9957d23861a996db P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260617 20:17:11.320580 31259 raft_consensus.cc:515] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.321484 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1045) took 3198 ms. Trace:
I20260617 20:17:11.321492 29379 tablet_bootstrap.cc:492] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:11.321631 29376 rpcz_store.cc:276] 0617 20:17:08.122602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.122955 (+ 353us) service_pool.cc:224] Handling call
0617 20:17:11.240558 (+3117603us) ts_tablet_manager.cc:1151] Deleting tablet e3897179e7724fdeb87a979ae4ef2091
0617 20:17:11.240569 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.311308 (+ 70739us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.314041 (+ 2733us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.321441 (+ 7400us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3117429}
I20260617 20:17:11.322178 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1047) took 3139 ms. Trace:
I20260617 20:17:11.322253 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71049338f673401bad32204d232bfe43" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.322322 29376 rpcz_store.cc:276] 0617 20:17:08.182303 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.183114 (+ 811us) service_pool.cc:224] Handling call
0617 20:17:11.322044 (+3138930us) ts_tablet_manager.cc:1151] Deleting tablet 5d93449f5d5d41fb9883db3bce10f969
0617 20:17:11.322053 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.322144 (+ 91us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3138706}
W20260617 20:17:11.322748 29198 leader_election.cc:343] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.322798 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1046) took 3141 ms. Trace:
I20260617 20:17:11.322992 29376 rpcz_store.cc:276] 0617 20:17:08.180875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.183062 (+ 2187us) service_pool.cc:224] Handling call
0617 20:17:11.322675 (+3139613us) ts_tablet_manager.cc:1151] Deleting tablet 6f08bdd9c769403db89c20aabdc58d59
0617 20:17:11.322683 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.322756 (+ 73us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3107538}
I20260617 20:17:11.323346 31259 leader_election.cc:290] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.323580 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1048) took 3082 ms. Trace:
I20260617 20:17:11.323711 29376 rpcz_store.cc:276] 0617 20:17:08.241257 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.241352 (+ 95us) service_pool.cc:224] Handling call
0617 20:17:11.323326 (+3081974us) ts_tablet_manager.cc:1151] Deleting tablet 05e5918dcafc4accb0345a8389b65412
0617 20:17:11.323339 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.323520 (+ 181us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3081713}
I20260617 20:17:11.324102 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1055) took 2876 ms. Trace:
I20260617 20:17:11.324244 29376 rpcz_store.cc:276] 0617 20:17:08.447635 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.447783 (+ 148us) service_pool.cc:224] Handling call
0617 20:17:11.323967 (+2876184us) ts_tablet_manager.cc:1151] Deleting tablet aa626e3cdc7240deaf399b50b0258c50
0617 20:17:11.323975 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.324041 (+ 66us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2875958}
I20260617 20:17:11.324661 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1056) took 2876 ms. Trace:
I20260617 20:17:11.324724 31249 raft_consensus.cc:493] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.324810 29376 rpcz_store.cc:276] 0617 20:17:08.447891 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.448035 (+ 144us) service_pool.cc:224] Handling call
0617 20:17:11.324521 (+2876486us) ts_tablet_manager.cc:1151] Deleting tablet c10b96bee83b419dbfc2a8e26f88e719
0617 20:17:11.324529 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.324601 (+ 72us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2876329}
I20260617 20:17:11.324852 31249 raft_consensus.cc:515] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.325344 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1057) took 2877 ms. Trace:
I20260617 20:17:11.325407 31249 leader_election.cc:290] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.325433 29376 rpcz_store.cc:276] 0617 20:17:08.448107 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.448216 (+ 109us) service_pool.cc:224] Handling call
0617 20:17:11.325033 (+2876817us) ts_tablet_manager.cc:1151] Deleting tablet ca4924e2825e4ec9b3302c1abb9c0bcf
0617 20:17:11.325040 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.325274 (+ 234us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2876692}
I20260617 20:17:11.326515 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1063) took 2818 ms. Trace:
I20260617 20:17:11.326669 29376 rpcz_store.cc:276] 0617 20:17:08.508350 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.510253 (+ 1903us) service_pool.cc:224] Handling call
0617 20:17:11.326376 (+2816123us) ts_tablet_manager.cc:1151] Deleting tablet 078875241c324538ad6f93de1169aeb8
0617 20:17:11.326384 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.326463 (+ 79us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2815826}
I20260617 20:17:11.326768 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71049338f673401bad32204d232bfe43" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.326769 29379 tablet_bootstrap.cc:654] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.326941 28978 raft_consensus.cc:3060] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.327637 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1070) took 2607 ms. Trace:
I20260617 20:17:11.327762 29376 rpcz_store.cc:276] 0617 20:17:08.719867 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.719933 (+ 66us) service_pool.cc:224] Handling call
0617 20:17:11.327204 (+2607271us) ts_tablet_manager.cc:1151] Deleting tablet 203666e6127b49ed92731bc87ce01798
0617 20:17:11.327212 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.327585 (+ 373us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2607033}
I20260617 20:17:11.328184 29376 tablet_replica.cc:333] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:11.328483 29376 raft_consensus.cc:2243] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:11.329046 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3091c332a14c4c99bd28e401769e30" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.329535 28925 leader_election.cc:343] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.329991 29376 raft_consensus.cc:2272] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:11.330812 28978 raft_consensus.cc:2468] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:11.331096 29383 tablet_bootstrap.cc:492] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:11.331657 29383 ts_tablet_manager.cc:1403] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
W20260617 20:17:11.332211 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1045) could send its response
W20260617 20:17:11.332434 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1047) could send its response
W20260617 20:17:11.332635 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1046) could send its response
W20260617 20:17:11.332818 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1048) could send its response
W20260617 20:17:11.332988 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1055) could send its response
I20260617 20:17:11.332576 29383 raft_consensus.cc:359] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:11.333447 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1056) could send its response
W20260617 20:17:11.333722 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1057) could send its response
I20260617 20:17:11.333588 29383 raft_consensus.cc:385] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.334246 29376 ts_tablet_manager.cc:1916] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:11.335995 30967 raft_consensus.cc:493] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.334297 29383 raft_consensus.cc:740] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.334645 30852 raft_consensus.cc:493] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.336776 30967 raft_consensus.cc:515] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.337615 30852 raft_consensus.cc:515] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.338204 30852 leader_election.cc:290] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.338248 30967 leader_election.cc:290] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.339377 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9655a1164fa84f53bdb9fd31b2fcda78" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:11.339408 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5949e832ca477e9effbe340f439e9c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.340231 29198 leader_election.cc:343] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:11.340507 28925 leader_election.cc:343] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.340858 29383 consensus_queue.cc:260] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.341684 29383 ts_tablet_manager.cc:1434] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260617 20:17:11.342031 29383 tablet_bootstrap.cc:492] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:11.343745 29383 tablet_bootstrap.cc:654] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:11.334789 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1063) could send its response
W20260617 20:17:11.344961 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1070) could send its response
W20260617 20:17:11.346843 29198 consensus_peers.cc:597] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:11.347163 29197 leader_election.cc:304] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.347503 30852 raft_consensus.cc:2804] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.347628 30852 raft_consensus.cc:697] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:11.347891 30852 consensus_queue.cc:237] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.352838 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3091c332a14c4c99bd28e401769e30" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.353540 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9655a1164fa84f53bdb9fd31b2fcda78" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.354254 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5949e832ca477e9effbe340f439e9c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.354547 28978 raft_consensus.cc:2468] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:17:11.355312 28925 leader_election.cc:343] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.355424 28925 leader_election.cc:304] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.355858 31263 raft_consensus.cc:2749] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:11.356403 28925 leader_election.cc:343] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.356500 28925 leader_election.cc:304] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.356863 31263 raft_consensus.cc:2749] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.357594 29378 tablet_bootstrap.cc:654] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.358451 29197 leader_election.cc:304] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.359053 31221 raft_consensus.cc:2804] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.359213 31221 raft_consensus.cc:493] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.359356 31221 raft_consensus.cc:3060] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.361891 31221 raft_consensus.cc:515] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.362998 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5949e832ca477e9effbe340f439e9c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:11.363608 29198 leader_election.cc:343] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.363823 31221 leader_election.cc:290] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.364796 31221 consensus_queue.cc:1048] T 20d0b861d48e4baf94387f4ff9d9f778 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.365578 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5949e832ca477e9effbe340f439e9c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.365742 28978 raft_consensus.cc:3060] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.368918 28978 raft_consensus.cc:2468] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:11.387727 29197 leader_election.cc:304] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.388408 30852 raft_consensus.cc:2804] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.389417 30852 raft_consensus.cc:697] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:11.389812 30852 consensus_queue.cc:237] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.402009 29379 tablet_bootstrap.cc:492] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:11.402415 29379 ts_tablet_manager.cc:1403] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.081s user 0.013s sys 0.026s
I20260617 20:17:11.402618 31263 raft_consensus.cc:493] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.402892 31263 raft_consensus.cc:515] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.403725 29379 raft_consensus.cc:359] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.404031 29379 raft_consensus.cc:385] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.404138 29379 raft_consensus.cc:740] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.404455 31263 leader_election.cc:290] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.404937 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dc704cf0844f579cced79fdf8c3da5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.405646 28925 leader_election.cc:343] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.406052 29379 consensus_queue.cc:260] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.411070 29379 ts_tablet_manager.cc:1434] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260617 20:17:11.411689 29379 tablet_bootstrap.cc:492] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:11.413681 29383 tablet_bootstrap.cc:492] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:11.413981 29383 ts_tablet_manager.cc:1403] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.072s user 0.006s sys 0.000s
I20260617 20:17:11.414604 29379 tablet_bootstrap.cc:654] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.414763 29383 raft_consensus.cc:359] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.414948 29383 raft_consensus.cc:385] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.415045 29383 raft_consensus.cc:740] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.415280 29383 consensus_queue.cc:260] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.420085 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dc704cf0844f579cced79fdf8c3da5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.426090 29376 ts_tablet_manager.cc:1929] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260617 20:17:11.429216 28925 leader_election.cc:343] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.429378 28925 leader_election.cc:304] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.429605 31119 tablet_loader.cc:96] loaded metadata for tablet 5135429388f240619dcbdc7dc1a066d1 (table default.Table_35da9942c88b483c842bd60a4e136618 [id=0484fe618c604fc6ae5cf909437940b5])
I20260617 20:17:11.430080 31119 tablet_loader.cc:96] loaded metadata for tablet 513d335e9dfb4ab69ab0c455d7139905 (table default.Table_088c2b4ca59e4dd49f684c9f6648bc57 [id=47c6b29f6e284a1b9cd984f16d925103])
I20260617 20:17:11.429852 31263 raft_consensus.cc:2749] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.432533 28631 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRePpQS/build/asan/bin/kudu
/tmp/dist-test-taskRePpQS/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.254:37301
--webserver_interface=127.27.245.254
--webserver_port=40135
--builtin_ntp_servers=127.27.245.212:40183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260617 20:17:11.434213 31119 tablet_loader.cc:96] loaded metadata for tablet 515f6603b0304f5b87eb18547b8e2f32 (table default.Table_0b8e0aa46bda414b9cd909ead421e411 [id=5cfb591827bb415bb5e640c3f4dad12a])
I20260617 20:17:11.446106 29379 tablet_bootstrap.cc:492] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:11.446316 29379 ts_tablet_manager.cc:1403] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.009s
I20260617 20:17:11.447434 29379 raft_consensus.cc:359] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.447700 29379 raft_consensus.cc:385] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.447814 29379 raft_consensus.cc:740] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.448158 29379 consensus_queue.cc:260] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.449730 29379 ts_tablet_manager.cc:1434] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:11.451452 29378 tablet_bootstrap.cc:492] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:11.451654 29378 ts_tablet_manager.cc:1403] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.139s user 0.005s sys 0.000s
I20260617 20:17:11.452435 29378 raft_consensus.cc:359] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.452538 29379 tablet_bootstrap.cc:492] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:11.457952 29378 raft_consensus.cc:385] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.458091 29378 raft_consensus.cc:740] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.458405 29379 tablet_bootstrap.cc:654] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.458395 29378 consensus_queue.cc:260] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.459131 29376 log.cc:1199] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/64538fdf51f94e8e985fec6202baac22
I20260617 20:17:11.459257 29378 ts_tablet_manager.cc:1434] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20260617 20:17:11.459600 29378 tablet_bootstrap.cc:492] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:11.453430 30852 consensus_queue.cc:1048] T 80d778641c354c679ee9e7d7b3eae3b5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.459741 29376 ts_tablet_manager.cc:1950] T 64538fdf51f94e8e985fec6202baac22 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:11.434948 31119 tablet_loader.cc:96] loaded metadata for tablet 5272e7bed48247d99cb6a86a11156b8e (table default.Table_4facc39fb37f4b1e88d70be7148b6582 [id=98fc6157ed4d4c618c7b9dba872d0ecb])
I20260617 20:17:11.463083 31119 tablet_loader.cc:96] loaded metadata for tablet 53f11c5f92494120afa1399d1edea521 (table default.Table_440996b6cc8d431c9c09e1912c9b9ffd [id=7270dd3680e948a0aa58347b5ae70b2a])
I20260617 20:17:11.463466 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1071) took 2743 ms. Trace:
I20260617 20:17:11.463667 30852 raft_consensus.cc:493] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.464746 30852 raft_consensus.cc:515] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.466553 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d23acc051c34ebfb0edb790faec1b2b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.469965 29198 leader_election.cc:343] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.470278 31009 consensus_queue.cc:1048] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.471864 30852 leader_election.cc:290] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.451977 29383 ts_tablet_manager.cc:1434] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20260617 20:17:11.464648 29376 rpcz_store.cc:276] 0617 20:17:08.720023 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.720207 (+ 184us) service_pool.cc:224] Handling call
0617 20:17:11.328107 (+2607900us) ts_tablet_manager.cc:1151] Deleting tablet 64538fdf51f94e8e985fec6202baac22
0617 20:17:11.328115 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.371310 (+ 43195us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.425986 (+ 54676us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.463407 (+ 37421us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2607761}
W20260617 20:17:11.472560 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1071) could send its response
I20260617 20:17:11.472493 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d23acc051c34ebfb0edb790faec1b2b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.472720 28983 raft_consensus.cc:2468] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:11.474064 29197 leader_election.cc:304] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.474246 29383 tablet_bootstrap.cc:492] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:11.474509 30852 raft_consensus.cc:2804] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.474706 30852 raft_consensus.cc:493] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.474864 30852 raft_consensus.cc:3060] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.476301 29383 tablet_bootstrap.cc:654] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.478063 30852 raft_consensus.cc:515] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.479276 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d23acc051c34ebfb0edb790faec1b2b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:11.479954 29198 leader_election.cc:343] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.480644 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d23acc051c34ebfb0edb790faec1b2b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.480870 28983 raft_consensus.cc:3060] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.481927 29378 tablet_bootstrap.cc:654] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.483801 28983 raft_consensus.cc:2468] T 4d23acc051c34ebfb0edb790faec1b2b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:11.484206 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1073) took 2684 ms. Trace:
I20260617 20:17:11.484359 29376 rpcz_store.cc:276] 0617 20:17:08.799609 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.800635 (+ 1026us) service_pool.cc:224] Handling call
0617 20:17:11.472487 (+2671852us) ts_tablet_manager.cc:1151] Deleting tablet e401eea0717d4cbb8319e4d4b1ada410
0617 20:17:11.484028 (+ 11541us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.484159 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2671618}
I20260617 20:17:11.493824 31119 tablet_loader.cc:96] loaded metadata for tablet 54969e138cf745739b54203c11e4c94e (table default.Table_8d26d11366614614982fcb5b40bb6620 [id=2f7caf34e912409caa372c4ac69c6f7d])
I20260617 20:17:11.495306 31119 tablet_loader.cc:96] loaded metadata for tablet 56584a4f576842a8b0f7315b7161cb68 (table default.Table_07e0f258ed6b45a7ad99bcf9bb2c3b75 [id=0a8eaaf090244a6c8d16398a62b5a2f1])
I20260617 20:17:11.496946 31119 tablet_loader.cc:96] loaded metadata for tablet 5884c83d394c40008c2d2c7ee5dcf2d7 (table default.Table_74a72450663a45a99d4b9e8a250bd9db [id=1d4c9a9b22e44723ae5c2ed384191a94])
I20260617 20:17:11.497797 31119 tablet_loader.cc:96] loaded metadata for tablet 5914907a02df482088aab72d98ea7cc1 (table default.Table_8c1e2652a5d745fda18a0e7512b22ecd [id=081eadc2fe45408ebc3c66ef10aca087])
I20260617 20:17:11.485136 29197 leader_election.cc:304] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.485370 30852 leader_election.cc:290] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.513582 30852 raft_consensus.cc:2804] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.513748 30852 raft_consensus.cc:697] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:11.514007 30852 consensus_queue.cc:237] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.508508 31094 consensus_queue.cc:1048] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.494807 31221 raft_consensus.cc:493] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.516460 31221 raft_consensus.cc:515] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.517010 31221 leader_election.cc:290] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.518921 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00c2be45d82425bb70ae577fa3155fa" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.519110 28978 raft_consensus.cc:2468] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:11.519625 29197 leader_election.cc:304] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:11.519870 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00c2be45d82425bb70ae577fa3155fa" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:11.519999 31221 raft_consensus.cc:2804] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.520087 31221 raft_consensus.cc:493] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.520179 31221 raft_consensus.cc:3060] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:11.520591 29198 leader_election.cc:343] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.521690 31009 consensus_queue.cc:1048] T f43549813e294796baca2a1a64dbcfb9 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.522960 31221 raft_consensus.cc:515] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.525849 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00c2be45d82425bb70ae577fa3155fa" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.526062 28978 raft_consensus.cc:3060] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.530123 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00c2be45d82425bb70ae577fa3155fa" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.530223 31221 leader_election.cc:290] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.530553 28978 raft_consensus.cc:2468] T d00c2be45d82425bb70ae577fa3155fa P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:17:11.531252 29198 leader_election.cc:343] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.531428 29197 leader_election.cc:304] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.531981 31221 raft_consensus.cc:2804] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.532998 31221 raft_consensus.cc:697] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:11.533954 31221 consensus_queue.cc:237] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.544902 29378 tablet_bootstrap.cc:492] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:11.545158 29378 ts_tablet_manager.cc:1403] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.086s user 0.003s sys 0.001s
I20260617 20:17:11.546890 29378 raft_consensus.cc:359] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.548895 29378 raft_consensus.cc:385] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.549257 29378 raft_consensus.cc:740] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.554684 29378 consensus_queue.cc:260] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.556511 31119 tablet_loader.cc:96] loaded metadata for tablet 592c58b06f8543feb1439044f1c5203c (table default.Table_d4ee09ae0a4649cdb22c66655ef3b4e6 [id=a0096dddd4124258915aa8acec69d3ff])
I20260617 20:17:11.558393 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1077) took 2663 ms. Trace:
I20260617 20:17:11.561450 29378 ts_tablet_manager.cc:1434] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
W20260617 20:17:11.565053 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1073) could send its response
I20260617 20:17:11.574373 29383 tablet_bootstrap.cc:492] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:11.576642 29378 tablet_bootstrap.cc:492] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:11.577029 31171 raft_consensus.cc:493] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.577209 31171 raft_consensus.cc:515] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.577977 31171 leader_election.cc:290] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.579246 29378 tablet_bootstrap.cc:654] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.580039 29379 tablet_bootstrap.cc:492] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:11.580571 29379 ts_tablet_manager.cc:1403] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.128s user 0.003s sys 0.031s
I20260617 20:17:11.581526 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ec778da4c9467d90c7151f36ffaa79" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.581943 28978 raft_consensus.cc:2393] T 07ec778da4c9467d90c7151f36ffaa79 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:11.582178 29379 raft_consensus.cc:359] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.582422 29379 raft_consensus.cc:385] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.582499 29379 raft_consensus.cc:740] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.583117 29376 rpcz_store.cc:276] 0617 20:17:08.882725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.883272 (+ 547us) service_pool.cc:224] Handling call
0617 20:17:11.546438 (+2663166us) ts_tablet_manager.cc:1151] Deleting tablet ee9afd550a6d4d2e9edd84e4b49186c4
0617 20:17:11.546450 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.546564 (+ 114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2648960}
I20260617 20:17:11.583173 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ec778da4c9467d90c7151f36ffaa79" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:11.591351 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1077) could send its response
I20260617 20:17:11.595630 31171 raft_consensus.cc:493] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.595860 31171 raft_consensus.cc:515] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.595911 31119 tablet_loader.cc:96] loaded metadata for tablet 59a3766053144e6c9ee680f099ff1766 (table default.Table_5568c77256244c37989abf62aea01e5e [id=d86155eb37074ec3a29fa8b560d0649d])
I20260617 20:17:11.596666 31171 leader_election.cc:290] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.596786 31119 tablet_loader.cc:96] loaded metadata for tablet 5a0462db75104cd6bdf54ba9777f792b (table default.Table_6ff97e18c72d48f69a219285a41f4d5d [id=a06591d34596487a9191e5f06f2572da])
I20260617 20:17:11.597321 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee909c8988d49779612e98f5cd82972" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.597419 29063 leader_election.cc:304] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.597508 28983 raft_consensus.cc:2468] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:11.597895 31119 tablet_loader.cc:96] loaded metadata for tablet 5a6d25d728654de68061884976356d42 (table default.Table_32efdf31b50248e5ada2c2b690ff5aba [id=c275e777ecd64ecebf32e9cd34239a86])
I20260617 20:17:11.597882 29062 leader_election.cc:304] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:17:11.598133 31171 raft_consensus.cc:3060] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.598500 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1074) took 2716 ms. Trace:
I20260617 20:17:11.598639 31220 consensus_queue.cc:1048] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.598891 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee909c8988d49779612e98f5cd82972" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.599093 29258 raft_consensus.cc:2468] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:11.599260 29383 ts_tablet_manager.cc:1403] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.102s user 0.004s sys 0.000s
I20260617 20:17:11.600795 31287 raft_consensus.cc:2804] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.601382 31287 raft_consensus.cc:493] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.601445 31171 raft_consensus.cc:2749] T 07ec778da4c9467d90c7151f36ffaa79 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.601488 31287 raft_consensus.cc:3060] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.600646 29383 raft_consensus.cc:359] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.602128 29383 raft_consensus.cc:385] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.602262 29383 raft_consensus.cc:740] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.604158 31287 raft_consensus.cc:515] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.605140 29383 consensus_queue.cc:260] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.607798 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee909c8988d49779612e98f5cd82972" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.608013 28983 raft_consensus.cc:3060] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.611655 28983 raft_consensus.cc:2468] T fee909c8988d49779612e98f5cd82972 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:11.612128 29062 leader_election.cc:304] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:17:11.612406 31171 raft_consensus.cc:2804] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.612661 31171 raft_consensus.cc:697] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:11.613426 31171 consensus_queue.cc:237] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.614562 29383 ts_tablet_manager.cc:1434] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20260617 20:17:11.614956 29383 tablet_bootstrap.cc:492] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:11.607105 29376 rpcz_store.cc:276] 0617 20:17:08.867092 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.867718 (+ 626us) service_pool.cc:224] Handling call
0617 20:17:11.583678 (+2715960us) ts_tablet_manager.cc:1151] Deleting tablet b61162160ec248b7aa6c73c399be1842
0617 20:17:11.583689 (+ 11us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.583793 (+ 104us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2685820}
W20260617 20:17:11.610154 29197 consensus_peers.cc:597] T dd89c8452c444af99d8bce0c7cbf8ce1 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd89c8452c444af99d8bce0c7cbf8ce1. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:11.616605 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1074) could send its response
I20260617 20:17:11.617146 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1079) took 2661 ms. Trace:
I20260617 20:17:11.617369 29376 rpcz_store.cc:276] 0617 20:17:08.956062 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:08.956686 (+ 624us) service_pool.cc:224] Handling call
0617 20:17:11.616966 (+2660280us) ts_tablet_manager.cc:1151] Deleting tablet ab011d76c5ff4eae8e20fceab66513e1
0617 20:17:11.616978 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.617098 (+ 120us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2622849}
W20260617 20:17:11.617817 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1079) could send its response
I20260617 20:17:11.618321 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1082) took 2622 ms. Trace:
I20260617 20:17:11.618618 29376 rpcz_store.cc:276] 0617 20:17:08.995589 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.018361 (+ 22772us) service_pool.cc:224] Handling call
0617 20:17:11.618141 (+2599780us) ts_tablet_manager.cc:1151] Deleting tablet 93daae49ea3b4abd8623f64bffdd1f6a
0617 20:17:11.618153 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.618284 (+ 131us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2599580}
W20260617 20:17:11.618952 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1082) could send its response
I20260617 20:17:11.619369 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1085) took 2531 ms. Trace:
I20260617 20:17:11.619567 29376 rpcz_store.cc:276] 0617 20:17:09.087457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.087523 (+ 66us) service_pool.cc:224] Handling call
0617 20:17:11.619218 (+2531695us) ts_tablet_manager.cc:1151] Deleting tablet c9f2a320a1e14115bfe7e70a498a4f27
0617 20:17:11.619227 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.619325 (+ 98us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2531506}
W20260617 20:17:11.619956 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1085) could send its response
I20260617 20:17:11.620340 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1086) took 2525 ms. Trace:
I20260617 20:17:11.620579 29376 rpcz_store.cc:276] 0617 20:17:09.094810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.094866 (+ 56us) service_pool.cc:224] Handling call
0617 20:17:11.620224 (+2525358us) ts_tablet_manager.cc:1151] Deleting tablet cbeae97639fd4e6290768dae12f6a4ce
0617 20:17:11.620238 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.620307 (+ 69us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2525161}
W20260617 20:17:11.621080 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1086) could send its response
I20260617 20:17:11.621650 29376 tablet_replica.cc:333] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:11.622256 29376 raft_consensus.cc:2243] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:11.623231 31119 tablet_loader.cc:96] loaded metadata for tablet 5bf67f3f62714cd3bb9cce3f207cc3b8 (table default.Table_cf5a1e5db7c2470ab6ad65a7d57777d1 [id=13717f883a3449dd9014fff544ad7d7a])
I20260617 20:17:11.623792 29376 raft_consensus.cc:2272] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:11.624636 31119 tablet_loader.cc:96] loaded metadata for tablet 5c9b99132b80406cb860b679bfdd782c (table default.Table_41576d8b3a1d4789ab70d3afb1cd0fbe [id=efa2e89ef6244e92803dd43d0ef74d50])
I20260617 20:17:11.625099 31119 tablet_loader.cc:96] loaded metadata for tablet 5cc6f47821064ebf869380dea06e965f (table default.Table_fdeeb511d87e4fcc8659b17d363c9834 [id=71f04739faee495782d0b18a7c3ab912])
I20260617 20:17:11.626154 31249 raft_consensus.cc:493] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.626292 31249 raft_consensus.cc:515] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.626577 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fee909c8988d49779612e98f5cd82972" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:11.626832 29257 raft_consensus.cc:3060] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.626878 31249 leader_election.cc:290] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.625988 31287 leader_election.cc:290] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.627482 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4598874c14344c58ef0b87508b67211" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.627997 28925 leader_election.cc:343] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.630369 29257 raft_consensus.cc:2468] T fee909c8988d49779612e98f5cd82972 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:11.625941 29379 consensus_queue.cc:260] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.634531 29379 ts_tablet_manager.cc:1434] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.054s user 0.001s sys 0.001s
I20260617 20:17:11.638612 29379 tablet_bootstrap.cc:492] T 18791cd3384f4bd48c333a3460e85286 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:17:11.639343 29527 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.254:37301, user_credentials={real_user=slave}} blocked reactor thread for 58327.7us
I20260617 20:17:11.640645 31220 consensus_queue.cc:1048] T a6522ae212784b7ebd47cc3403aa3477 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260617 20:17:11.644428 29378 tablet_bootstrap.cc:492] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:11.647661 29378 ts_tablet_manager.cc:1403] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.071s user 0.006s sys 0.000s
I20260617 20:17:11.648584 29378 raft_consensus.cc:359] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.640103 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4598874c14344c58ef0b87508b67211" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.652097 31119 tablet_loader.cc:96] loaded metadata for tablet 5da459a52667402aa7a94a88bdc6f4e6 (table default.Table_e1570318e62a4455991ccbddfea26e31 [id=bf708541e8b248beb550ef49994ed8d0])
I20260617 20:17:11.639077 29376 ts_tablet_manager.cc:1916] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:11.655191 29379 tablet_bootstrap.cc:654] T 18791cd3384f4bd48c333a3460e85286 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:11.650413 28925 leader_election.cc:343] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.661087 28925 leader_election.cc:304] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.661808 31249 raft_consensus.cc:2749] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.662060 29378 raft_consensus.cc:385] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.662166 29378 raft_consensus.cc:740] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.662421 29378 consensus_queue.cc:260] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.663107 31119 tablet_loader.cc:96] loaded metadata for tablet 5da9fa5bc3b3478487aab3949b547e09 (table default.Table_a7ae2b556b104787bb92a47f706bc91a [id=31199bd88feb40559cb20211be2ec3c1])
I20260617 20:17:11.655920 29383 tablet_bootstrap.cc:654] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.667232 29378 ts_tablet_manager.cc:1434] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.019s user 0.001s sys 0.001s
I20260617 20:17:11.670394 31287 raft_consensus.cc:493] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.670555 31287 raft_consensus.cc:515] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.671236 31287 leader_election.cc:290] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.672770 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5949e832ca477e9effbe340f439e9c" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.675872 31119 tablet_loader.cc:96] loaded metadata for tablet 5e847937667c4915b0d4da48c3fe92e2 (table default.Table_3d7d626f6bae4e3cbfc7bd41f1cdc5f1 [id=1759f8d2f7b84bfabbcc8d99a861193b])
I20260617 20:17:11.676156 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5949e832ca477e9effbe340f439e9c" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.678025 28978 raft_consensus.cc:2393] T 3e5949e832ca477e9effbe340f439e9c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:11.679551 29062 leader_election.cc:304] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.680011 31287 raft_consensus.cc:3060] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.683130 31287 raft_consensus.cc:2749] T 3e5949e832ca477e9effbe340f439e9c P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.690073 31249 raft_consensus.cc:493] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.690258 31249 raft_consensus.cc:515] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.690882 31249 leader_election.cc:290] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.691821 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eedf2442f964048b7a3a460b6b22f2a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.692250 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eedf2442f964048b7a3a460b6b22f2a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.692497 28925 leader_election.cc:343] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.692691 31287 raft_consensus.cc:493] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260617 20:17:11.692727 28925 leader_election.cc:343] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.692828 28925 leader_election.cc:304] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.692821 31287 raft_consensus.cc:515] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.693490 31249 raft_consensus.cc:2749] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.694192 29376 ts_tablet_manager.cc:1929] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:11.694500 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eba86bae9e91404185d248dfd722a413" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.694633 31287 leader_election.cc:290] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.695824 29376 log.cc:1199] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/f31bf7ed828f44b398f5bdac6b9b63e7
W20260617 20:17:11.697703 29062 leader_election.cc:343] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: eba86bae9e91404185d248dfd722a413
I20260617 20:17:11.697882 29062 leader_election.cc:304] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.699174 31287 raft_consensus.cc:2749] T eba86bae9e91404185d248dfd722a413 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.701889 31119 tablet_loader.cc:96] loaded metadata for tablet 5f7664154b784cf8addbe0df32da99f0 (table default.Table_487f14a2a0554f68af6b03801e647fac [id=6a8fb68aa5024673a1b88ae934abd00e])
I20260617 20:17:11.703094 29376 ts_tablet_manager.cc:1950] T f31bf7ed828f44b398f5bdac6b9b63e7 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:11.704804 31119 tablet_loader.cc:96] loaded metadata for tablet 604862f683984695b393cd9ca3500bdc (table default.Table_c67156b0dace4897967975f7f41f09fe [id=f48dcb0c33bd44f484cc4d1b0caadb88])
I20260617 20:17:11.706238 31119 tablet_loader.cc:96] loaded metadata for tablet 61d5e895c4604795bb49a2ac99afdbf9 (table default.Table_94e5e206c8b144c1816cbe3cc8338ffa [id=95ab812b28e14b0e9285f3e3bedf77fc])
I20260617 20:17:11.706705 29378 tablet_bootstrap.cc:492] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:11.706898 31119 tablet_loader.cc:96] loaded metadata for tablet 6323292f162b4063b7c413eaecfce791 (table default.Table_6608950ce63c4189ba3fd0cca3a42bd9 [id=5e4eb42ba8894b78a217d5af391de888])
I20260617 20:17:11.708459 31119 tablet_loader.cc:96] loaded metadata for tablet 64d4b8a353854196871cb6fcd8916d4c (table default.Table_95eb640bc73740e7b1c9475c7f7bcbe4 [id=c1092a9a835f4dc79f36cae5bb02e374])
I20260617 20:17:11.708786 31119 tablet_loader.cc:96] loaded metadata for tablet 653937f4da17475abffb3448069f4ea7 (table default.Table_ff10865b6d2c4c6d9ab53cc4154f7340 [id=d795edb3e121421a9c66a4ab7906bcb9])
I20260617 20:17:11.710031 29378 tablet_bootstrap.cc:654] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.710572 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1087) took 2614 ms. Trace:
I20260617 20:17:11.711433 29376 rpcz_store.cc:276] 0617 20:17:09.095331 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.095385 (+ 54us) service_pool.cc:224] Handling call
0617 20:17:11.621508 (+2526123us) ts_tablet_manager.cc:1151] Deleting tablet f31bf7ed828f44b398f5bdac6b9b63e7
0617 20:17:11.621522 (+ 14us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.659240 (+ 37718us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.691339 (+ 32099us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.709765 (+ 18426us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2525491}
W20260617 20:17:11.713683 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1087) could send its response
I20260617 20:17:11.718178 31119 tablet_loader.cc:96] loaded metadata for tablet 659979f3f2684c82ae2ef15f9e3bec8d (table default.Table_47b418c88d02450e9238113d4fc932de [id=2b7e7c876e3c42eda2033e3d88820007])
I20260617 20:17:11.718125 29376 tablet_replica.cc:333] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:11.720229 29383 tablet_bootstrap.cc:492] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:11.720597 29383 ts_tablet_manager.cc:1403] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.106s user 0.007s sys 0.007s
I20260617 20:17:11.721091 29376 raft_consensus.cc:2243] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:11.722257 29376 raft_consensus.cc:2272] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:11.723805 29383 raft_consensus.cc:359] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.724406 29376 ts_tablet_manager.cc:1916] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:11.724341 29383 raft_consensus.cc:385] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.724916 29383 raft_consensus.cc:740] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.725731 29383 consensus_queue.cc:260] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.730589 29383 ts_tablet_manager.cc:1434] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260617 20:17:11.731889 29383 tablet_bootstrap.cc:492] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:11.743598 29383 tablet_bootstrap.cc:654] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.744517 29378 tablet_bootstrap.cc:492] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:11.744729 29378 ts_tablet_manager.cc:1403] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.002s
I20260617 20:17:11.745786 29378 raft_consensus.cc:359] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.746033 29378 raft_consensus.cc:385] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.746167 29378 raft_consensus.cc:740] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.746543 29378 consensus_queue.cc:260] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.746814 31119 tablet_loader.cc:96] loaded metadata for tablet 659d9bd49e334260970d7fd7fb3abb80 (table default.Table_367156c006bc4543b26e6c3c6cb494a8 [id=a51c20a22e004ab984955c1231c87c20])
I20260617 20:17:11.747888 31119 tablet_loader.cc:96] loaded metadata for tablet 66b4232cd60142e0901264c663e94487 (table default.Table_56be7326decb482f8c632474abe1fba3 [id=b068fb664ccb41908426d488f2d1303c])
I20260617 20:17:11.750119 29378 ts_tablet_manager.cc:1434] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:17:11.751209 31119 tablet_loader.cc:96] loaded metadata for tablet 672aba4228fc44ef9cea80dd6f07c3c9 (table default.Table_ab1320db24234450830394363e3d77d8 [id=c3b8272c0a664a97878487a63f309f6f])
I20260617 20:17:11.752626 31119 tablet_loader.cc:96] loaded metadata for tablet 690c28a83d8e44d4bf437da35aec9f40 (table default.Table_c77f056453554773a2687ccba8bb4056 [id=afcac1117c1a4e0e972ca9c008b1acfe])
I20260617 20:17:11.753973 29378 tablet_bootstrap.cc:492] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:11.757156 29379 tablet_bootstrap.cc:492] T 18791cd3384f4bd48c333a3460e85286 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:11.757498 29379 ts_tablet_manager.cc:1403] T 18791cd3384f4bd48c333a3460e85286 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.120s user 0.007s sys 0.012s
I20260617 20:17:11.758757 31119 tablet_loader.cc:96] loaded metadata for tablet 697c247751f2404d839d0b973c6ba7b6 (table default.Table_b1dbf26dd897427fb16163fa330af154 [id=9aadc9d3022d495c893d9293d28b2d78])
I20260617 20:17:11.758711 29379 raft_consensus.cc:359] T 18791cd3384f4bd48c333a3460e85286 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.759146 29379 raft_consensus.cc:385] T 18791cd3384f4bd48c333a3460e85286 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.759295 29379 raft_consensus.cc:740] T 18791cd3384f4bd48c333a3460e85286 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.759843 29379 consensus_queue.cc:260] T 18791cd3384f4bd48c333a3460e85286 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.761658 29379 ts_tablet_manager.cc:1434] T 18791cd3384f4bd48c333a3460e85286 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:11.762226 29378 tablet_bootstrap.cc:654] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.762705 29379 tablet_bootstrap.cc:492] T 4d23acc051c34ebfb0edb790faec1b2b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:11.766754 29379 tablet_bootstrap.cc:654] T 4d23acc051c34ebfb0edb790faec1b2b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.772509 31287 raft_consensus.cc:493] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.772670 31287 raft_consensus.cc:515] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.773284 31287 leader_election.cc:290] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.774111 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d0b861d48e4baf94387f4ff9d9f778" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.781543 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20d0b861d48e4baf94387f4ff9d9f778" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.782361 29063 leader_election.cc:304] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.782598 29383 tablet_bootstrap.cc:492] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:11.783746 31287 raft_consensus.cc:2749] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.784102 29376 ts_tablet_manager.cc:1929] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:11.784391 29376 log.cc:1199] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/eba86bae9e91404185d248dfd722a413
I20260617 20:17:11.784742 29383 ts_tablet_manager.cc:1403] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.001s
I20260617 20:17:11.785961 29379 tablet_bootstrap.cc:492] T 4d23acc051c34ebfb0edb790faec1b2b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:11.786197 29379 ts_tablet_manager.cc:1403] T 4d23acc051c34ebfb0edb790faec1b2b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.002s
I20260617 20:17:11.787184 31119 tablet_loader.cc:96] loaded metadata for tablet 6b3091c332a14c4c99bd28e401769e30 (table default.Table_778028dc2b7b43e9b5b16d42baf40772 [id=19bd9015790b453194adb1f20e520a9a])
I20260617 20:17:11.787729 29376 ts_tablet_manager.cc:1950] T eba86bae9e91404185d248dfd722a413 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:11.788268 31119 tablet_loader.cc:96] loaded metadata for tablet 6c3dd481bc2745fba5460e26e49fa53b (table default.Table_d6c8360190ec4dfeb18e990430f716cd [id=c11c505593f1442e8811e75167217fb9])
I20260617 20:17:11.788977 31119 tablet_loader.cc:96] loaded metadata for tablet 6ce393d563a446f08aa7dfb896d3e32c (table default.Table_97ba340d89a0446caac56caf5b2cde59 [id=2f5114c6a06f42cd8742c62168dd5032])
I20260617 20:17:11.789461 31119 tablet_loader.cc:96] loaded metadata for tablet 6d62885cedcc4821ac430f1d6df3bded (table default.Table_db3cad8ad5504503992f09f4cbfa7246 [id=ce09aecc32044c59a85905f3c8d82e42])
I20260617 20:17:11.790182 31119 tablet_loader.cc:96] loaded metadata for tablet 6d6dc68c7f10490f87df2b70a548cf72 (table default.Table_bb2d4abaff574992b845f37916732047 [id=e5516c07301447348a57361f1cdc74bf])
I20260617 20:17:11.790465 29378 tablet_bootstrap.cc:492] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:11.790604 29378 ts_tablet_manager.cc:1403] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.002s
I20260617 20:17:11.790182 29383 raft_consensus.cc:359] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.791339 29378 raft_consensus.cc:359] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.791522 29378 raft_consensus.cc:385] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.791318 29383 raft_consensus.cc:385] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.791585 29378 raft_consensus.cc:740] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.791700 29376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1088) took 2696 ms. Trace:
I20260617 20:17:11.791842 29378 consensus_queue.cc:260] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.791755 29383 raft_consensus.cc:740] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.792249 29376 rpcz_store.cc:276] 0617 20:17:09.095482 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:09.096006 (+ 524us) service_pool.cc:224] Handling call
0617 20:17:11.717703 (+2621697us) ts_tablet_manager.cc:1151] Deleting tablet eba86bae9e91404185d248dfd722a413
0617 20:17:11.717720 (+ 17us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0617 20:17:11.744173 (+ 26453us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.765358 (+ 21185us) tablet_metadata.cc:665] Metadata flushed
0617 20:17:11.791496 (+ 26138us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2617979}
I20260617 20:17:11.793063 31119 tablet_loader.cc:96] loaded metadata for tablet 6d84e71b70d2486ab3658fc4e7d56286 (table default.Table_e260ca83764a418697982bac8c69b880 [id=e7190b334ac442dbaf3eaca387972445])
I20260617 20:17:11.792757 29383 consensus_queue.cc:260] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:11.793210 29197 connection.cc:466] server connection from 127.0.0.1:41028 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41028 (request call id 1088) could send its response
I20260617 20:17:11.795406 31249 raft_consensus.cc:493] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.795558 31249 raft_consensus.cc:515] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.796128 31249 leader_election.cc:290] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.796584 29378 ts_tablet_manager.cc:1434] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260617 20:17:11.797552 29383 ts_tablet_manager.cc:1434] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260617 20:17:11.797791 29378 tablet_bootstrap.cc:492] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:11.798595 29383 tablet_bootstrap.cc:492] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:11.798658 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c583de2973e4fb0abacf2692f3ab829" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:11.799420 29378 tablet_bootstrap.cc:654] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.799435 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c583de2973e4fb0abacf2692f3ab829" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:11.800148 28925 leader_election.cc:343] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:11.801174 28925 leader_election.cc:343] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.801366 28925 leader_election.cc:304] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.801740 31249 raft_consensus.cc:2749] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.799857 29379 raft_consensus.cc:359] T 4d23acc051c34ebfb0edb790faec1b2b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.802441 29379 raft_consensus.cc:385] T 4d23acc051c34ebfb0edb790faec1b2b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.803033 29379 raft_consensus.cc:740] T 4d23acc051c34ebfb0edb790faec1b2b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.804491 29379 consensus_queue.cc:260] T 4d23acc051c34ebfb0edb790faec1b2b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.805987 31287 raft_consensus.cc:493] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.806114 31287 raft_consensus.cc:515] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.806700 31287 leader_election.cc:290] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:11.808349 29062 leader_election.cc:343] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 90ae9c63c8c541bc91ecedd798a7d60f
I20260617 20:17:11.808235 29379 ts_tablet_manager.cc:1434] T 4d23acc051c34ebfb0edb790faec1b2b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.022s user 0.001s sys 0.001s
I20260617 20:17:11.809286 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ae9c63c8c541bc91ecedd798a7d60f" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:11.810010 29255 raft_consensus.cc:2393] T 90ae9c63c8c541bc91ecedd798a7d60f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:11.809995 29379 tablet_bootstrap.cc:492] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:11.810536 29063 leader_election.cc:304] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.810796 31287 raft_consensus.cc:3060] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.811750 29383 tablet_bootstrap.cc:654] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.813441 31287 raft_consensus.cc:2749] T 90ae9c63c8c541bc91ecedd798a7d60f P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.813658 30683 raft_consensus.cc:493] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.813835 30683 raft_consensus.cc:515] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.814576 30683 leader_election.cc:290] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.815675 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a176d1f3b0446984af141e02bac329" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.815889 28978 raft_consensus.cc:2468] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:11.816424 29197 leader_election.cc:304] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:11.816754 30683 raft_consensus.cc:2804] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.817819 29379 tablet_bootstrap.cc:654] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.819104 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a176d1f3b0446984af141e02bac329" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.820262 29198 leader_election.cc:343] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.824642 31220 raft_consensus.cc:493] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.824784 31220 raft_consensus.cc:515] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.825516 31220 leader_election.cc:290] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.826529 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40845d7a668045ec9a40cb6d1d76137d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:11.827833 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40845d7a668045ec9a40cb6d1d76137d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:11.828037 28978 raft_consensus.cc:2468] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:11.828615 29197 leader_election.cc:304] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:11.829583 31220 raft_consensus.cc:2804] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:11.829823 31220 raft_consensus.cc:493] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:11.829918 31220 raft_consensus.cc:3060] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.832630 31220 raft_consensus.cc:515] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.833628 31220 leader_election.cc:290] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:11.834192 29198 leader_election.cc:343] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.834661 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40845d7a668045ec9a40cb6d1d76137d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:11.834743 29379 tablet_bootstrap.cc:492] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:11.835011 29379 ts_tablet_manager.cc:1403] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.008s
W20260617 20:17:11.835141 29198 leader_election.cc:343] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.835700 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40845d7a668045ec9a40cb6d1d76137d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:11.835868 28978 raft_consensus.cc:3060] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.838418 28978 raft_consensus.cc:2468] T 40845d7a668045ec9a40cb6d1d76137d P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:11.837976 29379 raft_consensus.cc:359] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.838516 29379 raft_consensus.cc:385] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.838905 29197 leader_election.cc:304] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:11.839265 30852 raft_consensus.cc:2804] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:11.839386 30852 raft_consensus.cc:697] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:11.839169 29379 raft_consensus.cc:740] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.839591 30852 consensus_queue.cc:237] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.840323 29379 consensus_queue.cc:260] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.843940 29379 ts_tablet_manager.cc:1434] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260617 20:17:11.847811 29379 tablet_bootstrap.cc:492] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:11.856384 29379 tablet_bootstrap.cc:654] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.859532 31249 raft_consensus.cc:493] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.859683 31249 raft_consensus.cc:515] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.860247 31249 leader_election.cc:290] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:11.861122 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b01c9c27904a1986e285477921ac4f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:11.861662 28925 leader_election.cc:343] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.862185 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b01c9c27904a1986e285477921ac4f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:11.862684 28925 leader_election.cc:343] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.862792 28925 leader_election.cc:304] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.863256 31249 raft_consensus.cc:2749] T 33b01c9c27904a1986e285477921ac4f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.868037 31119 tablet_loader.cc:96] loaded metadata for tablet 6db24d70cc7643599d7be9158b5a7450 (table default.Table_20dcfb508ecf4cacbaca2e229fe563d7 [id=ccb19fa7c76b445f9801722edcd4dfb0])
I20260617 20:17:11.873399 31119 tablet_loader.cc:96] loaded metadata for tablet 6db7d5bf9a254b98b87ad25df1f51b3b (table default.Table_8d8166172c80424da57e5f348c59a32c [id=a5d1a4cb417d4d7ba4d33324672c42a9])
I20260617 20:17:11.877712 31119 tablet_loader.cc:96] loaded metadata for tablet 6efb29f2e56c4838b0efd0171229088a (table default.Table_1e06b58a614b4e83af282cace8749f39 [id=bf54a099a679476485430b505a037ea3])
I20260617 20:17:11.893117 31119 tablet_loader.cc:96] loaded metadata for tablet 6f256936080443dbae1b538f0fbbd7d4 (table default.Table_5a7af34a137e4cd5bc14d4166ea07903 [id=b4ce945ce47043d68218ebf69c580d3f])
I20260617 20:17:11.894418 31119 tablet_loader.cc:96] loaded metadata for tablet 70a2c1a89d224960b0175c9842d85e5d (table default.Table_24dde6dc70d64bee8c127475dac477af [id=c6e16b1e13ec49cd8e2660e0e336abeb])
I20260617 20:17:11.894845 31119 tablet_loader.cc:96] loaded metadata for tablet 71049338f673401bad32204d232bfe43 (table default.Table_9628d76200d64a67a8095ff0895ab927 [id=23afb56e2d6d4944943854ecd94017ea])
I20260617 20:17:11.905805 30852 consensus_queue.cc:1048] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.932279 31220 consensus_queue.cc:1048] T 07ec778da4c9467d90c7151f36ffaa79 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.942682 31249 raft_consensus.cc:493] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.942854 31249 raft_consensus.cc:515] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.943560 31249 leader_election.cc:290] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.944567 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85633d391613474db52dd2f86210a659" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:11.948455 28925 leader_election.cc:343] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.949218 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85633d391613474db52dd2f86210a659" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:11.949287 31249 raft_consensus.cc:493] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:11.949433 31249 raft_consensus.cc:515] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:11.950055 31249 leader_election.cc:290] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:11.950584 29383 tablet_bootstrap.cc:492] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:11.950732 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae5bf7cdde5427cb24d6144ccb274f5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:11.951567 28925 leader_election.cc:343] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:11.952185 28925 leader_election.cc:343] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.952180 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae5bf7cdde5427cb24d6144ccb274f5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:11.952306 28925 leader_election.cc:304] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.951606 31119 tablet_loader.cc:96] loaded metadata for tablet 71342100c8f746d384b4cef73086afd2 (table default.Table_78df0b7688e5419a8ae514d3c4e5399e [id=62448d1c0fe54010b3b491e6c5b47bfc])
W20260617 20:17:11.952872 28925 leader_election.cc:343] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:11.953006 28925 leader_election.cc:304] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:11.953347 31249 raft_consensus.cc:2749] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.953526 31249 raft_consensus.cc:2749] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:11.955821 31119 tablet_loader.cc:96] loaded metadata for tablet 7381c348acbd462b8e04587b2eb948b6 (table default.Table_9cbb96ec056a4e329cf862c7bd244585 [id=cc73212423a64c5eab12af219ad5af5c])
I20260617 20:17:11.968128 29378 tablet_bootstrap.cc:492] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:11.968303 29378 ts_tablet_manager.cc:1403] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.171s user 0.025s sys 0.021s
I20260617 20:17:11.969058 29378 raft_consensus.cc:359] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.969213 29378 raft_consensus.cc:385] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.969257 29378 raft_consensus.cc:740] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.969476 29378 consensus_queue.cc:260] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:11.950749 29383 ts_tablet_manager.cc:1403] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.153s user 0.014s sys 0.030s
I20260617 20:17:11.976311 29383 raft_consensus.cc:359] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.976596 29383 raft_consensus.cc:385] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.976704 29383 raft_consensus.cc:740] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.977054 29383 consensus_queue.cc:260] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.979544 29383 ts_tablet_manager.cc:1434] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s
I20260617 20:17:11.978991 31119 tablet_loader.cc:96] loaded metadata for tablet 73d9202320ff4dcebe1897459f8d2238 (table default.Table_cee27611d8f547eca1c10f1e335f4a7c [id=6ffa00c2439b4485b9fd7cfcc84ad616])
I20260617 20:17:11.980077 31119 tablet_loader.cc:96] loaded metadata for tablet 74c73ae1007d44ce958ad02fa5787651 (table default.Table_5c3dfa3702bc41ad99c1ae8bb53dce13 [id=0586dbd68a634d83ab9b00d2ba7f38af])
I20260617 20:17:11.980870 29383 tablet_bootstrap.cc:492] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:11.981427 31119 tablet_loader.cc:96] loaded metadata for tablet 7592de494f9c428fb062ccc94766b784 (table default.Table_cb082a7a5a9a4bc2a3bbec80980daecd [id=92cf868f819444efa0bbc6b0bb233b8e])
I20260617 20:17:11.982239 31119 tablet_loader.cc:96] loaded metadata for tablet 768f932c2c6a43589f026a5a4ecbe660 (table default.Table_618ad76b555e4e38a2a0f86b2a755535 [id=a675f66582984b53aaed7fef04f05745])
I20260617 20:17:11.982697 31119 tablet_loader.cc:96] loaded metadata for tablet 76b5855e0e4149219a9b152ac1f9b958 (table default.Table_c25af0a4fa2f44b5b7680070d7f18a31 [id=fe89136dd04a45a18a88883eb05e12d7])
I20260617 20:17:11.983229 29121 raft_consensus.cc:3060] T 49e7a29b7fdd411e9957d23861a996db P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:11.986498 31220 consensus_queue.cc:1048] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:11.987663 29379 tablet_bootstrap.cc:492] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:11.987924 29379 ts_tablet_manager.cc:1403] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.140s user 0.008s sys 0.032s
I20260617 20:17:11.988073 29378 ts_tablet_manager.cc:1434] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.020s user 0.002s sys 0.000s
I20260617 20:17:11.988692 29378 tablet_bootstrap.cc:492] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:11.989212 29379 raft_consensus.cc:359] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.989588 29379 raft_consensus.cc:385] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:11.989737 29379 raft_consensus.cc:740] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:11.990166 29379 consensus_queue.cc:260] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:11.991322 29379 ts_tablet_manager.cc:1434] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:11.992769 29379 tablet_bootstrap.cc:492] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:11.993088 29378 tablet_bootstrap.cc:654] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:11.995958 31259 consensus_queue.cc:1048] T 49e7a29b7fdd411e9957d23861a996db P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.006330 29383 tablet_bootstrap.cc:654] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.009469 29379 tablet_bootstrap.cc:654] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.012001 29125 raft_consensus.cc:3060] T 18791cd3384f4bd48c333a3460e85286 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.015796 31259 consensus_queue.cc:1048] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.029826 31287 raft_consensus.cc:493] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.029973 31287 raft_consensus.cc:515] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.030522 31287 leader_election.cc:290] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.031414 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c6804fbb34f5baebdb366f2e0b1bf" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.031595 29255 raft_consensus.cc:2468] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
W20260617 20:17:12.032049 29062 leader_election.cc:343] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: e79c6804fbb34f5baebdb366f2e0b1bf
I20260617 20:17:12.032452 29063 leader_election.cc:304] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:12.032878 31287 raft_consensus.cc:2804] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.032964 31287 raft_consensus.cc:493] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.033030 31287 raft_consensus.cc:3060] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.037701 29379 tablet_bootstrap.cc:492] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.037606 31287 raft_consensus.cc:515] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:12.039247 29062 leader_election.cc:343] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: e79c6804fbb34f5baebdb366f2e0b1bf
I20260617 20:17:12.039634 29383 tablet_bootstrap.cc:492] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.039911 29383 ts_tablet_manager.cc:1403] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.060s user 0.005s sys 0.003s
I20260617 20:17:12.041576 30683 raft_consensus.cc:493] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.042032 30683 raft_consensus.cc:3060] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.041932 29383 raft_consensus.cc:359] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.042292 29383 raft_consensus.cc:385] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.042439 29383 raft_consensus.cc:740] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.042783 29383 consensus_queue.cc:260] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.044166 29379 ts_tablet_manager.cc:1403] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.004s
I20260617 20:17:12.045899 30852 consensus_queue.cc:1048] T 18791cd3384f4bd48c333a3460e85286 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.045814 29383 ts_tablet_manager.cc:1434] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:17:12.048013 29383 tablet_bootstrap.cc:492] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.049863 29379 raft_consensus.cc:359] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.051204 29379 raft_consensus.cc:385] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.051849 29379 raft_consensus.cc:740] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.052289 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e79c6804fbb34f5baebdb366f2e0b1bf" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:12.052459 29255 raft_consensus.cc:3060] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.053277 29379 consensus_queue.cc:260] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.055213 29255 raft_consensus.cc:2468] T e79c6804fbb34f5baebdb366f2e0b1bf P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:12.056547 29063 leader_election.cc:304] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254
I20260617 20:17:12.056980 31171 raft_consensus.cc:2804] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.057139 31171 raft_consensus.cc:697] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:12.056977 29379 ts_tablet_manager.cc:1434] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.012s user 0.000s sys 0.003s
I20260617 20:17:12.057507 31171 consensus_queue.cc:237] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.058995 29379 tablet_bootstrap.cc:492] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.059904 30852 consensus_queue.cc:1048] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.059887 29383 tablet_bootstrap.cc:654] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.057011 31287 leader_election.cc:290] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.067533 29379 tablet_bootstrap.cc:654] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.067786 31287 consensus_queue.cc:1048] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:12.078336 29198 consensus_peers.cc:597] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:12.080412 31119 tablet_loader.cc:96] loaded metadata for tablet 77f685eeac48402888cbc8ef97fb4b94 (table default.Table_fe54346acedc4aee9fe8151c12a389fc [id=32c61aa9610e428fa8d5c794b078e0a1])
I20260617 20:17:12.080394 30852 consensus_queue.cc:1048] T 54969e138cf745739b54203c11e4c94e P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.080776 31119 tablet_loader.cc:96] loaded metadata for tablet 7832578335fb427286d85e63bdf35379 (table default.Table_eb9f201319f9403fb808594dd9583fe8 [id=44e8c8aaae8242c6993b571a018ec8b6])
I20260617 20:17:12.081115 31119 tablet_loader.cc:96] loaded metadata for tablet 791580f2131c424a87878723205864b5 (table default.Table_f251f69819b7456a9a108dfefb1414bd [id=659fc9e914b14c72b7d2a3571a01608a])
I20260617 20:17:12.082836 31119 tablet_loader.cc:96] loaded metadata for tablet 7aff4af99ef04f709a46a3ebaacad925 (table default.Table_d4d37c5379c9419c8b12c966da753137 [id=c1634e2c68bd4432a3d7552f7ae02e07])
I20260617 20:17:12.082100 29379 tablet_bootstrap.cc:492] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.083478 31119 tablet_loader.cc:96] loaded metadata for tablet 7b14f846015b4e82b2c3bdebc21b07b9 (table default.Table_6878f9bd771944d8be106fbf847f8baa [id=91adfc411b404fa097607e44707e211c])
W20260617 20:17:12.083689 29062 consensus_peers.cc:597] T ebd98889d08f4683ba4b2ee98a74254d P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ebd98889d08f4683ba4b2ee98a74254d. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:12.084250 29379 ts_tablet_manager.cc:1403] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.005s
I20260617 20:17:12.087903 29383 tablet_bootstrap.cc:492] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.088176 29383 ts_tablet_manager.cc:1403] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.001s
I20260617 20:17:12.089879 29383 raft_consensus.cc:359] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.090319 29383 raft_consensus.cc:385] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.090480 29383 raft_consensus.cc:740] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.091125 29383 consensus_queue.cc:260] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.094837 30683 raft_consensus.cc:515] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.095885 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a176d1f3b0446984af141e02bac329" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:12.096062 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a176d1f3b0446984af141e02bac329" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.096235 28983 raft_consensus.cc:3060] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:12.096423 29198 leader_election.cc:343] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.096599 30683 leader_election.cc:290] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.099005 28983 raft_consensus.cc:2468] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.100687 29383 ts_tablet_manager.cc:1434] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260617 20:17:12.102784 29197 leader_election.cc:304] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.103060 31221 raft_consensus.cc:493] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.103169 31221 raft_consensus.cc:515] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.103726 31221 leader_election.cc:290] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.103847 31221 raft_consensus.cc:2804] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.103952 31221 raft_consensus.cc:697] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.104146 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceb3ae3c1a44442966ad37fbcbc658b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.104189 31221 consensus_queue.cc:237] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.104308 29121 raft_consensus.cc:2468] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.104657 29198 leader_election.cc:304] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:12.104938 31220 raft_consensus.cc:2804] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.105001 31220 raft_consensus.cc:493] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.105063 31220 raft_consensus.cc:3060] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.105824 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceb3ae3c1a44442966ad37fbcbc658b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.106027 28981 raft_consensus.cc:2468] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.101516 29379 raft_consensus.cc:359] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.106525 29383 tablet_bootstrap.cc:492] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.106577 29379 raft_consensus.cc:385] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.106977 29379 raft_consensus.cc:740] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.107661 31220 raft_consensus.cc:515] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.108140 31220 leader_election.cc:290] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.108201 29379 consensus_queue.cc:260] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.109194 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceb3ae3c1a44442966ad37fbcbc658b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:12.109505 29121 raft_consensus.cc:3060] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.110195 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ceb3ae3c1a44442966ad37fbcbc658b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.110351 28981 raft_consensus.cc:3060] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.112018 29121 raft_consensus.cc:2468] T 4ceb3ae3c1a44442966ad37fbcbc658b P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.112639 29198 leader_election.cc:304] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:12.112968 31220 raft_consensus.cc:2804] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.113026 28981 raft_consensus.cc:2468] T 4ceb3ae3c1a44442966ad37fbcbc658b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.113147 31220 raft_consensus.cc:697] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.112375 29379 ts_tablet_manager.cc:1434] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20260617 20:17:12.113570 31220 consensus_queue.cc:237] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.127365 29379 tablet_bootstrap.cc:492] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.130724 29383 tablet_bootstrap.cc:654] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.133764 31221 consensus_queue.cc:1048] T 326eb1cffb9a47078320e6fcba0743ce P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.141812 29379 tablet_bootstrap.cc:654] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.147548 31313 raft_consensus.cc:493] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.147696 31313 raft_consensus.cc:515] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.148275 31313 leader_election.cc:290] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.148895 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd24a60a91b43cd9e31ecca3d21ec60" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.149286 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd24a60a91b43cd9e31ecca3d21ec60" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.149783 28925 leader_election.cc:343] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:12.150243 28925 consensus_peers.cc:597] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:12.150843 28925 leader_election.cc:343] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.150940 28925 leader_election.cc:304] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.151298 31313 raft_consensus.cc:2749] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.160449 31119 tablet_loader.cc:96] loaded metadata for tablet 7e92c53710da422da9777635d4478100 (table default.Table_7b4739816cc340b5b1f9a29e08d5032d [id=4e09fd32f7a44b49bb9dbeb71dae470d])
I20260617 20:17:12.160921 31119 tablet_loader.cc:96] loaded metadata for tablet 7e9876434d9640ce9a4b30336c499241 (table default.Table_3dc2c3ecaddb44aab8d117d29872dfd5 [id=7c887cea4a7c4feea06af161c4c9b87d])
I20260617 20:17:12.161185 29379 tablet_bootstrap.cc:492] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.163617 29379 ts_tablet_manager.cc:1403] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.001s
W20260617 20:17:12.171047 28925 consensus_peers.cc:597] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:12.174883 29383 tablet_bootstrap.cc:492] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.175112 29383 ts_tablet_manager.cc:1403] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.069s user 0.006s sys 0.002s
I20260617 20:17:12.175443 29378 tablet_bootstrap.cc:492] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.175637 29378 ts_tablet_manager.cc:1403] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.187s user 0.025s sys 0.023s
I20260617 20:17:12.176119 29383 raft_consensus.cc:359] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.176294 29378 raft_consensus.cc:359] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.176373 29383 raft_consensus.cc:385] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.176487 29378 raft_consensus.cc:385] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.176576 29378 raft_consensus.cc:740] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.176550 29383 raft_consensus.cc:740] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.176898 29378 consensus_queue.cc:260] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.177055 29383 consensus_queue.cc:260] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.179481 31119 tablet_loader.cc:96] loaded metadata for tablet 7ecc4b5e866945b1aec9e4a84cf360ff (table default.Table_e271ce7263b74cbfadbee5ec752a965d [id=f3ff33ab728e488a802d626b5dff181d])
I20260617 20:17:12.186110 31119 tablet_loader.cc:96] loaded metadata for tablet 7ee67832c2b54aa181c1c2ac5b6c5f82 (table default.Table_a19dcdf8816f4caf9cf0d25a9aa3094d [id=8ef73a8dfb464790947b7bf43986d370])
I20260617 20:17:12.186887 31119 tablet_loader.cc:96] loaded metadata for tablet 7f16576b43f9457e8e58dabd2103f433 (table default.Table_89996edf26734b579b82eaf9bc18dbd0 [id=8486a38e5e0344b4ab9c222ea975ac2e])
I20260617 20:17:12.187115 29383 ts_tablet_manager.cc:1434] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20260617 20:17:12.188078 29379 raft_consensus.cc:359] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.189769 29379 raft_consensus.cc:385] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.190482 29383 tablet_bootstrap.cc:492] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.190685 29379 raft_consensus.cc:740] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.192701 29379 consensus_queue.cc:260] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.197235 29378 ts_tablet_manager.cc:1434] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20260617 20:17:12.197768 29378 tablet_bootstrap.cc:492] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.198333 31220 raft_consensus.cc:493] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.198169 29379 ts_tablet_manager.cc:1434] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.034s user 0.003s sys 0.000s
I20260617 20:17:12.198493 31220 raft_consensus.cc:515] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.198779 31313 raft_consensus.cc:493] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.198889 31313 raft_consensus.cc:515] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.199395 31313 leader_election.cc:290] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.199533 29378 tablet_bootstrap.cc:654] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.199995 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ab6fe7319940fcabd315193c51e199" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.201035 28925 leader_election.cc:343] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.200584 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ab6fe7319940fcabd315193c51e199" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.204633 31119 tablet_loader.cc:96] loaded metadata for tablet 7fb3d6e959e24fc2864f87984010493c (table default.Table_fc2cdea718fc4d83ab66e9c4d231a8f0 [id=791fd9c127eb4213b1f362d7ac1acf73])
I20260617 20:17:12.212898 31220 leader_election.cc:290] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.214040 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a89e42d091f423bb926f671797141ea" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.214695 28925 leader_election.cc:343] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.214740 29383 tablet_bootstrap.cc:654] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.214828 28925 leader_election.cc:304] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:12.215691 29198 leader_election.cc:343] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.216884 31249 raft_consensus.cc:2749] T 88ab6fe7319940fcabd315193c51e199 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.218269 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a89e42d091f423bb926f671797141ea" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.218452 28985 raft_consensus.cc:2468] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.218878 29197 leader_election.cc:304] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.219532 31220 raft_consensus.cc:2804] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.219633 31220 raft_consensus.cc:493] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.219702 31220 raft_consensus.cc:3060] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.222163 29378 tablet_bootstrap.cc:492] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.222426 29378 ts_tablet_manager.cc:1403] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.004s
I20260617 20:17:12.222353 31220 raft_consensus.cc:515] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.223546 29378 raft_consensus.cc:359] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.223821 29378 raft_consensus.cc:385] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.223883 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a89e42d091f423bb926f671797141ea" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.223943 29378 raft_consensus.cc:740] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.224057 28985 raft_consensus.cc:3060] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.224323 29378 consensus_queue.cc:260] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.226305 29378 ts_tablet_manager.cc:1434] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260617 20:17:12.227207 29378 tablet_bootstrap.cc:492] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.231225 29378 tablet_bootstrap.cc:654] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.231353 29383 tablet_bootstrap.cc:492] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.231534 29383 ts_tablet_manager.cc:1403] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.042s user 0.008s sys 0.003s
I20260617 20:17:12.232342 29383 raft_consensus.cc:359] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.232566 29383 raft_consensus.cc:385] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.233340 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a89e42d091f423bb926f671797141ea" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:12.234761 28985 raft_consensus.cc:2468] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:17:12.233819 29198 leader_election.cc:343] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.237742 29197 leader_election.cc:304] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.238055 30683 raft_consensus.cc:2804] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.238175 30683 raft_consensus.cc:697] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.238312 29383 raft_consensus.cc:740] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.238413 30683 consensus_queue.cc:237] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.238492 29383 consensus_queue.cc:260] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.239028 29383 ts_tablet_manager.cc:1434] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 20:17:12.239282 29383 tablet_bootstrap.cc:492] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.233933 31220 leader_election.cc:290] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.240013 31313 raft_consensus.cc:493] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.240128 31313 raft_consensus.cc:515] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.240675 31313 leader_election.cc:290] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.241672 29383 tablet_bootstrap.cc:654] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.241925 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425c1727564745b2ab84b39a2d190db5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:12.242493 28925 leader_election.cc:343] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.242950 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425c1727564745b2ab84b39a2d190db5" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.243460 28925 leader_election.cc:343] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.243559 28925 leader_election.cc:304] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.243952 31313 raft_consensus.cc:2749] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.251180 29383 tablet_bootstrap.cc:492] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.251434 29383 ts_tablet_manager.cc:1403] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.003s
I20260617 20:17:12.252261 29379 tablet_bootstrap.cc:492] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.254061 31119 tablet_loader.cc:96] loaded metadata for tablet 80bc9fa552114c2f90f77c67ab63b0e6 (table default.Table_00f049c59fbd43bc8134a419c3d654a5 [id=da1befcdf0ba45d1b52d9236dfbbde60])
I20260617 20:17:12.254385 29379 tablet_bootstrap.cc:654] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.256516 29383 raft_consensus.cc:359] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.257516 29383 raft_consensus.cc:385] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.257725 29383 raft_consensus.cc:740] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.258160 29383 consensus_queue.cc:260] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.259039 29383 ts_tablet_manager.cc:1434] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 20:17:12.259209 31119 tablet_loader.cc:96] loaded metadata for tablet 80d778641c354c679ee9e7d7b3eae3b5 (table default.Table_8bc2da3ec59547e290194b2ec6184b7f [id=de3384ef7984460abc15ca893a9f8c83])
I20260617 20:17:12.259797 29383 tablet_bootstrap.cc:492] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.260876 31119 tablet_loader.cc:96] loaded metadata for tablet 82ec75621f88424d963ffe235a5149f4 (table default.Table_5bb2dea5397f4dee834759955006f657 [id=bbd9142963fd450583aef1d8d715e35c])
W20260617 20:17:12.264219 29198 consensus_peers.cc:597] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:12.265900 29383 tablet_bootstrap.cc:654] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.266885 29378 tablet_bootstrap.cc:492] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.267709 29378 ts_tablet_manager.cc:1403] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.010s
I20260617 20:17:12.269362 31119 tablet_loader.cc:96] loaded metadata for tablet 835dd184c2fc4e109187ca30894b6cd2 (table default.Table_2a1a4568e12941bf8abda5bc5f6a3477 [id=7ff91d1db9e249efa3d80acfddc13a27])
I20260617 20:17:12.269924 29379 tablet_bootstrap.cc:492] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.270139 29379 ts_tablet_manager.cc:1403] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.008s
I20260617 20:17:12.270956 29379 raft_consensus.cc:359] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.271215 29379 raft_consensus.cc:385] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.271334 29379 raft_consensus.cc:740] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.271613 29379 consensus_queue.cc:260] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.271344 29378 raft_consensus.cc:359] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.272027 29378 raft_consensus.cc:385] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.272606 29379 ts_tablet_manager.cc:1434] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:12.272387 29378 raft_consensus.cc:740] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.275647 29379 tablet_bootstrap.cc:492] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.278577 29379 tablet_bootstrap.cc:654] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.280920 29383 tablet_bootstrap.cc:492] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.281349 29383 ts_tablet_manager.cc:1403] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.001s
I20260617 20:17:12.272069 31119 tablet_loader.cc:96] loaded metadata for tablet 839ae2f924494679a1389ad61be65259 (table default.Table_889e523bb22f4128b77891b85373222a [id=151b6dafa03949f5a089baff4544f16d])
I20260617 20:17:12.282160 29383 raft_consensus.cc:359] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.282399 29383 raft_consensus.cc:385] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.282480 31119 tablet_loader.cc:96] loaded metadata for tablet 8449a9905bbe4cdcbc211e437b1bd2b9 (table default.Table_3f075eeaca7944f5a62ec0392ebea2d6 [id=869901d606b0494db3b02b698908f9b2])
I20260617 20:17:12.282495 29383 raft_consensus.cc:740] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.282773 29383 consensus_queue.cc:260] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.283386 29383 ts_tablet_manager.cc:1434] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:12.283881 29383 tablet_bootstrap.cc:492] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.288239 29383 tablet_bootstrap.cc:654] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.291718 31119 tablet_loader.cc:96] loaded metadata for tablet 8797ef75e5174c99bfae4de206eb1fda (table default.Table_6a488f8547fe46278096d8acc2c1753f [id=e0ac5a8ae5b34be48d2d85947f803ead])
I20260617 20:17:12.273633 29378 consensus_queue.cc:260] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.294046 29379 tablet_bootstrap.cc:492] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.294196 29379 ts_tablet_manager.cc:1403] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20260617 20:17:12.293287 29378 ts_tablet_manager.cc:1434] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.025s user 0.001s sys 0.002s
I20260617 20:17:12.294909 29379 raft_consensus.cc:359] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.295073 29379 raft_consensus.cc:385] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.295128 29379 raft_consensus.cc:740] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.295315 29379 consensus_queue.cc:260] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.295576 29378 tablet_bootstrap.cc:492] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.296089 29379 ts_tablet_manager.cc:1434] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:12.296335 29379 tablet_bootstrap.cc:492] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.298168 29379 tablet_bootstrap.cc:654] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.299717 31287 raft_consensus.cc:493] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.299842 31287 raft_consensus.cc:515] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.300424 31287 leader_election.cc:290] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.300765 31119 tablet_loader.cc:96] loaded metadata for tablet 87d0e2ecc16e4285a1d8337a5336caf2 (table default.Table_724f440ee4704ab9b73c964377608058 [id=bcc2e0ae5e6b4ab9b36f37350872c6f8])
I20260617 20:17:12.301697 31119 tablet_loader.cc:96] loaded metadata for tablet 88b1b9ea19f443338bc743653621ceb3 (table default.Table_f168e10b93404a79b1d7a16f09857071 [id=db84a2ce6b424df9a2e40f4ae49b9efe])
I20260617 20:17:12.302148 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71049338f673401bad32204d232bfe43" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.304868 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71049338f673401bad32204d232bfe43" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.306007 28985 raft_consensus.cc:2393] T 71049338f673401bad32204d232bfe43 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:12.306986 29062 leader_election.cc:304] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.307292 29378 tablet_bootstrap.cc:654] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.307457 30852 raft_consensus.cc:493] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.307533 31287 raft_consensus.cc:3060] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.307606 30852 raft_consensus.cc:515] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.308164 30852 leader_election.cc:290] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.309026 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d811ca370ee54db8a7e4f6056017cd01" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.309769 29198 leader_election.cc:343] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.310089 31287 raft_consensus.cc:2749] T 71049338f673401bad32204d232bfe43 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.310904 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d811ca370ee54db8a7e4f6056017cd01" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.311131 28978 raft_consensus.cc:2468] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.311590 29197 leader_election.cc:304] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.311964 30852 raft_consensus.cc:2804] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.312031 30852 raft_consensus.cc:493] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.312099 30852 raft_consensus.cc:3060] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.314859 30852 raft_consensus.cc:515] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.316217 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d811ca370ee54db8a7e4f6056017cd01" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:12.316730 29198 leader_election.cc:343] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.316880 30852 leader_election.cc:290] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.317090 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d811ca370ee54db8a7e4f6056017cd01" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.317231 28978 raft_consensus.cc:3060] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.320060 28978 raft_consensus.cc:2468] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.322448 29378 tablet_bootstrap.cc:492] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.323019 29197 leader_election.cc:304] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.323098 29378 ts_tablet_manager.cc:1403] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.003s
I20260617 20:17:12.323455 31220 raft_consensus.cc:2804] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.323572 31220 raft_consensus.cc:697] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.323882 31220 consensus_queue.cc:237] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.324090 29378 raft_consensus.cc:359] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.324242 29378 raft_consensus.cc:385] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.324294 29378 raft_consensus.cc:740] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.326476 29378 consensus_queue.cc:260] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.326913 31220 consensus_queue.cc:1048] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.327592 29378 ts_tablet_manager.cc:1434] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:12.328784 29378 tablet_bootstrap.cc:492] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.330566 29378 tablet_bootstrap.cc:654] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.332782 31119 tablet_loader.cc:96] loaded metadata for tablet 88f20eb0a7284d318970d001fa9e83dd (table default.Table_287b99d05553492ea2ef943ec6e829b7 [id=e32642a0d72a44b1817195574c4ad00f])
I20260617 20:17:12.334408 31119 tablet_loader.cc:96] loaded metadata for tablet 8c0cfb6ce2374c1a8ae22f5f6028fe6c (table default.Table_fc1d88f958a0469686a6eb2def4897dd [id=3fa51dbd276946a1acfb91f97348743b])
I20260617 20:17:12.334990 31119 tablet_loader.cc:96] loaded metadata for tablet 8d1f912a45a64dfab6affbc972d27e6b (table default.Table_411f66b9447a436d8d71bc99a62285fc [id=732a974bd6a84f428014fcc980ed9390])
W20260617 20:17:12.339557 29198 consensus_peers.cc:597] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:12.342947 29378 tablet_bootstrap.cc:492] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.343557 29378 ts_tablet_manager.cc:1403] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.001s
I20260617 20:17:12.344563 29378 raft_consensus.cc:359] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.345717 29378 raft_consensus.cc:385] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.345932 29378 raft_consensus.cc:740] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.346412 29378 consensus_queue.cc:260] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.347447 29378 ts_tablet_manager.cc:1434] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260617 20:17:12.348131 29378 tablet_bootstrap.cc:492] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.355641 29378 tablet_bootstrap.cc:654] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.356097 29379 tablet_bootstrap.cc:492] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.356271 29379 ts_tablet_manager.cc:1403] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.060s user 0.010s sys 0.006s
I20260617 20:17:12.356971 29379 raft_consensus.cc:359] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.357080 31220 consensus_queue.cc:1048] T 71049338f673401bad32204d232bfe43 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.357159 29379 raft_consensus.cc:385] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.357213 29379 raft_consensus.cc:740] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.357450 29379 consensus_queue.cc:260] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.358876 29379 ts_tablet_manager.cc:1434] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:17:12.359375 29379 tablet_bootstrap.cc:492] T 6f15a7c18faa4e36bbb62809bb6e976c P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.360595 31313 raft_consensus.cc:493] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.360728 31313 raft_consensus.cc:515] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.362123 31313 leader_election.cc:290] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.362226 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5806949c371b41b0a162a4c8cbf6b435" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.362740 28925 leader_election.cc:343] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.363101 29379 tablet_bootstrap.cc:654] T 6f15a7c18faa4e36bbb62809bb6e976c P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.363144 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5806949c371b41b0a162a4c8cbf6b435" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:12.363634 28925 leader_election.cc:343] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.363729 28925 leader_election.cc:304] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.364105 31313 raft_consensus.cc:2749] T 5806949c371b41b0a162a4c8cbf6b435 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.366470 29378 tablet_bootstrap.cc:492] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.366644 29378 ts_tablet_manager.cc:1403] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20260617 20:17:12.367441 29378 raft_consensus.cc:359] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.367672 29378 raft_consensus.cc:385] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.367776 29378 raft_consensus.cc:740] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.368043 29378 consensus_queue.cc:260] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.368634 31119 tablet_loader.cc:96] loaded metadata for tablet 8e765deb9fe84707a5e9e2964310a36d (table default.Table_3463b514edb64b81813246ee4f8ed157 [id=6e73368fb6f74908b0583b369af8de2c])
I20260617 20:17:12.368731 29378 ts_tablet_manager.cc:1434] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:12.369055 29378 tablet_bootstrap.cc:492] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.370961 29383 tablet_bootstrap.cc:492] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.371085 29383 ts_tablet_manager.cc:1403] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.087s user 0.011s sys 0.012s
I20260617 20:17:12.372829 29383 raft_consensus.cc:359] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.375120 29383 raft_consensus.cc:385] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.375236 29383 raft_consensus.cc:740] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.374446 31220 consensus_queue.cc:1048] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.377576 31313 raft_consensus.cc:493] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.377696 31313 raft_consensus.cc:515] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.377988 29383 consensus_queue.cc:260] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.378221 31313 leader_election.cc:290] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.378479 29383 ts_tablet_manager.cc:1434] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 20:17:12.378737 29383 tablet_bootstrap.cc:492] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.378832 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3bb8cd7df47aea4746f74f1ca2dc1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.379338 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3bb8cd7df47aea4746f74f1ca2dc1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:12.379444 28925 leader_election.cc:343] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.379866 29379 tablet_bootstrap.cc:492] T 6f15a7c18faa4e36bbb62809bb6e976c P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
W20260617 20:17:12.379897 28925 leader_election.cc:343] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.380002 28925 leader_election.cc:304] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.380045 29379 ts_tablet_manager.cc:1403] T 6f15a7c18faa4e36bbb62809bb6e976c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.001s
I20260617 20:17:12.380652 31313 raft_consensus.cc:2749] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.380713 29379 raft_consensus.cc:359] T 6f15a7c18faa4e36bbb62809bb6e976c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.380923 29379 raft_consensus.cc:385] T 6f15a7c18faa4e36bbb62809bb6e976c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.381014 29379 raft_consensus.cc:740] T 6f15a7c18faa4e36bbb62809bb6e976c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.381250 29379 consensus_queue.cc:260] T 6f15a7c18faa4e36bbb62809bb6e976c P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.381626 29383 tablet_bootstrap.cc:654] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.382098 29379 ts_tablet_manager.cc:1434] T 6f15a7c18faa4e36bbb62809bb6e976c P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:12.382570 29379 tablet_bootstrap.cc:492] T 40845d7a668045ec9a40cb6d1d76137d P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.384136 31119 tablet_loader.cc:96] loaded metadata for tablet 900aed4f54934151be309160585cf9c6 (table default.Table_d545ddbe325840ff8bcb2ab57f727e55 [id=f4d29aefa68d44c68fc90dd0f1d0bcdf])
I20260617 20:17:12.384286 29379 tablet_bootstrap.cc:654] T 40845d7a668045ec9a40cb6d1d76137d P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.392946 29378 tablet_bootstrap.cc:654] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.403462 29378 tablet_bootstrap.cc:492] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.403853 31287 consensus_queue.cc:1048] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.404356 29383 tablet_bootstrap.cc:492] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.404493 29383 ts_tablet_manager.cc:1403] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.005s
I20260617 20:17:12.405534 29383 raft_consensus.cc:359] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.405730 29383 raft_consensus.cc:385] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.405845 29383 raft_consensus.cc:740] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.406172 29383 consensus_queue.cc:260] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.408391 29379 tablet_bootstrap.cc:492] T 40845d7a668045ec9a40cb6d1d76137d P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.408567 29379 ts_tablet_manager.cc:1403] T 40845d7a668045ec9a40cb6d1d76137d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.001s
I20260617 20:17:12.409329 29379 raft_consensus.cc:359] T 40845d7a668045ec9a40cb6d1d76137d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.409521 29379 raft_consensus.cc:385] T 40845d7a668045ec9a40cb6d1d76137d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.409593 29379 raft_consensus.cc:740] T 40845d7a668045ec9a40cb6d1d76137d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.409837 29379 consensus_queue.cc:260] T 40845d7a668045ec9a40cb6d1d76137d P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.410140 29383 ts_tablet_manager.cc:1434] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:17:12.410409 29378 ts_tablet_manager.cc:1403] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.003s
I20260617 20:17:12.411285 29379 ts_tablet_manager.cc:1434] T 40845d7a668045ec9a40cb6d1d76137d P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:12.411823 31220 raft_consensus.cc:493] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.411967 31220 raft_consensus.cc:515] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.412271 29379 tablet_bootstrap.cc:492] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.412647 31220 leader_election.cc:290] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.413166 31119 tablet_loader.cc:96] loaded metadata for tablet 93ff519f9db34a7b9a4686f09722a501 (table default.Table_24eb651bcbec4bafbac0b0612438512f [id=704477b29a8548ed9d8fd39b7e9e89a5])
I20260617 20:17:12.413425 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d79b7023ae478698a06562b2e4c578" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.413607 28983 raft_consensus.cc:2468] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.413713 29378 raft_consensus.cc:359] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.413847 29378 raft_consensus.cc:385] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.413846 31119 tablet_loader.cc:96] loaded metadata for tablet 952dd29df20f451e8d47baf3026d3008 (table default.Table_5ba1cc04120f480096f12966b301a7ac [id=27dd87e5a02e40c08b5e66d0d47aafcb])
I20260617 20:17:12.413894 29378 raft_consensus.cc:740] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.414027 29197 leader_election.cc:304] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:12.414357 31220 raft_consensus.cc:2804] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.414428 31220 raft_consensus.cc:493] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.414485 31220 raft_consensus.cc:3060] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.414774 31119 tablet_loader.cc:96] loaded metadata for tablet 9655a1164fa84f53bdb9fd31b2fcda78 (table default.Table_e7b17c557187475d91de751c47b28644 [id=ce30ff8f9aa148879cb0f930fffc1f51])
I20260617 20:17:12.415948 31119 tablet_loader.cc:96] loaded metadata for tablet 97541af7c02d46b98106692d92778741 (table default.Table_702d2d2262b845b68b13e005c388d10b [id=f608d4e53a0f4d37af562e6ce53576d8])
I20260617 20:17:12.416551 31119 tablet_loader.cc:96] loaded metadata for tablet 98871c8e8d6240e2bf8bd305bc986b81 (table default.Table_c2f68ef5042044f6aa4494001d1f0238 [id=3d58d8b3e80d42bc9ac7f1481831b490])
I20260617 20:17:12.414095 29378 consensus_queue.cc:260] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.417016 31220 raft_consensus.cc:515] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.417865 31249 raft_consensus.cc:493] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.417974 31249 raft_consensus.cc:515] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.418438 29378 ts_tablet_manager.cc:1434] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 20:17:12.418503 31249 leader_election.cc:290] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.418924 29378 tablet_bootstrap.cc:492] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.419092 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d79b7023ae478698a06562b2e4c578" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.419334 29379 tablet_bootstrap.cc:654] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.419858 31249 consensus_queue.cc:1048] T 6f15a7c18faa4e36bbb62809bb6e976c P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.419922 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3180f1336fd841d8b4cf7fdf94015955" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.420660 29198 leader_election.cc:343] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:12.420979 28925 leader_election.cc:343] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.421890 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3180f1336fd841d8b4cf7fdf94015955" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:12.422636 28925 leader_election.cc:343] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.422739 28925 leader_election.cc:304] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.423170 31249 raft_consensus.cc:2749] T 3180f1336fd841d8b4cf7fdf94015955 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.423902 31220 leader_election.cc:290] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.424495 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d79b7023ae478698a06562b2e4c578" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:12.424651 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d79b7023ae478698a06562b2e4c578" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.424850 28983 raft_consensus.cc:3060] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:12.424942 29198 leader_election.cc:343] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.428442 28983 raft_consensus.cc:2468] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.429510 29197 leader_election.cc:304] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.429749 29378 tablet_bootstrap.cc:654] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.429980 30852 raft_consensus.cc:2804] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.430130 30852 raft_consensus.cc:697] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.430410 30852 consensus_queue.cc:237] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.434257 29383 tablet_bootstrap.cc:492] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.436131 29383 tablet_bootstrap.cc:654] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.443692 29378 tablet_bootstrap.cc:492] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.444425 29378 ts_tablet_manager.cc:1403] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.006s
I20260617 20:17:12.445494 29378 raft_consensus.cc:359] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.445959 29383 tablet_bootstrap.cc:492] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.446089 29383 ts_tablet_manager.cc:1403] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260617 20:17:12.446724 29383 raft_consensus.cc:359] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.446794 29378 raft_consensus.cc:385] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.446879 29383 raft_consensus.cc:385] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.446945 29383 raft_consensus.cc:740] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.447094 29378 raft_consensus.cc:740] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.447125 29383 consensus_queue.cc:260] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.447559 29383 ts_tablet_manager.cc:1434] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:17:12.447822 29383 tablet_bootstrap.cc:492] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.447582 29378 consensus_queue.cc:260] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.449476 29378 ts_tablet_manager.cc:1434] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:17:12.449555 29383 tablet_bootstrap.cc:654] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.451277 29383 tablet_bootstrap.cc:492] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.451457 29383 ts_tablet_manager.cc:1403] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260617 20:17:12.452147 29383 raft_consensus.cc:359] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.452365 29383 raft_consensus.cc:385] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.452462 29383 raft_consensus.cc:740] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.452733 29383 consensus_queue.cc:260] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.454082 29383 ts_tablet_manager.cc:1434] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:17:12.452327 31220 consensus_queue.cc:1048] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.455075 29383 tablet_bootstrap.cc:492] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.455868 31249 consensus_queue.cc:1048] T 6f544f486c144cd89ca7c5b83d252ee9 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.459151 29383 tablet_bootstrap.cc:654] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.459584 31249 raft_consensus.cc:493] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.459705 31249 raft_consensus.cc:515] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.460199 31249 leader_election.cc:290] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.460806 29258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d281eec19b34aaa8729d8891547b8e4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.460891 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d281eec19b34aaa8729d8891547b8e4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.462387 28925 leader_election.cc:343] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:12.462594 28925 leader_election.cc:343] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.462678 28925 leader_election.cc:304] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.465449 31249 raft_consensus.cc:2749] T 4d281eec19b34aaa8729d8891547b8e4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.472746 29378 tablet_bootstrap.cc:492] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.474440 29379 tablet_bootstrap.cc:492] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.474591 29378 tablet_bootstrap.cc:654] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.474617 29379 ts_tablet_manager.cc:1403] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.009s
I20260617 20:17:12.474614 31119 tablet_loader.cc:96] loaded metadata for tablet 9a4c040cfe4445bca51e302a98b40971 (table default.Table_fbc7dc910d9b4eda962ff4b9328e00a3 [id=1efcb5e6de134a54bc4250ae502080e6])
I20260617 20:17:12.475188 31119 tablet_loader.cc:96] loaded metadata for tablet 9ab260f13530487683d12ff01a43668f (table default.Table_cd47ca20a5094cada0101a3fafba4f5d [id=550f5bf4ac614fc9a1a2778070e7f3a0])
I20260617 20:17:12.475478 29379 raft_consensus.cc:359] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.475684 29379 raft_consensus.cc:385] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.475746 29379 raft_consensus.cc:740] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.475943 29379 consensus_queue.cc:260] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.476641 29379 ts_tablet_manager.cc:1434] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:12.485100 31119 tablet_loader.cc:96] loaded metadata for tablet 9af3af6bc87843cfa6cd74e3d5e230f4 (table default.Table_e92a88d95d63479491b84cc8ead2dc24 [id=95cd9fa957494d3a99653c28159cf4b2])
I20260617 20:17:12.486263 29379 tablet_bootstrap.cc:492] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.487998 29379 tablet_bootstrap.cc:654] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.490337 31119 tablet_loader.cc:96] loaded metadata for tablet 9d249b5bf5364d77b7a51fa9defdb628 (table default.Table_1dcb619bfb304bcc890afe629b9e4694 [id=57af564b4ab34bc88d4dae9a0f8b2ff4])
I20260617 20:17:12.490492 31313 raft_consensus.cc:493] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.490662 31313 raft_consensus.cc:515] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.491374 31313 leader_election.cc:290] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.492116 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6323292f162b4063b7c413eaecfce791" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.493621 28925 leader_election.cc:343] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.494213 31094 consensus_queue.cc:1048] T 3e5949e832ca477e9effbe340f439e9c P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.495460 31119 tablet_loader.cc:96] loaded metadata for tablet 9dad85a23c0a45218fcd6ac04c12831a (table default.Table_b5d227c61e734225b76fd057b7ad9b96 [id=4cb0ef24b723455aacc2dc61526886d1])
I20260617 20:17:12.495525 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6323292f162b4063b7c413eaecfce791" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.495786 29257 raft_consensus.cc:2468] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:12.497527 29378 tablet_bootstrap.cc:492] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.497716 29378 ts_tablet_manager.cc:1403] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.003s
I20260617 20:17:12.498512 31119 tablet_loader.cc:96] loaded metadata for tablet 9df10ad7697f4134a13f04513c97d956 (table default.Table_222acbc48ebc47a3bd27b7ab3260796a [id=90b3785ca15e4bec9d8135bae72e4998])
I20260617 20:17:12.498752 29378 raft_consensus.cc:359] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.499010 29378 raft_consensus.cc:385] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.499084 29378 raft_consensus.cc:740] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.499364 29378 consensus_queue.cc:260] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.501669 28925 leader_election.cc:304] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.504509 29121 raft_consensus.cc:3060] T 4d23acc051c34ebfb0edb790faec1b2b P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.508472 31094 consensus_queue.cc:1048] T 4d23acc051c34ebfb0edb790faec1b2b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.512360 31220 raft_consensus.cc:493] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.512559 31220 raft_consensus.cc:515] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.513478 31220 leader_election.cc:290] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.514791 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8d29712eee47e497872df101404f26" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.515014 28981 raft_consensus.cc:2468] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.515530 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8d29712eee47e497872df101404f26" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.515606 29197 leader_election.cc:304] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
W20260617 20:17:12.516127 29198 leader_election.cc:343] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.516641 31221 raft_consensus.cc:2804] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.516729 31221 raft_consensus.cc:493] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.516894 31221 raft_consensus.cc:3060] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.520673 31221 raft_consensus.cc:515] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.520850 31119 tablet_loader.cc:96] loaded metadata for tablet 9fb0759ee9a34f3d96623bbe6dcc46d9 (table default.Table_a1c77cc368fb44969f11416cb083598b [id=475aa0d2f8044cd8b52cf31085dda15d])
I20260617 20:17:12.521317 31119 tablet_loader.cc:96] loaded metadata for tablet a05fd5cf1aa44d24a81bf1be178ad8b9 (table default.Table_202d346de7a14d6f9cad64a5e8ea8391 [id=6cef714c5570465286ae445cc7bb9109])
I20260617 20:17:12.521512 31221 leader_election.cc:290] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.521696 31119 tablet_loader.cc:96] loaded metadata for tablet a122f01420334404a3ffe711c6f10bf4 (table default.Table_560c145ddbd849009a37389bcd5428eb [id=4bf3d921af9d4bb89d123dad34a6cffa])
I20260617 20:17:12.522056 31119 tablet_loader.cc:96] loaded metadata for tablet a17684c0e6b545d1a22801071b6a72ac (table default.Table_430bbaa8b17349048f8c2e456ddc650f [id=3b2c339d6e9542b4ac564c99abae1946])
I20260617 20:17:12.522565 31119 tablet_loader.cc:96] loaded metadata for tablet a2f917126dc34f27a70b26ad7daa3afe (table default.Table_aa47b2f6d9c446669f0a2ba8447cb83f [id=e57dad6d4c2e4149827ee1829842ae76])
I20260617 20:17:12.523120 31119 tablet_loader.cc:96] loaded metadata for tablet a3205efad2b24178ba761606a25661ff (table default.Table_122065b5c3db4c0eae386133c84b7940 [id=d1350616b5dc41e98e4b1554a10ddafb])
I20260617 20:17:12.524381 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8d29712eee47e497872df101404f26" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:12.525319 29198 leader_election.cc:343] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.526391 29379 tablet_bootstrap.cc:492] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.526573 29379 ts_tablet_manager.cc:1403] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.005s
I20260617 20:17:12.527562 29379 raft_consensus.cc:359] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.527745 29379 raft_consensus.cc:385] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.527832 29379 raft_consensus.cc:740] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.528323 29379 consensus_queue.cc:260] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.529102 29379 ts_tablet_manager.cc:1434] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:12.529985 31313 raft_consensus.cc:2804] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.530102 31313 raft_consensus.cc:493] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.530172 31313 raft_consensus.cc:3060] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.530586 29379 tablet_bootstrap.cc:492] T 6f544f486c144cd89ca7c5b83d252ee9 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.532346 29379 tablet_bootstrap.cc:654] T 6f544f486c144cd89ca7c5b83d252ee9 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.536904 31119 tablet_loader.cc:96] loaded metadata for tablet a3c31f1bba074ba580601b7e8c64ea0b (table default.Table_e6f97190105641898b676e78e1d0dfea [id=bef694b9811f4556a4448465e54defdb])
I20260617 20:17:12.539553 31119 tablet_loader.cc:96] loaded metadata for tablet a3e20a1092b746a8b8ddd4386a682229 (table default.Table_8b3f418465f142c784a9c20784e64477 [id=a3772e01cb314c7e88e85833d727617d])
I20260617 20:17:12.542132 31171 consensus_queue.cc:1048] T fee909c8988d49779612e98f5cd82972 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.542430 31119 tablet_loader.cc:96] loaded metadata for tablet a4d8a0034aa34b7b9e16ff087dacc4f7 (table default.Table_8a75e972290d447da9487d018bf2f205 [id=186b2fd455324d58a32cf586defc04a3])
I20260617 20:17:12.542848 31119 tablet_loader.cc:96] loaded metadata for tablet a522f064b9f944d1802f8b730f208ed0 (table default.Table_213292c85f774f9cadad87077963c82a [id=e2933414bca44da084411334f63ccfb7])
I20260617 20:17:12.547524 31171 raft_consensus.cc:493] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.547652 31171 raft_consensus.cc:515] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.548197 31171 leader_election.cc:290] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.548226 31370 raft_consensus.cc:493] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.548569 31370 raft_consensus.cc:515] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.548779 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a56191018d04a2881ee3e1a243c1a19" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.548961 28981 raft_consensus.cc:2468] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:12.549386 31370 leader_election.cc:290] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.549412 29062 leader_election.cc:304] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:17:12.549680 31171 raft_consensus.cc:2804] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.549749 31171 raft_consensus.cc:493] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.549824 31171 raft_consensus.cc:3060] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.549852 31094 raft_consensus.cc:493] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.550055 31094 raft_consensus.cc:515] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.551046 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a56191018d04a2881ee3e1a243c1a19" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.551241 29257 raft_consensus.cc:2468] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:12.551931 31094 leader_election.cc:290] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.552387 31171 raft_consensus.cc:515] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.552954 31171 leader_election.cc:290] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.553187 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35d84540ee74348a3222c5b928e002f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.553380 31119 tablet_loader.cc:96] loaded metadata for tablet a590289e6b4e495cb551523ccbfd9989 (table default.Table_766764a313d042c290c82395b15fcbfa [id=71a8746b74234cc5998761b1a5f7c85a])
I20260617 20:17:12.553680 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a56191018d04a2881ee3e1a243c1a19" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.553785 31119 tablet_loader.cc:96] loaded metadata for tablet a6372df669ca4fc4818243778d2186f5 (table default.Table_fcd950bebde64e8bafd0dae2ec3f7149 [id=8ca6a6b12902442fbff567cb44a4e03d])
I20260617 20:17:12.553861 28981 raft_consensus.cc:3060] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.554157 31119 tablet_loader.cc:96] loaded metadata for tablet a6522ae212784b7ebd47cc3403aa3477 (table default.Table_332fe4fe72a24b07981c7f0150c254bd [id=a63c4334ac2d4313b19978ee3b4eeff8])
I20260617 20:17:12.554648 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a56191018d04a2881ee3e1a243c1a19" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.554845 29125 raft_consensus.cc:2393] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 6d4ce30e1fce4591b64c398747f8d37a in this term.
I20260617 20:17:12.555074 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35d84540ee74348a3222c5b928e002f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.555174 29120 raft_consensus.cc:3060] T 20d0b861d48e4baf94387f4ff9d9f778 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.555712 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a56191018d04a2881ee3e1a243c1a19" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:12.555902 29257 raft_consensus.cc:3060] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:12.557745 28925 leader_election.cc:343] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.558796 29257 raft_consensus.cc:2468] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:12.560833 31094 raft_consensus.cc:493] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.560988 31094 raft_consensus.cc:515] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.561918 31094 leader_election.cc:290] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.565008 29063 leader_election.cc:304] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:12.565366 31171 raft_consensus.cc:2804] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.565464 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcecdba377334298b883d80a9e192acd" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.565711 29121 raft_consensus.cc:2468] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.566054 31171 raft_consensus.cc:697] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
W20260617 20:17:12.566128 28925 leader_election.cc:343] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.566283 28925 leader_election.cc:304] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.566432 31171 consensus_queue.cc:237] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.566553 31372 raft_consensus.cc:2749] T e35d84540ee74348a3222c5b928e002f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.571750 29198 leader_election.cc:304] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:12.572171 31094 raft_consensus.cc:2804] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.572295 31094 raft_consensus.cc:493] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.572388 31094 raft_consensus.cc:3060] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.572535 31119 tablet_loader.cc:96] loaded metadata for tablet a7b20564ac93482b84672c09e5489cfd (table default.Table_b16811c4e5c6448194a1adf7df3d96a2 [id=cc3218b558cf46c8ad88fb1ec7fa82b5])
I20260617 20:17:12.575774 31094 raft_consensus.cc:515] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.575924 31119 tablet_loader.cc:96] loaded metadata for tablet a7b441fa98b949bcb263524036755b14 (table default.Table_2831ca4ebfea4801b37ec6e9d3c0dca2 [id=beac08fbe27b40de8af16d42634ed76f])
I20260617 20:17:12.578310 31220 raft_consensus.cc:493] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.578492 31220 raft_consensus.cc:515] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.579052 31119 tablet_loader.cc:96] loaded metadata for tablet a9f9d4701a8b469b90dbb2ccacff121a (table default.Table_874c5733c8264dda8206652cd4019646 [id=c98f3dd0bba745a8949f2742d8917003])
I20260617 20:17:12.579377 31220 leader_election.cc:290] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.580773 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcecdba377334298b883d80a9e192acd" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:12.580945 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4598874c14344c58ef0b87508b67211" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.581091 29120 raft_consensus.cc:3060] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.582264 31313 raft_consensus.cc:515] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.583318 31313 leader_election.cc:290] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.584129 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6323292f162b4063b7c413eaecfce791" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:12.584332 29257 raft_consensus.cc:3060] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.584656 28981 raft_consensus.cc:2468] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
W20260617 20:17:12.586858 29198 leader_election.cc:343] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.587260 29257 raft_consensus.cc:2468] T 6323292f162b4063b7c413eaecfce791 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 1.
I20260617 20:17:12.587406 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6323292f162b4063b7c413eaecfce791" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:12.588224 28925 leader_election.cc:304] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:12.590888 31374 raft_consensus.cc:2804] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.591316 31374 raft_consensus.cc:697] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 LEADER]: Becoming Leader. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Running, Role: LEADER
I20260617 20:17:12.591651 31374 consensus_queue.cc:237] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.592126 29120 raft_consensus.cc:2468] T bcecdba377334298b883d80a9e192acd P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
W20260617 20:17:12.599160 29527 consensus_peers.cc:597] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5 -> Peer 590225c8ea36448093b77385d238a34a (127.27.245.254:37301): Couldn't send request to peer 590225c8ea36448093b77385d238a34a. Status: Network error: Client connection negotiation failed: client connection to 127.27.245.254:37301: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260617 20:17:12.600973 29379 tablet_bootstrap.cc:492] T 6f544f486c144cd89ca7c5b83d252ee9 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.601181 29379 ts_tablet_manager.cc:1403] T 6f544f486c144cd89ca7c5b83d252ee9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.003s
I20260617 20:17:12.601583 31119 tablet_loader.cc:96] loaded metadata for tablet ab6e06eb2e7644168fa2d99a1890f6b6 (table default.Table_66545ee179e84436aea66f777fb80da9 [id=3f31b8564b28492c88c42f1534943265])
I20260617 20:17:12.602034 29379 raft_consensus.cc:359] T 6f544f486c144cd89ca7c5b83d252ee9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.602209 31119 tablet_loader.cc:96] loaded metadata for tablet ac29f4bbb2e2426da906ef60a950ccc3 (table default.Table_9a706992e1f74b07b585f66b6491d7e3 [id=763ed9048a1747ca897515ce507ae459])
I20260617 20:17:12.602259 29379 raft_consensus.cc:385] T 6f544f486c144cd89ca7c5b83d252ee9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.602358 29379 raft_consensus.cc:740] T 6f544f486c144cd89ca7c5b83d252ee9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.602643 31119 tablet_loader.cc:96] loaded metadata for tablet ac3aad616b92480d877b463e0de56b72 (table default.Table_1404d8949a194779a7fe937bc4857a4a [id=5c83a4e7711c4b928e15a365aa351fbe])
I20260617 20:17:12.603042 31119 tablet_loader.cc:96] loaded metadata for tablet ac3e2e37819a4e509f2001846121e3bc (table default.Table_f72a129643494deabc2a8c6f86129b46 [id=542d2522b8a44eae883475e3cdbeba0a])
I20260617 20:17:12.603685 29379 consensus_queue.cc:260] T 6f544f486c144cd89ca7c5b83d252ee9 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.604203 31119 tablet_loader.cc:96] loaded metadata for tablet ae8574874a194473bb5891e604a25ce8 (table default.Table_762c733e4f8445ad97f36fc9ee70147a [id=f62d71842e284523bbca857af62a367a])
I20260617 20:17:12.604696 29379 ts_tablet_manager.cc:1434] T 6f544f486c144cd89ca7c5b83d252ee9 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:12.608536 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8d29712eee47e497872df101404f26" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.608713 28981 raft_consensus.cc:3060] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.608750 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a56191018d04a2881ee3e1a243c1a19" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.608975 28988 raft_consensus.cc:2393] T 8a56191018d04a2881ee3e1a243c1a19 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 6d4ce30e1fce4591b64c398747f8d37a in this term.
I20260617 20:17:12.610256 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcecdba377334298b883d80a9e192acd" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.610417 28988 raft_consensus.cc:2468] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.611253 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcecdba377334298b883d80a9e192acd" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.611398 28988 raft_consensus.cc:3060] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.611543 28981 raft_consensus.cc:2468] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.614403 28988 raft_consensus.cc:2468] T bcecdba377334298b883d80a9e192acd P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.615000 29379 tablet_bootstrap.cc:492] T 6323292f162b4063b7c413eaecfce791 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.616878 29379 tablet_bootstrap.cc:654] T 6323292f162b4063b7c413eaecfce791 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.619768 31171 raft_consensus.cc:493] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.619956 31171 raft_consensus.cc:515] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.620905 31171 leader_election.cc:290] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.621158 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54969e138cf745739b54203c11e4c94e" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.623651 31119 tablet_loader.cc:96] loaded metadata for tablet aeb3bfc1983e406dbf48407a58aa3a43 (table default.Table_f43bb549bf7345e1ad723086a9536f11 [id=f94ce78782ee4bb1955c515b945a4279])
I20260617 20:17:12.624660 31119 tablet_loader.cc:96] loaded metadata for tablet aefd00baa1784c7887104b0650556ff6 (table default.Table_a9feae94e42c4ffc87ff57c32a580c64 [id=749a20b2889949018a13034961c884ed])
I20260617 20:17:12.640894 31119 tablet_loader.cc:96] loaded metadata for tablet af7d6e3fbaa141b9ab2970d1ae02d989 (table default.Table_0abef9ea18ea4a1ab736d589813de366 [id=80b783d8ec91433c904e27e8f78b6bd6])
I20260617 20:17:12.640929 29198 leader_election.cc:304] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:12.641963 31220 raft_consensus.cc:493] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.642136 31220 raft_consensus.cc:515] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.643054 31220 leader_election.cc:290] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:12.643208 29379 tablet_bootstrap.cc:492] T 6323292f162b4063b7c413eaecfce791 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.643216 31220 raft_consensus.cc:2804] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.643450 29379 ts_tablet_manager.cc:1403] T 6323292f162b4063b7c413eaecfce791 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.029s user 0.004s sys 0.000s
I20260617 20:17:12.644393 29379 raft_consensus.cc:359] T 6323292f162b4063b7c413eaecfce791 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:12.644595 28925 leader_election.cc:343] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.645813 31249 raft_consensus.cc:493] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.646076 31249 raft_consensus.cc:515] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.646829 31249 leader_election.cc:290] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.647603 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b2d190dda24f0e800b6f75bc165a57" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.648860 31119 tablet_loader.cc:96] loaded metadata for tablet af84dd50832149e4ab7a6532e3ae2aad (table default.Table_7b002b69063948828e757ca68368920c [id=9467d8b934c542718392056fc09c83ec])
I20260617 20:17:12.649327 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54969e138cf745739b54203c11e4c94e" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:12.650148 28925 leader_election.cc:343] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.650420 31220 raft_consensus.cc:697] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.650755 31220 consensus_queue.cc:237] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.654182 31009 raft_consensus.cc:493] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:12.654332 31009 raft_consensus.cc:515] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.654963 31009 leader_election.cc:290] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.655409 31119 tablet_loader.cc:96] loaded metadata for tablet afbdb8d7562742e6903465afa71efa25 (table default.Table_d4ddf99bf0e44da4bd61741ec0ac2065 [id=cfcf57f5da064087ba790a7f348b4778])
W20260617 20:17:12.656044 29062 leader_election.cc:343] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 5eaddd6519dc490c8358be629b21a2d9
I20260617 20:17:12.656744 31119 tablet_loader.cc:96] loaded metadata for tablet b162a0ef91d1447b838331ba6ef93bf4 (table default.Table_47860f92f62f4376b2396e6936d2969a [id=fa80809528dd419192774bcc7ac5f5bf])
I20260617 20:17:12.658623 31119 tablet_loader.cc:96] loaded metadata for tablet b1b743909bed449f9cacba14d2d93ab8 (table default.Table_ac58b4b8071a43ea8e6c8839689b83dd [id=9a98514409064f4bbfd6c2d962b0d03c])
I20260617 20:17:12.660806 31119 tablet_loader.cc:96] loaded metadata for tablet b333d38847aa462e98640a49d46c8cb4 (table default.Table_ecf2ff52cdbb4225b5543050fe111b98 [id=0a2de017443647cfb80f0d4906471adb])
I20260617 20:17:12.671267 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9655a1164fa84f53bdb9fd31b2fcda78" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.671500 28983 raft_consensus.cc:2468] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.674027 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4598874c14344c58ef0b87508b67211" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.674263 28985 raft_consensus.cc:2468] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.675736 31119 tablet_loader.cc:96] loaded metadata for tablet b3631e93c8684f02a2dd28a51080d006 (table default.Table_2c2192003f3b4117a9804a627934942c [id=89f26a2cd90440a4948ae3718ee5cf3b])
I20260617 20:17:12.678388 29197 leader_election.cc:304] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.679181 31221 raft_consensus.cc:2749] T 8a56191018d04a2881ee3e1a243c1a19 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.679360 31221 consensus_queue.cc:1048] T 9574c6f0765b4329af28d72c8e94240a P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.683826 29063 leader_election.cc:304] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.684253 31287 raft_consensus.cc:2749] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.685205 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b2d190dda24f0e800b6f75bc165a57" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.685377 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9655a1164fa84f53bdb9fd31b2fcda78" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.686003 29198 leader_election.cc:343] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:12.686314 29063 leader_election.cc:343] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 5eaddd6519dc490c8358be629b21a2d9
I20260617 20:17:12.686429 29063 leader_election.cc:304] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.686650 31287 raft_consensus.cc:2749] T 5eaddd6519dc490c8358be629b21a2d9 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260617 20:17:12.687644 28925 leader_election.cc:343] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.687781 28925 leader_election.cc:304] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.577188 31094 leader_election.cc:290] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.696130 29378 ts_tablet_manager.cc:1434] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.198s user 0.012s sys 0.072s
I20260617 20:17:12.696522 29378 tablet_bootstrap.cc:492] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.696807 29197 leader_election.cc:304] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.697039 31221 raft_consensus.cc:2804] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.697150 31221 raft_consensus.cc:697] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.697402 31221 consensus_queue.cc:237] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.698575 29378 tablet_bootstrap.cc:654] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.702966 29379 raft_consensus.cc:385] T 6323292f162b4063b7c413eaecfce791 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.707406 29378 tablet_bootstrap.cc:492] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.707916 29378 ts_tablet_manager.cc:1403] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260617 20:17:12.709344 29379 raft_consensus.cc:740] T 6323292f162b4063b7c413eaecfce791 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.709627 29379 consensus_queue.cc:260] T 6323292f162b4063b7c413eaecfce791 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.710554 31313 raft_consensus.cc:493] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.710745 31313 raft_consensus.cc:515] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:12.711562 31313 leader_election.cc:290] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.712370 31249 raft_consensus.cc:2749] T c4b2d190dda24f0e800b6f75bc165a57 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.713150 29378 raft_consensus.cc:359] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.713398 29378 raft_consensus.cc:385] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.713510 29378 raft_consensus.cc:740] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.713847 29378 consensus_queue.cc:260] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.714171 29379 ts_tablet_manager.cc:1434] T 6323292f162b4063b7c413eaecfce791 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.071s user 0.022s sys 0.000s
I20260617 20:17:12.714572 29378 ts_tablet_manager.cc:1434] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20260617 20:17:12.714888 29379 tablet_bootstrap.cc:492] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.716856 29378 tablet_bootstrap.cc:492] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.716861 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37214b955d63478088b9f723bcbc588a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.717549 28925 leader_election.cc:343] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.718015 29379 tablet_bootstrap.cc:654] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.721117 29378 tablet_bootstrap.cc:654] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.724818 29379 tablet_bootstrap.cc:492] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.725031 29379 ts_tablet_manager.cc:1403] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260617 20:17:12.725440 31287 raft_consensus.cc:493] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.725620 31287 raft_consensus.cc:515] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.725736 29379 raft_consensus.cc:359] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.725934 29379 raft_consensus.cc:385] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.726016 29379 raft_consensus.cc:740] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.726240 29379 consensus_queue.cc:260] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.726845 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a89e42d091f423bb926f671797141ea" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.727095 28985 raft_consensus.cc:2393] T 7a89e42d091f423bb926f671797141ea P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:12.726660 31287 leader_election.cc:290] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.731487 29379 ts_tablet_manager.cc:1434] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260617 20:17:12.731807 29379 tablet_bootstrap.cc:492] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.733210 29379 tablet_bootstrap.cc:654] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.737651 29383 tablet_bootstrap.cc:492] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.737785 29383 ts_tablet_manager.cc:1403] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.283s user 0.029s sys 0.073s
I20260617 20:17:12.738494 29383 raft_consensus.cc:359] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.738682 29383 raft_consensus.cc:385] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.738729 29383 raft_consensus.cc:740] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.738875 29383 consensus_queue.cc:260] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.739208 29383 ts_tablet_manager.cc:1434] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260617 20:17:12.739462 29383 tablet_bootstrap.cc:492] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.740614 31119 tablet_loader.cc:96] loaded metadata for tablet b5241ab75a034ee3b57c07185835a858 (table default.Table_fb7dcd897fa349bb9ea70a359a51453c [id=83f9dade4df942c1b12e41fa46385fe0])
I20260617 20:17:12.740716 31094 raft_consensus.cc:493] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.740818 31094 raft_consensus.cc:515] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.741357 31094 leader_election.cc:290] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.742002 29383 tablet_bootstrap.cc:654] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.742434 31009 raft_consensus.cc:493] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.742560 31009 raft_consensus.cc:515] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.743062 31009 leader_election.cc:290] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:12.743824 29062 leader_election.cc:343] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 75c59cf5f5e8486baf1e038a44657f33
I20260617 20:17:12.746666 31009 raft_consensus.cc:493] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.746786 31009 raft_consensus.cc:515] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.747325 31009 leader_election.cc:290] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.747874 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d79b7023ae478698a06562b2e4c578" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.748126 28985 raft_consensus.cc:2393] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:12.752419 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3091c332a14c4c99bd28e401769e30" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.752429 29197 leader_election.cc:304] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.752696 31259 raft_consensus.cc:2804] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.752771 31259 raft_consensus.cc:493] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.752854 31259 raft_consensus.cc:3060] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:12.753417 29198 leader_election.cc:343] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.755577 31259 raft_consensus.cc:515] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.756182 31259 leader_election.cc:290] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:12.758387 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9655a1164fa84f53bdb9fd31b2fcda78" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:12.759402 29198 leader_election.cc:343] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.759639 29197 leader_election.cc:304] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.760192 31259 raft_consensus.cc:2804] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.760313 31259 raft_consensus.cc:493] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.760417 31259 raft_consensus.cc:3060] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.763232 31259 raft_consensus.cc:515] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.763890 31259 leader_election.cc:290] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.764489 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4598874c14344c58ef0b87508b67211" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:12.765062 29198 leader_election.cc:343] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.766362 31009 raft_consensus.cc:493] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.766516 31009 raft_consensus.cc:515] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.767149 31009 leader_election.cc:290] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:12.768319 29062 leader_election.cc:343] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: da50400f49e24ca589519e6ec823957d
I20260617 20:17:12.768898 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3091c332a14c4c99bd28e401769e30" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.769107 28983 raft_consensus.cc:2468] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.780265 31221 raft_consensus.cc:493] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.780483 31221 raft_consensus.cc:515] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.781081 31221 leader_election.cc:290] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.781656 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eedf2442f964048b7a3a460b6b22f2a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.782210 29198 leader_election.cc:343] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.782385 31119 tablet_loader.cc:96] loaded metadata for tablet b62b22ff17964ee6934023fb85e0b7ec (table default.Table_a5cd3098d5b249b9a132cf32515128ed [id=c0d29667017e4717bc645aed9382a886])
I20260617 20:17:12.782843 31119 tablet_loader.cc:96] loaded metadata for tablet b6b783ff58d643fda6ba016173200063 (table default.Table_c816a44858d34b368a1e701cdbebd429 [id=d4618abed4d0489187b4d138ed28867a])
I20260617 20:17:12.783089 29383 tablet_bootstrap.cc:492] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.783377 29383 ts_tablet_manager.cc:1403] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.002s
I20260617 20:17:12.784608 29383 raft_consensus.cc:359] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.785125 29383 raft_consensus.cc:385] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.785346 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37214b955d63478088b9f723bcbc588a" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.786074 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d79b7023ae478698a06562b2e4c578" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.786608 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a89e42d091f423bb926f671797141ea" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.785281 29383 raft_consensus.cc:740] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.787515 29383 consensus_queue.cc:260] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.788740 29383 ts_tablet_manager.cc:1434] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260617 20:17:12.788960 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4598874c14344c58ef0b87508b67211" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.789125 28983 raft_consensus.cc:3060] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.790053 29383 tablet_bootstrap.cc:492] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.791888 28983 raft_consensus.cc:2468] T c4598874c14344c58ef0b87508b67211 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.792011 31119 tablet_loader.cc:96] loaded metadata for tablet b6ba8b7d18af44b58800e588279e2e0b (table default.Table_daa321ef525b447390f30edf50f160bc [id=489b6871a12b4a68b7f600556cfc5b8e])
I20260617 20:17:12.792588 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9655a1164fa84f53bdb9fd31b2fcda78" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.792801 28985 raft_consensus.cc:3060] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.795717 28985 raft_consensus.cc:2468] T 9655a1164fa84f53bdb9fd31b2fcda78 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.797137 29383 tablet_bootstrap.cc:654] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.798185 29378 tablet_bootstrap.cc:492] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.798357 29378 ts_tablet_manager.cc:1403] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.082s user 0.009s sys 0.013s
I20260617 20:17:12.799242 31119 tablet_loader.cc:96] loaded metadata for tablet b6bc2304de37441bb78cd12cab5ca3c3 (table default.Table_f2c4f9d463814ae2883f800f27c5d14d [id=2e23848d3d274b3b950f282dc2e7b767])
I20260617 20:17:12.799381 29378 raft_consensus.cc:359] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.799557 29378 raft_consensus.cc:385] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.799623 29378 raft_consensus.cc:740] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.799899 29378 consensus_queue.cc:260] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.800693 29378 ts_tablet_manager.cc:1434] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:12.801203 29378 tablet_bootstrap.cc:492] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.802450 31119 tablet_loader.cc:96] loaded metadata for tablet b72d894a445d4f12aa228607181ed1e8 (table default.Table_99df9464c22045a1ac1834514adf1ade [id=5cc4725ffa5544ba8675f6734818f8d6])
I20260617 20:17:12.802489 29379 tablet_bootstrap.cc:492] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.802613 29379 ts_tablet_manager.cc:1403] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.071s user 0.009s sys 0.011s
I20260617 20:17:12.803854 29378 tablet_bootstrap.cc:654] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.804538 29379 raft_consensus.cc:359] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.804759 29379 raft_consensus.cc:385] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.805604 29379 raft_consensus.cc:740] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.805889 29379 consensus_queue.cc:260] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.805984 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da50400f49e24ca589519e6ec823957d" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.806269 29255 raft_consensus.cc:2393] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:12.806375 29379 ts_tablet_manager.cc:1434] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:12.806667 29379 tablet_bootstrap.cc:492] T d00c2be45d82425bb70ae577fa3155fa P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.808072 29379 tablet_bootstrap.cc:654] T d00c2be45d82425bb70ae577fa3155fa P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.808074 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eedf2442f964048b7a3a460b6b22f2a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.808297 28985 raft_consensus.cc:2468] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:17:12.810062 29063 leader_election.cc:343] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 75c59cf5f5e8486baf1e038a44657f33
I20260617 20:17:12.810173 29063 leader_election.cc:304] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.810551 31009 raft_consensus.cc:2749] T 75c59cf5f5e8486baf1e038a44657f33 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.815091 31119 tablet_loader.cc:96] loaded metadata for tablet b9008e7ea8f54896b5d4e51a2512f85b (table default.Table_ef916ebf00b449979408f9dab4fb264e [id=3b1ee3a0a7f54dfd921749144e963305])
I20260617 20:17:12.815562 31119 tablet_loader.cc:96] loaded metadata for tablet b93bbcd1a2ae42409dbc9158aab0a9eb (table default.Table_e610c8b1186543a1ba5ab1899c8b672a [id=449b06b7f15e49dda75c4027f7f8e833])
I20260617 20:17:12.816195 31119 tablet_loader.cc:96] loaded metadata for tablet ba3ad8de250a47da9c9a31dff7f495b5 (table default.Table_dbb696fb66174d14a4bc214d64519784 [id=167e32829ea04e9ab2dbc2c0dcb63b2f])
I20260617 20:17:12.816591 31119 tablet_loader.cc:96] loaded metadata for tablet bb0a3e7952fe421596baf563a3891292 (table default.Table_35fc3c1b8a6c461087e80918d278d106 [id=2822a1c1a34341019a5380cec3062f69])
I20260617 20:17:12.817217 31119 tablet_loader.cc:96] loaded metadata for tablet bb6a2adbc5fb4c1e915dee1b524f3aa5 (table default.Table_a2980fa5162245c081e94675f6a1fd9e [id=8d19f88dfaeb45c088856dfb46408809])
I20260617 20:17:12.817334 29063 leader_election.cc:304] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.817737 31009 raft_consensus.cc:3060] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.820608 31009 raft_consensus.cc:2749] T 7a89e42d091f423bb926f671797141ea P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.821049 29063 leader_election.cc:304] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.821416 31009 raft_consensus.cc:3060] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.823796 31009 raft_consensus.cc:2749] T 89d79b7023ae478698a06562b2e4c578 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:12.824239 28925 leader_election.cc:343] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.824366 28925 leader_election.cc:304] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.824736 31374 raft_consensus.cc:2749] T 37214b955d63478088b9f723bcbc588a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.825824 29063 leader_election.cc:304] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.826226 31009 raft_consensus.cc:3060] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.829021 31009 raft_consensus.cc:2749] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.831127 29197 leader_election.cc:304] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.833951 31220 raft_consensus.cc:2804] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.834075 31220 raft_consensus.cc:493] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.834188 31220 raft_consensus.cc:3060] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.837131 31220 raft_consensus.cc:515] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.838917 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3091c332a14c4c99bd28e401769e30" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:12.839604 29198 leader_election.cc:343] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.839819 31220 leader_election.cc:290] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.846267 31119 tablet_loader.cc:96] loaded metadata for tablet bc48e61d2d3d4bca8051eafaa49c6534 (table default.Table_5ace1745da5345cfa1f9f0c9585cb25b [id=0c5b63bc129d49cbb0994843cc2ef6c9])
I20260617 20:17:12.846863 31119 tablet_loader.cc:96] loaded metadata for tablet bcecdba377334298b883d80a9e192acd (table default.Table_5818420ded12484fb2b9e6dea664ff12 [id=e0f22822bb2d4cf2bafa8e5c49de8f45])
I20260617 20:17:12.847376 31119 tablet_loader.cc:96] loaded metadata for tablet bcface890a254023b283e28a1770f3f1 (table default.Table_89dd72be1c17431fb9eca41b33a12fc7 [id=77f8609e9cfc4c9ca0ba955bbb7b088b])
I20260617 20:17:12.847832 31119 tablet_loader.cc:96] loaded metadata for tablet bd7d5f6b8bce44fa8e4065613989bda7 (table default.Table_9620456571e44a95930dec879ff4ad69 [id=5cdd5fb7c9d044b580f8670847d3c60e])
I20260617 20:17:12.848341 31119 tablet_loader.cc:96] loaded metadata for tablet be96f417f6614e569555f37c2838369d (table default.Table_dff75187402b408b81d75a7c7619d2d5 [id=fce0f344d79e48c791907e51536847d6])
I20260617 20:17:12.848809 31119 tablet_loader.cc:96] loaded metadata for tablet bfac7fefb3e54f18896703d01c0c7ee4 (table default.Table_87e22bfc578e47a49cb67beea659b86e [id=2844b3e6636d4e77bce1461fb477b36d])
I20260617 20:17:12.851739 31221 consensus_queue.cc:1048] T d00c2be45d82425bb70ae577fa3155fa P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.852612 29197 leader_election.cc:304] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.853574 31388 raft_consensus.cc:2804] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.857852 31388 raft_consensus.cc:697] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.858323 31388 consensus_queue.cc:237] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.862418 29378 tablet_bootstrap.cc:492] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.862605 29378 ts_tablet_manager.cc:1403] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.062s user 0.010s sys 0.010s
I20260617 20:17:12.863008 31374 raft_consensus.cc:493] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.863152 31374 raft_consensus.cc:515] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.863463 29378 raft_consensus.cc:359] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.863601 29378 raft_consensus.cc:385] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.863652 29378 raft_consensus.cc:740] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.863931 31374 leader_election.cc:290] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.863867 29378 consensus_queue.cc:260] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.864209 31119 tablet_loader.cc:96] loaded metadata for tablet c09634384b5747659c34d25a489f6279 (table default.Table_8d0debb3585c4a1f80594e8f6e5600dd [id=10265d7c2b0a467c8d5a3aded9e23521])
I20260617 20:17:12.864821 29378 ts_tablet_manager.cc:1434] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:12.864879 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663dbe73689d4849a85b68a79ea4062c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.865253 29378 tablet_bootstrap.cc:492] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:17:12.865495 28925 leader_election.cc:343] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.865684 31119 tablet_loader.cc:96] loaded metadata for tablet c1562c10a72f4bb2b8f88d79fb75f6ff (table default.Table_5970f728d64e408e83358eb27947ecc7 [id=673bf1a902ce4f54938b68a4c5cd01a3])
I20260617 20:17:12.867157 29378 tablet_bootstrap.cc:654] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.867551 29197 leader_election.cc:304] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.867650 29379 tablet_bootstrap.cc:492] T d00c2be45d82425bb70ae577fa3155fa P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.867794 29379 ts_tablet_manager.cc:1403] T d00c2be45d82425bb70ae577fa3155fa P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.011s
I20260617 20:17:12.867966 31220 raft_consensus.cc:2804] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.868105 31220 raft_consensus.cc:697] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.868345 31220 consensus_queue.cc:237] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.868798 29379 raft_consensus.cc:359] T d00c2be45d82425bb70ae577fa3155fa P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.868953 29379 raft_consensus.cc:385] T d00c2be45d82425bb70ae577fa3155fa P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.869002 29379 raft_consensus.cc:740] T d00c2be45d82425bb70ae577fa3155fa P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.869182 29379 consensus_queue.cc:260] T d00c2be45d82425bb70ae577fa3155fa P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.871013 29379 ts_tablet_manager.cc:1434] T d00c2be45d82425bb70ae577fa3155fa P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:12.871603 29197 leader_election.cc:304] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.873814 29379 tablet_bootstrap.cc:492] T d811ca370ee54db8a7e4f6056017cd01 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.875654 29379 tablet_bootstrap.cc:654] T d811ca370ee54db8a7e4f6056017cd01 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.889796 31119 tablet_loader.cc:96] loaded metadata for tablet c2c7e5b1a28e4ce1943df3cab1f3ee97 (table default.Table_a17cfbbd20be4ffe99351c3b1ac11457 [id=39cd55a8cab4400db925a6c2d7e7da82])
I20260617 20:17:12.895951 31221 raft_consensus.cc:2804] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.896118 31221 raft_consensus.cc:493] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.896152 31119 tablet_loader.cc:96] loaded metadata for tablet c41c83bb87a54c9487b64bbc345eb340 (table default.Table_143cff941bb14515ba8932f1263aedce [id=622a20953f3e4e9ab9469343794042c7])
I20260617 20:17:12.896225 31221 raft_consensus.cc:3060] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.896298 29379 tablet_bootstrap.cc:492] T d811ca370ee54db8a7e4f6056017cd01 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.896476 29379 ts_tablet_manager.cc:1403] T d811ca370ee54db8a7e4f6056017cd01 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20260617 20:17:12.897189 29379 raft_consensus.cc:359] T d811ca370ee54db8a7e4f6056017cd01 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.897416 29379 raft_consensus.cc:385] T d811ca370ee54db8a7e4f6056017cd01 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.897495 29379 raft_consensus.cc:740] T d811ca370ee54db8a7e4f6056017cd01 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.897684 29379 consensus_queue.cc:260] T d811ca370ee54db8a7e4f6056017cd01 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.898144 29379 ts_tablet_manager.cc:1434] T d811ca370ee54db8a7e4f6056017cd01 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:12.898398 29379 tablet_bootstrap.cc:492] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:12.899024 31221 raft_consensus.cc:515] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.899973 29379 tablet_bootstrap.cc:654] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.901000 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eedf2442f964048b7a3a460b6b22f2a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:12.901665 29198 leader_election.cc:343] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.901887 31119 tablet_loader.cc:96] loaded metadata for tablet c4598874c14344c58ef0b87508b67211 (table default.Table_6f8a81734a6345ebb32b7ac32365e739 [id=259e4a64dcfe44db8b28b012ed5b400f])
I20260617 20:17:12.902597 31119 tablet_loader.cc:96] loaded metadata for tablet c59a8c127d5b446a90b57a7677c37c08 (table default.Table_62c85e3d42be4e9ca7183846e7d67145 [id=7563af483989440d91cf7f444a68d2ba])
I20260617 20:17:12.902699 31221 leader_election.cc:290] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.903314 31119 tablet_loader.cc:96] loaded metadata for tablet c73bdcc1cefd48f3b99e0c059c3a7467 (table default.Table_3481e499412e4b75ba8ad01b04b448a4 [id=3d369e1099c944688151bb38c8da0855])
I20260617 20:17:12.905706 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663dbe73689d4849a85b68a79ea4062c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:12.907208 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3091c332a14c4c99bd28e401769e30" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.907397 28985 raft_consensus.cc:3060] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.910115 28985 raft_consensus.cc:2468] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.911177 29121 raft_consensus.cc:3060] T 40845d7a668045ec9a40cb6d1d76137d P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.914366 31220 consensus_queue.cc:1048] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.922952 31119 tablet_loader.cc:96] loaded metadata for tablet cbd8b00391f046b694000c9dc8a8de5d (table default.Table_657118477519461f9cc86b131622bc53 [id=9823363011cb4dd18410323e0f58b7b0])
I20260617 20:17:12.924631 31119 tablet_loader.cc:96] loaded metadata for tablet cc8d29712eee47e497872df101404f26 (table default.Table_6ff346c8167a49878fc3900007fa2904 [id=a3145e0f371647c98fb79739624d5258])
I20260617 20:17:12.925503 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eedf2442f964048b7a3a460b6b22f2a" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:12.925669 28983 raft_consensus.cc:3060] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.926996 29379 tablet_bootstrap.cc:492] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:12.927120 29379 ts_tablet_manager.cc:1403] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.006s
I20260617 20:17:12.927718 29379 raft_consensus.cc:359] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.927863 29379 raft_consensus.cc:385] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.927907 29379 raft_consensus.cc:740] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.928119 29379 consensus_queue.cc:260] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.928632 28983 raft_consensus.cc:2468] T 5eedf2442f964048b7a3a460b6b22f2a P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:12.929193 29379 ts_tablet_manager.cc:1434] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:12.929872 29379 tablet_bootstrap.cc:492] T 9574c6f0765b4329af28d72c8e94240a P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
W20260617 20:17:12.930629 28925 leader_election.cc:343] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.930763 28925 leader_election.cc:304] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:12.931123 31374 raft_consensus.cc:2749] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:12.931713 31388 raft_consensus.cc:493] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.931993 31388 raft_consensus.cc:515] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.933127 31388 leader_election.cc:290] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.934420 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19d34e3bbe3453ca6de6ed7e62f7af4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:12.934612 29117 raft_consensus.cc:2468] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.935084 29198 leader_election.cc:304] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:12.935555 31259 raft_consensus.cc:2804] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.936745 31119 tablet_loader.cc:96] loaded metadata for tablet cd67273fdfcb49dc82dd401f63e92663 (table default.Table_18e868cdbb12445fb4ae545f0bb0fe4a [id=ab13b375103549b4b6a7d6f05f1d23f1])
I20260617 20:17:12.938227 31390 consensus_queue.cc:1048] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.938308 31119 tablet_loader.cc:96] loaded metadata for tablet d00c2be45d82425bb70ae577fa3155fa (table default.Table_977eca2b43be413ea87a6f080ea27de0 [id=805224e5ece140629e8db5fc81aac186])
I20260617 20:17:12.938822 31119 tablet_loader.cc:96] loaded metadata for tablet d076991ad9fb4498a11fd22fa8339889 (table default.Table_60d477681d1a4083b05f1e0d08fcfdd8 [id=7eab30028e33494792adc5d948da0727])
I20260617 20:17:12.939241 31119 tablet_loader.cc:96] loaded metadata for tablet d08a9b89bc4e4f66ab533a280a2499da (table default.Table_66d9873c0541455b9003127d8cd07f3d [id=d31cb66a2e974a00a957dd5e0ad579cf])
I20260617 20:17:12.939330 31390 raft_consensus.cc:493] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.939428 31390 raft_consensus.cc:515] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.939617 31119 tablet_loader.cc:96] loaded metadata for tablet d123638c3d384630b367ac3fd209caba (table default.Table_6997907f38d14a7aa42f81aae35fae5c [id=af163181d9af4bfbb34871d76855800a])
I20260617 20:17:12.939884 31390 leader_election.cc:290] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:12.940414 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52873eade4048af81a8e51233b9d079" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:12.940976 29198 leader_election.cc:343] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.941690 29383 tablet_bootstrap.cc:492] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:12.941841 29383 ts_tablet_manager.cc:1403] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.152s user 0.014s sys 0.020s
I20260617 20:17:12.942840 29383 raft_consensus.cc:359] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.943017 29383 raft_consensus.cc:385] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.943099 29383 raft_consensus.cc:740] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.943351 29383 consensus_queue.cc:260] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.944536 29383 ts_tablet_manager.cc:1434] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:12.945277 29383 tablet_bootstrap.cc:492] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:12.949148 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19d34e3bbe3453ca6de6ed7e62f7af4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.949394 28983 raft_consensus.cc:2468] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.950176 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52873eade4048af81a8e51233b9d079" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.950372 28983 raft_consensus.cc:2468] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:12.951977 29197 leader_election.cc:304] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.952036 31009 consensus_queue.cc:1048] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.952556 31388 consensus_queue.cc:1048] T 40845d7a668045ec9a40cb6d1d76137d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.953045 29378 tablet_bootstrap.cc:492] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.953192 29378 ts_tablet_manager.cc:1403] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.088s user 0.011s sys 0.023s
I20260617 20:17:12.953943 29378 raft_consensus.cc:359] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.954115 31388 raft_consensus.cc:2804] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.954137 29378 raft_consensus.cc:385] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.954229 29378 raft_consensus.cc:740] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.954313 31388 raft_consensus.cc:697] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.954479 29378 consensus_queue.cc:260] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.955900 29197 leader_election.cc:304] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.956075 29378 ts_tablet_manager.cc:1434] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:17:12.956137 30852 raft_consensus.cc:2804] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:12.956270 30852 raft_consensus.cc:697] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:12.956349 29378 tablet_bootstrap.cc:492] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.957657 29197 leader_election.cc:304] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:12.957904 31390 raft_consensus.cc:2804] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:12.958001 31390 raft_consensus.cc:493] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:12.958103 31390 raft_consensus.cc:3060] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:12.958503 29378 tablet_bootstrap.cc:654] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.958508 31119 tablet_loader.cc:96] loaded metadata for tablet d1a012fac7714688b6a137f9bf53d983 (table default.Table_873f0c1e037f45099135433d2b96f732 [id=1ef49ac225d4413eb812605395bafda5])
I20260617 20:17:12.958863 31119 tablet_loader.cc:96] loaded metadata for tablet d1c345b2f54848b4a16966bef53c8863 (table default.Table_1ba25cf94e2c4be8a766c5e248de7a85 [id=4fa575ccc91743c09374480aea4e5e34])
I20260617 20:17:12.959225 31220 consensus_queue.cc:1048] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:12.966136 31119 tablet_loader.cc:96] loaded metadata for tablet d2089215acdf478ca725c9d26b94d692 (table default.Table_2b5031b4d42c4d51b39279536a2c19d9 [id=395d6bc9360549c69d616b8ccf8d01cd])
I20260617 20:17:12.967005 29378 tablet_bootstrap.cc:492] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:12.967195 29378 ts_tablet_manager.cc:1403] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.008s
I20260617 20:17:12.968075 29378 raft_consensus.cc:359] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.968264 29378 raft_consensus.cc:385] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:12.968338 29378 raft_consensus.cc:740] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:12.968591 29378 consensus_queue.cc:260] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.969420 29378 ts_tablet_manager.cc:1434] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:12.970346 31119 tablet_loader.cc:96] loaded metadata for tablet d2d7a2a556e24e02a3f74d56c9bed78e (table default.Table_f47ba95e589c47759a3ca685e8e9a067 [id=b41299e9f3a84c2e91c6a082d8bba55d])
I20260617 20:17:12.971176 31119 tablet_loader.cc:96] loaded metadata for tablet d4130f3529ef4adaa4cedf12e53b6895 (table default.Table_fe8f1bae47eb40e8b88f9832e8b127b3 [id=d037cdc970c044ec92ca7b0b46be209f])
I20260617 20:17:12.972188 31009 raft_consensus.cc:493] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.972348 31009 raft_consensus.cc:515] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.972590 29378 tablet_bootstrap.cc:492] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:12.972982 31009 leader_election.cc:290] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.973271 29379 tablet_bootstrap.cc:654] T 9574c6f0765b4329af28d72c8e94240a P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.973575 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a176d1f3b0446984af141e02bac329" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.973793 28978 raft_consensus.cc:2393] T 29a176d1f3b0446984af141e02bac329 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:12.979012 31009 raft_consensus.cc:493] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.979212 31009 raft_consensus.cc:515] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.980130 31009 leader_election.cc:290] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:12.982205 29378 tablet_bootstrap.cc:654] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.985734 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b278ba32316c42d1b101e9803657af99" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:12.986007 28985 raft_consensus.cc:2393] T b278ba32316c42d1b101e9803657af99 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate 5ca3d93189744132bbf55ac01f3a8254 in this term.
I20260617 20:17:12.988651 31119 tablet_loader.cc:96] loaded metadata for tablet d4e0cb39b07d4549afe362b9e4fa97c5 (table default.Table_02d45e2cbb6a42f893c6227bbaa2a9f4 [id=cdb2e24324f546e5b21edbf9e6214aed])
I20260617 20:17:12.989071 31119 tablet_loader.cc:96] loaded metadata for tablet d550602ded3547999e868537e76f6616 (table default.Table_0bc4f3c08e5b47659b13d6eca2ae81e9 [id=173e3b23db204721a1f091565549c7a9])
I20260617 20:17:12.989964 31119 tablet_loader.cc:96] loaded metadata for tablet d673bc9892c94725b270ef3b9dc768f4 (table default.Table_94b332516c584687b839358618c3a83f [id=4c35d4143aa84654a48adab9624a7330])
I20260617 20:17:12.990370 31119 tablet_loader.cc:96] loaded metadata for tablet d6c0e56493b948dfb531ef123d9e13fc (table default.Table_4290f341cd6741dd921290be5d1e3032 [id=84e2e8a1c775449282853c7e5a85b1e6])
I20260617 20:17:12.991425 31119 tablet_loader.cc:96] loaded metadata for tablet d7dc54deac9948d7a930120d73b62279 (table default.Table_c365798fc83d4befad2195f6b2ac7fca [id=94d11e5f866048c2bfc5b147e2da303f])
I20260617 20:17:12.991520 29383 tablet_bootstrap.cc:654] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:12.991816 31119 tablet_loader.cc:96] loaded metadata for tablet d7dc704cf0844f579cced79fdf8c3da5 (table default.Table_0fa7c2d732b943eb86cf43d30ab2d880 [id=47a11e9a79bb4d778e64e90707d01584])
I20260617 20:17:12.956604 30852 consensus_queue.cc:237] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.995069 31220 raft_consensus.cc:493] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:12.995232 31220 raft_consensus.cc:515] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:12.996769 31390 raft_consensus.cc:515] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:12.998005 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52873eade4048af81a8e51233b9d079" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:12.998854 29198 leader_election.cc:343] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:12.999331 31390 leader_election.cc:290] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.000264 31119 tablet_loader.cc:96] loaded metadata for tablet dc11f416bf5647c78a5ab687cad53792 (table default.Table_6ead2c895ac049739a31aaabe45390fe [id=e24801a55bc8441891995304c46d0e57])
I20260617 20:17:13.000638 31119 tablet_loader.cc:96] loaded metadata for tablet dc717bac916140afa61a463435cc1e7c (table default.Table_3e14083b032f4f0aa58a5586a505644f [id=d8748c2388784fad857370a86fb9fc4e])
I20260617 20:17:13.000974 31119 tablet_loader.cc:96] loaded metadata for tablet dc8f02157ae04da7975bf2ee22f549a0 (table default.Table_aead2dfbc56e41b09cb8d70dd31f9fe7 [id=5ced09db636a4865bbb6661928063245])
I20260617 20:17:13.001452 31374 raft_consensus.cc:493] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.001579 31374 raft_consensus.cc:515] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.001850 31220 leader_election.cc:290] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.002625 31119 tablet_loader.cc:96] loaded metadata for tablet dd8a7096a09147789ac203c150a19419 (table default.Table_60e1d64970554bb3abb8978936794bad [id=7c9e551df8084f139824eadb433b077a])
I20260617 20:17:13.002588 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3dd481bc2745fba5460e26e49fa53b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:13.003013 31119 tablet_loader.cc:96] loaded metadata for tablet de42ac9a05aa4c60a7d93c1236888d64 (table default.Table_60168eec2672477faf619c2033f3b5c7 [id=8b0b35107e334201892508576676c82b])
W20260617 20:17:13.003127 29198 leader_election.cc:343] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.003417 31119 tablet_loader.cc:96] loaded metadata for tablet debb84d5e57b4bc9ba37b0fab2d6698b (table default.Table_daffb8813d634b3aa74a7b834732a833 [id=2b41138080f94fd6907df45a5cb21850])
I20260617 20:17:13.003959 31119 tablet_loader.cc:96] loaded metadata for tablet df3ddcafcfc147d1930ac0384871bbf7 (table default.Table_32fba2216d87484fbd69b7a0dfe9a80f [id=f6c336d65ae448b08d66b390926bd547])
I20260617 20:17:13.004527 31119 tablet_loader.cc:96] loaded metadata for tablet df7fdc0a9d1f4f7b9ca823cc72ae8d65 (table default.Table_883b608d1f174bd19a9e3d10a4c6ee3f [id=2727bf760ca44d7487975216690b2739])
I20260617 20:17:13.004844 31119 tablet_loader.cc:96] loaded metadata for tablet dfa3b652083d4112b69d305ba90730a9 (table default.Table_33cfc094d5004faab8f883e15663eac5 [id=8e179900a6774ea3877a6e4347aa9fbe])
I20260617 20:17:13.005869 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29a176d1f3b0446984af141e02bac329" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.006707 31388 consensus_queue.cc:237] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.007201 31220 raft_consensus.cc:493] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.007329 31220 raft_consensus.cc:515] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.007939 31220 leader_election.cc:290] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.006003 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b278ba32316c42d1b101e9803657af99" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.008278 29257 raft_consensus.cc:2393] T b278ba32316c42d1b101e9803657af99 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:13.008592 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae5bf7cdde5427cb24d6144ccb274f5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.009243 29198 leader_election.cc:343] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.012543 29379 tablet_bootstrap.cc:492] T 9574c6f0765b4329af28d72c8e94240a P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:13.013677 31220 raft_consensus.cc:493] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.013849 31220 raft_consensus.cc:515] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.014595 31220 leader_election.cc:290] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.017355 31119 tablet_loader.cc:96] loaded metadata for tablet e0f69bdc116f402e9e157b451232a2a9 (table default.Table_8d05c7ebda0b4513a30b51d3248efb1f [id=867f1e0df6cf48cf90ddde6238e9b9c2])
I20260617 20:17:13.017551 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a09fbb3e8eb4b66acba0d6b572713ef" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.018195 31119 tablet_loader.cc:96] loaded metadata for tablet e164ead74ef44bbbb33f65f7ede5a8e2 (table default.Table_3198a4e3806449bc8871764c181d5ebf [id=cb568e8af2da4807b99a6d07c57afca9])
I20260617 20:17:13.018980 31220 consensus_queue.cc:1048] T 4ceb3ae3c1a44442966ad37fbcbc658b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.015277 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dc704cf0844f579cced79fdf8c3da5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:13.018827 29063 leader_election.cc:304] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.022348 29063 leader_election.cc:304] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.022738 31009 raft_consensus.cc:3060] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.023983 31119 tablet_loader.cc:96] loaded metadata for tablet e224d4ecd45040cfabcdbc347cfa62cb (table default.Table_cdb4c1e8ce7042bc828e729ef36aba9b [id=1fb4a405d43541e4bc7d9dc251a2c25e])
I20260617 20:17:13.024479 31119 tablet_loader.cc:96] loaded metadata for tablet e22695cd32c44283888eaaae0c10a9c6 (table default.Table_e4bae15c95f24a148e48b458b3ffd46d [id=e68eecbfbae442c493ec7dbf49c718f2])
I20260617 20:17:13.024827 31119 tablet_loader.cc:96] loaded metadata for tablet e2c415bf337f4687be7a80cd49a775cc (table default.Table_ff86bab000284059be724d40d2dde59b [id=ad35a5714c444343b6fad6d58dc87e04])
I20260617 20:17:13.025467 31287 raft_consensus.cc:3060] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.026657 31119 tablet_loader.cc:96] loaded metadata for tablet e2e2c1655df34edab115e64de53e22b7 (table default.Table_500d59e85d2c4e8187ce78b975eacfa3 [id=bfdb2fa2c6914b33ac9d1aa90be0d8b3])
I20260617 20:17:13.027068 31119 tablet_loader.cc:96] loaded metadata for tablet e2f906eb1286493ab134c4b959cd1b6a (table default.Table_828a81e6756742db828d8880981f1021 [id=f5d1fae02fa1431d9913117bbef77d7d])
I20260617 20:17:13.028612 31287 raft_consensus.cc:2749] T b278ba32316c42d1b101e9803657af99 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:13.029209 29198 leader_election.cc:343] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.029771 31009 raft_consensus.cc:2749] T 29a176d1f3b0446984af141e02bac329 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.030378 31119 tablet_loader.cc:96] loaded metadata for tablet e4ff51037a354457a0adc06020295ba9 (table default.Table_62b5e2225918452592675fc7e49ea2e0 [id=05a8eb4228f84b2b9eba7ee1c90dd385])
I20260617 20:17:13.031474 31119 tablet_loader.cc:96] loaded metadata for tablet e5003302863d4390b423054685c8c24b (table default.Table_321214072f004f76a346e51f39acde1f [id=4bed2d5737114eeda76e61e6a4a3fddd])
I20260617 20:17:13.032277 31119 tablet_loader.cc:96] loaded metadata for tablet e5396b42681e4a1fbf0df74c86ee810c (table default.Table_75e979e8d7bd46d29cf374e5f594e095 [id=df45a919527444a5b096737284b70a5c])
I20260617 20:17:13.033053 31119 tablet_loader.cc:96] loaded metadata for tablet e58fbec4a9f14ddda42b5a4c0263972c (table default.Table_0ea7c7718805448cbcc37cfd8539684e [id=cd4abe077ee04673bad87834b3af273b])
I20260617 20:17:13.034757 31119 tablet_loader.cc:96] loaded metadata for tablet e7eb77c619e04c448a084638668dbb6a (table default.Table_b8793ca9db0342aab1948326509066a8 [id=edd51a8755804964934adedfa19328a6])
W20260617 20:17:13.035431 29062 consensus_peers.cc:597] T e79c6804fbb34f5baebdb366f2e0b1bf P 6d4ce30e1fce4591b64c398747f8d37a -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e79c6804fbb34f5baebdb366f2e0b1bf. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:13.035701 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a52873eade4048af81a8e51233b9d079" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:13.035892 28983 raft_consensus.cc:3060] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.035676 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3dd481bc2745fba5460e26e49fa53b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.036238 28978 raft_consensus.cc:2468] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
W20260617 20:17:13.040016 28925 leader_election.cc:343] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.040705 31119 tablet_loader.cc:96] loaded metadata for tablet e7f822e3f4ca4946a116ee172e83628b (table default.Table_fc6995f292e54195899ee9c42fa0a9cc [id=ba042ddba3704bf490d642394b2c3f9c])
I20260617 20:17:13.041694 31119 tablet_loader.cc:96] loaded metadata for tablet e84c2f0be1ce4ac18f8964c2b717a8f8 (table default.Table_dd291560b73540e38b18bf2c933613e3 [id=402dda6ba37a41cfa20933ed8152918e])
I20260617 20:17:13.043397 31119 tablet_loader.cc:96] loaded metadata for tablet e997dd0d85eb4e9d9e2205d3997f2df3 (table default.Table_f83bfe624dc64693998c453f0f0c42fd [id=756fa2b70ecd4112ad896545476251be])
I20260617 20:17:13.043527 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dc704cf0844f579cced79fdf8c3da5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.043699 28978 raft_consensus.cc:2468] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:13.044028 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae5bf7cdde5427cb24d6144ccb274f5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.044198 28988 raft_consensus.cc:2468] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:13.044407 31374 leader_election.cc:290] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.044715 29379 ts_tablet_manager.cc:1403] T 9574c6f0765b4329af28d72c8e94240a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.115s user 0.005s sys 0.013s
I20260617 20:17:13.045725 29379 raft_consensus.cc:359] T 9574c6f0765b4329af28d72c8e94240a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.046000 29379 raft_consensus.cc:385] T 9574c6f0765b4329af28d72c8e94240a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.046092 29379 raft_consensus.cc:740] T 9574c6f0765b4329af28d72c8e94240a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.046177 31119 tablet_loader.cc:96] loaded metadata for tablet ea82d485fe0e4f7fac5c6374f51d7bb4 (table default.Table_25485c53fc824593aebd48840afae10e [id=4f66039ab9ea457fa2bc42d45a087826])
I20260617 20:17:13.046345 29379 consensus_queue.cc:260] T 9574c6f0765b4329af28d72c8e94240a P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.047173 29379 ts_tablet_manager.cc:1434] T 9574c6f0765b4329af28d72c8e94240a P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:13.049012 31119 tablet_loader.cc:96] loaded metadata for tablet ead0291870a443d9b76ea919a45a4303 (table default.Table_d353f219381d4d17a2927a233465454c [id=0ef22e22306747b28d49d58d0fa45620])
I20260617 20:17:13.049777 31119 tablet_loader.cc:96] loaded metadata for tablet eae5935a4adc4c8dbfa6888c02b2dced (table default.Table_2b5d45aad044441c84c126666d3c05d5 [id=bf23e5dfb99040f2987306a3d260e92a])
I20260617 20:17:13.053797 31119 tablet_loader.cc:96] loaded metadata for tablet ec871f7502c24af6920ce16f4b62330a (table default.Table_e6d2efb704e44c7a8ea2697ad784c448 [id=8e71ae5eb0e44723af7609769009a976])
I20260617 20:17:13.053996 29383 tablet_bootstrap.cc:492] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:13.054620 29383 ts_tablet_manager.cc:1403] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.109s user 0.000s sys 0.003s
I20260617 20:17:13.055075 31119 tablet_loader.cc:96] loaded metadata for tablet efdf2ae366924eaeaf9d4b9d21eb1142 (table default.Table_52b729f02c4d498794d81ba38d3b5364 [id=ab1ca24d24264ec7a935227ddc98d5a3])
I20260617 20:17:13.056267 31119 tablet_loader.cc:96] loaded metadata for tablet f14113dd9098456599d7b72626bedcd6 (table default.Table_b97bf3349f93422cbd2b08e176e4d5da [id=d50a3264b4d349dea980a3ad95ac87f8])
I20260617 20:17:13.060154 31119 tablet_loader.cc:96] loaded metadata for tablet f2c1fd3f325841c297d123ad1ac0fe9d (table default.Table_fb677487243a423f83473bfcd261bbf4 [id=b4613adf2f5b40a780f81d91421a689a])
I20260617 20:17:13.054291 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a09fbb3e8eb4b66acba0d6b572713ef" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:13.060801 31119 tablet_loader.cc:96] loaded metadata for tablet f384b65e9c324aa0953324c33d9a3d72 (table default.Table_7f36ddd489fc48f8b9ad5920baa0d8cb [id=93862a2d6edb4810bd079433287be030])
W20260617 20:17:13.061168 28925 leader_election.cc:343] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.061347 28925 leader_election.cc:304] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.061518 31119 tablet_loader.cc:96] loaded metadata for tablet f43549813e294796baca2a1a64dbcfb9 (table default.Table_07b69bc96042426b925d4a1072ec0d08 [id=8015a245e8574c7580068edea8104f06])
I20260617 20:17:13.061896 31374 raft_consensus.cc:2749] T 5a09fbb3e8eb4b66acba0d6b572713ef P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.062366 31119 tablet_loader.cc:96] loaded metadata for tablet f5636950d5d445c297b7e3286645d013 (table default.Table_5c6561f5414e4882a5dda6848359c27b [id=c4224ca184794bd2ae291ed645b924d0])
I20260617 20:17:13.062954 31259 raft_consensus.cc:493] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:13.063073 31259 raft_consensus.cc:3060] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.064898 31119 tablet_loader.cc:96] loaded metadata for tablet f57d1591442045d6bda930d8993ae4db (table default.Table_26c8b16b5bf24bda8bf9851b87f0bde0 [id=bf02335abe5b47bb8251b52c6dc5ab81])
I20260617 20:17:13.065886 31119 tablet_loader.cc:96] loaded metadata for tablet f6c9d59b6b5a4dee8ca970247f613e53 (table default.Table_7412226c178b4fdfa79664f5975d834a [id=f398dc41286d4aa690f3d7b3d45015a8])
I20260617 20:17:13.066020 29197 leader_election.cc:304] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.066480 29197 leader_election.cc:304] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.066538 30852 raft_consensus.cc:2804] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:13.066655 30852 raft_consensus.cc:493] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:13.066823 29197 leader_election.cc:304] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.066831 30852 raft_consensus.cc:3060] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.067159 31094 raft_consensus.cc:2804] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:13.067231 31094 raft_consensus.cc:493] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:13.067312 31094 raft_consensus.cc:3060] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.069645 29379 tablet_bootstrap.cc:492] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:13.069706 31094 raft_consensus.cc:515] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.070205 31119 tablet_loader.cc:96] loaded metadata for tablet f91951f4fffa4723aa4d8099fcedd50b (table default.Table_5d01dcb6629a40f2a3dc693bbb860d62 [id=75a5082717854698a606ad842b2f107d])
I20260617 20:17:13.070295 31094 leader_election.cc:290] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.070456 31094 raft_consensus.cc:2804] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:13.070531 31094 raft_consensus.cc:493] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:13.070598 31094 raft_consensus.cc:3060] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.070794 31119 tablet_loader.cc:96] loaded metadata for tablet f9b012261017481891665cb90f670207 (table default.Table_006cb367b3ec46459d97e77c25bc67ae [id=f9b9fa870edd48daa8498a3f371ec669])
I20260617 20:17:13.070849 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dc704cf0844f579cced79fdf8c3da5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:13.071225 31119 tablet_loader.cc:96] loaded metadata for tablet fa123fc62a594dd19f20b520760fe6c4 (table default.Table_d9c37095429e4a2c8300865cb8711a27 [id=dad13ba825d74009ad1899b403ab5745])
W20260617 20:17:13.071336 29198 leader_election.cc:343] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.071223 29383 raft_consensus.cc:359] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.072196 31119 tablet_loader.cc:96] loaded metadata for tablet fb2a0578122c421ab45bf56edb7cffdb (table default.Table_eddd37adcac449fdafd97ff4e5f726ea [id=28482c1294b7476d96b490f73d8b9d28])
I20260617 20:17:13.073099 29379 tablet_bootstrap.cc:654] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.072023 29383 raft_consensus.cc:385] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.073544 31094 raft_consensus.cc:515] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.073520 29383 raft_consensus.cc:740] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.074105 31094 leader_election.cc:290] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.069650 30852 raft_consensus.cc:515] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.075055 31119 tablet_loader.cc:96] loaded metadata for tablet fc0548e9864f49cf8ee8c5d6d1e798d5 (table default.Table_07ee116a00f04f99aa9e85d08ba5b147 [id=5d39a5d87ba74b7abc3ee6e074f9591b])
I20260617 20:17:13.075948 31119 tablet_loader.cc:96] loaded metadata for tablet fd226ca6595148638d5036356c50313f (table default.Table_eeda1b309ce24b77967522bd8810c6d8 [id=aaa2d2913e5d438b901d6bd519eaf891])
I20260617 20:17:13.076239 31119 tablet_loader.cc:96] loaded metadata for tablet fd925162282c439a850839e46d63fe75 (table default.Table_24b0bdcfb9354683bf9478d54ffdf945 [id=f6cf07559f1d4f52a95b5ee1dbad77eb])
I20260617 20:17:13.074893 29383 consensus_queue.cc:260] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.077320 31119 tablet_loader.cc:96] loaded metadata for tablet fef5756f8960440eb6598246f300bc8a (table default.Table_7ab3e811b872450d856ef65057509c9e [id=062470abc0a44c6a847efb062ea85285])
I20260617 20:17:13.080058 31119 tablet_loader.cc:96] loaded metadata for tablet ff2ca88b9ba54931adf1329ea664b5e6 (table default.Table_42197450734d46538ca8460001e86a63 [id=fc499f8db0824acfaf15a78fd5bb2a5f])
I20260617 20:17:13.082077 31119 tablet_loader.cc:96] loaded metadata for tablet ff6bd059a5f5406e9c7f0c46c25ddbbe (table default.Table_b1e1ccfbd65149709f90def87a0de455 [id=269eefef16a244c7b332a14c1e54c1c0])
I20260617 20:17:13.074261 31009 raft_consensus.cc:493] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.087239 31009 raft_consensus.cc:515] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:13.087375 31119 catalog_manager.cc:1511] Time spent T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Loading table and tablet metadata into memory: real 3.445s user 0.321s sys 0.159s
I20260617 20:17:13.087513 31119 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260617 20:17:13.088168 31009 leader_election.cc:290] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:13.078370 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae5bf7cdde5427cb24d6144ccb274f5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:13.081005 29120 raft_consensus.cc:3060] T d811ca370ee54db8a7e4f6056017cd01 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:13.089051 29198 leader_election.cc:343] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.089504 29569 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:60712 (request call id 0) took 2497 ms. Trace:
I20260617 20:17:13.089634 29569 rpcz_store.cc:276] 0617 20:17:10.591889 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:10.597705 (+ 5816us) service_pool.cc:224] Handling call
0617 20:17:13.089431 (+2491726us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260617 20:17:13.091261 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3dd481bc2745fba5460e26e49fa53b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:13.091822 29198 leader_election.cc:343] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.092007 31388 consensus_queue.cc:1048] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.092517 31259 raft_consensus.cc:515] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.092726 31388 consensus_queue.cc:1048] T 29a176d1f3b0446984af141e02bac329 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.093997 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19d34e3bbe3453ca6de6ed7e62f7af4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:13.094141 29125 raft_consensus.cc:3060] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.097666 29125 raft_consensus.cc:2468] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:13.098239 29198 leader_election.cc:304] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:13.098611 31388 raft_consensus.cc:2804] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:13.098788 31388 raft_consensus.cc:697] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:13.099110 31388 consensus_queue.cc:237] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:13.104713 29062 leader_election.cc:343] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 08290c23fff5449481789b29d15c4781
I20260617 20:17:13.105014 29378 tablet_bootstrap.cc:492] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.105170 29378 ts_tablet_manager.cc:1403] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.133s user 0.010s sys 0.010s
I20260617 20:17:13.106981 28988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dc704cf0844f579cced79fdf8c3da5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:13.107164 28988 raft_consensus.cc:3060] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.107299 29125 raft_consensus.cc:3060] T 6f15a7c18faa4e36bbb62809bb6e976c P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:13.108270 29063 leader_election.cc:343] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 08290c23fff5449481789b29d15c4781
I20260617 20:17:13.108428 29063 leader_election.cc:304] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.108683 31287 raft_consensus.cc:2749] T 08290c23fff5449481789b29d15c4781 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.109159 31374 raft_consensus.cc:493] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.109277 31374 raft_consensus.cc:515] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.111531 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae5bf7cdde5427cb24d6144ccb274f5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:13.111685 28978 raft_consensus.cc:3060] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.112509 31374 leader_election.cc:290] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.113837 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a819956f29954a4dbbd1aa1dcccad3c0" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:13.113857 29378 raft_consensus.cc:359] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.114019 29378 raft_consensus.cc:385] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.114079 29378 raft_consensus.cc:740] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.114269 29378 consensus_queue.cc:260] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
W20260617 20:17:13.114480 28925 leader_election.cc:343] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.114790 29378 ts_tablet_manager.cc:1434] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260617 20:17:13.115089 29378 tablet_bootstrap.cc:492] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.117559 31259 leader_election.cc:290] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.119504 29378 tablet_bootstrap.cc:654] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.119738 28987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c3dd481bc2745fba5460e26e49fa53b" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:13.122671 28987 raft_consensus.cc:3060] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.119917 28984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d19d34e3bbe3453ca6de6ed7e62f7af4" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:13.123224 28984 raft_consensus.cc:3060] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.124918 29379 tablet_bootstrap.cc:492] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:13.125448 29379 ts_tablet_manager.cc:1403] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.003s
I20260617 20:17:13.121822 28988 raft_consensus.cc:2468] T d7dc704cf0844f579cced79fdf8c3da5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:13.126303 31119 catalog_manager.cc:1294] Loaded cluster ID: 46a5ac7d37d748d69d2d5bbcb74d8c61
I20260617 20:17:13.126297 29379 raft_consensus.cc:359] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.126488 29379 raft_consensus.cc:385] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.126506 31119 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260617 20:17:13.126554 29379 raft_consensus.cc:740] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.126756 29379 consensus_queue.cc:260] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.127373 29379 ts_tablet_manager.cc:1434] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:13.127660 29379 tablet_bootstrap.cc:492] T a52873eade4048af81a8e51233b9d079 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:13.129257 29379 tablet_bootstrap.cc:654] T a52873eade4048af81a8e51233b9d079 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.129321 31371 raft_consensus.cc:493] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.129448 31371 raft_consensus.cc:515] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.130517 29197 leader_election.cc:304] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.130831 31390 raft_consensus.cc:2804] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:13.130931 31390 raft_consensus.cc:697] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:13.131142 31390 consensus_queue.cc:237] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.131639 31371 leader_election.cc:290] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.132441 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9370421288e2449fae454aec32883810" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.132998 28925 leader_election.cc:343] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.136031 28978 raft_consensus.cc:2468] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:13.139678 28984 raft_consensus.cc:2468] T d19d34e3bbe3453ca6de6ed7e62f7af4 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:13.141896 28987 raft_consensus.cc:2468] T 6c3dd481bc2745fba5460e26e49fa53b P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:13.143522 28983 raft_consensus.cc:2468] T a52873eade4048af81a8e51233b9d079 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:13.144471 29257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a819956f29954a4dbbd1aa1dcccad3c0" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.144801 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9370421288e2449fae454aec32883810" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:13.145424 28925 leader_election.cc:343] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.145560 28925 leader_election.cc:304] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.146571 31371 raft_consensus.cc:2749] T a819956f29954a4dbbd1aa1dcccad3c0 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.151798 29383 ts_tablet_manager.cc:1434] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.097s user 0.001s sys 0.001s
I20260617 20:17:13.152242 29383 tablet_bootstrap.cc:492] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:13.153759 29383 tablet_bootstrap.cc:654] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.156847 30852 leader_election.cc:290] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:13.159807 28925 leader_election.cc:343] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.159897 29117 raft_consensus.cc:3060] T 6f544f486c144cd89ca7c5b83d252ee9 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.159929 28925 leader_election.cc:304] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.160307 31371 raft_consensus.cc:2749] T 9370421288e2449fae454aec32883810 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.162120 29197 leader_election.cc:304] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.162693 31390 raft_consensus.cc:2804] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:13.162854 31390 raft_consensus.cc:697] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:13.163136 31390 consensus_queue.cc:237] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.173238 29379 tablet_bootstrap.cc:492] T a52873eade4048af81a8e51233b9d079 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:13.173478 29379 ts_tablet_manager.cc:1403] T a52873eade4048af81a8e51233b9d079 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.046s user 0.006s sys 0.009s
I20260617 20:17:13.174207 29379 raft_consensus.cc:359] T a52873eade4048af81a8e51233b9d079 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.174420 29379 raft_consensus.cc:385] T a52873eade4048af81a8e51233b9d079 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.174503 29379 raft_consensus.cc:740] T a52873eade4048af81a8e51233b9d079 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.174800 29379 consensus_queue.cc:260] T a52873eade4048af81a8e51233b9d079 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.176596 29379 ts_tablet_manager.cc:1434] T a52873eade4048af81a8e51233b9d079 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:17:13.176858 29379 tablet_bootstrap.cc:492] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:13.177863 29378 tablet_bootstrap.cc:492] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.178037 29378 ts_tablet_manager.cc:1403] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.000s
I20260617 20:17:13.178731 29379 tablet_bootstrap.cc:654] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.179251 29378 raft_consensus.cc:359] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.179481 29378 raft_consensus.cc:385] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.179577 29378 raft_consensus.cc:740] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.179809 29378 consensus_queue.cc:260] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.180013 29197 leader_election.cc:304] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.180358 29378 ts_tablet_manager.cc:1434] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:13.180692 29197 leader_election.cc:304] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.180914 29378 tablet_bootstrap.cc:492] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.180971 31259 raft_consensus.cc:2804] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:13.181125 30852 raft_consensus.cc:2804] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:13.181360 30852 raft_consensus.cc:697] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:13.181428 31259 raft_consensus.cc:697] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:13.182360 31259 consensus_queue.cc:237] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.182690 30852 consensus_queue.cc:237] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.183509 29378 tablet_bootstrap.cc:654] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.185240 29378 tablet_bootstrap.cc:492] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.187461 29378 ts_tablet_manager.cc:1403] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260617 20:17:13.189895 31094 consensus_queue.cc:1048] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.191712 29378 raft_consensus.cc:359] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.195351 29378 raft_consensus.cc:385] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.195515 29378 raft_consensus.cc:740] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.199013 29378 consensus_queue.cc:260] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.199611 29378 ts_tablet_manager.cc:1434] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260617 20:17:13.204955 31119 catalog_manager.cc:1539] Loading token signing keys...
I20260617 20:17:13.223225 29383 tablet_bootstrap.cc:492] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:13.225730 29120 raft_consensus.cc:3060] T 54969e138cf745739b54203c11e4c94e P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.227195 29383 ts_tablet_manager.cc:1403] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.000s
I20260617 20:17:13.227807 29383 raft_consensus.cc:359] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.227946 29383 raft_consensus.cc:385] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.227988 29383 raft_consensus.cc:740] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.228199 31371 raft_consensus.cc:493] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.228163 29383 consensus_queue.cc:260] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.228333 31371 raft_consensus.cc:515] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.229005 31371 leader_election.cc:290] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.229672 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342e29fbc98442ea2e2d25c7aea8853" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.230381 28925 leader_election.cc:343] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.234624 31418 raft_consensus.cc:493] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.234786 31418 raft_consensus.cc:515] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.235509 31418 leader_election.cc:290] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:13.236250 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3091c332a14c4c99bd28e401769e30" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.236449 28985 raft_consensus.cc:2393] T 6b3091c332a14c4c99bd28e401769e30 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:13.230834 30852 consensus_queue.cc:1048] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260617 20:17:13.240998 29259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3091c332a14c4c99bd28e401769e30" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.242735 29063 leader_election.cc:304] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.228613 29383 ts_tablet_manager.cc:1434] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260617 20:17:13.243466 31418 raft_consensus.cc:3060] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.246325 31418 raft_consensus.cc:2749] T 6b3091c332a14c4c99bd28e401769e30 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.234505 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342e29fbc98442ea2e2d25c7aea8853" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:13.251889 28925 leader_election.cc:343] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.252025 28925 leader_election.cc:304] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.252395 31371 raft_consensus.cc:2749] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.253986 29383 tablet_bootstrap.cc:492] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:13.260901 29120 raft_consensus.cc:3060] T 9574c6f0765b4329af28d72c8e94240a P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.261323 31389 consensus_queue.cc:1048] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.276750 31418 raft_consensus.cc:493] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.276899 31418 raft_consensus.cc:515] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.277482 31418 leader_election.cc:290] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:13.278062 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8d29712eee47e497872df101404f26" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.278276 28985 raft_consensus.cc:2393] T cc8d29712eee47e497872df101404f26 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:13.283814 31119 catalog_manager.cc:6080] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Loaded TSK: 0
I20260617 20:17:13.296830 29383 tablet_bootstrap.cc:654] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.298820 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8d29712eee47e497872df101404f26" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.298918 31119 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260617 20:17:13.299355 29063 leader_election.cc:304] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.299711 31418 raft_consensus.cc:3060] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.302292 31418 raft_consensus.cc:2749] T cc8d29712eee47e497872df101404f26 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.304591 31259 raft_consensus.cc:493] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.304795 31259 raft_consensus.cc:515] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.305719 31259 leader_election.cc:290] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.306203 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c583de2973e4fb0abacf2692f3ab829" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.306818 29198 leader_election.cc:343] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.307422 31371 raft_consensus.cc:493] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.307556 31371 raft_consensus.cc:515] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.308166 31371 leader_election.cc:290] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.312791 29379 tablet_bootstrap.cc:492] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:13.313009 29379 ts_tablet_manager.cc:1403] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.136s user 0.018s sys 0.009s
I20260617 20:17:13.313673 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c583de2973e4fb0abacf2692f3ab829" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.313854 28985 raft_consensus.cc:2468] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:13.313968 29379 raft_consensus.cc:359] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.314133 29379 raft_consensus.cc:385] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.314191 29379 raft_consensus.cc:740] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.314450 29379 consensus_queue.cc:260] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.315927 29379 ts_tablet_manager.cc:1434] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260617 20:17:13.319571 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6dc68c7f10490f87df2b70a548cf72" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:13.320081 28925 leader_election.cc:343] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.321580 29197 leader_election.cc:304] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.324211 31259 raft_consensus.cc:2804] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:13.324344 31259 raft_consensus.cc:493] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:13.324469 31259 raft_consensus.cc:3060] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.316208 29379 tablet_bootstrap.cc:492] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:13.328631 29379 tablet_bootstrap.cc:654] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.329149 31259 raft_consensus.cc:515] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.330173 31259 leader_election.cc:290] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.330230 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c583de2973e4fb0abacf2692f3ab829" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:13.330552 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d6dc68c7f10490f87df2b70a548cf72" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.330717 29198 leader_election.cc:343] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:13.331141 28925 leader_election.cc:343] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.331282 28925 leader_election.cc:304] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.331710 31371 raft_consensus.cc:2749] T 6d6dc68c7f10490f87df2b70a548cf72 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.332880 31390 consensus_queue.cc:1048] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:13.336817 31281 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260617 20:17:13.337234 31281 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260617 20:17:13.337435 31281 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260617 20:17:13.340536 29378 tablet_bootstrap.cc:492] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.343743 29378 tablet_bootstrap.cc:654] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.350086 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c583de2973e4fb0abacf2692f3ab829" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:13.350268 28981 raft_consensus.cc:3060] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.350807 29383 tablet_bootstrap.cc:492] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:13.351297 29383 ts_tablet_manager.cc:1403] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.097s user 0.002s sys 0.002s
I20260617 20:17:13.352901 28981 raft_consensus.cc:2468] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:13.354387 29578 master_service.cc:960] ReplaceTablet: received request to replace tablet b7a26cb68df548f9b716c72e36b11647 from {username='slave'} at 127.0.0.1:60712
I20260617 20:17:13.355229 29378 tablet_bootstrap.cc:492] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.355437 29378 ts_tablet_manager.cc:1403] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20260617 20:17:13.356388 29578 master_service.cc:960] ReplaceTablet: received request to replace tablet 0916139a64df436fafa18c7e86fbf91c from {username='slave'} at 127.0.0.1:60712
I20260617 20:17:13.356784 29378 raft_consensus.cc:359] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.357023 29378 raft_consensus.cc:385] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.357110 29378 raft_consensus.cc:740] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.357384 29378 consensus_queue.cc:260] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.358069 29378 ts_tablet_manager.cc:1434] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:13.358680 29578 master_service.cc:960] ReplaceTablet: received request to replace tablet add6e21cef3b4c02910486841e36ce4a from {username='slave'} at 127.0.0.1:60712
I20260617 20:17:13.358762 29378 tablet_bootstrap.cc:492] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.360540 29378 tablet_bootstrap.cc:654] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.366513 31447 raft_consensus.cc:493] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5ea3f9265d84474ab3bced8dd5aecc5)
I20260617 20:17:13.365361 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet d811ca370ee54db8a7e4f6056017cd01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:52 UTC) from {username='slave'} at 127.0.0.1:45764
I20260617 20:17:13.365494 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 89d79b7023ae478698a06562b2e4c578 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:45764
I20260617 20:17:13.368408 31259 raft_consensus.cc:493] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.369625 29383 raft_consensus.cc:359] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.369930 29383 raft_consensus.cc:385] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.370039 29383 raft_consensus.cc:740] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.370278 29383 consensus_queue.cc:260] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.360122 29578 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_83cd5e3f2921420f822eee497a0087d5" } modify_external_catalogs: true
I20260617 20:17:13.370667 29578 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_83cd5e3f2921420f822eee497a0087d5" } modify_external_catalogs: true
I20260617 20:17:13.371192 29383 ts_tablet_manager.cc:1434] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20260617 20:17:13.369087 31259 raft_consensus.cc:515] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.372856 31259 leader_election.cc:290] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:13.373135 29383 tablet_bootstrap.cc:492] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:13.374383 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6d214816540ac90dc9b2ad3cdb89f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:13.374629 29117 raft_consensus.cc:2468] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:13.375113 29198 leader_election.cc:304] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:13.377121 29379 tablet_bootstrap.cc:492] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:13.377342 29379 ts_tablet_manager.cc:1403] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.001s
I20260617 20:17:13.377391 31390 raft_consensus.cc:2804] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:13.377528 31390 raft_consensus.cc:493] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:13.377660 31390 raft_consensus.cc:3060] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.378218 29379 raft_consensus.cc:359] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.378430 29379 raft_consensus.cc:385] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.378516 29379 raft_consensus.cc:740] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.378799 29379 consensus_queue.cc:260] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.380735 31390 raft_consensus.cc:515] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:13.381013 31281 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
I20260617 20:17:13.381537 31453 tablet_replica.cc:333] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:13.381762 31390 leader_election.cc:290] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:13.381737 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6d214816540ac90dc9b2ad3cdb89f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:13.381889 29117 raft_consensus.cc:3060] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:13.381968 31281 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260617 20:17:13.382123 31281 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260617 20:17:13.382364 31453 raft_consensus.cc:2243] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260617 20:17:13.382514 31281 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260617 20:17:13.384490 29117 raft_consensus.cc:2468] T c2c6d214816540ac90dc9b2ad3cdb89f P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:13.384763 31453 raft_consensus.cc:2272] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:13.386677 29569 catalog_manager.cc:5788] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833) does not have the latest schema for tablet 9655a1164fa84f53bdb9fd31b2fcda78 (table default.Table_e7b17c557187475d91de751c47b28644 [id=ce30ff8f9aa148879cb0f930fffc1f51]). Expected version 1 got 0
I20260617 20:17:13.385572 29378 tablet_bootstrap.cc:492] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.387136 29378 ts_tablet_manager.cc:1403] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.004s
W20260617 20:17:13.387908 29569 catalog_manager.cc:5888] Failed to send AlterTable RPC for tablet 9655a1164fa84f53bdb9fd31b2fcda78 (table default.Table_e7b17c557187475d91de751c47b28644 [id=ce30ff8f9aa148879cb0f930fffc1f51], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 9655a1164fa84f53bdb9fd31b2fcda78 consensus state has no leader
I20260617 20:17:13.387866 29378 raft_consensus.cc:359] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.388126 29378 raft_consensus.cc:385] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.388207 29378 raft_consensus.cc:740] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.388430 29378 consensus_queue.cc:260] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.389142 29378 ts_tablet_manager.cc:1434] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:13.389463 29378 tablet_bootstrap.cc:492] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.389670 29379 ts_tablet_manager.cc:1434] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260617 20:17:13.390231 31453 ts_tablet_manager.cc:1916] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:13.390300 29198 leader_election.cc:304] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:13.392515 31094 raft_consensus.cc:2804] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:13.392643 31094 raft_consensus.cc:697] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:13.392858 31094 consensus_queue.cc:237] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.390691 29379 tablet_bootstrap.cc:492] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:13.394675 29173 heartbeater.cc:499] Master 127.27.245.252:46059 was elected leader, sending a full tablet report...
I20260617 20:17:13.391359 29378 tablet_bootstrap.cc:654] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.405642 29383 tablet_bootstrap.cc:654] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.408023 29575 master_service.cc:960] ReplaceTablet: received request to replace tablet 1f2c8a0fe63c440493b357e73f763357 from {username='slave'} at 127.0.0.1:60712
I20260617 20:17:13.409870 29569 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_8556e2b7c18a49e09b7a01b9683d4f58" } modify_external_catalogs: true
I20260617 20:17:13.410130 29569 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_8556e2b7c18a49e09b7a01b9683d4f58" } modify_external_catalogs: true
I20260617 20:17:13.410689 29379 tablet_bootstrap.cc:654] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.412124 29568 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_f1bf6a12189741bc8144442a0121eb38" } modify_external_catalogs: true
I20260617 20:17:13.412369 29568 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_f1bf6a12189741bc8144442a0121eb38" } modify_external_catalogs: true
I20260617 20:17:13.416884 29536 master_service.cc:960] ReplaceTablet: received request to replace tablet e401eea0717d4cbb8319e4d4b1ada410 from {username='slave'} at 127.0.0.1:60712
I20260617 20:17:13.422118 29378 tablet_bootstrap.cc:492] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.422302 29378 ts_tablet_manager.cc:1403] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.004s
I20260617 20:17:13.422945 29378 raft_consensus.cc:359] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.423137 29378 raft_consensus.cc:385] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.423113 29308 heartbeater.cc:499] Master 127.27.245.252:46059 was elected leader, sending a full tablet report...
I20260617 20:17:13.423214 29378 raft_consensus.cc:740] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.423467 29378 consensus_queue.cc:260] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.424326 29378 ts_tablet_manager.cc:1434] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:13.424825 29378 tablet_bootstrap.cc:492] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.426551 29378 tablet_bootstrap.cc:654] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.428722 29383 tablet_bootstrap.cc:492] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:13.428859 29383 ts_tablet_manager.cc:1403] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.056s user 0.004s sys 0.000s
I20260617 20:17:13.429601 29383 raft_consensus.cc:359] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.429771 29383 raft_consensus.cc:385] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.429826 29383 raft_consensus.cc:740] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.430145 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6d214816540ac90dc9b2ad3cdb89f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:13.430315 28981 raft_consensus.cc:3060] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.431073 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6d214816540ac90dc9b2ad3cdb89f" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.432858 28981 raft_consensus.cc:2468] T c2c6d214816540ac90dc9b2ad3cdb89f P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:13.433912 29378 tablet_bootstrap.cc:492] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.434024 29378 ts_tablet_manager.cc:1403] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260617 20:17:13.434614 29378 raft_consensus.cc:359] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.434762 29378 raft_consensus.cc:385] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.434803 29378 raft_consensus.cc:740] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.435010 29378 consensus_queue.cc:260] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.435087 29535 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "default.Table_c48b276ef09c48ee84047dd3034067f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:13.435803 29378 ts_tablet_manager.cc:1434] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:13.436079 29378 tablet_bootstrap.cc:492] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.435902 29536 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "default.Table_8b97adf7186f462095ddb237ff692547"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260617 20:17:13.436323 31371 raft_consensus.cc:493] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.436424 31371 raft_consensus.cc:515] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.436863 29563 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_0b8e0aa46bda414b9cd909ead421e411" } modify_external_catalogs: true
I20260617 20:17:13.437031 31371 leader_election.cc:290] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.437111 29563 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_0b8e0aa46bda414b9cd909ead421e411" } modify_external_catalogs: true
I20260617 20:17:13.437979 29583 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_706c0e9f917f49388f2da836758dcf8d" } new_table_name: "default.Table_aad716a6a0c94ae39196d52c82bab54e" modify_external_catalogs: true
I20260617 20:17:13.438169 29035 heartbeater.cc:499] Master 127.27.245.252:46059 was elected leader, sending a full tablet report...
I20260617 20:17:13.438604 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e765deb9fe84707a5e9e2964310a36d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.439049 28925 leader_election.cc:343] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:13.439471 29526 catalog_manager.cc:4809] Async tablet task AlterTable RPC for tablet 9655a1164fa84f53bdb9fd31b2fcda78 (table default.Table_e7b17c557187475d91de751c47b28644 [id=ce30ff8f9aa148879cb0f930fffc1f51], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9655a1164fa84f53bdb9fd31b2fcda78 consensus state has no leader
I20260617 20:17:13.439817 29378 tablet_bootstrap.cc:654] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.440223 31447 raft_consensus.cc:515] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590225c8ea36448093b77385d238a34a" member_type: VOTER last_known_addr { host: "127.27.245.254" port: 37301 } } peers { permanent_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" member_type: VOTER last_known_addr { host: "127.27.245.253" port: 38361 } } peers { permanent_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" member_type: VOTER last_known_addr { host: "127.27.245.252" port: 46059 } }
I20260617 20:17:13.441869 29543 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_b6faf540da644f658eb715d3ffacd616" } modify_external_catalogs: true
I20260617 20:17:13.442051 29543 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_b6faf540da644f658eb715d3ffacd616" } modify_external_catalogs: true
I20260617 20:17:13.443087 31281 master_runner.cc:387] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.27.245.212:40183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.27.245.254:37301,127.27.245.253:38361,127.27.245.252:46059
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.27.245.254:37301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.27.245.254
--webserver_port=40135
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision faec34f53d4c9dd1e3a6dd2b7314d2fc7aadff6c
build type FASTDEBUG
built by None at 17 Jun 2026 19:49:13 UTC on bdcb31816ec0
build id 12442
ASAN enabled
I20260617 20:17:13.444015 29565 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_fae70178b45747a29dfd1be32d78cff6" } new_table_name: "default.Table_51b9344e06e94c7fa8c10c29bc3da4d1" modify_external_catalogs: true
I20260617 20:17:13.445091 31281 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260617 20:17:13.446573 29536 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b97adf7186f462095ddb237ff692547 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:13.447378 31281 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260617 20:17:13.448150 31447 leader_election.cc:290] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 590225c8ea36448093b77385d238a34a (127.27.245.254:37301), f5ea3f9265d84474ab3bced8dd5aecc5 (127.27.245.252:46059)
W20260617 20:17:13.449268 29535 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c48b276ef09c48ee84047dd3034067f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:13.451678 31418 raft_consensus.cc:493] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:13.451807 31418 raft_consensus.cc:515] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.452330 31418 leader_election.cc:290] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:13.453572 29062 leader_election.cc:343] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: e3897179e7724fdeb87a979ae4ef2091
I20260617 20:17:13.460121 29378 tablet_bootstrap.cc:492] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.460275 29378 ts_tablet_manager.cc:1403] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.004s
I20260617 20:17:13.460827 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e765deb9fe84707a5e9e2964310a36d" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.461027 29378 raft_consensus.cc:359] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.461191 29378 raft_consensus.cc:385] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.461256 29378 raft_consensus.cc:740] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.461481 29378 consensus_queue.cc:260] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.462018 29378 ts_tablet_manager.cc:1434] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:13.462280 29378 tablet_bootstrap.cc:492] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.464182 29378 tablet_bootstrap.cc:654] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.470839 31390 consensus_queue.cc:1048] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.478677 29620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "87437cd320a4470fa0dedd43aa7ea3eb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1308 } } ignore_live_leader: false dest_uuid: "f5ea3f9265d84474ab3bced8dd5aecc5" is_pre_election: true
I20260617 20:17:13.479293 29383 consensus_queue.cc:260] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.480109 29383 ts_tablet_manager.cc:1434] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.051s user 0.002s sys 0.000s
I20260617 20:17:13.481410 29383 tablet_bootstrap.cc:492] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:17:13.482685 30313 leader_election.cc:336] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 590225c8ea36448093b77385d238a34a (127.27.245.254:37301): Network error: Client connection negotiation failed: client connection to 127.27.245.254:37301: connect: Connection refused (error 111)
I20260617 20:17:13.482896 30313 leader_election.cc:304] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87437cd320a4470fa0dedd43aa7ea3eb; no voters: 590225c8ea36448093b77385d238a34a, f5ea3f9265d84474ab3bced8dd5aecc5
I20260617 20:17:13.486967 29383 tablet_bootstrap.cc:654] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.492969 31453 ts_tablet_manager.cc:1929] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:13.493150 31453 log.cc:1199] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/d811ca370ee54db8a7e4f6056017cd01
I20260617 20:17:13.493465 29379 tablet_bootstrap.cc:492] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:13.493602 29379 ts_tablet_manager.cc:1403] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.103s user 0.003s sys 0.001s
I20260617 20:17:13.495580 29379 raft_consensus.cc:359] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.502350 31453 ts_tablet_manager.cc:1950] T d811ca370ee54db8a7e4f6056017cd01 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:13.506093 31453 tablet_replica.cc:333] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: stopping tablet replica
I20260617 20:17:13.507447 31389 consensus_queue.cc:1048] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.508898 29522 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet d811ca370ee54db8a7e4f6056017cd01 (table default.Table_8bd2d33a2bb845f6879b462750ebe59c [id=92f8e90bbc1a4563bf267eaa0f900101]) successfully deleted
I20260617 20:17:13.509172 31453 raft_consensus.cc:2243] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:13.509349 31453 pending_rounds.cc:70] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: Trying to abort 1 pending ops.
I20260617 20:17:13.509415 31453 pending_rounds.cc:77] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7297955563237773312 op_type: NO_OP noop_request { }
I20260617 20:17:13.509518 31453 raft_consensus.cc:2889] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260617 20:17:13.509609 31453 raft_consensus.cc:2272] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260617 20:17:13.510416 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 45375.6us
I20260617 20:17:13.511381 29379 raft_consensus.cc:385] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.511672 29197 leader_election.cc:304] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.513458 29379 raft_consensus.cc:740] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.508937 29120 raft_consensus.cc:3060] T d00c2be45d82425bb70ae577fa3155fa P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.516839 29383 tablet_bootstrap.cc:492] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:13.517490 29383 ts_tablet_manager.cc:1403] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.000s
I20260617 20:17:13.526237 30683 raft_consensus.cc:2804] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:13.526388 30683 raft_consensus.cc:697] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:13.526619 30683 consensus_queue.cc:237] T 2c583de2973e4fb0abacf2692f3ab829 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.528827 29379 consensus_queue.cc:260] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.530230 29379 ts_tablet_manager.cc:1434] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20260617 20:17:13.531700 31453 ts_tablet_manager.cc:1916] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:13.534713 31371 raft_consensus.cc:493] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.534847 31371 raft_consensus.cc:515] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.535419 31371 leader_election.cc:290] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.539305 29383 raft_consensus.cc:359] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.539541 29383 raft_consensus.cc:385] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.540030 29383 raft_consensus.cc:740] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.541039 29383 consensus_queue.cc:260] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.541621 29383 ts_tablet_manager.cc:1434] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20260617 20:17:13.543435 29383 tablet_bootstrap.cc:492] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:13.550184 31453 ts_tablet_manager.cc:1929] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:13.550387 31453 log.cc:1199] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-0/wal/wals/89d79b7023ae478698a06562b2e4c578
I20260617 20:17:13.551218 31453 ts_tablet_manager.cc:1950] T 89d79b7023ae478698a06562b2e4c578 P 5ca3d93189744132bbf55ac01f3a8254: Deleting consensus metadata
I20260617 20:17:13.552479 29522 catalog_manager.cc:5027] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): tablet 89d79b7023ae478698a06562b2e4c578 (table default.Table_ab272d9bce0349baa6e89f438aeae096 [id=9acd747f0c134e3d98485dd851ed980f]) successfully deleted
W20260617 20:17:13.552687 28925 leader_election.cc:343] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.552847 28925 leader_election.cc:304] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.553145 31475 raft_consensus.cc:2749] T 8e765deb9fe84707a5e9e2964310a36d P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.554159 31371 consensus_queue.cc:1048] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.536173 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a5480896af417f93a98e336890f8e1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.557185 28925 leader_election.cc:343] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.559242 29378 tablet_bootstrap.cc:492] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.559419 29378 ts_tablet_manager.cc:1403] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.097s user 0.022s sys 0.012s
I20260617 20:17:13.560246 31171 consensus_queue.cc:1048] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.562089 31447 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 87437cd320a4470fa0dedd43aa7ea3eb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260617 20:17:13.564956 29379 tablet_bootstrap.cc:492] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:13.567001 29378 raft_consensus.cc:359] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.568351 29378 raft_consensus.cc:385] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.568506 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a89e42d091f423bb926f671797141ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:16:54 UTC) from {username='slave'} at 127.0.0.1:51016
I20260617 20:17:13.568585 29378 raft_consensus.cc:740] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.569023 29378 consensus_queue.cc:260] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.569186 31479 tablet_replica.cc:333] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:13.569504 31479 raft_consensus.cc:2243] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Raft consensus shutting down.
I20260617 20:17:13.569867 29378 ts_tablet_manager.cc:1434] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260617 20:17:13.570322 31479 raft_consensus.cc:2272] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:13.570990 29378 tablet_bootstrap.cc:492] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.572142 31479 ts_tablet_manager.cc:1916] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:13.573736 29378 tablet_bootstrap.cc:654] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.577656 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet a819956f29954a4dbbd1aa1dcccad3c0 with delete_type TABLET_DATA_DELETED (replaced by tablet ccd6f76a201e40f8be224a93c701fea9) from {username='slave'} at 127.0.0.1:51016
I20260617 20:17:13.580483 29378 tablet_bootstrap.cc:492] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.580637 29378 ts_tablet_manager.cc:1403] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20260617 20:17:13.581399 29378 raft_consensus.cc:359] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.584283 29378 raft_consensus.cc:385] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.584414 29378 raft_consensus.cc:740] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.584669 29378 consensus_queue.cc:260] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.585351 31479 ts_tablet_manager.cc:1929] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260617 20:17:13.585495 31479 log.cc:1199] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/7a89e42d091f423bb926f671797141ea
I20260617 20:17:13.585907 31479 ts_tablet_manager.cc:1950] T 7a89e42d091f423bb926f671797141ea P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:13.586025 29378 ts_tablet_manager.cc:1434] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:17:13.586505 31479 tablet_replica.cc:333] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6: stopping tablet replica
I20260617 20:17:13.586736 31479 raft_consensus.cc:2243] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260617 20:17:13.586930 29378 tablet_bootstrap.cc:492] T e5396b42681e4a1fbf0df74c86ee810c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.586925 31479 raft_consensus.cc:2272] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260617 20:17:13.587680 31479 ts_tablet_manager.cc:1916] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260617 20:17:13.588130 29578 catalog_manager.cc:5983] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Sending DeleteTablet for 3 replicas of tablet 17d1d5603a9d4aa8bb41c651025fad16
I20260617 20:17:13.588759 29378 tablet_bootstrap.cc:654] T e5396b42681e4a1fbf0df74c86ee810c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.590044 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d1d5603a9d4aa8bb41c651025fad16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:45764
W20260617 20:17:13.590843 29522 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 17d1d5603a9d4aa8bb41c651025fad16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17d1d5603a9d4aa8bb41c651025fad16 already in progress: creating tablet
I20260617 20:17:13.594558 31390 consensus_queue.cc:1048] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.606395 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50a5480896af417f93a98e336890f8e1" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.608664 31479 ts_tablet_manager.cc:1929] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260617 20:17:13.609449 31479 log.cc:1199] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting WAL directory at /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/ts-2/wal/wals/a819956f29954a4dbbd1aa1dcccad3c0
I20260617 20:17:13.610285 31479 ts_tablet_manager.cc:1950] T a819956f29954a4dbbd1aa1dcccad3c0 P a8c0aea0206f44d683ed3b6b18c719f6: Deleting consensus metadata
I20260617 20:17:13.613844 29526 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet 7a89e42d091f423bb926f671797141ea (table default.Table_651121ed4f3b4491ac90435c5b0c3b1d [id=4377e7ebf32b49db99bb68a65e2d1c80]) successfully deleted
I20260617 20:17:13.614357 29526 catalog_manager.cc:5027] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): tablet a819956f29954a4dbbd1aa1dcccad3c0 (table default.Table_2ad82bac5fac4ab8964031a88138d64d [id=6a0c1850d45b4e53b04c59905d2d5692]) successfully deleted
I20260617 20:17:13.615828 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d1d5603a9d4aa8bb41c651025fad16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:51016
W20260617 20:17:13.618373 29198 consensus_peers.cc:597] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:13.619781 29378 tablet_bootstrap.cc:492] T e5396b42681e4a1fbf0df74c86ee810c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.619913 29378 ts_tablet_manager.cc:1403] T e5396b42681e4a1fbf0df74c86ee810c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.010s
I20260617 20:17:13.619990 29379 tablet_bootstrap.cc:654] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.620582 29378 raft_consensus.cc:359] T e5396b42681e4a1fbf0df74c86ee810c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.620748 29378 raft_consensus.cc:385] T e5396b42681e4a1fbf0df74c86ee810c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.620796 29378 raft_consensus.cc:740] T e5396b42681e4a1fbf0df74c86ee810c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.620999 29378 consensus_queue.cc:260] T e5396b42681e4a1fbf0df74c86ee810c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.622614 29378 ts_tablet_manager.cc:1434] T e5396b42681e4a1fbf0df74c86ee810c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260617 20:17:13.623668 29378 tablet_bootstrap.cc:492] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.629086 29117 raft_consensus.cc:3060] T 6323292f162b4063b7c413eaecfce791 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:13.631315 28925 leader_election.cc:343] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.631640 28925 leader_election.cc:304] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.632164 31371 raft_consensus.cc:2749] T 50a5480896af417f93a98e336890f8e1 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:13.632544 29197 consensus_peers.cc:597] T 89d79b7023ae478698a06562b2e4c578 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:13.632826 31390 consensus_queue.cc:1048] T bcecdba377334298b883d80a9e192acd P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:13.633570 29063 leader_election.cc:343] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: e3897179e7724fdeb87a979ae4ef2091
I20260617 20:17:13.633721 29063 leader_election.cc:304] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.634001 31287 raft_consensus.cc:2749] T e3897179e7724fdeb87a979ae4ef2091 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:13.634402 31287 consensus_queue.cc:1048] T 8a56191018d04a2881ee3e1a243c1a19 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.635421 29383 tablet_bootstrap.cc:654] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.638280 31475 consensus_queue.cc:1048] T 6323292f162b4063b7c413eaecfce791 P 5ca3d93189744132bbf55ac01f3a8254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:13.649772 29526 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 17d1d5603a9d4aa8bb41c651025fad16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17d1d5603a9d4aa8bb41c651025fad16 already in progress: creating tablet
I20260617 20:17:13.655539 31287 raft_consensus.cc:493] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.655715 31287 raft_consensus.cc:515] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.656406 31287 leader_election.cc:290] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:13.661526 29378 tablet_bootstrap.cc:654] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.661818 29383 tablet_bootstrap.cc:492] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:13.661983 29383 ts_tablet_manager.cc:1403] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.119s user 0.003s sys 0.000s
I20260617 20:17:13.662739 29383 raft_consensus.cc:359] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.662912 29383 raft_consensus.cc:385] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.662971 29383 raft_consensus.cc:740] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.662153 31488 raft_consensus.cc:493] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.663164 29383 consensus_queue.cc:260] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.663184 31488 raft_consensus.cc:515] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.663919 29383 ts_tablet_manager.cc:1434] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260617 20:17:13.664180 29383 tablet_bootstrap.cc:492] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:13.665153 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44524b02e6f4c1291bca50e9261459b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.665614 28925 leader_election.cc:343] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.665854 29383 tablet_bootstrap.cc:654] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.669363 31488 leader_election.cc:290] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.670509 31390 consensus_queue.cc:1048] T cc8d29712eee47e497872df101404f26 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.671644 31287 raft_consensus.cc:493] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:13.671644 31171 raft_consensus.cc:493] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:13.671826 31287 raft_consensus.cc:515] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.671864 31171 raft_consensus.cc:515] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.672348 31171 leader_election.cc:290] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:13.672345 31287 leader_election.cc:290] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:13.692013 31374 raft_consensus.cc:493] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.692842 31374 raft_consensus.cc:515] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.693948 31374 leader_election.cc:290] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.699456 31374 raft_consensus.cc:493] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.699649 31374 raft_consensus.cc:515] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.700170 29378 tablet_bootstrap.cc:492] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.700299 29378 ts_tablet_manager.cc:1403] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.002s
I20260617 20:17:13.700728 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defb7ba4604412597316f8e5c8d5ccd" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:13.700872 31374 leader_election.cc:290] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.700914 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6c261318b24a6caa3a376215f44f0f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:13.701115 29378 raft_consensus.cc:359] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.701277 29378 raft_consensus.cc:385] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 20:17:13.701310 28925 leader_election.cc:343] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.701396 29378 raft_consensus.cc:740] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.703653 29378 consensus_queue.cc:260] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
W20260617 20:17:13.703958 28925 leader_election.cc:343] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.704959 29378 ts_tablet_manager.cc:1434] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260617 20:17:13.705273 29378 tablet_bootstrap.cc:492] T 6db24d70cc7643599d7be9158b5a7450 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.710618 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae5bf7cdde5427cb24d6144ccb274f5" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.710942 28983 raft_consensus.cc:2393] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:13.713212 30852 raft_consensus.cc:493] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.713464 30852 raft_consensus.cc:515] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
W20260617 20:17:13.713451 29062 leader_election.cc:343] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 64538fdf51f94e8e985fec6202baac22
W20260617 20:17:13.713882 29062 leader_election.cc:343] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 8b6f05ae7d624efba571d059ce2f1c91
I20260617 20:17:13.714136 30852 leader_election.cc:290] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.713581 31374 raft_consensus.cc:493] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.715821 31374 raft_consensus.cc:515] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.716034 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0916139a64df436fafa18c7e86fbf91c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.716554 29198 leader_election.cc:343] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.718515 29378 tablet_bootstrap.cc:654] T 6db24d70cc7643599d7be9158b5a7450 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.718984 31374 leader_election.cc:290] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.719333 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09634384b5747659c34d25a489f6279" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.719776 28925 leader_election.cc:343] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.725651 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44524b02e6f4c1291bca50e9261459b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.727741 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe6c261318b24a6caa3a376215f44f0f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.728333 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defb7ba4604412597316f8e5c8d5ccd" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.733371 31374 raft_consensus.cc:493] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.733459 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c09634384b5747659c34d25a489f6279" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.742800 29379 tablet_bootstrap.cc:492] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:13.742995 29379 ts_tablet_manager.cc:1403] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.178s user 0.004s sys 0.000s
I20260617 20:17:13.743767 29379 raft_consensus.cc:359] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.744092 29379 raft_consensus.cc:385] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.744192 29379 raft_consensus.cc:740] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.744709 29379 consensus_queue.cc:260] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.745975 29379 ts_tablet_manager.cc:1434] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260617 20:17:13.748528 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ae5bf7cdde5427cb24d6144ccb274f5" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:13.750936 28925 leader_election.cc:343] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.751070 28925 leader_election.cc:304] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.751273 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0916139a64df436fafa18c7e86fbf91c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.751721 31475 raft_consensus.cc:2749] T d44524b02e6f4c1291bca50e9261459b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:13.752998 28925 leader_election.cc:343] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.753099 28925 leader_election.cc:304] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.753446 31475 raft_consensus.cc:2749] T fe6c261318b24a6caa3a376215f44f0f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:13.753810 28925 leader_election.cc:343] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.753901 28925 leader_election.cc:304] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.754231 31475 raft_consensus.cc:2749] T 3defb7ba4604412597316f8e5c8d5ccd P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:13.754588 28925 leader_election.cc:343] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.754676 28925 leader_election.cc:304] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.754997 31475 raft_consensus.cc:2749] T c09634384b5747659c34d25a489f6279 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.755561 29063 leader_election.cc:304] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.762913 31287 raft_consensus.cc:3060] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:13.763541 29063 leader_election.cc:343] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 8b6f05ae7d624efba571d059ce2f1c91
I20260617 20:17:13.763646 29063 leader_election.cc:304] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.763849 31171 raft_consensus.cc:2749] T 8b6f05ae7d624efba571d059ce2f1c91 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260617 20:17:13.764014 29063 leader_election.cc:343] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 64538fdf51f94e8e985fec6202baac22
I20260617 20:17:13.764098 29063 leader_election.cc:304] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.764286 31171 raft_consensus.cc:2749] T 64538fdf51f94e8e985fec6202baac22 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:13.764626 29379 tablet_bootstrap.cc:492] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:13.765709 31287 raft_consensus.cc:2749] T 0ae5bf7cdde5427cb24d6144ccb274f5 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.766453 29379 tablet_bootstrap.cc:654] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.733582 31374 raft_consensus.cc:515] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.784505 31374 leader_election.cc:290] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.784721 28981 raft_consensus.cc:2468] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:13.784909 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 17d1d5603a9d4aa8bb41c651025fad16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:57736
I20260617 20:17:13.786264 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0916139a64df436fafa18c7e86fbf91c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.787225 28925 leader_election.cc:343] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:13.788053 31492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260617 20:17:13.791438 31499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:17:13.796332 29383 tablet_bootstrap.cc:492] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:13.796518 29383 ts_tablet_manager.cc:1403] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.132s user 0.003s sys 0.000s
I20260617 20:17:13.797391 29383 raft_consensus.cc:359] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.797664 29383 raft_consensus.cc:385] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.797806 29383 raft_consensus.cc:740] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.798117 29383 consensus_queue.cc:260] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.802798 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0916139a64df436fafa18c7e86fbf91c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.803159 29261 raft_consensus.cc:2468] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ca3d93189744132bbf55ac01f3a8254 in term 0.
I20260617 20:17:13.804167 30852 consensus_queue.cc:1048] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.816037 29197 leader_election.cc:304] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.817422 31374 raft_consensus.cc:493] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.817577 31374 raft_consensus.cc:515] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.818249 31374 leader_election.cc:290] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:13.819259 29526 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 17d1d5603a9d4aa8bb41c651025fad16 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17d1d5603a9d4aa8bb41c651025fad16 already in progress: creating tablet
I20260617 20:17:13.819557 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3766053144e6c9ee680f099ff1766" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.821043 28925 leader_election.cc:343] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.821738 29378 tablet_bootstrap.cc:492] T 6db24d70cc7643599d7be9158b5a7450 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.821905 29378 ts_tablet_manager.cc:1403] T 6db24d70cc7643599d7be9158b5a7450 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.117s user 0.003s sys 0.012s
I20260617 20:17:13.822777 29378 raft_consensus.cc:359] T 6db24d70cc7643599d7be9158b5a7450 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.822980 29378 raft_consensus.cc:385] T 6db24d70cc7643599d7be9158b5a7450 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.823040 29378 raft_consensus.cc:740] T 6db24d70cc7643599d7be9158b5a7450 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.824769 30852 raft_consensus.cc:2804] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:13.824936 30852 raft_consensus.cc:493] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:13.825102 30852 raft_consensus.cc:3060] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.827993 30852 raft_consensus.cc:515] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.829071 30852 leader_election.cc:290] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.829396 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0916139a64df436fafa18c7e86fbf91c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:13.829463 29378 consensus_queue.cc:260] T 6db24d70cc7643599d7be9158b5a7450 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
W20260617 20:17:13.829967 29198 leader_election.cc:343] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.830199 29378 ts_tablet_manager.cc:1434] T 6db24d70cc7643599d7be9158b5a7450 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20260617 20:17:13.830600 29378 tablet_bootstrap.cc:492] T c3496887f6a045e293698d09d9cc1c16 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.831693 28925 leader_election.cc:304] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.832079 31374 raft_consensus.cc:2804] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:13.832149 31374 raft_consensus.cc:493] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:13.832209 31374 raft_consensus.cc:3060] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.832960 29378 tablet_bootstrap.cc:654] T c3496887f6a045e293698d09d9cc1c16 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.834650 31374 raft_consensus.cc:515] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.835166 31374 leader_election.cc:290] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.836836 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0916139a64df436fafa18c7e86fbf91c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:13.837051 28981 raft_consensus.cc:2393] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 5ca3d93189744132bbf55ac01f3a8254 in this term.
I20260617 20:17:13.838721 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59a3766053144e6c9ee680f099ff1766" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.839377 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0916139a64df436fafa18c7e86fbf91c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:13.839815 28925 leader_election.cc:343] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.840150 31281 server_base.cc:1061] running on GCE node
I20260617 20:17:13.842881 29379 tablet_bootstrap.cc:492] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:13.843185 29379 ts_tablet_manager.cc:1403] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.079s user 0.003s sys 0.000s
W20260617 20:17:13.847870 31506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260617 20:17:13.851023 29379 raft_consensus.cc:359] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.851305 29379 raft_consensus.cc:385] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.851402 29379 raft_consensus.cc:740] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.854079 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0916139a64df436fafa18c7e86fbf91c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:13.854413 29261 raft_consensus.cc:2393] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ca3d93189744132bbf55ac01f3a8254 in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:13.857684 31281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260617 20:17:13.859269 31374 raft_consensus.cc:493] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.859434 31374 raft_consensus.cc:515] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.860091 31374 leader_election.cc:290] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.862569 29383 ts_tablet_manager.cc:1434] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.066s user 0.002s sys 0.000s
I20260617 20:17:13.863166 29383 tablet_bootstrap.cc:492] T 88ab6fe7319940fcabd315193c51e199 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
W20260617 20:17:13.865829 28925 leader_election.cc:343] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.865963 28925 leader_election.cc:304] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.866413 31374 raft_consensus.cc:2749] T 59a3766053144e6c9ee680f099ff1766 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.868654 28925 leader_election.cc:304] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.869158 31374 raft_consensus.cc:2749] T 0916139a64df436fafa18c7e86fbf91c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.869508 29378 tablet_bootstrap.cc:492] T c3496887f6a045e293698d09d9cc1c16 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.869647 29378 ts_tablet_manager.cc:1403] T c3496887f6a045e293698d09d9cc1c16 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.003s
I20260617 20:17:13.870453 29378 raft_consensus.cc:359] T c3496887f6a045e293698d09d9cc1c16 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.870644 29378 raft_consensus.cc:385] T c3496887f6a045e293698d09d9cc1c16 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.870712 29378 raft_consensus.cc:740] T c3496887f6a045e293698d09d9cc1c16 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.870971 29378 consensus_queue.cc:260] T c3496887f6a045e293698d09d9cc1c16 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.872768 29378 ts_tablet_manager.cc:1434] T c3496887f6a045e293698d09d9cc1c16 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260617 20:17:13.873826 29383 tablet_bootstrap.cc:654] T 88ab6fe7319940fcabd315193c51e199 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.875872 29378 tablet_bootstrap.cc:492] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.881239 29378 tablet_bootstrap.cc:654] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.889608 29197 leader_election.cc:304] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:13.890019 31389 raft_consensus.cc:2749] T 0916139a64df436fafa18c7e86fbf91c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260617 20:17:13.891218 29198 consensus_peers.cc:597] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:13.891623 31374 raft_consensus.cc:493] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.891861 31374 raft_consensus.cc:515] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.892633 31374 leader_election.cc:290] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.894183 29378 tablet_bootstrap.cc:492] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.894321 29378 ts_tablet_manager.cc:1403] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.001s
I20260617 20:17:13.895116 29378 raft_consensus.cc:359] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.895280 29378 raft_consensus.cc:385] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.851696 29379 consensus_queue.cc:260] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.895349 29378 raft_consensus.cc:740] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.861845 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afb3ed704bb4a269d92f1741455161b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.896026 28925 leader_election.cc:343] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.893430 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf28f4e434da794db9391ca7ad738" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.896638 28925 leader_election.cc:343] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.896915 31287 raft_consensus.cc:493] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.897044 31287 raft_consensus.cc:515] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.897866 31287 leader_election.cc:290] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:13.898516 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c583de2973e4fb0abacf2692f3ab829" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.898727 28981 raft_consensus.cc:2393] T 2c583de2973e4fb0abacf2692f3ab829 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:13.900720 29379 ts_tablet_manager.cc:1434] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.057s user 0.002s sys 0.000s
I20260617 20:17:13.900794 29378 consensus_queue.cc:260] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.901849 29379 tablet_bootstrap.cc:492] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:13.902902 29378 ts_tablet_manager.cc:1434] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20260617 20:17:13.904678 29378 tablet_bootstrap.cc:492] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.904605 31389 consensus_queue.cc:1048] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.906533 29378 tablet_bootstrap.cc:654] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.906697 30852 consensus_queue.cc:1048] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.909010 31374 raft_consensus.cc:493] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.909138 31374 raft_consensus.cc:515] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.909725 31374 leader_election.cc:290] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.910820 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083b8903abd646dc89717b9d2caf5647" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.911301 28925 leader_election.cc:343] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.911974 31281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260617 20:17:13.913407 31389 consensus_queue.cc:1048] T 6b3091c332a14c4c99bd28e401769e30 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.914834 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afb3ed704bb4a269d92f1741455161b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.919255 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf28f4e434da794db9391ca7ad738" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.921060 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "083b8903abd646dc89717b9d2caf5647" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.922329 29379 tablet_bootstrap.cc:654] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:13.938360 28925 leader_election.cc:343] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.938494 28925 leader_election.cc:304] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.938969 31374 raft_consensus.cc:2749] T 6afb3ed704bb4a269d92f1741455161b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:13.940719 28925 leader_election.cc:343] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.940846 28925 leader_election.cc:304] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.941248 31374 raft_consensus.cc:2749] T 4a6bf28f4e434da794db9391ca7ad738 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.943099 31389 raft_consensus.cc:493] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.943274 31389 raft_consensus.cc:515] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.943912 31389 leader_election.cc:290] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.944808 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85633d391613474db52dd2f86210a659" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.945358 29198 leader_election.cc:343] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:13.945911 28925 leader_election.cc:343] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.946028 28925 leader_election.cc:304] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.946496 31374 raft_consensus.cc:2749] T 083b8903abd646dc89717b9d2caf5647 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.949862 29383 tablet_bootstrap.cc:492] T 88ab6fe7319940fcabd315193c51e199 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:13.950096 29383 ts_tablet_manager.cc:1403] T 88ab6fe7319940fcabd315193c51e199 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.087s user 0.014s sys 0.007s
I20260617 20:17:13.950929 29383 raft_consensus.cc:359] T 88ab6fe7319940fcabd315193c51e199 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.951198 29383 raft_consensus.cc:385] T 88ab6fe7319940fcabd315193c51e199 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.951331 29383 raft_consensus.cc:740] T 88ab6fe7319940fcabd315193c51e199 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.951614 29383 consensus_queue.cc:260] T 88ab6fe7319940fcabd315193c51e199 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:13.951745 31374 raft_consensus.cc:493] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.951829 29568 catalog_manager.cc:5983] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Sending DeleteTablet for 3 replicas of tablet 007cea7c267b4f7d99edaf5dcd7c8ab1
I20260617 20:17:13.951879 29575 catalog_manager.cc:5983] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Sending DeleteTablet for 3 replicas of tablet 1f2c8a0fe63c440493b357e73f763357
I20260617 20:17:13.951884 31374 raft_consensus.cc:515] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.952203 29383 ts_tablet_manager.cc:1434] T 88ab6fe7319940fcabd315193c51e199 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:13.952452 29575 catalog_manager.cc:6784] ReplaceTablet: tablet 1f2c8a0fe63c440493b357e73f763357 deleted and replaced by tablet d72ba4f28d054d128c1bd3eedc7a2c97
I20260617 20:17:13.952430 31374 leader_election.cc:290] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.952486 29383 tablet_bootstrap.cc:492] T 33b01c9c27904a1986e285477921ac4f P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:13.954356 29095 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f2c8a0fe63c440493b357e73f763357 with delete_type TABLET_DATA_DELETED (replaced by tablet d72ba4f28d054d128c1bd3eedc7a2c97) from {username='slave'} at 127.0.0.1:57736
I20260617 20:17:13.954568 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:57736
I20260617 20:17:13.954598 29383 tablet_bootstrap.cc:654] T 33b01c9c27904a1986e285477921ac4f P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.955744 28969 tablet_service.cc:1558] Processing DeleteTablet for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:45764
I20260617 20:17:13.955971 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f2c8a0fe63c440493b357e73f763357 with delete_type TABLET_DATA_DELETED (replaced by tablet d72ba4f28d054d128c1bd3eedc7a2c97) from {username='slave'} at 127.0.0.1:45764
I20260617 20:17:13.956357 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f2c8a0fe63c440493b357e73f763357 with delete_type TABLET_DATA_DELETED (replaced by tablet d72ba4f28d054d128c1bd3eedc7a2c97) from {username='slave'} at 127.0.0.1:51016
I20260617 20:17:13.956475 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:51016
W20260617 20:17:13.957175 29522 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 already in progress: creating tablet
W20260617 20:17:13.957345 29526 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 1f2c8a0fe63c440493b357e73f763357 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f2c8a0fe63c440493b357e73f763357 already in progress: creating tablet
W20260617 20:17:13.957674 29522 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 1f2c8a0fe63c440493b357e73f763357 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f2c8a0fe63c440493b357e73f763357 already in progress: creating tablet
W20260617 20:17:13.957981 29526 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 already in progress: creating tablet
W20260617 20:17:13.958217 29526 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 1f2c8a0fe63c440493b357e73f763357 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1f2c8a0fe63c440493b357e73f763357 already in progress: creating tablet
W20260617 20:17:13.958653 29526 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 007cea7c267b4f7d99edaf5dcd7c8ab1 already in progress: creating tablet
I20260617 20:17:13.958926 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f47e81154eb48fb9e891cfff5250af2" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.959483 28925 leader_election.cc:343] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.961947 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c583de2973e4fb0abacf2692f3ab829" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.965004 29379 tablet_bootstrap.cc:492] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:13.965185 29379 ts_tablet_manager.cc:1403] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.001s
I20260617 20:17:13.966022 29379 raft_consensus.cc:359] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.966255 29379 raft_consensus.cc:385] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.966353 29379 raft_consensus.cc:740] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.967551 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f47e81154eb48fb9e891cfff5250af2" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:13.968437 31374 raft_consensus.cc:493] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.968571 31374 raft_consensus.cc:515] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.969192 31374 leader_election.cc:290] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:13.968289 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85633d391613474db52dd2f86210a659" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:13.969813 28981 raft_consensus.cc:2468] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:13.970484 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd226ca6595148638d5036356c50313f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:13.971000 28925 leader_election.cc:343] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:13.976286 29378 tablet_bootstrap.cc:492] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:13.976429 29378 ts_tablet_manager.cc:1403] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.072s user 0.006s sys 0.014s
W20260617 20:17:13.975229 28636 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 68956.9us
I20260617 20:17:13.976979 31281 hybrid_clock.cc:648] HybridClock initialized: now 1781727433976102 us; error 1189 us; skew 500 ppm
I20260617 20:17:13.977232 29378 raft_consensus.cc:359] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.977411 29378 raft_consensus.cc:385] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:13.977468 29378 raft_consensus.cc:740] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:13.977558 31281 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260617 20:17:13.977711 29378 consensus_queue.cc:260] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:13.978832 29378 ts_tablet_manager.cc:1434] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260617 20:17:13.979310 29378 tablet_bootstrap.cc:492] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:13.982057 29378 tablet_bootstrap.cc:654] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:13.982710 29063 leader_election.cc:304] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:13.983040 31287 raft_consensus.cc:3060] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.985857 31287 raft_consensus.cc:2749] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.986982 29120 raft_consensus.cc:3060] T a52873eade4048af81a8e51233b9d079 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:13.990104 30852 consensus_queue.cc:1048] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:13.993252 31287 raft_consensus.cc:493] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:13.993396 31287 raft_consensus.cc:515] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:13.994380 31287 leader_election.cc:290] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:13.994840 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9655a1164fa84f53bdb9fd31b2fcda78" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:14.000681 31287 raft_consensus.cc:493] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:14.000854 31287 raft_consensus.cc:515] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.002595 31287 leader_election.cc:290] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
W20260617 20:17:14.003607 29062 leader_election.cc:343] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 5b2797384f7845969ee9744b444f1acc
I20260617 20:17:14.004220 30852 consensus_queue.cc:1048] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260617 20:17:14.012466 29176 tablet.cc:2406] T 2c583de2973e4fb0abacf2692f3ab829 P 6d4ce30e1fce4591b64c398747f8d37a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 20:17:14.023330 31281 webserver.cc:533] Webserver started at http://127.27.245.254:40135/ using document root <none> and password file <none>
W20260617 20:17:14.025434 29311 tablet.cc:2406] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 20:17:14.028450 29565 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "default.Table_c95ae0622f74490595be5a1f000ea37f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:14.029166 29565 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c95ae0622f74490595be5a1f000ea37f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:14.030258 29569 catalog_manager.cc:5983] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Sending DeleteTablet for 3 replicas of tablet 1d75020e2d2e427082beb79691e86de7
I20260617 20:17:14.031296 29224 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d75020e2d2e427082beb79691e86de7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:51016
I20260617 20:17:14.031577 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d75020e2d2e427082beb79691e86de7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:57736
I20260617 20:17:14.031599 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d75020e2d2e427082beb79691e86de7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:45764
I20260617 20:17:14.032330 29543 catalog_manager.cc:5983] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Sending DeleteTablet for 3 replicas of tablet 4372081172384c9f96388d38208d9853
W20260617 20:17:14.032505 29526 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 1d75020e2d2e427082beb79691e86de7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d75020e2d2e427082beb79691e86de7 already in progress: creating tablet
I20260617 20:17:14.033167 29543 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "default.Table_8e6f9ff291b647d9adf81553bf8f453b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:14.033422 29526 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 1d75020e2d2e427082beb79691e86de7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d75020e2d2e427082beb79691e86de7 already in progress: creating tablet
W20260617 20:17:14.033749 29543 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e6f9ff291b647d9adf81553bf8f453b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:14.033779 29107 tablet_service.cc:1558] Processing DeleteTablet for tablet 4372081172384c9f96388d38208d9853 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:57736
W20260617 20:17:14.034523 29526 catalog_manager.cc:5007] TS 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): delete failed for tablet 4372081172384c9f96388d38208d9853 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4372081172384c9f96388d38208d9853 already in progress: creating tablet
I20260617 20:17:14.034812 29229 tablet_service.cc:1558] Processing DeleteTablet for tablet 4372081172384c9f96388d38208d9853 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:51016
W20260617 20:17:14.035209 29522 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 1d75020e2d2e427082beb79691e86de7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d75020e2d2e427082beb79691e86de7 already in progress: creating tablet
W20260617 20:17:14.035387 29526 catalog_manager.cc:5007] TS a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): delete failed for tablet 4372081172384c9f96388d38208d9853 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4372081172384c9f96388d38208d9853 already in progress: creating tablet
I20260617 20:17:14.035624 29569 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "default.Table_22264e3f117c4fa1a7c4fd2c9bf5a88a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:14.036221 29569 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22264e3f117c4fa1a7c4fd2c9bf5a88a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:14.037434 29535 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "default.Table_272f6d4789324b869132cd475da2844b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:14.037848 29535 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_272f6d4789324b869132cd475da2844b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:14.038766 28954 tablet_service.cc:1558] Processing DeleteTablet for tablet 4372081172384c9f96388d38208d9853 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-17 20:17:13 UTC) from {username='slave'} at 127.0.0.1:45764
W20260617 20:17:14.039492 29522 catalog_manager.cc:5007] TS 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): delete failed for tablet 4372081172384c9f96388d38208d9853 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4372081172384c9f96388d38208d9853 already in progress: creating tablet
W20260617 20:17:14.057154 28925 leader_election.cc:343] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.057331 28925 leader_election.cc:304] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.057837 31374 raft_consensus.cc:2749] T 7f47e81154eb48fb9e891cfff5250af2 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:13.966629 29379 consensus_queue.cc:260] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.061347 31281 fs_manager.cc:362] Metadata directory not provided
I20260617 20:17:14.063236 31287 raft_consensus.cc:493] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.063364 31287 raft_consensus.cc:515] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.064699 31287 leader_election.cc:290] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:14.065128 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85633d391613474db52dd2f86210a659" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:14.065384 28981 raft_consensus.cc:2468] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:14.065809 29062 leader_election.cc:304] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:17:14.066103 31287 raft_consensus.cc:2804] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:14.066134 29378 tablet_bootstrap.cc:492] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:14.066196 31287 raft_consensus.cc:493] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:14.066252 29378 ts_tablet_manager.cc:1403] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.087s user 0.009s sys 0.016s
I20260617 20:17:14.065658 31281 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260617 20:17:14.066357 31287 raft_consensus.cc:3060] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.067013 29378 raft_consensus.cc:359] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.067181 29378 raft_consensus.cc:385] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.067236 29378 raft_consensus.cc:740] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.067444 29378 consensus_queue.cc:260] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.068746 29378 ts_tablet_manager.cc:1434] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:14.069350 31287 raft_consensus.cc:515] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.069316 29378 tablet_bootstrap.cc:492] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:14.070385 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85633d391613474db52dd2f86210a659" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:14.070542 28985 raft_consensus.cc:3060] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.071705 29378 tablet_bootstrap.cc:654] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.073151 28985 raft_consensus.cc:2468] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:14.073590 29062 leader_election.cc:304] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:17:14.073848 31171 raft_consensus.cc:2804] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:14.073957 31171 raft_consensus.cc:697] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:14.074160 31171 consensus_queue.cc:237] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.078356 31287 leader_election.cc:290] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:14.081353 29378 tablet_bootstrap.cc:492] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:14.081489 29378 ts_tablet_manager.cc:1403] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260617 20:17:14.082213 29378 raft_consensus.cc:359] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.082376 29378 raft_consensus.cc:385] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.082444 29378 raft_consensus.cc:740] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.084632 29378 consensus_queue.cc:260] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.086105 29378 ts_tablet_manager.cc:1434] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260617 20:17:14.086390 29378 tablet_bootstrap.cc:492] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:14.088986 29378 tablet_bootstrap.cc:654] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.091113 29121 raft_consensus.cc:3060] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.094333 31389 consensus_queue.cc:1048] T 5eedf2442f964048b7a3a460b6b22f2a P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:14.098922 29563 catalog_manager.cc:5978] Not sending DeleteTablet requests; no consensus state for tablet 515f6603b0304f5b87eb18547b8e2f32
I20260617 20:17:14.106024 30852 raft_consensus.cc:493] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.106573 30852 raft_consensus.cc:515] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.108752 30852 leader_election.cc:290] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.109875 29197 leader_election.cc:304] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.110344 30852 raft_consensus.cc:2804] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:14.111186 31389 consensus_queue.cc:1048] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:14.110502 30852 raft_consensus.cc:493] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:14.111807 30852 raft_consensus.cc:3060] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.116766 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd24a60a91b43cd9e31ecca3d21ec60" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:14.116940 28978 raft_consensus.cc:2468] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:14.122973 29536 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "default.Table_16e5222656434ff38d46e698a07d9546"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:14.130048 29536 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16e5222656434ff38d46e698a07d9546 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:14.131328 29563 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_0dc3002823be41b18039e536eb0d547b" } new_table_name: "default.Table_52ee64ebf400478e9534dee35eadf633" modify_external_catalogs: true
I20260617 20:17:14.132586 29543 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_4b555cc3fa1e4dd5b51da47450054b76" } new_table_name: "default.Table_e8af0625b52b462a80073b3d7b60c9db" modify_external_catalogs: true
I20260617 20:17:14.144608 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd24a60a91b43cd9e31ecca3d21ec60" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:14.145495 29198 leader_election.cc:343] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.146384 29383 tablet_bootstrap.cc:492] T 33b01c9c27904a1986e285477921ac4f P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:14.146565 29383 ts_tablet_manager.cc:1403] T 33b01c9c27904a1986e285477921ac4f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.194s user 0.012s sys 0.038s
I20260617 20:17:14.147426 29383 raft_consensus.cc:359] T 33b01c9c27904a1986e285477921ac4f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.147608 29383 raft_consensus.cc:385] T 33b01c9c27904a1986e285477921ac4f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.147697 29383 raft_consensus.cc:740] T 33b01c9c27904a1986e285477921ac4f P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.147979 29383 consensus_queue.cc:260] T 33b01c9c27904a1986e285477921ac4f P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.148634 29383 ts_tablet_manager.cc:1434] T 33b01c9c27904a1986e285477921ac4f P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260617 20:17:14.150054 30852 raft_consensus.cc:515] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.151429 30852 leader_election.cc:290] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.152139 29261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9655a1164fa84f53bdb9fd31b2fcda78" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.152621 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85633d391613474db52dd2f86210a659" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.152849 29255 raft_consensus.cc:2393] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:14.152904 29383 tablet_bootstrap.cc:492] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:14.153334 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85633d391613474db52dd2f86210a659" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
I20260617 20:17:14.153592 29255 raft_consensus.cc:2393] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d4ce30e1fce4591b64c398747f8d37a in current term 1: Already voted for candidate a8c0aea0206f44d683ed3b6b18c719f6 in this term.
I20260617 20:17:14.154134 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd226ca6595148638d5036356c50313f" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.154587 31533 raft_consensus.cc:493] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.154701 31533 raft_consensus.cc:515] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.153695 29120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85633d391613474db52dd2f86210a659" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:14.155210 31533 leader_election.cc:290] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:14.156940 29198 leader_election.cc:343] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 29c65bb7c45e40a081de91d4c1c5cf56
I20260617 20:17:14.157859 29383 tablet_bootstrap.cc:654] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.159088 31389 consensus_queue.cc:1048] T 9655a1164fa84f53bdb9fd31b2fcda78 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:14.159915 29569 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "default.Table_c851010d6b214599b076482a51e3b95f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:14.160645 29569 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c851010d6b214599b076482a51e3b95f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:14.162575 29565 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "default.Table_cf9750d0cd074e80b29fe0ea53d190c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:14.163098 29565 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf9750d0cd074e80b29fe0ea53d190c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:14.167207 29379 ts_tablet_manager.cc:1434] T 85633d391613474db52dd2f86210a659 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.202s user 0.002s sys 0.000s
I20260617 20:17:14.167711 29379 tablet_bootstrap.cc:492] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:14.170557 28985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85633d391613474db52dd2f86210a659" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:14.170817 28985 raft_consensus.cc:2393] T 85633d391613474db52dd2f86210a659 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8c0aea0206f44d683ed3b6b18c719f6 in current term 1: Already voted for candidate 6d4ce30e1fce4591b64c398747f8d37a in this term.
W20260617 20:17:14.171329 29063 leader_election.cc:343] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: 5b2797384f7845969ee9744b444f1acc
I20260617 20:17:14.171504 29063 leader_election.cc:304] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.172089 29063 leader_election.cc:304] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.172500 31287 raft_consensus.cc:2749] T 5b2797384f7845969ee9744b444f1acc P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:14.176576 29379 tablet_bootstrap.cc:654] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
W20260617 20:17:14.176636 28925 leader_election.cc:343] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.176813 28925 leader_election.cc:304] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.177577 31488 raft_consensus.cc:2749] T fd226ca6595148638d5036356c50313f P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:14.179888 29378 tablet_bootstrap.cc:492] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:14.180111 29378 ts_tablet_manager.cc:1403] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.094s user 0.005s sys 0.015s
I20260617 20:17:14.181520 29378 raft_consensus.cc:359] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.181708 29378 raft_consensus.cc:385] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.181789 29378 raft_consensus.cc:740] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.182062 29378 consensus_queue.cc:260] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.184594 29383 tablet_bootstrap.cc:492] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:14.184911 29383 ts_tablet_manager.cc:1403] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.000s
I20260617 20:17:14.185870 29378 ts_tablet_manager.cc:1434] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260617 20:17:14.186538 29378 tablet_bootstrap.cc:492] T debb84d5e57b4bc9ba37b0fab2d6698b P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:14.188408 31281 fs_manager.cc:714] Time spent opening directory manager: real 0.081s user 0.001s sys 0.005s
I20260617 20:17:14.190693 29378 tablet_bootstrap.cc:654] T debb84d5e57b4bc9ba37b0fab2d6698b P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.193387 31287 raft_consensus.cc:2749] T 9655a1164fa84f53bdb9fd31b2fcda78 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:14.204528 29535 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "default.Table_2b557d2815304bcdabeae5346a5bef96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260617 20:17:14.205168 29535 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b557d2815304bcdabeae5346a5bef96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260617 20:17:14.207154 29536 catalog_manager.cc:3569] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_daa321ef525b447390f30edf50f160bc" } new_table_name: "default.Table_f5089c39d4564eee821b4bb6baeef4f0" modify_external_catalogs: true
I20260617 20:17:14.207842 29378 tablet_bootstrap.cc:492] T debb84d5e57b4bc9ba37b0fab2d6698b P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:14.207988 29378 ts_tablet_manager.cc:1403] T debb84d5e57b4bc9ba37b0fab2d6698b P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.004s
I20260617 20:17:14.208767 29378 raft_consensus.cc:359] T debb84d5e57b4bc9ba37b0fab2d6698b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.208957 29378 raft_consensus.cc:385] T debb84d5e57b4bc9ba37b0fab2d6698b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.209038 29378 raft_consensus.cc:740] T debb84d5e57b4bc9ba37b0fab2d6698b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.209323 29378 consensus_queue.cc:260] T debb84d5e57b4bc9ba37b0fab2d6698b P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.209832 31389 consensus_queue.cc:1048] T 0ae5bf7cdde5427cb24d6144ccb274f5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:14.210430 31389 consensus_queue.cc:1048] T c4598874c14344c58ef0b87508b67211 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:14.210705 31533 consensus_queue.cc:1048] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:14.210846 29197 leader_election.cc:304] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.211059 31094 raft_consensus.cc:2804] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:14.211154 31094 raft_consensus.cc:493] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:14.211246 31094 raft_consensus.cc:3060] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.211346 29383 raft_consensus.cc:359] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.211525 29383 raft_consensus.cc:385] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.211597 29383 raft_consensus.cc:740] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.211794 29383 consensus_queue.cc:260] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.213099 31533 consensus_queue.cc:1048] T d19d34e3bbe3453ca6de6ed7e62f7af4 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:14.213430 31390 raft_consensus.cc:493] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.213573 31390 raft_consensus.cc:515] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.214244 31390 leader_election.cc:290] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:14.215857 31094 raft_consensus.cc:515] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.216396 31094 leader_election.cc:290] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.216521 31374 raft_consensus.cc:493] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.216667 31374 raft_consensus.cc:515] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.209808 30683 consensus_queue.cc:1048] T a52873eade4048af81a8e51233b9d079 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260617 20:17:14.217262 31374 leader_election.cc:290] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.221395 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f232832e4af48e691ddd50576188203" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:14.222195 28925 leader_election.cc:343] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.224666 31552 tablet.cc:1724] T 219d85e4fd9b4ba3baf1e08d2b18a32c P a8c0aea0206f44d683ed3b6b18c719f6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:14.225950 29379 tablet_bootstrap.cc:492] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:14.226394 29379 ts_tablet_manager.cc:1403] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.001s
I20260617 20:17:14.227164 29379 raft_consensus.cc:359] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.227403 29379 raft_consensus.cc:385] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.227514 29379 raft_consensus.cc:740] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.227811 29379 consensus_queue.cc:260] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.232185 29379 ts_tablet_manager.cc:1434] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260617 20:17:14.233053 29379 tablet_bootstrap.cc:492] T 425c1727564745b2ab84b39a2d190db5 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:14.235597 29379 tablet_bootstrap.cc:654] T 425c1727564745b2ab84b39a2d190db5 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.238494 29378 ts_tablet_manager.cc:1434] T debb84d5e57b4bc9ba37b0fab2d6698b P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.030s user 0.000s sys 0.003s
I20260617 20:17:14.239141 29378 tablet_bootstrap.cc:492] T 043f11c4e0d84c6ba4c5b6b6cc9c10db P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:14.241472 29378 tablet_bootstrap.cc:654] T 043f11c4e0d84c6ba4c5b6b6cc9c10db P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.243943 31547 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20260617 20:17:14.260030 29198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.194:41833, user_credentials={real_user=slave}} blocked reactor thread for 83669.6us
I20260617 20:17:14.261109 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425c1727564745b2ab84b39a2d190db5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:14.263304 31281 fs_manager.cc:730] Time spent opening block manager: real 0.073s user 0.004s sys 0.001s
I20260617 20:17:14.266736 31287 raft_consensus.cc:493] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.266993 31287 raft_consensus.cc:515] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.267926 31287 leader_election.cc:290] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:14.268115 29378 tablet_bootstrap.cc:492] T 043f11c4e0d84c6ba4c5b6b6cc9c10db P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
W20260617 20:17:14.270637 29197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.245.193:38317, user_credentials={real_user=slave}} blocked reactor thread for 59251us
I20260617 20:17:14.271359 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd24a60a91b43cd9e31ecca3d21ec60" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:14.269004 28981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dc704cf0844f579cced79fdf8c3da5" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:14.271719 29378 ts_tablet_manager.cc:1403] T 043f11c4e0d84c6ba4c5b6b6cc9c10db P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.003s
I20260617 20:17:14.272289 29197 leader_election.cc:304] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.272572 29378 raft_consensus.cc:359] T 043f11c4e0d84c6ba4c5b6b6cc9c10db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.272790 31389 raft_consensus.cc:2749] T 85633d391613474db52dd2f86210a659 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260617 20:17:14.273732 29378 raft_consensus.cc:385] T 043f11c4e0d84c6ba4c5b6b6cc9c10db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 20:17:14.273734 29197 leader_election.cc:343] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 29c65bb7c45e40a081de91d4c1c5cf56
I20260617 20:17:14.273857 29197 leader_election.cc:304] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.274134 31548 raft_consensus.cc:2749] T 29c65bb7c45e40a081de91d4c1c5cf56 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:14.275586 29383 ts_tablet_manager.cc:1434] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.091s user 0.005s sys 0.007s
I20260617 20:17:14.276386 29383 tablet_bootstrap.cc:492] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:14.281091 29378 raft_consensus.cc:740] T 043f11c4e0d84c6ba4c5b6b6cc9c10db P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.281584 29383 tablet_bootstrap.cc:654] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.287072 31390 raft_consensus.cc:493] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.287248 31390 raft_consensus.cc:515] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.287673 29378 consensus_queue.cc:260] T 043f11c4e0d84c6ba4c5b6b6cc9c10db P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.287820 31390 leader_election.cc:290] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:14.288153 29378 ts_tablet_manager.cc:1434] T 043f11c4e0d84c6ba4c5b6b6cc9c10db P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.016s user 0.000s sys 0.001s
W20260617 20:17:14.289126 29198 leader_election.cc:343] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:14.289815 29198 leader_election.cc:343] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.291375 29378 tablet_bootstrap.cc:492] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:14.295332 31287 raft_consensus.cc:493] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.295544 31287 raft_consensus.cc:515] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.297998 29378 tablet_bootstrap.cc:654] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.300737 31287 leader_election.cc:290] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:14.265192 31281 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data,/tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal
uuid: "590225c8ea36448093b77385d238a34a"
format_stamp: "Formatted at 2026-06-17 20:16:40 on dist-test-slave-dvcr"
I20260617 20:17:14.306531 31281 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskRePpQS/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1781727399778427-28631-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260617 20:17:14.298879 31488 raft_consensus.cc:493] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.301468 28980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed860fa375848708beb31ff89056214" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:14.309398 28980 raft_consensus.cc:2468] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 0.
I20260617 20:17:14.309366 31488 raft_consensus.cc:515] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.301726 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425c1727564745b2ab84b39a2d190db5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:14.309711 28978 raft_consensus.cc:2468] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:14.302174 28984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd24a60a91b43cd9e31ecca3d21ec60" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:14.309965 28984 raft_consensus.cc:3060] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.310048 31488 leader_election.cc:290] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.312172 29383 tablet_bootstrap.cc:492] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:14.312359 29383 ts_tablet_manager.cc:1403] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.002s
I20260617 20:17:14.312718 28984 raft_consensus.cc:2468] T cdd24a60a91b43cd9e31ecca3d21ec60 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:14.311020 31555 tablet.cc:1724] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 6d4ce30e1fce4591b64c398747f8d37a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:14.313462 29383 raft_consensus.cc:359] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.313633 28978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342e29fbc98442ea2e2d25c7aea8853" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:14.313686 29383 raft_consensus.cc:385] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.313789 29383 raft_consensus.cc:740] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.313834 28978 raft_consensus.cc:2468] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:14.313182 29062 leader_election.cc:304] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:17:14.313992 29383 consensus_queue.cc:260] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.307545 31374 raft_consensus.cc:493] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.314549 29383 ts_tablet_manager.cc:1434] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260617 20:17:14.314538 31374 raft_consensus.cc:515] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.315152 31374 leader_election.cc:290] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.320176 29383 tablet_bootstrap.cc:492] T 37214b955d63478088b9f723bcbc588a P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:14.321388 31287 raft_consensus.cc:2804] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:14.321488 31287 raft_consensus.cc:493] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:14.321550 31287 raft_consensus.cc:3060] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.322275 29383 tablet_bootstrap.cc:654] T 37214b955d63478088b9f723bcbc588a P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.322749 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f232832e4af48e691ddd50576188203" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.324256 31564 tablet.cc:1724] T 219d85e4fd9b4ba3baf1e08d2b18a32c P 5ca3d93189744132bbf55ac01f3a8254: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260617 20:17:14.327561 31287 raft_consensus.cc:515] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.328888 28989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed860fa375848708beb31ff89056214" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:14.329089 28989 raft_consensus.cc:3060] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.329741 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62c5a2071dd46dfbde504459508b069" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.331792 28989 raft_consensus.cc:2468] T 1ed860fa375848708beb31ff89056214 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d4ce30e1fce4591b64c398747f8d37a in term 1.
I20260617 20:17:14.332319 29062 leader_election.cc:304] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a; no voters:
I20260617 20:17:14.332638 31171 raft_consensus.cc:2804] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:14.332767 31171 raft_consensus.cc:697] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 LEADER]: Becoming Leader. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Running, Role: LEADER
I20260617 20:17:14.333006 31171 consensus_queue.cc:237] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.334139 29378 tablet_bootstrap.cc:492] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:14.334291 29378 ts_tablet_manager.cc:1403] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.003s
I20260617 20:17:14.335142 29378 raft_consensus.cc:359] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.335439 29378 raft_consensus.cc:385] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.335656 29378 raft_consensus.cc:740] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.335986 29378 consensus_queue.cc:260] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.336166 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6435bac04e472c99e81b6e7e9a6012" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.337023 29125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62c5a2071dd46dfbde504459508b069" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:14.337098 29121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f6435bac04e472c99e81b6e7e9a6012" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:14.338073 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342e29fbc98442ea2e2d25c7aea8853" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:14.338564 28925 leader_election.cc:343] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:14.339012 28925 leader_election.cc:343] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.339202 29117 raft_consensus.cc:3060] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.342970 29378 ts_tablet_manager.cc:1434] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
I20260617 20:17:14.343680 29378 tablet_bootstrap.cc:492] T 51182783b1ba499fbd7f06c7e580e8af P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
W20260617 20:17:14.342626 29198 leader_election.cc:343] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.345402 31287 leader_election.cc:290] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Requested vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:14.346284 29378 tablet_bootstrap.cc:654] T 51182783b1ba499fbd7f06c7e580e8af P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.346846 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dc704cf0844f579cced79fdf8c3da5" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.347548 31389 consensus_queue.cc:1048] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:14.349961 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed860fa375848708beb31ff89056214" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.352062 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed860fa375848708beb31ff89056214" candidate_uuid: "6d4ce30e1fce4591b64c398747f8d37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6"
W20260617 20:17:14.352758 28925 leader_election.cc:343] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.352911 28925 leader_election.cc:304] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:14.353437 28925 leader_election.cc:343] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.353454 31389 consensus_queue.cc:1048] T d7dc704cf0844f579cced79fdf8c3da5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:14.353565 28925 leader_election.cc:304] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:14.353905 28925 leader_election.cc:343] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.354044 28925 leader_election.cc:304] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.354370 31488 raft_consensus.cc:2749] T 4f232832e4af48e691ddd50576188203 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:14.354774 31488 raft_consensus.cc:2749] T f62c5a2071dd46dfbde504459508b069 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:14.354943 31488 raft_consensus.cc:2749] T 5f6435bac04e472c99e81b6e7e9a6012 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:14.357064 31389 raft_consensus.cc:493] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.357188 31389 raft_consensus.cc:515] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.357772 31389 leader_election.cc:290] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.358098 29383 tablet_bootstrap.cc:492] T 37214b955d63478088b9f723bcbc588a P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:14.358253 29383 ts_tablet_manager.cc:1403] T 37214b955d63478088b9f723bcbc588a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.003s
I20260617 20:17:14.359182 29383 raft_consensus.cc:359] T 37214b955d63478088b9f723bcbc588a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.359388 29383 raft_consensus.cc:385] T 37214b955d63478088b9f723bcbc588a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.359438 29383 raft_consensus.cc:740] T 37214b955d63478088b9f723bcbc588a P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.359658 29383 consensus_queue.cc:260] T 37214b955d63478088b9f723bcbc588a P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.363644 29063 leader_election.cc:304] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
W20260617 20:17:14.364459 29063 leader_election.cc:343] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:14.364840 29063 leader_election.cc:343] T 1ed860fa375848708beb31ff89056214 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.365334 29383 ts_tablet_manager.cc:1434] T 37214b955d63478088b9f723bcbc588a P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20260617 20:17:14.373018 29378 tablet_bootstrap.cc:492] T 51182783b1ba499fbd7f06c7e580e8af P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
W20260617 20:17:14.373143 29198 leader_election.cc:343] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Not found: Tablet not found: 3ae50375e5934acbb213379fb7c87989
I20260617 20:17:14.373210 29378 ts_tablet_manager.cc:1403] T 51182783b1ba499fbd7f06c7e580e8af P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.003s
I20260617 20:17:14.376021 29379 tablet_bootstrap.cc:492] T 425c1727564745b2ab84b39a2d190db5 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:14.376220 29379 ts_tablet_manager.cc:1403] T 425c1727564745b2ab84b39a2d190db5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.143s user 0.006s sys 0.002s
I20260617 20:17:14.377823 29383 tablet_bootstrap.cc:492] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:14.378594 29378 raft_consensus.cc:359] T 51182783b1ba499fbd7f06c7e580e8af P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.378829 29378 raft_consensus.cc:385] T 51182783b1ba499fbd7f06c7e580e8af P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.378906 29378 raft_consensus.cc:740] T 51182783b1ba499fbd7f06c7e580e8af P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.379395 29383 tablet_bootstrap.cc:654] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.380753 29197 leader_election.cc:304] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.381016 31389 raft_consensus.cc:2804] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:14.381098 31389 raft_consensus.cc:493] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:14.381176 31389 raft_consensus.cc:3060] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.382622 29378 consensus_queue.cc:260] T 51182783b1ba499fbd7f06c7e580e8af P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.384748 29378 ts_tablet_manager.cc:1434] T 51182783b1ba499fbd7f06c7e580e8af P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20260617 20:17:14.385251 31389 raft_consensus.cc:515] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.386637 31389 leader_election.cc:290] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:14.390175 29378 tablet_bootstrap.cc:492] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:14.391234 29197 leader_election.cc:304] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.391475 31550 raft_consensus.cc:2804] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:14.391584 31550 raft_consensus.cc:697] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:14.391820 31550 consensus_queue.cc:237] T cdd24a60a91b43cd9e31ecca3d21ec60 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.392009 29378 tablet_bootstrap.cc:654] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.392961 29197 leader_election.cc:304] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.393193 31389 raft_consensus.cc:2804] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:14.393265 31389 raft_consensus.cc:493] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:14.393374 31389 raft_consensus.cc:3060] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.394738 29116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425c1727564745b2ab84b39a2d190db5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:14.395787 31389 raft_consensus.cc:515] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.396359 31389 leader_election.cc:290] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317)
I20260617 20:17:14.403541 31009 raft_consensus.cc:2749] T d7dc704cf0844f579cced79fdf8c3da5 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:14.404762 29198 leader_election.cc:343] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.403177 29117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342e29fbc98442ea2e2d25c7aea8853" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:14.406884 29379 raft_consensus.cc:359] T 425c1727564745b2ab84b39a2d190db5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.407541 29379 raft_consensus.cc:385] T 425c1727564745b2ab84b39a2d190db5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260617 20:17:14.407851 29198 leader_election.cc:343] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.407778 29379 raft_consensus.cc:740] T 425c1727564745b2ab84b39a2d190db5 P 6d4ce30e1fce4591b64c398747f8d37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d4ce30e1fce4591b64c398747f8d37a, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.408311 29378 tablet_bootstrap.cc:492] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:14.408475 29378 ts_tablet_manager.cc:1403] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.001s
I20260617 20:17:14.409330 29378 raft_consensus.cc:359] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.409526 29378 raft_consensus.cc:385] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.409216 29379 consensus_queue.cc:260] T 425c1727564745b2ab84b39a2d190db5 P 6d4ce30e1fce4591b64c398747f8d37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.412850 31374 raft_consensus.cc:493] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.415055 31374 raft_consensus.cc:515] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.415764 31374 leader_election.cc:290] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.409619 29378 raft_consensus.cc:740] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.416416 29378 consensus_queue.cc:260] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.417156 29378 ts_tablet_manager.cc:1434] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20260617 20:17:14.421624 29378 tablet_bootstrap.cc:492] T 768f932c2c6a43589f026a5a4ecbe660 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:14.423672 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425c1727564745b2ab84b39a2d190db5" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:14.423885 28983 raft_consensus.cc:3060] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.426287 29378 tablet_bootstrap.cc:654] T 768f932c2c6a43589f026a5a4ecbe660 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.426808 28983 raft_consensus.cc:2468] T 425c1727564745b2ab84b39a2d190db5 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:14.426947 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db7d5bf9a254b98b87ad25df1f51b3b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:14.427767 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342e29fbc98442ea2e2d25c7aea8853" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:14.428001 28983 raft_consensus.cc:3060] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
W20260617 20:17:14.428200 28925 leader_election.cc:343] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.430805 28983 raft_consensus.cc:2468] T 4342e29fbc98442ea2e2d25c7aea8853 P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:14.439327 31374 raft_consensus.cc:493] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.439491 31374 raft_consensus.cc:515] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.440085 31374 leader_election.cc:290] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.441152 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af3af6bc87843cfa6cd74e3d5e230f4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:14.441705 28925 leader_election.cc:343] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.447034 29379 ts_tablet_manager.cc:1434] T 425c1727564745b2ab84b39a2d190db5 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent starting tablet: real 0.071s user 0.002s sys 0.002s
I20260617 20:17:14.449286 29379 tablet_bootstrap.cc:492] T 3180f1336fd841d8b4cf7fdf94015955 P 6d4ce30e1fce4591b64c398747f8d37a: Bootstrap starting.
I20260617 20:17:14.450063 31374 raft_consensus.cc:493] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.450191 31374 raft_consensus.cc:515] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.450758 31374 leader_election.cc:290] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.452157 31009 raft_consensus.cc:493] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a8c0aea0206f44d683ed3b6b18c719f6)
I20260617 20:17:14.452312 31009 raft_consensus.cc:515] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.452847 31009 leader_election.cc:290] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:14.453514 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a350456a8eb143838de58a05c76c9056" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
W20260617 20:17:14.453784 29062 leader_election.cc:343] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: f31bf7ed828f44b398f5bdac6b9b63e7
W20260617 20:17:14.455721 28925 leader_election.cc:343] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.456102 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6db7d5bf9a254b98b87ad25df1f51b3b" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.457094 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af3af6bc87843cfa6cd74e3d5e230f4" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.458465 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a350456a8eb143838de58a05c76c9056" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
W20260617 20:17:14.458834 29198 consensus_peers.cc:597] T 6c3dd481bc2745fba5460e26e49fa53b P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Couldn't send request to peer 6d4ce30e1fce4591b64c398747f8d37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260617 20:17:14.459896 28925 leader_election.cc:343] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.460019 28925 leader_election.cc:304] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.460371 31374 raft_consensus.cc:2749] T 6db7d5bf9a254b98b87ad25df1f51b3b P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:14.461071 28925 leader_election.cc:343] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.461184 28925 leader_election.cc:304] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.461534 31374 raft_consensus.cc:2749] T 9af3af6bc87843cfa6cd74e3d5e230f4 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260617 20:17:14.461894 28925 leader_election.cc:343] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.462013 28925 leader_election.cc:304] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.462420 31374 raft_consensus.cc:2749] T a350456a8eb143838de58a05c76c9056 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:14.463325 31550 raft_consensus.cc:493] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.463465 31550 raft_consensus.cc:515] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.464076 31550 leader_election.cc:290] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.464661 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da50400f49e24ca589519e6ec823957d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:14.464844 29119 raft_consensus.cc:2468] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:14.465247 29198 leader_election.cc:304] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:14.465574 31550 raft_consensus.cc:2804] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260617 20:17:14.465682 31550 raft_consensus.cc:493] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:14.465794 31550 raft_consensus.cc:3060] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Advancing to term 2
I20260617 20:17:14.468780 31550 raft_consensus.cc:515] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
W20260617 20:17:14.469012 29197 leader_election.cc:343] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: 3ae50375e5934acbb213379fb7c87989
I20260617 20:17:14.469164 29197 leader_election.cc:304] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8c0aea0206f44d683ed3b6b18c719f6; no voters: 5ca3d93189744132bbf55ac01f3a8254, 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.469441 31389 raft_consensus.cc:2749] T 3ae50375e5934acbb213379fb7c87989 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:14.469882 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da50400f49e24ca589519e6ec823957d" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
I20260617 20:17:14.470057 29119 raft_consensus.cc:3060] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Advancing to term 2
I20260617 20:17:14.470793 29197 leader_election.cc:304] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.471021 31390 raft_consensus.cc:2804] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:14.471115 31390 raft_consensus.cc:697] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:14.471340 31390 consensus_queue.cc:237] T 425c1727564745b2ab84b39a2d190db5 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.472679 29119 raft_consensus.cc:2468] T da50400f49e24ca589519e6ec823957d P 6d4ce30e1fce4591b64c398747f8d37a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 2.
I20260617 20:17:14.473284 29198 leader_election.cc:304] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6; no voters:
I20260617 20:17:14.473639 31551 raft_consensus.cc:2804] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260617 20:17:14.473750 31551 raft_consensus.cc:697] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [term 2 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:14.473994 31551 consensus_queue.cc:237] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.475405 29197 leader_election.cc:304] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.475713 31390 raft_consensus.cc:2804] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260617 20:17:14.475960 31390 raft_consensus.cc:697] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 LEADER]: Becoming Leader. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Running, Role: LEADER
I20260617 20:17:14.476215 31390 consensus_queue.cc:237] T 4342e29fbc98442ea2e2d25c7aea8853 P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.476972 31374 raft_consensus.cc:493] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.477157 31374 raft_consensus.cc:515] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.477948 31374 leader_election.cc:290] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833), a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189)
I20260617 20:17:14.478458 31374 raft_consensus.cc:493] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.478606 31374 raft_consensus.cc:515] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.479146 31374 leader_election.cc:290] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.480924 29379 tablet_bootstrap.cc:654] T 3180f1336fd841d8b4cf7fdf94015955 P 6d4ce30e1fce4591b64c398747f8d37a: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.484449 29383 tablet_bootstrap.cc:492] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P a8c0aea0206f44d683ed3b6b18c719f6: No bootstrap required, opened a new log
I20260617 20:17:14.485723 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc547148aa124907a5e5def6941f734c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:14.486290 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081844c92e744d5a870c47437999e895" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:14.487442 29383 ts_tablet_manager.cc:1403] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent bootstrapping tablet: real 0.122s user 0.004s sys 0.001s
I20260617 20:17:14.490239 31551 consensus_queue.cc:1048] T c2c6d214816540ac90dc9b2ad3cdb89f P a8c0aea0206f44d683ed3b6b18c719f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260617 20:17:14.469457 31550 leader_election.cc:290] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
W20260617 20:17:14.491442 28925 leader_election.cc:343] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:14.491829 28925 leader_election.cc:343] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:14.497699 29063 leader_election.cc:343] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Not found: Tablet not found: f31bf7ed828f44b398f5bdac6b9b63e7
I20260617 20:17:14.497853 29063 leader_election.cc:304] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d4ce30e1fce4591b64c398747f8d37a; no voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.498077 31009 raft_consensus.cc:2749] T f31bf7ed828f44b398f5bdac6b9b63e7 P 6d4ce30e1fce4591b64c398747f8d37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260617 20:17:14.499549 29378 tablet_bootstrap.cc:492] T 768f932c2c6a43589f026a5a4ecbe660 P 5ca3d93189744132bbf55ac01f3a8254: No bootstrap required, opened a new log
I20260617 20:17:14.499744 29378 ts_tablet_manager.cc:1403] T 768f932c2c6a43589f026a5a4ecbe660 P 5ca3d93189744132bbf55ac01f3a8254: Time spent bootstrapping tablet: real 0.078s user 0.001s sys 0.005s
I20260617 20:17:14.500564 29378 raft_consensus.cc:359] T 768f932c2c6a43589f026a5a4ecbe660 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.500770 29378 raft_consensus.cc:385] T 768f932c2c6a43589f026a5a4ecbe660 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.500849 29378 raft_consensus.cc:740] T 768f932c2c6a43589f026a5a4ecbe660 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ca3d93189744132bbf55ac01f3a8254, State: Initialized, Role: FOLLOWER
I20260617 20:17:14.501574 29378 consensus_queue.cc:260] T 768f932c2c6a43589f026a5a4ecbe660 P 5ca3d93189744132bbf55ac01f3a8254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } }
I20260617 20:17:14.502835 29378 ts_tablet_manager.cc:1434] T 768f932c2c6a43589f026a5a4ecbe660 P 5ca3d93189744132bbf55ac01f3a8254: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260617 20:17:14.504341 31390 raft_consensus.cc:493] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.504568 31390 raft_consensus.cc:515] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.505163 31390 leader_election.cc:290] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.506887 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc547148aa124907a5e5def6941f734c" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.507501 29255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "081844c92e744d5a870c47437999e895" candidate_uuid: "5ca3d93189744132bbf55ac01f3a8254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" is_pre_election: true
I20260617 20:17:14.513042 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663dbe73689d4849a85b68a79ea4062c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a" is_pre_election: true
I20260617 20:17:14.513914 29378 tablet_bootstrap.cc:492] T 3df2d190c1234ac3b5950d348ed2c701 P 5ca3d93189744132bbf55ac01f3a8254: Bootstrap starting.
I20260617 20:17:14.514413 29565 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60712 (request call id 27) took 1094 ms. Trace:
I20260617 20:17:14.514565 29565 rpcz_store.cc:276] 0617 20:17:13.420252 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:14.141026 (+720774us) service_pool.cc:224] Handling call
0617 20:17:14.162525 (+ 21499us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x616000060a54. stack: 00007fa8803b1496 00007fa8803b1250 00007fa87f3dc3ad 000000000099c914 000000000099c8dd 00007fa88f8926bd 00007fa88f8927b3 00007fa88c45ab21 00007fa8941bf95d 00007fa8943526c3 00007fa88adae7c6 00007fa88adae4f5 00007fa8874bb88e 00007fa8874ba76e 00007fa8874c09a8 00007fa8874c130f
0617 20:17:14.163183 (+ 658us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:14.163603 (+ 420us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:14.251872 (+ 88269us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:14.514266 (+262394us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:14.514371 (+ 105us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:14.240905 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:14.241799 (+ 894us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:14.241804 (+ 5us) write_op.cc:435] Acquired schema lock
0617 20:17:14.241806 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:14.242423 (+ 617us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:14.242613 (+ 190us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:14.242622 (+ 9us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:14.243251 (+ 629us) tablet.cc:701] Row locks acquired
0617 20:17:14.243428 (+ 177us) write_op.cc:260] PREPARE: finished
0617 20:17:14.243642 (+ 214us) write_op.cc:270] Start()
0617 20:17:14.243859 (+ 217us) write_op.cc:276] Timestamp: P: 1781727434243404 usec, L: 0
0617 20:17:14.243865 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 20:17:14.245554 (+ 1689us) log.cc:844] Serialized 433 byte log entry
0617 20:17:14.251215 (+ 5661us) op_driver.cc:464] REPLICATION: finished
0617 20:17:14.251319 (+ 104us) write_op.cc:301] APPLY: starting
0617 20:17:14.251347 (+ 28us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:14.251391 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:14.251424 (+ 33us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:14.251533 (+ 109us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:14.251569 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:14.251577 (+ 8us) write_op.cc:312] APPLY: finished
0617 20:17:14.251666 (+ 89us) log.cc:844] Serialized 29 byte log entry
0617 20:17:14.251726 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:14.251746 (+ 20us) write_op.cc:454] Released schema lock
0617 20:17:14.251753 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:14.255142 (+ 3389us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:14.255151 (+ 9us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":48749440,"child_traces":[["op",{"apply.queue_time_us":56,"apply.run_cpu_time_us":491,"apply.run_wall_time_us":491,"num_ops":2,"prepare.queue_time_us":76679,"prepare.run_cpu_time_us":1345,"prepare.run_wall_time_us":14221,"raft.queue_time_us":3856,"raft.run_cpu_time_us":472,"raft.run_wall_time_us":7271,"replication_time_us":7297}]]}
I20260617 20:17:14.515431 29565 master_service.cc:960] ReplaceTablet: received request to replace tablet a3c31f1bba074ba580601b7e8c64ea0b from {username='slave'} at 127.0.0.1:60712
I20260617 20:17:14.515679 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663dbe73689d4849a85b68a79ea4062c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254" is_pre_election: true
I20260617 20:17:14.515786 29378 tablet_bootstrap.cc:654] T 3df2d190c1234ac3b5950d348ed2c701 P 5ca3d93189744132bbf55ac01f3a8254: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.515905 28983 raft_consensus.cc:2468] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 0.
I20260617 20:17:14.516420 29569 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60712 (request call id 28) took 1095 ms. Trace:
W20260617 20:17:14.516834 29198 leader_election.cc:343] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
W20260617 20:17:14.516973 28925 leader_election.cc:343] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.516525 29569 rpcz_store.cc:276] 0617 20:17:13.420497 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:14.141473 (+720976us) service_pool.cc:224] Handling call
0617 20:17:14.159844 (+ 18371us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x616000060a54. stack: 00007fa8803b1496 00007fa8803b1250 00007fa87f3dc3ad 000000000099c914 000000000099c8dd 00007fa88f8926bd 00007fa88f8927b3 00007fa88c45ab21 00007fa8941bf95d 00007fa8943526c3 00007fa88adae7c6 00007fa88adae4f5 00007fa8874bb88e 00007fa8874ba76e 00007fa8874c09a8 00007fa8874c130f
0617 20:17:14.160740 (+ 896us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:14.161169 (+ 429us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:14.236612 (+ 75443us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:14.516287 (+279675us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:14.516382 (+ 95us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:14.225153 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:14.225419 (+ 266us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:14.225460 (+ 41us) write_op.cc:435] Acquired schema lock
0617 20:17:14.225464 (+ 4us) tablet.cc:662] Decoding operations
0617 20:17:14.225747 (+ 283us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:14.225893 (+ 146us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:14.225927 (+ 34us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:14.226212 (+ 285us) tablet.cc:701] Row locks acquired
0617 20:17:14.226216 (+ 4us) write_op.cc:260] PREPARE: finished
0617 20:17:14.226346 (+ 130us) write_op.cc:270] Start()
0617 20:17:14.226477 (+ 131us) write_op.cc:276] Timestamp: P: 1781727434226280 usec, L: 0
0617 20:17:14.226483 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 20:17:14.227384 (+ 901us) log.cc:844] Serialized 433 byte log entry
0617 20:17:14.235541 (+ 8157us) op_driver.cc:464] REPLICATION: finished
0617 20:17:14.235672 (+ 131us) write_op.cc:301] APPLY: starting
0617 20:17:14.235690 (+ 18us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:14.235738 (+ 48us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:14.235810 (+ 72us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:14.235972 (+ 162us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:14.236017 (+ 45us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:14.236027 (+ 10us) write_op.cc:312] APPLY: finished
0617 20:17:14.236107 (+ 80us) log.cc:844] Serialized 29 byte log entry
0617 20:17:14.236170 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:14.236193 (+ 23us) write_op.cc:454] Released schema lock
0617 20:17:14.236203 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:14.240277 (+ 4074us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:14.240287 (+ 10us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":41594240,"child_traces":[["op",{"apply.queue_time_us":63,"apply.run_cpu_time_us":612,"apply.run_wall_time_us":610,"num_ops":2,"prepare.queue_time_us":63475,"prepare.run_cpu_time_us":1176,"prepare.run_wall_time_us":14972,"raft.queue_time_us":1496,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":10137,"replication_time_us":8952}]]}
I20260617 20:17:14.517081 28925 leader_election.cc:304] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.517321 29569 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_b16811c4e5c6448194a1adf7df3d96a2" } modify_external_catalogs: true
I20260617 20:17:14.517462 31374 raft_consensus.cc:2749] T cc547148aa124907a5e5def6941f734c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:14.517503 29569 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "default.Table_b16811c4e5c6448194a1adf7df3d96a2" } modify_external_catalogs: true
W20260617 20:17:14.517855 28925 leader_election.cc:343] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c0aea0206f44d683ed3b6b18c719f6 (127.27.245.195:45189): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.517956 28925 leader_election.cc:304] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254; no voters: 6d4ce30e1fce4591b64c398747f8d37a, a8c0aea0206f44d683ed3b6b18c719f6
I20260617 20:17:14.518255 31374 raft_consensus.cc:2749] T 081844c92e744d5a870c47437999e895 P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260617 20:17:14.518821 29535 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:60712 (request call id 29) took 1098 ms. Trace:
I20260617 20:17:14.518924 29535 rpcz_store.cc:276] 0617 20:17:13.420766 (+ 0us) service_pool.cc:167] Inserting onto call queue
0617 20:17:14.200592 (+779826us) service_pool.cc:224] Handling call
0617 20:17:14.204457 (+ 3865us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x616000060a54. stack: 00007fa8803b1496 00007fa8803b1250 00007fa87f3dc3ad 000000000099c914 000000000099c8dd 00007fa88f8926bd 00007fa88f8927b3 00007fa88c45ab21 00007fa8941bf95d 00007fa8943526c3 00007fa88adae7c6 00007fa88adae4f5 00007fa8874bb88e 00007fa8874ba76e 00007fa8874c09a8 00007fa8874c130f
0617 20:17:14.205257 (+ 800us) catalog_manager.cc:2126] Acquired catalog manager lock
0617 20:17:14.205818 (+ 561us) catalog_manager.cc:2172] Created new table and tablet info
0617 20:17:14.278576 (+ 72758us) catalog_manager.cc:2232] Wrote table and tablets to system table
0617 20:17:14.518683 (+240107us) catalog_manager.cc:2266] Inserted table and tablets into CatalogManager maps
0617 20:17:14.518768 (+ 85us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0617 20:17:14.256012 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0617 20:17:14.257484 (+ 1472us) write_op.cc:432] Acquiring schema lock in shared mode
0617 20:17:14.257490 (+ 6us) write_op.cc:435] Acquired schema lock
0617 20:17:14.257492 (+ 2us) tablet.cc:662] Decoding operations
0617 20:17:14.259667 (+ 2175us) write_op.cc:620] Acquiring the partition lock for write op
0617 20:17:14.263223 (+ 3556us) write_op.cc:641] Partition lock acquired for write op
0617 20:17:14.263230 (+ 7us) tablet.cc:685] Acquiring locks for 2 operations
0617 20:17:14.264440 (+ 1210us) tablet.cc:701] Row locks acquired
0617 20:17:14.264443 (+ 3us) write_op.cc:260] PREPARE: finished
0617 20:17:14.264722 (+ 279us) write_op.cc:270] Start()
0617 20:17:14.265118 (+ 396us) write_op.cc:276] Timestamp: P: 1781727434264652 usec, L: 0
0617 20:17:14.265124 (+ 6us) op_driver.cc:348] REPLICATION: starting
0617 20:17:14.272595 (+ 7471us) log.cc:844] Serialized 433 byte log entry
0617 20:17:14.277745 (+ 5150us) op_driver.cc:464] REPLICATION: finished
0617 20:17:14.277981 (+ 236us) write_op.cc:301] APPLY: starting
0617 20:17:14.277997 (+ 16us) tablet.cc:1367] starting BulkCheckPresence
0617 20:17:14.278041 (+ 44us) tablet.cc:1370] finished BulkCheckPresence
0617 20:17:14.278073 (+ 32us) tablet.cc:1372] starting ApplyRowOperation cycle
0617 20:17:14.278182 (+ 109us) tablet.cc:1383] finished ApplyRowOperation cycle
0617 20:17:14.278218 (+ 36us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0617 20:17:14.278225 (+ 7us) write_op.cc:312] APPLY: finished
0617 20:17:14.278302 (+ 77us) log.cc:844] Serialized 29 byte log entry
0617 20:17:14.278382 (+ 80us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:14.278410 (+ 28us) write_op.cc:454] Released schema lock
0617 20:17:14.278420 (+ 10us) write_op.cc:341] FINISH: Updating metrics
0617 20:17:14.283384 (+ 4964us) write_op.cc:489] Releasing partition, row and schema locks
0617 20:17:14.283583 (+ 199us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":8304000,"child_traces":[["op",{"apply.queue_time_us":142,"apply.run_cpu_time_us":510,"apply.run_wall_time_us":509,"num_ops":2,"prepare.queue_time_us":49396,"prepare.run_cpu_time_us":1556,"prepare.run_wall_time_us":27367,"raft.queue_time_us":505,"raft.run_cpu_time_us":545,"raft.run_wall_time_us":7923,"replication_time_us":12588}]]}
I20260617 20:17:14.519655 29535 master_service.cc:960] ReplaceTablet: received request to replace tablet ab6e06eb2e7644168fa2d99a1890f6b6 from {username='slave'} at 127.0.0.1:60712
W20260617 20:17:14.529459 29197 leader_election.cc:343] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: da50400f49e24ca589519e6ec823957d
W20260617 20:17:14.530321 29197 leader_election.cc:343] T da50400f49e24ca589519e6ec823957d P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Not found: Tablet not found: da50400f49e24ca589519e6ec823957d
W20260617 20:17:14.530876 29197 consensus_peers.cc:597] T d811ca370ee54db8a7e4f6056017cd01 P a8c0aea0206f44d683ed3b6b18c719f6 -> Peer 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317): Couldn't send request to peer 5ca3d93189744132bbf55ac01f3a8254. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d811ca370ee54db8a7e4f6056017cd01. This is attempt 1: this message will repeat every 5th retry.
I20260617 20:17:14.531306 29197 leader_election.cc:304] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ca3d93189744132bbf55ac01f3a8254, a8c0aea0206f44d683ed3b6b18c719f6; no voters: 6d4ce30e1fce4591b64c398747f8d37a
I20260617 20:17:14.531526 31551 raft_consensus.cc:2804] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260617 20:17:14.531586 31551 raft_consensus.cc:493] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260617 20:17:14.531639 31551 raft_consensus.cc:3060] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.534124 31551 raft_consensus.cc:515] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } }
I20260617 20:17:14.535099 31551 leader_election.cc:290] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Requested vote from peers 5ca3d93189744132bbf55ac01f3a8254 (127.27.245.193:38317), 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833)
I20260617 20:17:14.536051 29119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663dbe73689d4849a85b68a79ea4062c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d4ce30e1fce4591b64c398747f8d37a"
W20260617 20:17:14.540943 29198 leader_election.cc:343] T 663dbe73689d4849a85b68a79ea4062c P a8c0aea0206f44d683ed3b6b18c719f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d4ce30e1fce4591b64c398747f8d37a (127.27.245.194:41833): Illegal state: must be running to vote when last-logged opid is not known
I20260617 20:17:14.521127 29383 raft_consensus.cc:359] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.541416 29383 raft_consensus.cc:385] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260617 20:17:14.541492 29383 raft_consensus.cc:740] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c0aea0206f44d683ed3b6b18c719f6, State: Initialized, Role: FOLLOWER
W20260617 20:17:14.541721 29038 tablet.cc:2406] T 043f11c4e0d84c6ba4c5b6b6cc9c10db P 5ca3d93189744132bbf55ac01f3a8254: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260617 20:17:14.541697 29383 consensus_queue.cc:260] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P a8c0aea0206f44d683ed3b6b18c719f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a" member_type: VOTER last_known_addr { host: "127.27.245.194" port: 41833 } } peers { permanent_uuid: "5ca3d93189744132bbf55ac01f3a8254" member_type: VOTER last_known_addr { host: "127.27.245.193" port: 38317 } }
I20260617 20:17:14.544150 29383 ts_tablet_manager.cc:1434] T b7e3bb8cd7df47aea4746f74f1ca2dc1 P a8c0aea0206f44d683ed3b6b18c719f6: Time spent starting tablet: real 0.055s user 0.001s sys 0.001s
I20260617 20:17:14.544488 29383 tablet_bootstrap.cc:492] T e35d84540ee74348a3222c5b928e002f P a8c0aea0206f44d683ed3b6b18c719f6: Bootstrap starting.
I20260617 20:17:14.545871 29383 tablet_bootstrap.cc:654] T e35d84540ee74348a3222c5b928e002f P a8c0aea0206f44d683ed3b6b18c719f6: Neither blocks nor log segments found. Creating new log.
I20260617 20:17:14.548099 29035 heartbeater.cc:499] Master 127.27.245.252:46059 was elected leader, sending a full tablet report...
I20260617 20:17:14.549384 28983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "663dbe73689d4849a85b68a79ea4062c" candidate_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ca3d93189744132bbf55ac01f3a8254"
I20260617 20:17:14.549561 28983 raft_consensus.cc:3060] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [term 0 FOLLOWER]: Advancing to term 1
I20260617 20:17:14.552806 28983 raft_consensus.cc:2468] T 663dbe73689d4849a85b68a79ea4062c P 5ca3d93189744132bbf55ac01f3a8254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c0aea0206f44d683ed3b6b18c719f6 in term 1.
I20260617 20:17:14.558182 29379 tablet_bootstrap.cc:492] T 3180f1336fd841d8b4cf7fdf94015955 P 6d4ce30e1fce4591b64c398747f8d37a: No bootstrap required, opened a new log
I20260617 20:17:14.559315 29379 ts_tablet_manager.cc:1403] T 3180f1336fd841d8b4cf7fdf94015955 P 6d4ce30e1fce4591b64c398747f8d37a: Time spent bootstrapping tablet: real 0.111s user 0.006s sys 0.002s
I20260617 20:17:14.559443 29565 catalog_manager.cc:5983] T 00000000000000000000000000000000 P f5ea3f9265d84474ab3bced8dd5aecc5: Sending DeleteTablet for 3 replicas of tablet a3c31f1bba074ba580601b7e8c64ea0b
I20260617 20:17:14.560132 31550 raft_consensus.cc:493] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260617 20:17:14.560307 31550 raft_consensus.cc:515] T c4b2d190dda24f0e800b6f75bc165a57 P a8c0aea0206f44d683ed3b6b18c719f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c0aea0206f44d683ed3b6b18c719f6" member_type: VOTER last_known_addr { host: "127.27.245.195" port: 45189 } } peers { permanent_uuid: "6d4ce30e1fce4591b64c398747f8d37a"